Mellanox Connectx-6 vs DPDK

[VitRidolfi]

Hallo everybody, 

 i've a problem to recognize the card in subject with a simple program that use DPDK.

1. Board:  [root@tip5.tip.tp R720 25] ~/DPDK_Test/dpdk_test ibv_devinfo
   hca_id: mlx5_0
   transport: InfiniBand (0)
   fw_ver: 22.44.1036
   node_guid: 1070:fd03:00df:9826
   sys_image_guid: 1070:fd03:00df:9826
   vendor_id: 0x02c9
   vendor_part_id: 4125
   hw_ver: 0x0
   board_id: MT_0000000359
   phys_port_cnt: 1
   port: 1
   state: PORT_ACTIVE (4)
   max_mtu: 4096 (5)
   active_mtu: 1024 (3)
   sm_lid: 0
   port_lid: 0
   port_lmc: 0x00
   link_layer: Ethernet (there's also the second port to 100GB, but same infos).
2. SO used: CentOs 8.0 with kernel 4.18.0-80.el8.x86_64
3. DPDK version: dpdk-20.11.9
4. Server Dell R720 32 core, 64Gb RAM
5. Actual card binding: 

   [root@tip5.tip.tp R720 25] /opt/dpdk-20.11.9/usertools ./dpdk-devbind.py -s

   Network devices using kernel driver
   ===================================
   0000:01:00.0 'NetXtreme BCM5720 2-port Gigabit Ethernet PCIe 165f' if=eth0 drv=tg3 unused=vfio-pci *Active*
   0000:01:00.1 'NetXtreme BCM5720 2-port Gigabit Ethernet PCIe 165f' if=eth1 drv=tg3 unused=vfio-pci
   0000:02:00.0 'NetXtreme BCM5720 2-port Gigabit Ethernet PCIe 165f' if=eth2 drv=tg3 unused=vfio-pci
   0000:02:00.1 'NetXtreme BCM5720 2-port Gigabit Ethernet PCIe 165f' if=eth3 drv=tg3 unused=vfio-pci
   0000:04:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection 10fb' if=eth8 drv=ixgbe unused=vfio-pci
   0000:04:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection 10fb' if=eth9 drv=ixgbe unused=vfio-pci
   0000:42:00.0 'MT2892 Family [ConnectX-6 Dx] 101d' if=eth10 drv=mlx5_core unused=vfio-pci
   0000:42:00.1 'MT2892 Family [ConnectX-6 Dx] 101d' if=eth11 drv=mlx5_core unused=vfio-pci
   0000:44:00.0 'I350 Gigabit Network Connection 1521' if=eth4 drv=igb unused=vfio-pci
   0000:44:00.1 'I350 Gigabit Network Connection 1521' if=eth5 drv=igb unused=vfio-pci
   0000:44:00.2 'I350 Gigabit Network Connection 1521' if=eth6 drv=igb unused=vfio-pci
   0000:44:00.3 'I350 Gigabit Network Connection 1521' if=eth7 drv=igb unused=vfio-pci

   Other Network devices
   =====================
   0000:06:08.0 'IDT77222/77252 155Mbps ATM MICRO ABR SAR Controller 0003' unused=vfio-pci
   0000:08:08.0 'IDT77222/77252 155Mbps ATM MICRO ABR SAR Controller 0003' unused=vfio-pci

   No 'Baseband' devices detected
   ============================== (but also with binding on "vfio-pci" obtaining the same result)

6. Result of running SW: [root@tip5.tip.tp R720 25] ~/DPDK_Test/dpdk_test ./dpdk_test.exe -l 1,3,5,7,9,11,13,15,17,19,21,23,25,27,29,31 -n 4 -- -p 0x3
   EAL: Detected 32 lcore(s)
   EAL: Detected 2 NUMA nodes
   EAL: Detected static linkage of DPDK
   EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
   EAL: Selected IOVA mode 'VA'
   EAL: Probing VFIO support...
   EAL: VFIO support initialized
   EAL: No legacy callbacks, legacy socket not created
   POWER: Env isn't set yet!
   POWER: Attempting to initialise ACPI cpufreq power management...
   POWER: File operations failed
   POWER: Cannot set governor of lcore 3 to userspace
   POWER: Attempting to initialise PSTAT power management...
   POWER: Initialized successfully for lcore 3 power management
   POWER: Initialized successfully for lcore 5 power management
   POWER: Initialized successfully for lcore 7 power management
   POWER: Initialized successfully for lcore 9 power management
   POWER: Initialized successfully for lcore 11 power management
   POWER: Initialized successfully for lcore 13 power management
   POWER: Initialized successfully for lcore 15 power management
   POWER: Initialized successfully for lcore 17 power management
   POWER: Initialized successfully for lcore 19 power management
   POWER: Initialized successfully for lcore 21 power management
   POWER: Initialized successfully for lcore 23 power management
   POWER: Initialized successfully for lcore 25 power management
   POWER: Initialized successfully for lcore 27 power management
   POWER: Initialized successfully for lcore 29 power management
   POWER: Initialized successfully for lcore 31 power management
   EAL: Error - exiting with code: 1
   Cause: Error: no ethernet ports detected

The problem is that the board are completly not revealed from sw.

Can someone help me?

Many thanks in advance & kind regars, Vittorio.

P.S. In attachment the code for test.

[Sreelakshmi1]

Hi VitRidolfi,

Greetings!

Thank you for posting in Intel community forum!

Apologies for the delay in response regarding this matter.

Kindly confirm whether the reported issue is resolved or if you need further assistance.

Meanwhile, we would like to inform you that since this issue involves DPDK not recognizing the ConnectX-6 Dx NIC, it likely requires further investigation at the DPDK driver level.

For deeper support, I recommend reaching out to:

1)DPDK : https://dpdk.org

We will proceed to close the request.

Thank you for understanding.

Best Regards,

Sreelakshmi

Intel Customer Support Technician