XL710 with ASUS Pro WS W680-ACE Board, Ubuntu 24, SFP+ port doesn't link

[Lshuai]

Hello,

    We have 3 X710 D4 converged Adapter, for DPDK testing purpose.

    On an Ubuntu 24(recently upgraded) server, it fails to establish the link.

    In previous version(Ubuntu16 or 14 not sure), our sfp+ and adapter work just fine, upgrade ruins everything...

    Tried upgrade i40e driver to 2.28.9 but no luck, here are some info below.

    Should I try downgrade NVM or anything else? 
    Looking forward your reply, thanks!

====================================================

gwn@gwn-System-Product-Name:~$ uname -a
Linux gwn-System-Product-Name 6.14.0-24-generic #24~24.04.3-Ubuntu SMP PREEMPT_DYNAMIC Mon Jul 7 16:39:17 UTC 2 x86_64 x86_64 x86_64 GNU/Linux
gwn@gwn-System-Product-Name:~$ sudo dmesg |grep i40e
[sudo] password for gwn:
[ 0.623874] i40e: Intel(R) Ethernet Connection XL710 Network Driver
[ 0.623876] i40e: Copyright (c) 2013 - 2019 Intel Corporation.
[ 0.640504] i40e 0000:01:00.0: fw 8.84.66032 api 1.14 nvm 8.40 0x8000af84 20.5.13 [8086:1572] [8086:0005]
[ 0.886327] i40e 0000:01:00.0: MAC address: 6c:fe:54:27:cf:60
[ 0.886619] i40e 0000:01:00.0: FW LLDP is enabled
[ 0.898637] i40e 0000:01:00.0: PCI-Express: Speed 8.0GT/s Width x8
[ 0.907833] i40e 0000:01:00.0: Features: PF-id[0] VFs: 32 VSIs: 2 QP: 24 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 0.923953] i40e 0000:01:00.1: fw 8.84.66032 api 1.14 nvm 8.40 0x8000af84 20.5.13 [8086:1572] [8086:0005]
[ 1.127953] i40e 0000:01:00.1: MAC address: 6c:fe:54:27:cf:61
[ 1.128240] i40e 0000:01:00.1: FW LLDP is enabled
[ 1.132767] i40e 0000:01:00.1: PCI-Express: Speed 8.0GT/s Width x8
[ 1.133150] i40e 0000:01:00.1: Features: PF-id[1] VFs: 32 VSIs: 2 QP: 24 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 1.148812] i40e 0000:01:00.2: fw 8.84.66032 api 1.14 nvm 8.40 0x8000af84 20.5.13 [8086:1572] [8086:0005]
[ 1.389100] i40e 0000:01:00.2: MAC address: 6c:fe:54:27:cf:62
[ 1.389383] i40e 0000:01:00.2: FW LLDP is enabled
[ 1.393790] i40e 0000:01:00.2: PCI-Express: Speed 8.0GT/s Width x8
[ 1.394174] i40e 0000:01:00.2: Features: PF-id[2] VFs: 32 VSIs: 2 QP: 24 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 1.409018] i40e 0000:01:00.3: fw 8.84.66032 api 1.14 nvm 8.40 0x8000af84 20.5.13 [8086:1572] [8086:0005]
[ 1.654765] i40e 0000:01:00.3: MAC address: 6c:fe:54:27:cf:63
[ 1.655049] i40e 0000:01:00.3: FW LLDP is enabled
[ 1.659622] i40e 0000:01:00.3: PCI-Express: Speed 8.0GT/s Width x8
[ 1.660006] i40e 0000:01:00.3: Features: PF-id[3] VFs: 32 VSIs: 2 QP: 24 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 1.675005] i40e 0000:02:00.0: fw 8.84.66032 api 1.14 nvm 8.40 0x8000af84 20.5.13 [8086:1572] [8086:0005]
[ 1.920017] i40e 0000:02:00.0: MAC address: 6c:fe:54:27:fe:a0
[ 1.920307] i40e 0000:02:00.0: FW LLDP is enabled
[ 1.924917] i40e 0000:02:00.0: PCI-Express: Speed 8.0GT/s Width x8
[ 1.925301] i40e 0000:02:00.0: Features: PF-id[0] VFs: 32 VSIs: 2 QP: 24 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 1.940099] i40e 0000:02:00.1: fw 8.84.66032 api 1.14 nvm 8.40 0x8000af84 20.5.13 [8086:1572] [8086:0005]
[ 2.178514] i40e 0000:02:00.1: MAC address: 6c:fe:54:27:fe:a1
[ 2.178799] i40e 0000:02:00.1: FW LLDP is enabled
[ 2.193696] i40e 0000:02:00.1: PCI-Express: Speed 8.0GT/s Width x8
[ 2.194080] i40e 0000:02:00.1: Features: PF-id[1] VFs: 32 VSIs: 2 QP: 24 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 2.209584] i40e 0000:02:00.2: fw 8.84.66032 api 1.14 nvm 8.40 0x8000af84 20.5.13 [8086:1572] [8086:0005]
[ 2.424344] i40e 0000:02:00.2: MAC address: 6c:fe:54:27:fe:a2
[ 2.424621] i40e 0000:02:00.2: FW LLDP is enabled
[ 2.429083] i40e 0000:02:00.2: PCI-Express: Speed 8.0GT/s Width x8
[ 2.429466] i40e 0000:02:00.2: Features: PF-id[2] VFs: 32 VSIs: 2 QP: 24 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 2.444017] i40e 0000:02:00.3: fw 8.84.66032 api 1.14 nvm 8.40 0x8000af84 20.5.13 [8086:1572] [8086:0005]
[ 2.689008] i40e 0000:02:00.3: MAC address: 6c:fe:54:27:fe:a3
[ 2.689291] i40e 0000:02:00.3: FW LLDP is enabled
[ 2.693763] i40e 0000:02:00.3: PCI-Express: Speed 8.0GT/s Width x8
[ 2.694146] i40e 0000:02:00.3: Features: PF-id[3] VFs: 32 VSIs: 2 QP: 24 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 2.709369] i40e 0000:09:00.0: fw 8.84.66032 api 1.14 nvm 8.40 0x8000af84 20.5.13 [8086:1572] [8086:0005]
[ 3.024661] i40e 0000:09:00.0: MAC address: 6c:fe:54:27:fc:b0
[ 3.024928] i40e 0000:09:00.0: FW LLDP is enabled
[ 3.029528] i40e 0000:09:00.0: PCI-Express: Speed 8.0GT/s Width x4
[ 3.029530] i40e 0000:09:00.0: PCI-Express bandwidth available for this device may be insufficient for optimal performance.
[ 3.029531] i40e 0000:09:00.0: Please move the device to a different PCI-e link with more lanes and/or higher transfer rate.
[ 3.029891] i40e 0000:09:00.0: Features: PF-id[0] VFs: 32 VSIs: 2 QP: 24 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 3.045389] i40e 0000:09:00.1: fw 8.84.66032 api 1.14 nvm 8.40 0x8000af84 20.5.13 [8086:1572] [8086:0005]
[ 3.360238] i40e 0000:09:00.1: MAC address: 6c:fe:54:27:fc:b1
[ 3.360499] i40e 0000:09:00.1: FW LLDP is enabled
[ 3.365096] i40e 0000:09:00.1: PCI-Express: Speed 8.0GT/s Width x4
[ 3.365097] i40e 0000:09:00.1: PCI-Express bandwidth available for this device may be insufficient for optimal performance.
[ 3.365097] i40e 0000:09:00.1: Please move the device to a different PCI-e link with more lanes and/or higher transfer rate.
[ 3.365458] i40e 0000:09:00.1: Features: PF-id[1] VFs: 32 VSIs: 2 QP: 24 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 3.379368] i40e 0000:09:00.2: fw 8.84.66032 api 1.14 nvm 8.40 0x8000af84 20.5.13 [8086:1572] [8086:0005]
[ 3.694165] i40e 0000:09:00.2: MAC address: 6c:fe:54:27:fc:b2
[ 3.694425] i40e 0000:09:00.2: FW LLDP is enabled
[ 3.698944] i40e 0000:09:00.2: PCI-Express: Speed 8.0GT/s Width x4
[ 3.698945] i40e 0000:09:00.2: PCI-Express bandwidth available for this device may be insufficient for optimal performance.
[ 3.698945] i40e 0000:09:00.2: Please move the device to a different PCI-e link with more lanes and/or higher transfer rate.
[ 3.699304] i40e 0000:09:00.2: Features: PF-id[2] VFs: 32 VSIs: 2 QP: 24 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 3.713393] i40e 0000:09:00.3: fw 8.84.66032 api 1.14 nvm 8.40 0x8000af84 20.5.13 [8086:1572] [8086:0005]
[ 4.028918] i40e 0000:09:00.3: MAC address: 6c:fe:54:27:fc:b3
[ 4.029184] i40e 0000:09:00.3: FW LLDP is enabled
[ 4.033757] i40e 0000:09:00.3: PCI-Express: Speed 8.0GT/s Width x4
[ 4.033758] i40e 0000:09:00.3: PCI-Express bandwidth available for this device may be insufficient for optimal performance.
[ 4.033759] i40e 0000:09:00.3: Please move the device to a different PCI-e link with more lanes and/or higher transfer rate.
[ 4.034119] i40e 0000:09:00.3: Features: PF-id[3] VFs: 32 VSIs: 2 QP: 24 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[ 4.034660] i40e 0000:01:00.2 enp1s0f2np2: renamed from eth1
[ 4.034724] i40e 0000:02:00.0 enp2s0f0np0: renamed from eth4
[ 4.034826] i40e 0000:09:00.0 enp9s0f0np0: renamed from eth8
[ 4.035035] i40e 0000:01:00.0 enp1s0f0np0: renamed from eth3
[ 4.035134] i40e 0000:09:00.1 enp9s0f1np1: renamed from eth9
[ 4.035298] i40e 0000:09:00.3 enp9s0f3np3: renamed from eth11
[ 4.035607] i40e 0000:02:00.2 enp2s0f2np2: renamed from eth6
[ 4.035672] i40e 0000:02:00.1 enp2s0f1np1: renamed from eth5
[ 4.035792] i40e 0000:02:00.3 enp2s0f3np3: renamed from eth7
[ 4.035895] i40e 0000:01:00.1 enp1s0f1np1: renamed from eth0
[ 4.035975] i40e 0000:09:00.2 enp9s0f2np2: renamed from eth10
[ 4.036030] i40e 0000:01:00.3 enp1s0f3np3: renamed from eth2
====================================================

gwn@gwn-System-Product-Name:~$ ethtool -i enp1s0f0np0
driver: i40e
version: 6.14.0-24-generic
firmware-version: 8.40 0x8000af84 20.5.13
expansion-rom-version:
bus-info: 0000:01:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes
gwn@gwn-System-Product-Name:~$
====================================================

Base Board Information
Manufacturer: ASUSTeK COMPUTER INC.
Product Name: Pro WS W680-ACE
Version: Rev 1.xx
Serial Number: 221113214500128
Asset Tag: Default string
Features:
Board is a hosting board
Board is replaceable
Location In Chassis: Default string
Chassis Handle: 0x0003
Type: Motherboard
Contained Object Handles: 0

[Lshuai]

P.S. Same thing happens on a Windows 10 enterprise edition, in control pannel adapters shows driver installed OK

but sfp+ plug in no response, any clue?

[Dineshbabu]

Hi Lshuai,

Greetings!

Thank you for posting in Intel Community. To assist you further, please provide the following information:

1. The complete model of the adapter

2. Clear pictures of the front and back of the adapter

3. Please confirm whether the adapter was purchased separately or came bundled with the system

Regards,

Dinesh

Intel Customer Support Technician

[Dineshbabu]

Hello Lshuai,

Greetings for the day!

We are following up to find out if you were able to find the information we provided. Please reply to confirm, so we can continue helping on a resolution. Looking forward to receiving your reply.

Regards,

Dinesh

Intel Customer Support Technician

[Dineshbabu]

Hello Lshuai,,

Greetings for the day!

We would like to inform you that we are closing this request due to no response being received for our previous follow-ups. Please don’t hesitate to reach out with any further questions in the future. Feel free to start a new conversation, as this thread will no longer be monitored.

Best regards, 

Dinesh

Intel Customer Support Technician

[Lshuai]

1. The complete model of the adapter

CNA X710-DA4 FH

2. Clear pictures of the front and back of the adapter

See attached

3. Please confirm whether the adapter was purchased separately or came bundled with the system

separately

[Dineshbabu]

Hi Lshuai,

Greetings!

Thank you for your response. Please note that Ubuntu 24 is not supported by the X710DA4 network adapter. We recommend using a supported operating system. For more information, please refer to the article below.

https://www.intel.com/content/www/us/en/support/articles/000025890/ethernet-products.html

Best regards, 

Dinesh

Intel Customer Support Technician

[Lshuai]

Thanks, I'll try lower Ubuntu.

For windows 10 enterprise, do you have any clue?

I checked property event, it gives event of

0x15

0xC000000BB

[Fikri_Intel]

Hi Lshuai,

Thank you for your response.

For the Windows 10 driver, you can find the driver with the link below:

https://www.intel.com/content/www/us/en/download/18293/intel-network-adapter-driver-for-windows-10.html

Make sure you have performed a clean removal of the old driver and install a fresh driver:

https://www.intel.com/content/www/us/en/support/articles/000058304/ethernet-products.html

Looking forward to your response.

Regards,

Fikri O.

[Dineshbabu]

Hello Lshuai,

Greetings for the day!

We are following up to find out if you were able to find the information we provided. Please reply to confirm, so we can continue helping on a resolution. Looking forward to receiving your reply.

Regards,

Dinesh

Intel Customer Support Technician

[Dineshbabu]

Hello Lshuai,

Greetings for the day!

We would like to inform you that we are closing this request due to no response being received for our previous follow-ups. Please don’t hesitate to reach out with any further questions in the future. Feel free to start a new conversation, as this thread will no longer be monitored.

Best regards, 

Dinesh

Intel Customer Support Technician