Linux ixgbe fails to load on board X540-AT2 at boot

[Prashant_Gupta]

I am having issues with the ixgbe driver in Linux (specifically Ubuntu 22.04).  The machine is a Supermicro server with a X9DRW-CTF31 motherboard. It has TWO built in X540-AT2 10GBase-T ethernet ports.   On boot, one of the onboard interfaces is labeled as disabled.  I have replicated this on CentOS 8 and Ubuntu 22.04.  The ixgbe module must be unloaded and re-loaded for both interfaces to be recognized.  Supermicro has no firmware updates specific to the ethernet interfaces, and I have the latest BIOS and firmware updates for the board. These ports are built-in to the motherboard so I am at a loss as to why this is happening. They are connected to a DELL PowerConnect 6248P switch.  It should eb noted that bonding is set up for both ports, but this of course fails when the machine is booted because one of the interfaces fails to come up.  This is resolved with re-loading of the ixgbe driver. Both NICs are recognized by lspci, and there is obviously not a hardware issue since the ports BOTH come up when the driver is reloaded. I could write a script to unload and reload the driver after boot but I was wondering if there is a fix for the driver.

[IntelSupport]

Hi Prashant_Gupta,

Greetings for the day!

This is regarding the case you have logged with us with the following details.

Case No: 06238811

Could you please let us know the current driver versions,

So that we can proceed further accordingly.

Please contact us for any further assistance.

Thank you for using Intel products and services.

Best Regards,

Mohammed Ali CM

[Prashant_Gupta]

Thank you for your response.  A little information about the machine:

Ubuntu 22.04.4 LTS (GNU/Linux 6.5.0-35-generic x86_64)

Supermicro X9DRW-CTF-31

Dual onboard X540-AT2 10GBase-T RJ-45 NIC

Below is the output of modinfo.  Is this how I get the version number?  I am using the driver that came with the kernel.

Is there another way to get the driver version if it is not contained below?

$ modinfo ixgbe
filename: /lib/modules/6.5.0-35-generic/kernel/drivers/net/ethernet/intel/ ixgbe/ixgbe.ko
license: GPL v2
description: Intel(R) 10 Gigabit PCI Express Network Driver
author: Intel Corporation, <linux.nics@intel.com>
srcversion: F52E6B7A783530114297118
alias: pci:v00008086d000015E5sv*sd*bc*sc*i*
alias: pci:v00008086d000015E4sv*sd*bc*sc*i*
alias: pci:v00008086d000015CEsv*sd*bc*sc*i*
alias: pci:v00008086d000015C8sv*sd*bc*sc*i*
alias: pci:v00008086d000015C7sv*sd*bc*sc*i*
alias: pci:v00008086d000015C6sv*sd*bc*sc*i*
alias: pci:v00008086d000015C4sv*sd*bc*sc*i*
alias: pci:v00008086d000015C3sv*sd*bc*sc*i*
alias: pci:v00008086d000015C2sv*sd*bc*sc*i*
alias: pci:v00008086d000015AEsv*sd*bc*sc*i*
alias: pci:v00008086d000015ACsv*sd*bc*sc*i*
alias: pci:v00008086d000015ADsv*sd*bc*sc*i*
alias: pci:v00008086d000015ABsv*sd*bc*sc*i*
alias: pci:v00008086d000015B0sv*sd*bc*sc*i*
alias: pci:v00008086d000015AAsv*sd*bc*sc*i*
alias: pci:v00008086d000015D1sv*sd*bc*sc*i*
alias: pci:v00008086d00001563sv*sd*bc*sc*i*
alias: pci:v00008086d00001560sv*sd*bc*sc*i*
alias: pci:v00008086d0000154Asv*sd*bc*sc*i*
alias: pci:v00008086d00001557sv*sd*bc*sc*i*
alias: pci:v00008086d00001558sv*sd*bc*sc*i*
alias: pci:v00008086d0000154Fsv*sd*bc*sc*i*
alias: pci:v00008086d0000154Dsv*sd*bc*sc*i*
alias: pci:v00008086d00001528sv*sd*bc*sc*i*
alias: pci:v00008086d000010F8sv*sd*bc*sc*i*
alias: pci:v00008086d0000151Csv*sd*bc*sc*i*
alias: pci:v00008086d00001529sv*sd*bc*sc*i*
alias: pci:v00008086d0000152Asv*sd*bc*sc*i*
alias: pci:v00008086d000010F9sv*sd*bc*sc*i*
alias: pci:v00008086d00001514sv*sd*bc*sc*i*
alias: pci:v00008086d00001507sv*sd*bc*sc*i*
alias: pci:v00008086d000010FBsv*sd*bc*sc*i*
alias: pci:v00008086d00001517sv*sd*bc*sc*i*
alias: pci:v00008086d000010FCsv*sd*bc*sc*i*
alias: pci:v00008086d000010F7sv*sd*bc*sc*i*
alias: pci:v00008086d00001508sv*sd*bc*sc*i*
alias: pci:v00008086d000010DBsv*sd*bc*sc*i*
alias: pci:v00008086d000010F4sv*sd*bc*sc*i*
alias: pci:v00008086d000010E1sv*sd*bc*sc*i*
alias: pci:v00008086d000010F1sv*sd*bc*sc*i*
alias: pci:v00008086d000010ECsv*sd*bc*sc*i*
alias: pci:v00008086d000010DDsv*sd*bc*sc*i*
alias: pci:v00008086d0000150Bsv*sd*bc*sc*i*
alias: pci:v00008086d000010C8sv*sd*bc*sc*i*
alias: pci:v00008086d000010C7sv*sd*bc*sc*i*
alias: pci:v00008086d000010C6sv*sd*bc*sc*i*
alias: pci:v00008086d000010B6sv*sd*bc*sc*i*
depends: dca,xfrm_algo,mdio
retpoline: Y
intree: Y
name: ixgbe
vermagic: 6.5.0-35-generic SMP preempt mod_unload modversions
sig_id: PKCS#7
signer: Build time autogenerated kernel key
sig_key: 62:0D:BC:92:0F:39:43:69:D0:2E:AB:3B:16:AD:C1:49:64:BF:9B:1E
sig_hashalgo: sha512
signature: 06:76:A8:CB:CD:70:0D:25:AE:5F:90:D5:B5:6A:A0:0A:57:FC:A5:75:
74:DA:89:D9:59:5F:E0:8D:4C:3A:77:2B:DC:41:87:32:2A:E1:68:9C:
B0:BF:39:DB:CF:F8:3F:2A:32:70:3E:69:2D:1C:3C:E8:3F:AF:77:A4:
00:04:37:81:56:6E:ED:7C:74:A4:11:D7:EC:3A:DF:7F:40:C0:E1:4C:
60:20:48:E3:07:24:69:95:20:50:34:48:65:0B:06:FD:D9:61:54:12:
AE:2B:DF:0A:81:9C:48:3B:9A:BF:88:B4:20:82:2D:D7:03:A4:ED:39:
EA:AE:4E:74:A7:57:FE:8D:88:B9:5E:C2:83:60:F0:28:4F:E7:E2:26:
81:53:93:41:2B:F5:BC:EB:92:C8:47:94:03:A3:B1:7F:3C:A6:4A:3C:
20:F9:11:BC:8C:DD:A3:E9:88:30:E7:AA:CF:F7:D0:D2:15:97:44:34:
77:AC:3B:B5:FD:2A:EA:69:94:9F:0F:13:71:E0:EF:41:3C:EA:F9:45:
59:7C:6C:78:9C:FB:25:27:08:46:12:FF:2B:1B:55:5B:09:F2:B2:73:
B1:54:5B:5A:FD:BD:F8:F9:FF:EC:6E:10:65:60:C5:24:5A:FE:67:22:
B2:64:32:2D:F9:5D:BE:03:9D:78:6D:86:36:7C:1D:38:28:A5:2C:82:
03:0E:82:DC:62:F3:CE:C8:1C:F3:28:F6:9F:DC:52:7F:38:90:89:35:
1C:1E:C7:9C:9D:9D:69:43:63:4F:D1:8F:4B:02:F9:F9:BB:80:EF:6C:
46:28:F4:E0:82:BB:3F:55:4E:66:AB:82:3C:89:8E:DE:06:23:C3:4F:
A7:6F:A6:70:5E:B6:5F:E3:04:F9:0C:FD:4D:AB:3C:16:77:8F:AF:99:
73:E6:D1:09:26:6D:F4:52:0D:3B:60:2D:CB:6A:19:4E:8A:71:8D:2A:
38:5F:38:86:34:80:11:D7:B5:33:05:F9:04:36:98:C4:D5:9D:F2:6B:
0A:83:18:00:04:E2:CA:D5:EA:F1:4D:3D:49:D4:F8:B0:50:2A:33:01:
41:E7:11:19:23:6B:3A:91:28:43:9B:A1:94:D5:80:B5:78:34:B0:5A:
BE:1E:45:21:52:D1:83:03:35:C7:34:99:85:62:CB:4B:1B:BD:A0:F8:
EE:D7:8F:93:A7:AB:7F:B3:56:33:16:FD:4C:66:3A:5E:87:24:E6:48:
9D:DF:66:C3:CD:3B:49:61:A6:BD:89:11:7E:49:2E:D9:05:51:8F:36:
5A:55:29:44:15:21:51:23:37:AE:E5:42:95:FA:4A:0D:C3:4C:64:9F:
D6:6D:4F:05:4F:E1:4B:D2:0A:2E:52:5A
parm: max_vfs:Maximum number of virtual functions to allocate per phys ical function - default is zero and maximum value is 63. (Deprecated) (uint)
parm: allow_unsupported_sfp:Allow unsupported and untested SFP+ module s on 82599-based adapters (bool)
parm: debug:Debug level (0=none,...,16=all) (int)

[Prashant_Gupta]

Also here is the output after boot where I look for error messages about the ixgbe module, and the second command is to show the two onboard interfaces. As you can see, when running lshw command the second interface is listed as disabled.  Again these commands are run immediately after boot.  In a follow up post I will provide the output when the module is unloaded and reloaded.

root@object2:/home/openstack# dmesg | grep ixgbe
[    6.319419] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver
[    6.336281] ixgbe: Copyright (c) 1999-2016 Intel Corporation.
[    6.653176] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count = 40, Tx Queue count = 40 XDP Queue count = 0
[    6.785232] ixgbe 0000:01:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link)
[    7.239249] ixgbe 0000:01:00.0: MAC: 3, PHY: 0, PBA No: 010000-000
[    7.239255] ixgbe 0000:01:00.0: 0c:c4:7a:63:72:b0
[    7.386345] ixgbe 0000:01:00.0: Intel(R) 10 Gigabit Network Connection
[    8.313781] ixgbe 0000:01:00.1: Multiqueue Enabled: Rx Queue count = 40, Tx Queue count = 40 XDP Queue count = 0
[    8.397234] ixgbe 0000:01:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link)
[    8.421225] ixgbe 0000:01:00.1: MAC: 3, PHY: 0, PBA No: 010000-000
[    8.421239] ixgbe 0000:01:00.1: 0c:c4:7a:63:72:b1
[    8.567247] ixgbe 0000:01:00.1: Intel(R) 10 Gigabit Network Connection
[    8.568742] ixgbe 0000:01:00.0 eno1: renamed from eth0
[   23.915048] ixgbe 0000:01:00.0: registered PHC device on eno1
[   27.294552] ixgbe 0000:01:00.0 eno1: NIC Link is Up 1 Gbps, Flow Control: RX/TX

root@object2:/home/openstack# lshw -C network
  *-network:0               
       description: Ethernet interface
       product: Ethernet Controller 10-Gigabit X540-AT2
       vendor: Intel Corporation
       physical id: 0
       bus info: pci@0000:01:00.0
       logical name: eno1
       version: 01
       serial: aa:7d:21:e6:5a:a2
       size: 1Gbit/s
       capacity: 10Gbit/s
       width: 64 bits
       clock: 33MHz
       capabilities: pm msi msix pciexpress bus_master cap_list ethernet physical tp 100bt-fd 1000bt-fd 10000bt-fd autonegotiation
       configuration: autonegotiation=on broadcast=yes driver=ixgbe driverversion=5.15.0-107-generic duplex=full firmware=0x800003e2 latency=0 link=yes multicast=yes port=twisted pair slave=yes speed=1Gbit/s
       resources: irq:80 memory:dd200000-dd3fffff ioport:8020(size=32) memory:dd404000-dd407fff memory:90000000-900fffff memory:90100000-901fffff
  *-network:1 DISABLED
       description: Ethernet interface
       product: Ethernet Controller 10-Gigabit X540-AT2
       vendor: Intel Corporation
       physical id: 0.1
       bus info: pci@0000:01:00.1
       logical name: eth1
       version: 01
       serial: 0c:c4:7a:63:72:b1
       capacity: 10Gbit/s
       width: 64 bits
       clock: 33MHz
       capabilities: pm msi msix pciexpress bus_master cap_list ethernet physical tp 100bt-fd 1000bt-fd 10000bt-fd autonegotiation
       configuration: autonegotiation=on broadcast=yes driver=ixgbe driverversion=5.15.0-107-generic firmware=0x800003e2 latency=0 link=no multicast=yes port=twisted pair

[Prashant_Gupta]

Here is the out put after running rmmod ixgbe && modprobe ixgbe essentially unloading and reloading the driver.  If you look at the output, the second NIC is now enabled:

root@object2:/home/openstack# rmmod ixgbe && modprobe ixgbe

root@object2:/home/openstack# dmesg | grep ixgbe
[    6.319419] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver
[    6.336281] ixgbe: Copyright (c) 1999-2016 Intel Corporation.
[    6.653176] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count = 40, Tx Queue count = 40 XDP Queue count = 0
[    6.785232] ixgbe 0000:01:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link)
[    7.239249] ixgbe 0000:01:00.0: MAC: 3, PHY: 0, PBA No: 010000-000
[    7.239255] ixgbe 0000:01:00.0: 0c:c4:7a:63:72:b0
[    7.386345] ixgbe 0000:01:00.0: Intel(R) 10 Gigabit Network Connection
[    8.313781] ixgbe 0000:01:00.1: Multiqueue Enabled: Rx Queue count = 40, Tx Queue count = 40 XDP Queue count = 0
[    8.397234] ixgbe 0000:01:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link)
[    8.421225] ixgbe 0000:01:00.1: MAC: 3, PHY: 0, PBA No: 010000-000
[    8.421239] ixgbe 0000:01:00.1: 0c:c4:7a:63:72:b1
[    8.567247] ixgbe 0000:01:00.1: Intel(R) 10 Gigabit Network Connection
[    8.568742] ixgbe 0000:01:00.0 eno1: renamed from eth0
[   23.915048] ixgbe 0000:01:00.0: registered PHC device on eno1
[   27.294552] ixgbe 0000:01:00.0 eno1: NIC Link is Up 1 Gbps, Flow Control: RX/TX
[  312.668876] ixgbe 0000:01:00.1: complete
[  312.669957] ixgbe 0000:01:00.0: removed PHC on eno1
[  313.069087] ixgbe 0000:01:00.0: complete
[  313.130485] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver
[  313.130488] ixgbe: Copyright (c) 1999-2016 Intel Corporation.
[  313.426650] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count = 40, Tx Queue count = 40 XDP Queue count = 0
[  313.510437] ixgbe 0000:01:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link)
[  313.534452] ixgbe 0000:01:00.0: MAC: 3, PHY: 0, PBA No: 010000-000
[  313.534458] ixgbe 0000:01:00.0: 0c:c4:7a:63:72:b0
[  313.673425] ixgbe 0000:01:00.0 eno1: renamed from eth0
[  313.712815] ixgbe 0000:01:00.0: Intel(R) 10 Gigabit Network Connection
[  313.929891] ixgbe 0000:01:00.0: registered PHC device on eno1
[  314.010628] ixgbe 0000:01:00.1: Multiqueue Enabled: Rx Queue count = 40, Tx Queue count = 40 XDP Queue count = 0
[  314.094433] ixgbe 0000:01:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link)
[  314.118465] ixgbe 0000:01:00.1: MAC: 3, PHY: 0, PBA No: 010000-000
[  314.118471] ixgbe 0000:01:00.1: 0c:c4:7a:63:72:b1
[  314.453854] ixgbe 0000:01:00.1: registered PHC device on eth0
[  314.592212] ixgbe 0000:01:00.1: Intel(R) 10 Gigabit Network Connection
[  317.289355] ixgbe 0000:01:00.0 eno1: NIC Link is Up 1 Gbps, Flow Control: RX/TX
[  319.304055] ixgbe 0000:01:00.1 eth0: NIC Link is Up 1 Gbps, Flow Control: RX/TX
root@object2:/home/openstack# lshw -C network
  *-network:0               
       description: Ethernet interface
       product: Ethernet Controller 10-Gigabit X540-AT2
       vendor: Intel Corporation
       physical id: 0
       bus info: pci@0000:01:00.0
       logical name: eno1
       version: 01
       serial: 0c:c4:7a:63:72:b0
       size: 1Gbit/s
       capacity: 10Gbit/s
       width: 64 bits
       clock: 33MHz
       capabilities: pm msi msix pciexpress bus_master cap_list ethernet physical tp 100bt-fd 1000bt-fd 10000bt-fd autonegotiation
       configuration: autonegotiation=on broadcast=yes driver=ixgbe driverversion=5.15.0-107-generic duplex=full firmware=0x800003e2 latency=0 link=yes multicast=yes port=twisted pair slave=yes speed=1Gbit/s
       resources: irq:80 memory:dd200000-dd3fffff ioport:8020(size=32) memory:dd404000-dd407fff memory:90000000-900fffff memory:90100000-901fffff
  *-network:1
       description: Ethernet interface
       product: Ethernet Controller 10-Gigabit X540-AT2
       vendor: Intel Corporation
       physical id: 0.1
       bus info: pci@0000:01:00.1
       logical name: eth0
       version: 01
       serial: 0c:c4:7a:63:72:b0
       size: 1Gbit/s
       capacity: 10Gbit/s
       width: 64 bits
       clock: 33MHz
       capabilities: pm msi msix pciexpress bus_master cap_list ethernet physical tp 100bt-fd 1000bt-fd 10000bt-fd autonegotiation
       configuration: autonegotiation=on broadcast=yes driver=ixgbe driverversion=5.15.0-107-generic duplex=full firmware=0x800003e2 latency=0 link=yes multicast=yes port=twisted pair slave=yes speed=1Gbit/s
       resources: irq:156 memory:dd000000-dd1fffff ioport:8000(size=32) memory:dd400000-dd403fff memory:90200000-902fffff memory:90300000-903fffff

[Prashant_Gupta]

here is the output from modinfo ixgbe :  I am unsure if it is providing the driver version.  If not, is there another command I should use?

modinfo ixgbe
filename: /lib/modules/6.5.0-35-generic/kernel/drivers/net/ethernet/intel/ ixgbe/ixgbe.ko
license: GPL v2
description: Intel(R) 10 Gigabit PCI Express Network Driver
author: Intel Corporation, <linux.nics@intel.com>
srcversion: F52E6B7A783530114297118
alias: pci:v00008086d000015E5sv*sd*bc*sc*i*
alias: pci:v00008086d000015E4sv*sd*bc*sc*i*
alias: pci:v00008086d000015CEsv*sd*bc*sc*i*
alias: pci:v00008086d000015C8sv*sd*bc*sc*i*
alias: pci:v00008086d000015C7sv*sd*bc*sc*i*
alias: pci:v00008086d000015C6sv*sd*bc*sc*i*
alias: pci:v00008086d000015C4sv*sd*bc*sc*i*
alias: pci:v00008086d000015C3sv*sd*bc*sc*i*
alias: pci:v00008086d000015C2sv*sd*bc*sc*i*
alias: pci:v00008086d000015AEsv*sd*bc*sc*i*
alias: pci:v00008086d000015ACsv*sd*bc*sc*i*
alias: pci:v00008086d000015ADsv*sd*bc*sc*i*
alias: pci:v00008086d000015ABsv*sd*bc*sc*i*
alias: pci:v00008086d000015B0sv*sd*bc*sc*i*
alias: pci:v00008086d000015AAsv*sd*bc*sc*i*
alias: pci:v00008086d000015D1sv*sd*bc*sc*i*
alias: pci:v00008086d00001563sv*sd*bc*sc*i*
alias: pci:v00008086d00001560sv*sd*bc*sc*i*
alias: pci:v00008086d0000154Asv*sd*bc*sc*i*
alias: pci:v00008086d00001557sv*sd*bc*sc*i*
alias: pci:v00008086d00001558sv*sd*bc*sc*i*
alias: pci:v00008086d0000154Fsv*sd*bc*sc*i*
alias: pci:v00008086d0000154Dsv*sd*bc*sc*i*
alias: pci:v00008086d00001528sv*sd*bc*sc*i*
alias: pci:v00008086d000010F8sv*sd*bc*sc*i*
alias: pci:v00008086d0000151Csv*sd*bc*sc*i*
alias: pci:v00008086d00001529sv*sd*bc*sc*i*
alias: pci:v00008086d0000152Asv*sd*bc*sc*i*
alias: pci:v00008086d000010F9sv*sd*bc*sc*i*
alias: pci:v00008086d00001514sv*sd*bc*sc*i*
alias: pci:v00008086d00001507sv*sd*bc*sc*i*
alias: pci:v00008086d000010FBsv*sd*bc*sc*i*
alias: pci:v00008086d00001517sv*sd*bc*sc*i*
alias: pci:v00008086d000010FCsv*sd*bc*sc*i*
alias: pci:v00008086d000010F7sv*sd*bc*sc*i*
alias: pci:v00008086d00001508sv*sd*bc*sc*i*
alias: pci:v00008086d000010DBsv*sd*bc*sc*i*
alias: pci:v00008086d000010F4sv*sd*bc*sc*i*
alias: pci:v00008086d000010E1sv*sd*bc*sc*i*
alias: pci:v00008086d000010F1sv*sd*bc*sc*i*
alias: pci:v00008086d000010ECsv*sd*bc*sc*i*
alias: pci:v00008086d000010DDsv*sd*bc*sc*i*
alias: pci:v00008086d0000150Bsv*sd*bc*sc*i*
alias: pci:v00008086d000010C8sv*sd*bc*sc*i*
alias: pci:v00008086d000010C7sv*sd*bc*sc*i*
alias: pci:v00008086d000010C6sv*sd*bc*sc*i*
alias: pci:v00008086d000010B6sv*sd*bc*sc*i*
depends: dca,xfrm_algo,mdio
retpoline: Y
intree: Y
name: ixgbe
vermagic: 6.5.0-35-generic SMP preempt mod_unload modversions
sig_id: PKCS#7
signer: Build time autogenerated kernel key
sig_key: 62:0D:BC:92:0F:39:43:69:D0:2E:AB:3B:16:AD:C1:49:64:BF:9B:1E
sig_hashalgo: sha512
signature: 06:76:A8:CB:CD:70:0D:25:AE:5F:90:D5:B5:6A:A0:0A:57:FC:A5:75:
74:DA:89:D9:59:5F:E0:8D:4C:3A:77:2B:DC:41:87:32:2A:E1:68:9C:
B0:BF:39:DB:CF:F8:3F:2A:32:70:3E:69:2D:1C:3C:E8:3F:AF:77:A4:
00:04:37:81:56:6E:ED:7C:74:A4:11:D7:EC:3A:DF:7F:40:C0:E1:4C:
60:20:48:E3:07:24:69:95:20:50:34:48:65:0B:06:FD:D9:61:54:12:
AE:2B:DF:0A:81:9C:48:3B:9A:BF:88:B4:20:82:2D:D7:03:A4:ED:39:
EA:AE:4E:74:A7:57:FE:8D:88:B9:5E:C2:83:60:F0:28:4F:E7:E2:26:
81:53:93:41:2B:F5:BC:EB:92:C8:47:94:03:A3:B1:7F:3C:A6:4A:3C:
20:F9:11:BC:8C:DD:A3:E9:88:30:E7:AA:CF:F7:D0:D2:15:97:44:34:
77:AC:3B:B5:FD:2A:EA:69:94:9F:0F:13:71:E0:EF:41:3C:EA:F9:45:
59:7C:6C:78:9C:FB:25:27:08:46:12:FF:2B:1B:55:5B:09:F2:B2:73:
B1:54:5B:5A:FD:BD:F8:F9:FF:EC:6E:10:65:60:C5:24:5A:FE:67:22:
B2:64:32:2D:F9:5D:BE:03:9D:78:6D:86:36:7C:1D:38:28:A5:2C:82:
03:0E:82:DC:62:F3:CE:C8:1C:F3:28:F6:9F:DC:52:7F:38:90:89:35:
1C:1E:C7:9C:9D:9D:69:43:63:4F:D1:8F:4B:02:F9:F9:BB:80:EF:6C:
46:28:F4:E0:82:BB:3F:55:4E:66:AB:82:3C:89:8E:DE:06:23:C3:4F:
A7:6F:A6:70:5E:B6:5F:E3:04:F9:0C:FD:4D:AB:3C:16:77:8F:AF:99:
73:E6:D1:09:26:6D:F4:52:0D:3B:60:2D:CB:6A:19:4E:8A:71:8D:2A:
38:5F:38:86:34:80:11:D7:B5:33:05:F9:04:36:98:C4:D5:9D:F2:6B:
0A:83:18:00:04:E2:CA:D5:EA:F1:4D:3D:49:D4:F8:B0:50:2A:33:01:
41:E7:11:19:23:6B:3A:91:28:43:9B:A1:94:D5:80:B5:78:34:B0:5A:
BE:1E:45:21:52:D1:83:03:35:C7:34:99:85:62:CB:4B:1B:BD:A0:F8:
EE:D7:8F:93:A7:AB:7F:B3:56:33:16:FD:4C:66:3A:5E:87:24:E6:48:
9D:DF:66:C3:CD:3B:49:61:A6:BD:89:11:7E:49:2E:D9:05:51:8F:36:
5A:55:29:44:15:21:51:23:37:AE:E5:42:95:FA:4A:0D:C3:4C:64:9F:
D6:6D:4F:05:4F:E1:4B:D2:0A:2E:52:5A
parm: max_vfs:Maximum number of virtual functions to allocate per phys ical function - default is zero and maximum value is 63. (Deprecated) (uint)
parm: allow_unsupported_sfp:Allow unsupported and untested SFP+ module s on 82599-based adapters (bool)
parm: debug:Debug level (0=none,...,16=all) (int)

[Poojitha]

Hi Prashant_Gupta,

Thank you for sharing the information. We appreciate you reaching out to us regarding the reported issue. As the product was in built in motherboard. we kindly advise you to contact the OEM Supermicro serve support team for further assistance. They will be best equipped to provide support and address any concerns related to your query.

Unfortunately we are unable to extend support for this product, as it falls outside of our support boundaries.

Thank you for your understanding!

Regards,

Poojitha

[MACM]

HI Prashant_Gupta,

Greetings for the day!

I hope this message finds you well.

We are following up to find out if you were able to find the information we provided. 

Kindly reply back to confirm and let us know if you need any further assistance.

Thank you for using Intel products and services.

Regards,

Ali

[Prashant_Gupta]

Unfortunately I was not.  As this an ixgbe - Intel driver issue with an intel chipset I was unable to find any information.  Supermicro has no control over the ixgbe driver provided in linux.

Please advise.

Prashant

[Subhashish]

Hi Prashant_Gupta,

Greetings!

please Refer to the below link :-

https://www.intel.com/content/www/us/en/download/14302/intel-network-adapter-driver-for-pcie-intel-10-gigabit-ethernet-network-connections-under-linux.html

Please try the latest driver 5.19.9, Please also cross check in your board manufacturer's support page, if there is any new driver release available.

Do note that the product in question is discontinued by intel as well. So we may or may not have further updates on the already existing drivers for X540 AT2.

Regards,

Subhashish_Intel.

[Subhashish]

Hello Prashant_Gupta,

Greetings for the day!

Hope you are doing well.

We do not mean to rush you but just wanted to follow up on the reported issue. We would like to know if you got the opportunity to review the shared Plan of Action(POA) from our last post.

Please write back to us for any doubts/query and we will be happy to assist you.

Regards,

Subhashish_Intel.

[MACM]

Hello @Prashant_Gupta 

Greetings for the day!

I hope this message finds you well.

We are still waiting for your reply.

Kindly revert back to us with the details so that we can assist you further.

Thank you for using Intel products and services.

Regards,

Mohammed Ali

[Prashant_Gupta]

My apologies. I had replied some days ago, but it seems the reply did not post.  I am getting compilation errors for the driver listed.  

Fails with the following error: "fatal error: linux/pci-aspm.h: No such file or directory #include <linux/pci-aspm.h>"

It is referred to in this post:

https://community.intel.com/t5/Ethernet-Products/Possible-workaround-for-installing-latest-ixgbe-drivers-on/m-p/694557

It seems my browser did not send the previous message I sent. My apologies and thank you for all of your help.

[Subhashish]

Hello Prashant_Gupta,

Thank you for sharing this information with us. We are working on this with our internal team and we will get back to you with an update at earliest.

Thank you for choosing Intel.

Regards,

Subhashish_Intel.

[Subhashish]

Hello Prashant_Gupta,

Greetings from Intel!

This is to update regarding our last communication. Linux usually does not enable additional ports beyond the primary on boot unless configured to do so.

If using the UI, there is a Network Manager that you have to check the box for the port to "Connect Automatically"

Could you please check the configuration that is there currently.

Regards,

Subhashish.

[Subhashish]

Hello Prashant_Gupta,

Greetings!

We just wanted to follow up on the issue reported. We just wanted to know if you got the opportunity to review our last communication and whether you tried our suggestion and what is the outcome.

Looking forward to hear from you.

Regards,

Subhashish_Intel.

[Subhashish]

Hello Prashant_Gupta,

Greetings!!

This is a second follow up regarding the issue reported to us. We just wanted to know if you got the opportunity to review our last update and whether you tried our suggestion and what is the outcome. Please let us know if there is any other help required.

Regards,

Subhashish_Intel.