Intel X540-AT2 hardware errors / crash on link state change - ixgbe - Kernel 4.1.3

[SMcLe4]

• Occurring on Kernel 4.1.3 (Centos 7.1)
• Very similar to intel_admin your forums / community is woeful - no wonder no one replies to issues here.

[SYeo3]

Hi s_mcleod,

Thank you for contacting Intel.

We would like to request for additional details in order to understand your environment. Please fill up information below:

1. Operating System:

2. Driver version:

3. Steps to replicate the issue.

We look forward to your reply.

Sincerely,

Sandy

[SMcLe4]

Hi, that information is already in my post:

1. Operating System: CentOS 7.1 (RHEL7) / Kernel 4.1.3

2. Driver version: Stock Kernel 4.1.3 driver which is 4.0.1-k

3. Steps to replicate the issue: Using bonding mode 1 (active/passive) the issue happens intermittently when the link state changes.

[SYeo3]

Hi s_mcleod,

Thanks for replying.

I see that you are using the built-in driver in CentOS*. Please try installing our driver. You may download the driver here:

https://downloadcenter.intel.com/product/60020/Intel-Ethernet-Controller-X540-AT2 Intel-Ethernet-Controller-X540-AT2 Drivers

Alternatively, you can also check for tested driver provided by your system or motherboard manufacturer.

We await your test results.

Sincerely,

Sandy

[SMcLe4]

Hi Sandy,

Two questions:

1) Thanks for the link, I see that the driver you've suggest is a few minor revisions ahead of whats in the current Linux kernel, tell me - in those minor revisions are there any updates that could relate to this crash?

2) The drive you've linked me to only seems to support old Linux kernels 'latest 2.4 series kernel as well as 2.6.x and 3.x versions' - no mention of the current stable Linux Kernels 4/4.1/4.2 etc... ?

Unfortunately Supermicro's website is very hard to navigate and they're not very good at releasing driver updates.

[st4]

Hi mcleod,

The driver on our website support kernel version from 2.6.18 up through 3.19.4. Based on the release notes http://downloadmirror.intel.com/24941/eng/readmeixgbe.txt http://downloadmirror.intel.com/24941/eng/readmeixgbe.txt below are the changes in this release

Changes in this release:

* Various Bug fixes

* Support for new X550 hardware (new features not enabled yet)

* VxLan RX checksump offload support

* Ubuntu version check in makefile

rgds,

wb

[SMcLe4]

Hi wb,

The stable kernel version is currently 4.1.3 though?

- What does 'Various Bug fixes' entail?

- Your source code fails to build:

root@test-centos-02:~ 1 # rpmbuild -tb ixgbe-4.0.3.tar.gz Executing(%prep): /bin/sh -e /var/tmp/rpm-tmp.pgg0To + umask 022 + cd /root/rpmbuild/BUILD + cd /root/rpmbuild/BUILD + rm -rf ixgbe-4.0.3 + /usr/bin/gzip -dc /root/ixgbe-4.0.3.tar.gz + /usr/bin/tar -xvvf - drwxr-xr-x root/root 0 2015-04-08 02:52 ixgbe-4.0.3/ -rw-r--r-- root/root 412417 2015-08-03 16:11 ixgbe-4.0.3/COPYING -rw-r--r-- root/root 9550 2015-04-08 02:52 ixgbe-4.0.3/ixgbe.spec -rw-r--r-- root/root 5682 2015-04-08 02:52 ixgbe-4.0.3/pci.updates -rw-r--r-- root/root 2048 2015-04-08 02:52 ixgbe-4.0.3/SUMS -rwxr-xr-x root/root 7257 2015-04-08 02:52 ixgbe-4.0.3/ixgbe.7 drwxr-xr-x root/root 0 2015-04-08 02:52 ixgbe-4.0.3/scripts/ -rwxr-xr-x root/root 6072 2015-04-08 02:52 ixgbe-4.0.3/scripts/set_irq_affinity drwxr-xr-x root/root 0 2015-04-08 02:52 ixgbe-4.0.3/src/ -rw-r--r-- root/root 29598 2015-04-08 02:52 ixgbe-4.0.3/src/kcompat_ethtool.c -rw-r--r-- root/root 6549 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_osdep.h -rw-r--r-- root/root 52160 2015-04-08 02:52 ixgbe-4.0.3/src/kcompat.c -rw-r--r-- root/root 2444 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_x540.h -rw-r--r-- root/root 156012 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_type.h -rw-r--r-- root/root 300605 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_main.c -rw-r--r-- root/root 23259 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_dcb_nl.c -rw-r--r-- root/root 3478 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_dcb_82598.h -rw-r--r-- root/root 6343 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_mbx.h -rw-r--r-- root/root 76940 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_82599.c -rw-r--r-- root/root 39690 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_sriov.c -rw-r--r-- root/root 3080 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_sriov.h -rw-r--r-- root/root 20490 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_dcb.c -rw-r--r-- root/root 5627 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_dcb.h -rw-r--r-- root/root 45777 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_api.c -rw-r--r-- root/root 7217 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_sysfs.c -rw-r--r-- root/root 4276 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_dcb_82599.h -rw-r--r-- root/root 7486 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_debugfs.c -rw-r--r-- root/root 12481 2015-04-08 02:52 ixgbe-4.0.3/src/Makefile -rw-r--r-- root/root 74719 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_phy.c -rw-r--r-- root/root 135006 2015-04-08 02:52 ixgbe-4.0.3/src/kcompat.h -rw-r--r-- root/root 4634 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_x550.h -rw-r--r-- root/root 18 2015-04-08 02:52 ixgbe-4.0.3/src/Module.supported -rw-r--r-- root/root 28711 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_x540.c -rw-r--r-- root/root 7782 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_phy.h -rw-r--r-- root/root 40160 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_82598.c -rw-r--r-- root/root 1890 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_osdep2.h -rw-r--r-- root/root 31347 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_param.c -rw-r--r-- root/root 10009 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_dcb_82598.c -rw-r--r-- root/root 35997 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe.h -rw-r--r-- root/root 107371 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_ethtool.c -rw-r--r-- root/root 36880 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_lib.c -rw-r--r-- root/root 28978 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_fcoe.c -rw-r--r-- root/root 136359 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_common.c -rw-r--r-- root/root 2635 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_fcoe.h -rw-r--r-- root/root 2622 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_82599.h -rw-r--r-- root/root 82609 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_x550.c -rw-r--r-- root/root 19527 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_mbx.c -rw-r--r-- root/root 9706 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_api.h -rw-r--r-- root/root 27304 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_procfs.c -rw-r--r-- root/root 16485 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_dcb_82599.c -rw-r--r-- root/root 1923 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_82598.h -rw-r--r-- root/root 7353 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_common.h -rw-r--r-- root/root 48850 2015-04-08 02:52 ixgbe-4.0.3/src/ixgbe_ptp.c -rwxr-xr-x root/root 45909 2015-04-08 02:52 ixgbe-4.0.3/README + STATUS=0 + '[' 0 -ne 0 ']' + cd ixgbe-4.0.3 + /usr/bin/chmod -Rf a+rX,u+w,g-w,o-w . + exit 0 Executing(%build): /bin/sh -e /var/tmp/rpm-tmp.jVb4KF + umask 022 + cd /root/rpmbuild/BUILD + cd ixgbe-4.0.3 + make -C src clean make: Entering directory `/root/rpmbuild/BUILD/ixgbe-4.0.3/src' make -C /lib/modules/4.1.3-1.el7.elrepo.x86_64/build SUBDIRS=/root/rpmbuild/BUILD/ixgbe-4.0.3/src clean make[1]: Entering directory `/usr/src/kernels/4.1.3-1.el7.elrepo.x86_64' make[1]: Leaving directory `/usr/src/kernels/4.1.3-1.el7.elrepo.x86_64' rm -rf ixgbe.ko ixgbe.o ixgbe.mod.c ixgbe.mod.o ixgbe_main.o ixgbe_common.o ixgbe_api.o ixgbe_param.o ixgbe_lib.o ixgbe_ethtool.o kcompat.o ixgbe_82598.o ixgbe_82599.o ixgbe_x540.o ixgbe_x550.o ixgbe_sriov.o ixgbe_mbx.o ixgbe_dcb.o ixgbe_dcb_82598.o ixgbe_dcb_82599.o ixgbe_sysfs.o ixgbe_procfs.o ixgbe_phy.o ixgbe_dcb_nl.o ixgbe_fcoe.o ixgbe_debugfs.o ixgbe_ptp.o ixgbe.7.gz .*cmd .tmp_versions make: Leaving directory `/root/rpmbuild/BUILD/ixgbe-4.0.3/src' + make -C src make: Entering directory `/root/rpmbuild/BUILD/ixgbe-4.0.3/src' make -C /lib/modules/4.1.3-1.el7.elrepo.x86_64/build SUBDIRS=/root/rpmbuild/BUILD/ixgbe-4.0.3/src modules make[1]: Entering directory `/usr/src/kernels/4.1.3-1.el7.elrepo.x86_64' CC [M] /root/rpmbuild/BUILD/ixgbe-4.0.3/src/ixgbe_main.o /root/rpmbuild/BUILD/ixgbe-4.0.3/src/ixgbe_main.c: In function 'ixgbe_ndo_bridge_getlink': /root/rpmbuild/BUILD/ixgbe-4.0.3/src/ixgbe_main.c:9475:2: error: too few arguments to function 'ndo_dflt_bridge_getlink' return ndo_dflt_bridge_getlink(skb, pid, seq, dev, mode, 0, 0); ^ In file included from include/net/dst.h:13:0, from include/net/sock.h:67, from include/linux/tcp.h:22, from /root/rpmbuild/BUILD/ixgbe-4.0.3/src/ixgbe_main.c:37: include/linux/rtnetlink.h:123:12: note: declared here extern int ndo_dflt_bridge_getlink(struct sk_buff *skb, u32 pid, u32 seq, ^ /root/rpmbuild/BUILD/ixgbe-4.0.3/src/ixgbe_main.c: At top level: /root/rpmbuild/BUILD/ixgbe-4.0.3/src/ixgbe_main.c:9563:2: warning: initialization from incompatible pointer type [enabled by default] .ndo_bridge_getlink = ixgbe_ndo_bridge_getlink, ^ /root/rpmbuild/BUILD/ixgbe-4.0.3/src/ixgbe_main.c:9563:2: warning: (near initialization for 'ixgbe_netdev_ops.ndo_bridge_getlink') [enabled by default] /root/rpmbuild/BUILD/ixgbe-4.0.3/src/ixgbe_main.c: In function 'ixgbe_ndo_bridge_getlink': /root/rpmbuild/BUILD/ixgbe-4.0.3/src/ixgbe_main.c:9479:1: warning: control reaches end of non-void function [-Wreturn-type] } ^ make[2]: *** [/root/rpmbuild/BUILD/ixgbe-4.0.3/src/ixgbe_main.o] Error 1 make[1]: *** [_module_/root/rpmbuild/BUILD/ixgbe-4.0.3/src] Error 2 make[1]: Leaving directory `/usr/src/kernels/4.1.3-1.el7.elrepo.x86_64' make: *** [default] Error 2 make: Leaving directory `/root/rpmbuild/BUILD/ixgbe-4.0.3/src' error: Bad exit status from /var/tmp/rpm-tmp.jVb4KF (%build) RPM build errors: Bad exit status from /var/tmp/rpm-tmp.jVb4KF (%build)

[SYeo3]

Hi s_mcleod,

Thanks for the updates. I'll check on this.

Sincerely,

Sandy

[SYeo3]

Hi s_mcleod,

The logs attached does not provide complete description of what the issue is. Please provide information below:

1. Describe the issue that you are seeing.

2. What is meant by link state change and what is causing that change?

3. Step by step procedure on how the issue can be replicated.

4. Platform:

- Supermicro X10DRW-E/X10DRW-NT

- Onboard X540-AT2 Dual Port NIC

- Operating Systems used: CentOS 7.1 (RHEL7) / Kernel 4.1.3

- Driver version: Stock Kernel 4.1.3 driver which is 4.0.1-k

Sincerely,

Sandy