Intel XL710-QDA2 can no longer be changed to 2x40 or 1x40 mode with latest firmware 5.02

[JPron2]

The 40Gb modes can no longer be selected using the qcu64e utility since the firmware upgrade from 4.42 to 5.02. Only 4x10 and 2x2x10 options are offered but the XL710-QDA2 card is QSFP+ capable.

# qcu64e /NIC=1 /INFO

Intel(R) QSFP+ Configuration Utility

QCU version: v2.26.17.06

Copyright(C) 2015 by Intel Corporation.

Software released under Intel Proprietary License.

Adapter supports QSFP+ Configuration modification.

Current Configuration: 4x10

Supported Configurations:

4x10

2x2x10A (Top 2 lanes on Module0; Bottom 2 lanes on Module 1)

2x2x10B

Cards that already are in 40Gb mode continue to function in 40Gb mode, but they report invalid configuration with qcu64e:

# qcu64e -nic=1 -info

Intel(R) QSFP+ Configuration Utility

QCU version: v2.26.17.06

Copyright(C) 2015 by Intel Corporation.

Software released under Intel Proprietary License.

Adapter supports QSFP+ Configuration modification.

Current Configuration: Invalid

Supported Configurations:

4x10

2x2x10A (Top 2 lanes on Module0; Bottom 2 lanes on Module 1)

2x2x10B

We are using the i40e driver 1.4.25 on Redhat 6: 2.6.32-573.18.1.el6.x86_64 kernel

# ethtool -i eth4

driver: i40e

version: 1.4.25

firmware-version: 5.02 0x80002285 0.0.0

bus-info: 0000:06:00.0

supports-statistics: yes

supports-test: yes

supports-eeprom-access: yes

supports-register-dump: yes

supports-priv-flags: yes

It looks like there is currently no way to downgrade the firmware, which make the cards that are now stuck in 4x10 unusable for us.

[st4]

Hi Joeri,

Yes, there is no way to downgrade the firware, but let me check on the configuration issue you encountered.

rgds,

wb

[st4]

Hi Joeri,

Can you help check the following:

1) What is the exact QSFP+ configuration utility used?

Is it downloaded from https://downloadcenter.intel.com/download/25851/Intel-QSFP-Configuration-Utility-Linux- https://downloadcenter.intel.com/download/25851/Intel-QSFP-Configuration-Utility-Linux- dated 3/14/16

OR

https://downloadcenter.intel.com/download/25849/Intel-QSFP-Configuration-Utility-OS-Independent- https://downloadcenter.intel.com/download/25849/Intel-QSFP-Configuration-Utility-OS-Independent-

dated 2/18/16

2) You mentioned cards already in 40Gb mode despite the "invalid configuration" error reported in qcu64e, does it mean the XL710-QDA2 is running in 40GBps connection without problem?

3) Can you try using other QSFP+ utility (dated 2/18/16 or 3/14/16) and cehck if the same issue persist?

4) When you try to run the command below, what is the output?

qcu64e -nic=1 /set=2x40

5) How many ports were active on the affected XL710-QDA2( are you referring to one QDA port connects to 40Gb switch port?)

Feel free to update me.

Thanks,

wb

[JPron2]

1) the first link for Linux

2) Yes, luckily they are working without any problem in 40Gbps mode

3) Just tried it, same result

4) Here it is:

qcu64e /NIC=1 /SET=2x40

Intel(R) QSFP+ Configuration Utility

QCU version: v2.26.17.06

Copyright(C) 2015 by Intel Corporation.

Software released under Intel Proprietary License.

Adapter supports QSFP+ Configuration modification.

Current Configuration: 2x2x10A (Top 2 lanes on Module0; Bottom 2 lanes on Module 1)

Supported Configurations:

4x10

2x2x10A (Top 2 lanes on Module0; Bottom 2 lanes on Module 1)

2x2x10B

Error: The chosen configuration is not supported by this adapter.

5) We have 2 ports active in 40Gb mode

[st4]

Hi Joeri,

Thank you for the info. Let me check on this.

rgds,

wb

[st4]

Hi Joeri,

Can you also provide the serial number and marking on the affected XL710-QDA2 and installed module?

Here is the link where you can refer to locate the serial number:

http://www.intel.com/content/www/us/en/support/network-and-i-o/ethernet-products/000007022.html Identify Your Intel® Network Adapter Model Using Serial Number

For the installed modules, please provide all the numbers written on the modules.

Thanks for your time on this.

rgds

wb

[JPron2]

it should be (please note that the link supplied is not for the XL710):

serial: 3875 3153 5870 6609 5387 8056

mac: 68:05:ca:34:8c:88

module: 1450 U90W1E1100 (*2)

[SYeo3]

Hi Joeri,

Thanks for the updates. We'll check on this and update you with our findings.

Sincerely,

Sandy

[st4]

Hi Joeri,

Than you for the info. Yes the link is not for the XL710 but the serial number should be something similar to that format but with additional digits. The serial number of XL710 should be in the format of 15 digits + 6 digits + 6-3

e.g

xxxxxxxxxxxxxxx xxxxxx xxxxxx-xxx

What is the brand of the modules?

thanks,

wb

[JPron2]

might this be the serial:

6805CA348C880080515ADH57401001

[st4]

Hi Joeri,

Thanks this is the serial number.

rgds,

wb

[st4]

Hi JOeri,

What is the brand of the modules?

rgds,

wb

[JPron2]

Where do I find the brand of the module?

The text I have on QSFP+ is:

1450 U90W1E1100

FYI: we just received new XL710 cards and they do offer the 40Gb configuration options. mac starts with 3C:FD:FE: the older "broken" cards have mac starting with: 68:05:CA

[st4]

Hi JOeri,

Thank you for the update, good to know the other NIC is working fine. I did not receive information that there is known issue

for the network adapter with mac address start with 68:05;CA. Please update me if you still have other concern about this.

Thanks

wb

[A_L_Intel]

This behavior is due to errata # 48 reported in the http://www.intel.com/content/www/us/en/embedded/products/networking/xl710-10-40-controller-spec-update.html Intel® Ethernet Controller XL710: Specification Update. The actual QCU (not the adapter firmware) is noticing that your adapter is using B0 silicon which was affected by this errata, and deciding not to allow a configuration change back to 40 GbE mode.

This errata doesn't matter if you are operating in 10 GbE mode. If your adapter(s) need to operate in nx40 GbE mode, we'd rather you get warranty replacements than trying to downgrade the firmware to trick it into working... as you can see from the errata description it's not a trivial issue.

Apologies for the lack of documentation around this change in QCU behavior, it was an oversight on our part and we'll be fixing that shortly.

South

[MAnza]

Hi

Is there an update on this issue? I am also facing the same problem.

My OS is Ubuntu 14.04.4 LTS

The card I have is Intel XL710-QDA2. /message/380703# 380703

Output of qcu info

./qcu64e /nic=1 /info

Intel(R) QSFP+ Configuration Utility

QCU version: v2.27.10.01

Copyright(C) 2016 by Intel Corporation.

Software released under Intel Proprietary License.

Adapter supports QSFP+ Configuration modification.

Current Configuration: 2x2x10A (Top 2 lanes on Module0; Bottom 2 lanes on Module 1)

Supported Configurations:

4x10

2x2x10A (Top 2 lanes on Module0; Bottom 2 lanes on Module 1)

2x2x10B

My card have mac starting with: 68:05:CA.

:~$ ethtool -i p1p1

driver: i40e

version: 1.4.25

firmware-version: 5.02 0x80002285 0.0.0

bus-info: 0000:81:00.0

supports-statistics: yes

supports-test: yes

supports-eeprom-access: yes

supports-register-dump: yes

supports-priv-flags: yes

Is there a way I can use this in nx40 GbE mode ? Is there a fix available. Please help.

Thanks

Anzal

[MAnza]

Hi

I think there is no update on this. I am OK with procuring a new XL710 QDA2. But how can I assure that the new one wont have this issue ?

My current MAC starts with 68:05:CA. I read on the thread here that adapters with MAC starting with 3C:FD:FE: does not have the issue.

Please let me know how to procure a proper adapter. Some model number,date,- some info that can assure that it can work in 40 G mode.

Thanks

Anzal

[AAlex20]

Got the same problem. As for me Intel should start recall affected hardware program.

Got 01/2016 production month replacement, is there any way to know hardware/silicon revision?