Ethernet Products
Determine ramifications of Intel® Ethernet products and technologies
4811 Discussions

XL710 firmware 9.10 - downgrade to previous version

DmytroBond
Beginner
2,606 Views

Hi,

 

The latest FW for Intel XL710 NIC has 9.10 version number.

https://www.intel.com/content/www/us/en/download/18190/non-volatile-memory-nvm-update-utility-for-intel-ethernet-network-adapter-700-series.html 

 

But there is no downgrade package for 9.10

The latest version that can be downgraded is 9.01

https://www.intel.com/content/www/us/en/download/683939/nvm-downgrade-packages-for-intel-ethernet-adapters-700-series.html

 

Could you please help me to get downgrade package to switch from version 9.10 to 8.70 or earliу.

 

0 Kudos
17 Replies
Mike_Intel
Moderator
2,583 Views

Hello DmytroBond,


Thank you for posting in Intel Ethernet Communities. 


For us to further check the issue, please provide the following details.


  1. Are you using a PCIe XL710 or is it embedded on the board?
  2. What is the brand and model of your motherboard/system?
  3. Can you tell us why do you need to downgrade? Are you having some issues with the network card?


If you have questions, please let us know. In case we do not hear from you, we will make a follow up after 3 workings days. Thank you.


Best regards,

Michael L.

Intel® Customer Support


0 Kudos
DmytroBond
Beginner
2,570 Views

Hi Michael,

 

1.

I'm using PCIe version XL710-QDA1

VID = 8086

DID = 1584

SVID = 8086

SDID = 0001

 

2.

Motherboard: Supermicro X12SPA-TF + 

CPU: Intel Xeon Gold 6336Y

 

3.

I'm running couple of VMs on top of ESXi 8.0 hypervisor. XL710 is configured in SR-IOV passthrough.

By default ESXi used  i40en PF driver version 1.11.2.5-1vmw and my XL710 was running 8.60 version of FW.

All existing VMs (Linux v3 kernel, Linux v4 kernel, Win Server 2019) was working fine with this setup.

 

But newly installed Ubuntu Server 22.10 VM  had kernel stability problems in iavf driver. So i decided to upgrade it to 4.7.0 version driver, which is the latest at this moment. Situation improved, but not drastically. 

Next attempt was to upgrade hypervisor PF driver and XL710 FW. I've installed i40en driver version 2.4.2.0 and FW 9.10. Upgrade finished with no errors, but now no one of my VMs have working network on XL710 VFs.  

 

Linux reporting:


[ 7.712907] ================================================================================
[ 7.713091] UBSAN: invalid-load in /iavf_virtchnl.c:1956:36
[ 7.713301] load of value 249 is not a valid value for type '_Bool'
[ 7.713S3S] ================================================================================
[ 8.889362] iavf 0000:lb:00.0: PF returned error -5 (VIRTCHN1 STATUS_ERR_PARAM) to our request 6
[9.897331] iavf 0000:1b:00.0 PF returned error -5 (VIRTCHNI STATUS _ERR_PARAM) to our request 6
[10.893307] iavf 0000:1b:00.0 PF returned error -5 (VIRTCHNI STATUS _ERR_PARAM) to our request 6
[11.897315] iavf 0000:1b:00.0 PF returned error -5 (VIRTCHNI STATUS _ERR_PARAM) to our request 6
[12.881310] iavf 0000:1b:00.0 PF returned error -5 (VIRTCHNI STATUS _ERR_PARAM) to our request 6
[13.897312] iavf 0000:1b:00.0 PF returned error -5 (VIRTCHNI STATUS _ERR_PARAM) to our request 6
[14.885312] iavf 0000:lb:00.0 PF returned error -5 (VIRTCHNI STATUS _ERR_PARAM) to our request 6

 

ESX kernel:

2022-12-07T15:39:59.114Z In(182) vmkernel: cpu22:2097761)i40en: i40en_UpdateUplinkLinkStatus:5834: Link is up at 40000 Mbps Full Duplex for device vmnic1
2022-12-07T15:39:59.494Z In(182) vmkernel: cpu19:2097761)i40en: indrv_PassthruConfigVFs:400: VMK_CFG_MTU_CHANGED: Guest OS changes VF0's MTU to 1508
2022-12-07T15:39:59.494Z In(182) vmkernel: cpu19:2097761)i40en: i40en_ConfigVsiRxQueue:2888: Unable to update mtu 1508 for VF 0, error 195887111
2022-12-07T15:39:59Z In(182) vmkernel:
2022-12-07T15:39:59.494Z In(182) vmkernel: cpu19:2097761)i40en: i40en_SendMsgToVf:1762: VF 0 does not support given command
2022-12-07T15:39:59.530Z In(182) vmkernel: cpu19:2097761)i40en: i40en_HandleMddEvent:10427: Malicious Driver Detection event on vmnic1 TX queue 22 PF number 0x00 VF number 0x00
2022-12-07T15:39:59.530Z In(182) vmkernel: cpu19:2097761)i40en: i40en_HandleMddEvent:10500: MDD event detected on vmnic1, PF reset issued

 

it will be good if there is a solution to keep latest PF drivers + FW and make the system working. But i would prefer to revert changes and move system to known working condition. That's why I asked for downgrade package.

 

Best regards, Dmytro 

0 Kudos
Mike_Intel
Moderator
2,569 Views

Hello DmytroBond,


Thank you for the quick reply. For us to further investigate the issue that you reported. Kindly send photos of the unit on both sides for us to validate if the unit is not an OEM unit.


If you have questions, please let us know. In case we do not hear from you, we will make a follow up after 3 workings days. Thank you.


Best regards,

Michael L.

Intel® Customer Support


0 Kudos
DmytroBond
Beginner
2,472 Views

Hi Michael,

Please, see photos below.

 

photo_2022-12-11_13-36-03 (4).jpg

photo_2022-12-11_13-36-03 (3).jpg

0 Kudos
Mike_Intel
Moderator
2,462 Views

Hello DmytroBond,


Thank you for sending the photos of the unit. I will have this issue checked if it is possible to downgrade the firmware to 8.70. Please give us 2 to 3 working days to provide an update on this.


Thank you and stay safe.


Best regards,

Michael L.

Intel® Customer Support


0 Kudos
Mike_Intel
Moderator
2,450 Views

Hello DmytroBond,

 

Thank you for patiently waiting for our update. You may download the downgrade file on the link below:


https://www.intel.com/content/www/us/en/download/683939/nvm-downgrade-packages-for-intel-ethernet-adapters-700-series.html

 

If you have questions, please let us know. In case we do not hear from you, we will make a follow up after 3 workings days. Thank you.

 

Best regards,

Michael L.

Intel® Customer Support


0 Kudos
Mike_Intel
Moderator
2,434 Views

Hello DmytroBond,

 

I hope you're having a wonderful day. I am just sending a soft follow up to check if you already tried downgrading the firmware. We will wait for your reply. 

 

If you have questions, please let us know. In case we do not hear from you, we will make a follow up after 3 workings days. Thank you.

 

Best regards,

Michael L.

Intel® Customer Support


0 Kudos
DmytroBond
Beginner
2,416 Views

Hi Michael,

 

Downgraded NIC firmware, but it didn't help.

Tested different versions of drivers with 9.10 and 8.70 firmware.

The symptoms are the same as I described in this message above. 

The only driver that works (with minor problems) is original 1.11.2.5-1vmw.

 

Guessing that this may be related to incompatibility between ESXi version and Intel driver. VMWare download page recommends these drivers for ESXi 8.0 (as I'm using), but Intel drivers release notes states that they are for ESXi 7.0 branch.  

Copyright(c) 2013 - 2022 Intel Corporation

This release includes the unified i40en VMware ESX Driver for Intel(R)
Ethernet Controllers X710, XL710, XXV710, and X722 family

Driver version: 2.4.2.0

Supported ESXi release: 7.0

 

0 Kudos
Mike_Intel
Moderator
2,383 Views

Hello DmytroBond,

 

Thank you for the update. For us to fully understand the issue, please provide the following details. 


  1. Can you provide a detailed explanation of the issue. Kindly do not include the downgrade of the firmware issue.
  2. Please share a screenshot of the issue
  3. Please help generate the SSU of your system. Kindly download the utility from the link below:

 

https://www.intel.com/content/www/us/en/download/18895/intel-system-support-utility-for-the-linux-operating-system.html?wapkw=ssu


If you have questions, please let us know. In case we do not hear from you, we will make a follow up after 3 workings days. Thank you.


 


Best regards,

Michael L.

Intel® Customer Support


0 Kudos
Mike_Intel
Moderator
2,343 Views

Hello DmytroBond,

 

I hope you're having a wonderful day. I am just sending a soft follow up on the information that we requested for us to further assist you. We will wait for your reply. 


If you have questions, please let us know. In case we do not hear from you, we will make a follow up after 3 workings days. Thank you.



Best regards,

Michael L.

Intel® Customer Support


0 Kudos
DmytroBond
Beginner
2,329 Views

Hi Michael,

 

Here is problem description.

 

VMWare recommends for ESXi 8.0 and XL710-QDA1 to use drivers from Intel version 2.4.2.0 and firmware 9.1

I installed this driver and upgraded NIC firmware. NIC PF driver was configured in SR-IOV mode with 8 VFs.

Virtual Machine running on this host is Ubuntu 22.10 with kernel 5.19.0-26-generic version and Intel iavf driver 4.7.0 version. 

 

This setup doesn't work.

VF driver do not start properly, no traffic.

 

VM kernel log attached.

Error begins at [ 16.492518] timestamp.

 

ESXi kernel log attached.

Error begins at 2022-12-22T21:35:06.561Z timestamp.

 

 

PS:  Hardware details:

NIC: XL710QDA1BLK, PCIe version

VID = 8086

DID = 1584

SVID = 8086

SDID = 0001

 

Motherboard: Supermicro X12SPA-TF + 

CPU: Intel Xeon Gold 6336Y

0 Kudos
Mike_Intel
Moderator
2,303 Views

Hello DmytroBond,

 

Thank you for the update. Can you also help generate the SSU logs for us to further investigate the issue. We also requested this in our previous post, however we are still waiting for it. Please download the utility here:


https://www.intel.com/content/www/us/en/download/18895/intel-system-support-utility-for-the-linux-operating-system.html?wapkw=ssu


If you have questions, please let us know. In case we do not hear from you, we will make a follow up after 3 workings days. Thank you.



Best regards,

Michael L.

Intel® Customer Support


0 Kudos
DmytroBond
Beginner
2,279 Views

Hi Michael,

 

Please see SSU report attached.

0 Kudos
Mike_Intel
Moderator
2,271 Views

Hello DmytroBond,

 

Thank you for the quick reply. I will have this check again this time regarding the issue that you encounter. Please give us 2 to 3 days to provide an update on this.


Thank you and stay safe.

 

Best regards,

Michael L.

Intel® Customer Support


0 Kudos
Mike_Intel
Moderator
2,232 Views

Hello DmytroBond,


Thank you so much for waiting for our update.


Upon checking, since you already tried the latest NVM 9.10 and 8.70 firmware with VMware provided 2.4.2.0 driversAt this point it is best contact the OS manufacturer VMware. VMware already have customized drivers which is tailored for your adapter. They are in best position where you can seek assistance so he does not lose features or customizations of the Ethernet controller.  

 

For more information. please see Intel® Ethernet Adapters Compatibility with VMware*

 

Where do I get technical support?

Technical support for VMware driver and operating system issues are provided by VMware Support or through the VMware Communities.


If you have questions, please let us know. In case we do not hear from you, we will make a follow up after 3 workings days. Thank you.



Best regards,

Michael L.

Intel® Customer Support


0 Kudos
Mike_Intel
Moderator
2,120 Views

Hello DmytroBond,

 

I hope you're having a wonderful day. I am just sending a soft follow up hoping that you already tried contacting VMware for further assistance.

 

If you have questions, please let us know. In case we do not hear from you, we will make a follow up after 3 workings days. Thank you.

 

 

Best regards,

Michael L.

Intel® Customer Support


0 Kudos
Mike_Intel
Moderator
2,089 Views

Hello DmytroBond,

 

I hope this message finds you well. I am just sending another follow up hoping that you are now talking with VMware for further assistance since we have verified that they are the best team who can assist you. Since we have not heard back from you, I need to close this inquiry. 


If you need any additional information, please submit a new question as this thread will no longer be monitored.


Thank you and stay safe.

 

 

Best regards,

Michael L.

Intel® Customer Support


0 Kudos
Reply