Firmware upgrade problem for E810-C-Q2: Rollback Blocked

Marco_Canini · ‎12-13-2022

Hello.

I have an Intel E810-C-Q2 Dual-Port 100GbE. We received it as part of a donation to the university by Intel

I would like to upgrade its firmware.

But when I tun the nvmupdate64e tool, it reports that the status is Rollback Blocked.

I cannot actually proceed with the firmware upgrade.

Is it possible to do something about this?

Thank you.

ethtool -i enp1s0f0
driver: ice
version: 1.9.11
firmware-version: 0.70 0x80002e75 1.2598.0
expansion-rom-version:
bus-info: 0000:01:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes

nvmupdate64e

Intel(R) Ethernet NVM Update Tool
NVMUpdate version 1.39.5.5
Copyright(C) 2013 - 2022 Intel Corporation.

Num Description Ver.(hex) DevId S:B Status
=== ================================== ============ ===== ====== ==============
01) Intel(R) Ethernet Network Adapter 0.112(0.70) 1592 00:001 Rollback
E810-C-Q2 Blocked

Caguicla_Intel · ‎12-13-2022

Hello Marco_Canini,

Thank you for posting in Intel Ethernet Communities.

Please share the following information that would help in checking your query.

1. Do you encounter any issue with the adapter aside from issue on updating the firmware?

2. Please share the PBA of the adapter. You may refer to the link below on where to find the PBA number. Providing photos of the adapter focusing on the markings (white sticker) found on the physical card will be highly appreciated for us to double check on it. The PBA consists 6-3 digit number located at the last part of the serial number. This would help us identify if you are using an Original Equipment Manufacturer(OEM) or retail version of Intel Ethernet Adapter.

Identify Your Intel® Network Adapter Model Using PBA Number
https://www.intel.com/content/www/us/en/support/articles/000007022/network-and-i-o/ethernet-products.html

3. Exact Operating System used

4. Where was the NVM update package downloaded? Please share the link with us.

5. How many units were affected by the issue.

Awaiting to your reply.

We will follow up after 3 business days in case we don't hear from you.

Best regards,

Crisselle C.

Intel® Customer Support

Caguicla_Intel · ‎12-18-2022

Hello Marco_Canini,

Good day!

This is just a follow up regarding the information we request for us to proceed checking your query. If you have questions or clarifications, feel free to let us know.

Awaiting to your reply.

We will follow up after 3 business days in case we don't hear from you.

Best regards,

Crisselle C.

Intel® Customer Support

Marco_Canini · ‎12-19-2022

Hello Criselle,

Took a while to get photos of the adapter. I'm attaching here.

1. No issue other than firmware upgrade

2. Please check the photo

3. Ubuntu 18.04

4. E810_NVMUpdatePackage_v4_01_Linux.tar.gz obtained from https://downloadmirror.intel.com/742508/Release_27.6.1.zip

5. We own 4 NICs as part of this donation. I would like to upgrade one at first.

Caguicla_Intel · ‎12-19-2022

Hello Marco_Canini,

No problem at all. Appreciate your effort in providing the photo of the adapter.

Please allow us to further check on this internally. We will give you an update as soon as possible but no later than 3 business days.

Hoping for your kind patience.

Best regards,

Crisselle C.

Intel® Customer Support

Caguicla_Intel · ‎12-20-2022

Hello Marco_Canini,

Apologies for the confusion.

A new version (1.10.1.2.2 ) of ice driver has been released. Can you try this first then perform Firmware update again before we escalate the request to our engineers?

Intel® Network Adapter Driver for E810 Series Devices under Linux*

https://www.intel.com/content/www/us/en/download/19630/intel-network-adapter-driver-for-e810-series-devices-under-linux.html

Looking forward to your reply.

In case we don't hear from you, we will follow up after 3 business days.

Best regards,

Crisselle C.

Intel® Customer Support

Marco_Canini · ‎12-20-2022

Hi Criselle,

I'm now running the latest Ubuntu (22.04) with Linux kernel 5.15.0-56-generic and I've upgraded the ice driver to the latest version.

ethtool -i enp1s0f0
driver: ice
version: 1.10.1.2.2
firmware-version: 0.70 0x80002e75 1.2598.0
expansion-rom-version:
bus-info: 0000:01:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes

I've also downloaded the latest NVM Update Tool (v 4.10)

E810_NVMUpdatePackage_v4_10_Linux.tar.gz from here.

The NVM update tool now reports that an update is available (previously it said Rollback Blocked).

./nvmupdate64e

Intel(R) Ethernet NVM Update Tool
NVMUpdate version 1.39.20.2
Copyright(C) 2013 - 2022 Intel Corporation.

WARNING: To avoid damage to your device, do not stop the update or reboot or power off the system during this update.
Inventory in progress. Please wait [***.......]

Num Description Ver.(hex) DevId S:B Status
=== ================================== ============ ===== ====== ==============
01) Intel(R) Ethernet Network Adapter 0.112(0.70) 1592 00:001 Update
E810-C-Q2 available

However, when I try to perform the firmware update I receive this error message without further details.

An error occurred when updating a firmware module.

Please let me know how to proceed.

Caguicla_Intel · ‎12-21-2022

Hello Marco_Canini,

Thank you for trying out the latest ice driver.

Can you share the screenshot of the issue as we will be escalating this request to our engineers?

Awaiting to hear from you soon.

Should there be no response from you, I’ll make sure to reach out after 3 business days.

Best regards,

Crisselle C.

Intel® Customer Support

Marco_Canini · ‎12-21-2022

Hello Criselle,

Thanks for escalating this.

I executed the tool as ./nvmupdate64e -o /tmp/nvm.log

Here is a screenshot:

Here is the log file:

<?xml version="1.0" encoding="UTF-8"?>
<DeviceUpdate lang="en">
<Instance vendor="8086" device="1592" subdevice="0002" subvendor="8086" bus="1" dev="0" func="0" PBA="K65390-005" port_id="Port 1 of 2" display="Intel(R) Ethernet
Network Adapter E810-C-Q2">
<Module type="PXE" version="1.0.2" previous_version="1.0.2">
<Status result="Fail" id="6">An error occurred when updating a firmware module.</Status>
</Module>
<Module type="EFI" version="1.1.6" previous_version="1.1.6">
<Status result="Fail" id="6">An error occurred when updating a firmware module.</Status>
</Module>
<Module type="Netlist" version="1.0.14.0" previous_version="1.0.14.0">
<Status result="Fail" id="6">An error occurred when updating a firmware module.</Status>
</Module>
<Module type="NVM" version="80002E75" previous_version="80002E75">
<Status result="Fail" id="6">An error occurred when updating a firmware module.</Status>
</Module>
<VPD>
<VPDField type="String">Intel(r) Ethernet Network Adapter E810-CQDA2</VPDField>
<VPDField type="Readable" key="V1">Intel(r) Ethernet Network Adapter E810-CQDA2</VPDField>
<VPDField type="Readable" key="PN">K65390-005</VPDField>
<VPDField type="Readable" key="SN">40A6B7075D70</VPDField>
<VPDField type="Readable" key="V2">0420</VPDField>
<VPDField type="Checksum" key="RV">B9</VPDField>
</VPD>
<MACAddresses>
<MAC address="40A6B7075D70">
</MAC>
</MACAddresses>
</Instance>
<Instance vendor="8086" device="1592" subdevice="0002" subvendor="8086" bus="1" dev="0" func="1" PBA="K65390-005" port_id="Port 2 of 2" display="Intel(R) Ethernet Network Adapter E810-C-Q2">
<Module type="PXE" version="1.0.2" previous_version="1.0.2">
<Status result="Fail" id="6">An error occurred when updating a firmware module.</Status>
</Module>
<Module type="EFI" version="1.1.6" previous_version="1.1.6">
<Status result="Fail" id="6">An error occurred when updating a firmware module.</Status>
</Module>
<Module type="Netlist" version="1.0.14.0" previous_version="1.0.14.0">
<Status result="Fail" id="6">An error occurred when updating a firmware module.</Status>
</Module>
<Module type="NVM" version="80002E75" previous_version="80002E75">
<Status result="Fail" id="6">An error occurred when updating a firmware module.</Status>
</Module>
<VPD>
<VPDField type="String">Intel(r) Ethernet Network Adapter E810-CQDA2</VPDField>
<VPDField type="Readable" key="V1">Intel(r) Ethernet Network Adapter E810-CQDA2</VPDField>
<VPDField type="Readable" key="PN">K65390-005</VPDField>
<VPDField type="Readable" key="SN">40A6B7075D70</VPDField>
<VPDField type="Readable" key="V2">0420</VPDField>
<VPDField type="Checksum" key="RV">B9</VPDField>
</VPD>
<MACAddresses>
<MAC address="40A6B7075D71">
</MAC>
</MACAddresses>
</Instance>
<NextUpdateAvailable> 0 </NextUpdateAvailable>
<RebootRequired> 0 </RebootRequired>
<PowerCycleRequired> 0 </PowerCycleRequired>
</DeviceUpdate>

Caguicla_Intel · ‎12-21-2022

Hello Marco_Canini,

Thank you for providing the requested information.

Please allow us to further check this with our engineers. Rest assured that we will give you an update as soon as possible but no later than 3 business days.

Hoping for your kind patience.

Best regards,

Crisselle C.

Intel Customer Support

Mike_Intel · ‎12-22-2022

Hello Marco_Canini,

I hope you are having a good day.

We are now in the process of checking this issue, we would like to clarify the following details.

What is the status of the adapter after the NVM update failure?
Is it still working properly?
May we also know the current NVM of the two remaining adapters?
Are they also both 0.70?

Awaiting to hear from you soon.

Should there be no response from you, I’ll make sure to reach out after 3 business days.

Best regards,

Michael L.

Intel® Customer Support

Mike_Intel · ‎12-27-2022

Hello Marco_Canini,

I hope you're having a wonderful day. I am just sending a soft follow up on the information that we requested for us to further assist you. We will wait for your reply.

Awaiting to hear from you soon.

Should there be no response from you, I’ll make sure to reach out after 3 business days.

Best regards,

Michael L.

Intel® Customer Support

Marco_Canini · ‎12-27-2022

Hello.

What is the status of the adapter after the NVM update failure?

Is it still working properly?

Yes. It is still working correctly.

May we also know the current NVM of the two remaining adapters?
Are they also both 0.70?

Yes, they are all the same configuration.

Mike_Intel · ‎12-28-2022

Hello Marco_Canini,

Thank you for the quick response.

I will forward this to our Engineers. Please give us 2 to 3 working days to provide an update.

Hoping for your kind patience.

Best regards,

Michael L.

Intel Customer Support

Mike_Intel · ‎01-02-2023

Hello Marco_Canini,

I hope you are having a good day.

We just want to update you that we are still checking this issue. Please give us another 2 to 3 working days to provide an update.

Hoping for your kind patience.

Best regards,

Michael L.

Intel Customer Support

Caguicla_Intel · ‎01-05-2023

Hello Marco_Canini,

Good day!

Please see below update from our engineers and ensure that the driver and Firmware combinations are correct and done in proper order. Driver update first followed by Firmware/NVM update

1) Please download and install driver: 1.10.1.2.2 from link below (Latest from Sourceforge and Download Center)

https://sourceforge.net/projects/e1000/files/ice%20stable/1.10.1.2.2/

2) Download and install latest Firmware package for Linux

https://www.intel.com/content/www/us/en/download/19626/non-volatile-memory-nvm-update-utility-for-intel-ethernet-network-adapters-e810-series-linux.html

Looking forward to your reply.

We will follow up after 3 business days in case we don't hear from you.

Best regards,

Crisselle C.

Intel® Customer Support

Marco_Canini · ‎01-07-2023

Hi Criselle.

Please note that I was already using the driver version 1.10.1.2.2 and NVM package version 4.10 (which I believe is the latest version).

The result with the update tool remains the same as I reported. This is again the output:

Tool execution completed with the following status: An error occurred when updating a firmware module.

How do you suggest to proceed?

Caguicla_Intel · ‎01-08-2023

Hello Marco_Canini,

Thank you for the swift response and we sincerely apologize if you still encounter the issue.

Just to confirm, do you have the same error as 'Update Failed' based on the screenshot your previously shared? If no, please share the screenshot of the exact issue encountered.

Hoping to hear from you soon.

We will follow up after 3 business days in case we don't hear a reply.

Best regards,

Crisselle C.

Intel Customer Support

Marco_Canini · ‎01-09-2023

Yes, it's the same error message as before.

Caguicla_Intel · ‎01-09-2023

Hello Marco_Canini,

Thank you for the swift response.

Please allow us to re-escalate the request to our engineers. We will give you an update as soon as possible but no later than 3 business days.

Hoping for your kind patience.

Best regards,

Crisselle C.

Intel Customer Support

Caguicla_Intel · ‎01-11-2023

Hello Marco_Canini,

Good day and I hope this message finds you well!

You mentioned that you only tried one of the adapters. With this, can you try another adapter to make sure it is not just the single adapter having the update issue.

Additionally, Intel NVM releases include a Minimum Security Revision (MinSRev) enforcement feature. The device might have encountered a Minimum Security Revision Control issue, Please see the following guide to update the MinSRev. https://cdrdv2.intel.com/v1/dl/getContent/635205?explicitVersion=true

This is the command that performs the MinSRev udpate: nvmupdate64e -u -optinminsrev -l update.log -o update.xml -c nvmupdate.cfg

Please try to upgrade the MinSRev and and check if you still have issue.

Awaiting to your reply.

Should there be no reply, we will follow up after 3 business days.

Best regards,

Crisselle C.

Intel Customer Support