E810 hyper-v with linux ubuntu as guest, not working SR-IOV after upgrade from windows 2019 to 2022

[dev246]

Hi.

I have several Dell servers with Intel E810-XXV-2 for OCP 2.0 and E810-C-Q2 network cards. I had Windows 2019 Datacenter installed on the servers, and several dozen virtual machines with Linux Ubuntu. Everything worked fine until I upgraded these servers to Windows 2022. After this upgrade, SR-IOV stopped working on Ubutnu guest machines. sr-iov works if the guest is windows.
This is not a Windows issue because I also have Qlogic QL41164 cards on which SRIOV on Ubuntu as a vm guest works without any problems. So it's more of an intell card problem.

Sr-Ivo itself turns on on Intel cards, but the card does not receive any IP from dhcp, after setting static addressing there is also no communication, the result of the lspci -v command:

5e98:00:02.0 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02)
        Subsystem: Intel Corporation Ethernet Adaptive Virtual Function
        Physical Slot: 1
        Flags: fast devsel, NUMA node 0
        Memory at fe0000000 (64-bit, prefetchable) [disabled] [size=128K]
        Memory at fe0020000 (64-bit, prefetchable) [disabled] [size=16K]
        Capabilities: [70] MSI-X: Enable- Count=5 Masked-
        Capabilities: [a0] Express Endpoint, MSI 00
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [148] Alternative Routing-ID Interpretation (ARI)
        Capabilities: [1a0] Transaction Processing Hints
        Capabilities: [1d0] Access Control Services

Of course, disabling sr-iov solves the problem, as does switching to a qlogic NIC with sr-iov enabled

Intel drivers and firmware from Release_28.2.1 from official intell site

[Fariz_Intel]

Hi dev246,

Thank you for posting on Intel Ethernet Communities.

Since it worked fine on Windows Server 2019 Datacenter until these servers were upgraded to Windows Server 2022, the issue might be related to the driver or firmware version.

To assist you further, we would need details about the driver or firmware version you installed. Alternatively, you can use Intel SSU to collect all the information about your system environment. You can refer to the link below for steps on installing and using the utility.

Intel System Support Utility for Windows: https://www.intel.com/content/www/us/en/download/18377/intel-system-support-utility-for-windows.html

Intel SSU scans for system and device information to assist with troubleshooting. The information can be viewed and saved to a file. See the release notes for installation instructions, supported hardware, what is new, bug fixes, and known issues.

Best regards,

Fariz_Intel

[dev246]

I attach SSU result

[dev246]

Sorry for the confusion, but sr-iov does not work on every guest OS. I was confused that after turning on sr-iov on VM with windows as guest, the hyper-v console showed the old IP address that the server had previously downloaded from DHCP, but there was no traffic anyway. The same with static addressing. Changing only the vSwitch and no other settings to the one from the Broadcom cards allows traffic immediately

[Fariz_Intel]

Hi dev246,

Thank you for the information provided.

Upon checking the SSU log, it looks like you are already using the latest driver. However, the NVM version is showing as 4.48. To ensure the accuracy of this information, we need your help to provide more information on the NVM version installed. For example, where did you obtain the NVM update file, or did you perform an NVM update recently? 

Driver:"icea.sys"

Driver Date:"06.28.2023 12:00 AM"

Driver Version:"1.13.242.0"

NVM Version:"4.48"

Best regards,

Fariz_Intel

[Fariz_Intel]

You can also refer to the Intel Ethernet Controller E810 Feature Support Matrix for more information on Hyper-V for the E810.

[dev246]

I always use Intel® Ethernet Adapter Complete Driver Pack  from https://www.intel.com/content/www/us/en/download/15084/intel-ethernet-adapter-complete-driver-pack.html .

Whenever I install drivers, I also run nvmupdae -a  from that Pack.
Recently with the release 28.2.1

I have 4 dell servers R750 and 3 dell servers with T640. All of them had Intel cards added. These were OEM cards, not branded dell-intell or other vendor-intel. I regularly update Intel cards from the link above on all servers, always the server and firmware (NVM). And I have this version of the driver and NVM on all servers

[Fariz_Intel]

Hi dev246,

I see, no worries, and yes, from the log, we can see that you are indeed using an Intel card. In that case, let us cross-check and share all the information with the engineering team. However, this might take some time for them to review.

Best regards,

Fariz_Intel

[dev246]

More than a month has passed, has anything been clarified with the engineers?

[dev246]

You noticed the NVM versions, If you give me a command on how to safely reinstall the firmware, I can try to do so

[dev246]

I forced the firmware update with the -f option, it worked without any problems. But the version is unchanged

01) Intel(R) Ethernet Network Adapter 4.48(4.30) 159B 00:094 Up to date
E810-XXV-2
02) Intel(R) Ethernet Network Adapter 4.48(4.30) 159B 00:217 Up to date
E810-XXV-2

[dev246]

Any updates ?