topic Re:Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU in Ethernet Products

Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

dg- — Wed, 30 Jul 2025 10:31:46 GMT

I am currently using an Intel E810 NIC as a PTP GM using the onboard GNSS module and also a CU/DU stack with direct connection to an RU. The PTP traffic is intended to reach the RU using the PF and the CU/DU stack is meant to run using the DPDK bound VF. However, I am not seeing any traffic from the VF reach the RU, and the RU arp tables only lists the PF mac address, not the VFs...

I am just wondering if there is anything specific to the E810 that I could have forgotten or anything preventing the CU/DU traffic from the VF reaching the RU? I am currently using the igb_uio driver to bind the VF to DPDK, previously, I was making use of vfio-pci but had the same (and then some) issues.

Re:Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

pujeeth — Wed, 30 Jul 2025 19:51:49 GMT

Hello dg-,

Greetings!!

Thank you for bring this issue to our attention,

We would request you to provide us the below information for further troubleshooting's.

1) Could you please provide the system/server model details where this Ethernet adapter is installed (model name)?

2) Is the adapter built-in, or was it added manually later?

3) Would you be able to share a screenshot of the error message you are encountering?

4) Kindly share the SSU (System Support Utility) logs as well.

Help Guide for the Intel® System Support Utility

https://www.intel.com/content/www/us/en/support/articles/000008563/ethernet-products.html

Regards,

Pujeeth

Intel Customer Support Technician

Re: Re:Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

dg- — Fri, 01 Aug 2025 09:52:39 GMT

Hi Pujeeth,

1) This is on a Dell PowerEdge XR11

2) Adapter was added manually later

3) I am seeing the following when I try to run dpdk-testpmd with vfio-pci, though, this wasn't an issue prior to a server reboot over a week ago. Since then, drivers have been reloaded/ reinstalled and it doesn't seem to be getting any better. dmesg | grep -e DMAR -e IOMMU, output looks good to me too.

below is the output when i try to use vfio-pci.

dpdk-testpmd output when VF bound to vfio-pci

Now to subvert this issue for the time being, I have made use of igb_uio for binding VF to DPDK, which does remove this specific issue. The issue right now is that no traffic from the VF is being sent to the RU, I should see OFH traffic but there are none, only PTP packets from the physical interface/PF, which isn't bound to DPDK... which I can see from packet captures. So to reiterate I have made a VF on the interface that is directly connected to the device using:

echo 1 > /sys/.../.../.../sriov_numfs

#which is then bound to dpdk using

dpdk-devbind.py -b igb_uio {interface id}

The PF is not bound to DPDK so that it can pass the PTP traffic to the RU for time sync and these can be seen reaching the RU. VF OFH-C/U packets are not reaching the RU or even the PF from this setup... I am a bit baffled.

4) I will get round to this later if that is ok!

Thanks

Re:Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

IntelSupport — Fri, 01 Aug 2025 10:40:33 GMT

Hello dg-,

Thank you for getting back to us.

Could you please confirm whether the Virtual Function (VF) has been configured with DPDK on your system? If not, we recommend following the steps outlined in the VF setup guide for DPDK.

You can find the detailed instructions at the following link:

https://edc.intel.com/content/www/us/en/design/products/ethernet/config-guide-e810-dpdk/virtual-function-vf-setup-with-dpdk/

Once you've completed the setup, please update us with the status so we can assist you further.

Best regards,

Shankith K P

Intel Customer Support Technician

Re: Re:Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

dg- — Fri, 01 Aug 2025 10:52:59 GMT

Hi Shankith,

Yes it has been configured with DPDK on my system. See below:

# dpdk-devbind.py -s

Network devices using DPDK-compatible driver
============================================
0000:8a:19.0 'Ethernet Adaptive Virtual Function 1889' numa_node=0 drv=igb_uio unused=iavf,vfio-pci

and here is the corresponding ip link show enp138s0f3 output (with mac addresses removed) :

17: enp138s0f3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc mq state UP mode DEFAULT group default qlen 1000
link/ether {mac}:1 brd ff:ff:ff:ff:ff:ff
vf 0 link/ether {mac}:2 brd ff:ff:ff:ff:ff:ff, spoof checking on, link-state auto, trust on

Re:Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

IntelSupport — Fri, 01 Aug 2025 12:01:27 GMT

Hello dg-,

To further check on the issue, Kindly share the SSU (System Support Utility) logs.

Help Guide for the Intel® System Support Utility

https://www.intel.com/content/www/us/en/support/articles/000008563/ethernet-products.html

Regards,

Shankith K P

Intel Customer Support Tech

Re: Re:Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

dg- — Fri, 01 Aug 2025 13:10:09 GMT

Hi, let me know if this is what you're looking for specifically.

Re:Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

IntelSupport — Fri, 01 Aug 2025 13:44:10 GMT

Hello dg-,

Thank you for sharing the logs with us.

Please allow us some time to review the information. We will get back to you with further updates as soon as possible.

Best regards,

Shankith K P

Intel Customer Support Technician

Re:Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

Sreelakshmi1 — Mon, 04 Aug 2025 06:32:26 GMT

Hi dg-,

Greetings!

Before we proceed with further troubleshooting, we suggest updating the driver using the link below to rule out any driver-related issues. Please let us know the status after the update.

https://www.intel.com/content/www/us/en/download/19630/intel-network-adapter-driver-for-e810-series-devices-under-linux.html

Best Regards,

Sreelakshmi

Intel Customer Support Technician

Re: Re:Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

dg- — Mon, 04 Aug 2025 09:14:53 GMT

Hi,

I am still seeing the same behaviour after updating from ice 2.2.8 to 2.2.9

Thanks

Re:Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

Sreelakshmi1 — Mon, 04 Aug 2025 10:52:12 GMT

Hi dg-,

Thank you for your response. Kindly allow us some time to further investigate the issue. We will keep you posted with any updates.

Best Regards,

Sreelakshmi

Intel Customer Support Technician

Re:Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

Akshaya1 — Wed, 06 Aug 2025 11:05:58 GMT

Hello dg-,

Could you please share the dmesg logs from the system?

Since you mentioned that when attempting to run dpdk-testpmd with vfio-pci, the issue appeared only after a server reboot. Could you please confirm if this means the entire configuration was working fine before the reboot, and there was VF traffic to the RU?

I look forward to your response.

Regards,

Akshaya

Intel Customer support Technician

Re: Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

dg- — Wed, 06 Aug 2025 11:11:41 GMT

Hi Akshaya,

The RU traffic issue was related to spoofchecking being enabled on the vf, I turned off spoofchecking and the traffic reached the RU.

I still have that issue with vfio-pci, so I have been using igb_uio instead. The no VF traffic to the RU issue was present prior to the reboot but the vfio-pci bus probe issue was not. Subsequent reboots and driver installations / module reloading hasn't helped either, only using igb_uio instead has worked.

Thanks,

dg-

Re:Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

Akshaya1 — Wed, 06 Aug 2025 11:17:51 GMT

Hi dg-,

Thank you for sharing the details.

To assist you further, Could you please share the dmesg logs from the system?

Regards,

Akshaya

Intel Customer support Technician

Re: Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

dg- — Wed, 06 Aug 2025 13:26:06 GMT

Hi, I removed the VF and created it again with

echo 1 > /sys/bus/pci/devices/interface_id/sriov_numfs

then bound to DPDK, set it as trusted, disabled spoofchk etc.

This is the output from dmesg:

[529172.547855] ice 0000:8a:00.3: Enabling 1 VFs
[529172.547868] ice 0000:8a:00.3: Enabling 1 VFs with 65 vectors and 16 queues per VF
[529172.653123] pci 0000:8a:19.0: [8086:1889] type 00 class 0x020000 PCIe Endpoint
[529172.653132] pci 0000:8a:19.0: enabling Extended Tags
[529172.653984] pci 0000:8a:19.0: Adding to iommu group 141
[529172.654053] iavf 0000:8a:19.0: enabling device (0000 -> 0002)
[529172.751101] iavf 0000:8a:19.0: Invalid MAC address 00:00:00:00:00:00, using random
[529172.751392] iavf 0000:8a:19.0: Multiqueue Enabled: Queue pair count = 16
[529172.751413] iavf 0000:8a:19.0: MAC address: ...
[529172.751415] iavf 0000:8a:19.0: GRO is enabled
[529172.763112] iavf 0000:8a:19.0 enp138s0f3v0: renamed from eth0
[529173.057126] iavf 0000:8a:19.0: Removing device
[529173.216569] ice 0000:8a:00.3: VF 0 is now trusted
[529173.217749] ice 0000:8a:00.3 enp138s0f3np3: Setting MAC xx:xx:xx:xx:xx:x2 on VF 0. VF driver will be reinitialized

and below is the output when I try to run a DPDK application using that VF:

EAL: Detected CPU lcores: 72
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: VFIO support initialized
EAL: Using IOMMU type 1 (Type 1)
EAL: Getting a vfio_dev_fd for 0000:8a:19.0 failed
PCI_BUS: Requested device 0000:8a:19.0 cannot be used
EAL: Cannot set up DMA remapping, error 22 (Invalid argument)
EAL: Cannot set up DMA remapping, error 22 (Invalid argument)
EAL: Cannot set up DMA remapping, error 22 (Invalid argument)

Re: Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

dg- — Wed, 06 Aug 2025 13:47:07 GMT

Hi Akshaya,

I removed VF 0, used rmmod to unload igb_uio & vfio-pci and then reloaded vfio-pci and recreated the VF and bound it to DPDK using vfio-pci...

The following output is the relevant part of dmesg, following this:

[529172.547855] ice 0000:8a:00.3: Enabling 1 VFs
[529172.547868] ice 0000:8a:00.3: Enabling 1 VFs with 65 vectors and 16 queues per VF
[529172.653123] pci 0000:8a:19.0: [8086:1889] type 00 class 0x020000 PCIe Endpoint
[529172.653132] pci 0000:8a:19.0: enabling Extended Tags
[529172.653984] pci 0000:8a:19.0: Adding to iommu group 141
[529172.654053] iavf 0000:8a:19.0: enabling device (0000 -> 0002)
[529172.751101] iavf 0000:8a:19.0: Invalid MAC address 00:00:00:00:00:00, using random
[529172.751392] iavf 0000:8a:19.0: Multiqueue Enabled: Queue pair count = 16
[529172.751413] iavf 0000:8a:19.0: MAC address: xx:xx:xx:xx:xx:xx
[529172.751415] iavf 0000:8a:19.0: GRO is enabled
[529172.763112] iavf 0000:8a:19.0 enp138s0f3v0: renamed from eth0
[529173.057126] iavf 0000:8a:19.0: Removing device
[529173.216569] ice 0000:8a:00.3: VF 0 is now trusted
[529173.217749] ice 0000:8a:00.3 enp138s0f3np3: Setting MAC xx:xx:xx:xx:xx:x2 on VF 0. VF driver will be reinitialized

Below is the output of the DPDK application so you can see the error

# gnb -c 33_aptsrsran_100MHz_550.yml

--== srsRAN gNB (commit d8bfdc9d9c) ==--

Re: Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

dg- — Wed, 06 Aug 2025 13:48:50 GMT

Hi Akshaya,

I removed VF 0, used rmmod to unload igb_uio & vfio-pci and then reloaded vfio-pci and recreated the VF and bound it to DPDK using vfio-pci...

The following output is the relevant part of dmesg, following this:

[529172.547855] ice 0000:8a:00.3: Enabling 1 VFs
[529172.547868] ice 0000:8a:00.3: Enabling 1 VFs with 65 vectors and 16 queues per VF
[529172.653123] pci 0000:8a:19.0: [8086:1889] type 00 class 0x020000 PCIe Endpoint
[529172.653132] pci 0000:8a:19.0: enabling Extended Tags
[529172.653984] pci 0000:8a:19.0: Adding to iommu group 141
[529172.654053] iavf 0000:8a:19.0: enabling device (0000 -> 0002)
[529172.751101] iavf 0000:8a:19.0: Invalid MAC address 00:00:00:00:00:00, using random
[529172.751392] iavf 0000:8a:19.0: Multiqueue Enabled: Queue pair count = 16
[529172.751413] iavf 0000:8a:19.0: MAC address: xx:xx:xx:xx:xx:xx
[529172.751415] iavf 0000:8a:19.0: GRO is enabled
[529172.763112] iavf 0000:8a:19.0 enp138s0f3v0: renamed from eth0
[529173.057126] iavf 0000:8a:19.0: Removing device
[529173.216569] ice 0000:8a:00.3: VF 0 is now trusted
[529173.217749] ice 0000:8a:00.3 enp138s0f3np3: Setting MAC xx:xx:xx:xx:xx:x2 on VF 0. VF driver will be reinitialized

Re:Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

Simon-Intel — Wed, 06 Aug 2025 14:06:39 GMT

Hi dg-,

Thank you for your response.

Please allow me some time to review this internally. We will get back to you with an update as soon as possible.

Thank you for your patience.

Best regards,

Simon

Intel Customer Support Technician

Re:Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

Akshaya1 — Mon, 11 Aug 2025 11:44:17 GMT

Hi dg-,

Thank you for your patience.

This seems to be a configuration issue since Before-reboot: System had proper IOMMU configuration → vfio-pci worked. After-reboot: IOMMU configuration lost → vfio-pci fails, igb_uio works after disabling spoof check

Please check the files and permissions after running the below command and let us know the update.

$ ls -l /dev/vfio

Regards,

Akshaya

Intel Customer support Technician

Re: Intel E810XXVDA4T SRIOV VF traffic doesn't reach RU

dg- — Tue, 12 Aug 2025 08:26:34 GMT

Hi,

This is the output

# ls -l /dev/vfio
total 0
crw-rw-rw- 1 root root 10, 196 Aug 11 15:36 vfio

# ls -l /dev/vfio/*
crw-rw-rw- 1 root root 10, 196 Aug 11 15:36 /dev/vfio/vfio

Thanks,

David