iavf_execute_cmd(): No response for cmd 15

[yohannmartineau]

Hello,

I have a load balancer application relying on DPDK 21.11 and I'm using Intel XXV710 boards. This is an application running in a container in a POD in k8s. The k8s worker node node hosting this POD is a VM. The access to the ports from the application is done through SR-IOV Virtual Functions.

After some days (sporadic issue) I have the following error message:

Failed to get Ethernet device stats for port ID 2 : RTE returned code -5
iavf_execute_cmd(): No response for cmd 15
iavf_query_stats(): fail to execute command OP_GET_STATS
iavf_dev_stats_get(): Get statistics failed

This application relies on DPDK pipeline model, so I have cores dedicated to Rx, other for "workers" and other for Tx.

The application is reading packets from the network using two ports (VF), one Rx core is reading from one Rx VF and another Rx core is reading from the second Rx VF, then I have a Tx core writing packets to two Tx ports (VFs).

This error message is only visible for Tx port, and packets can still be received but not sent.

Here is the firmware version used on the hypervisor hosting the VM:

driver: i40e
version: 2.12.6.5
firmware-version: 7.10 0x800075e6 19.5.12
expansion-rom-version:
bus-info: 0000:87:00.1
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes

From the intel i40e DPDK documentation, I can see that the recommended minimum version for DPDK21.11 is 8.30 and the customer is using 7.10.

DPDK version Kernel driver version Firmware version

24.03	2.24.6	9.40
23.11	2.23.17	9.30
23.07	2.22.20	9.20
23.03	2.22.18	9.20
22.11	2.20.12	9.01
22.07	2.19.3	8.70
22.03	2.17.15	8.30
21.11	2.17.4	8.30
21.08	2.15.9	8.30
21.05	2.15.9	8.30
21.02	2.14.13	8.00
20.11	2.14.13	8.00
20.08	2.12.6	7.30
20.05	2.11.27	7.30
20.02	2.10.19	7.20
19.11	2.9.21	7.00
19.08	2.8.43	7.00

So I suspect there may be a compatibility issue between the 7.10 firmware used at customer premises and my DPDK21.11 application, but I'm not sure.

What could possibly be wrong?

I'm trying to find the kernel version which is used from the i40e driver version, but when I run modinfo i40e, I have an srcversion but not a  x.y.z version. How could I find the mapping?

Thank  you

[Sachinks]

Hello yohannmartineau,

Thank you for posting in Intel community Forum.

Base on your inquiry, we see that you are receiving an error on Tx ports while using an application relying on DPDK 21.11 and Intel XXV710 boards.

Kindly provide us the below details so that we can check this for you.

1) The system model details ( motherboard)

2) Kindly let us know the application you are using. Is it a custom application?

3) Is the ethernet adapter built in with the motherboard or was it manually added?

Regards,

Sachin KS

[Sachinks]

Hello yohannmartineau,

Greetings!

This is a follow up. Kindly provide the details requested so that we can check this for you.

Regards,

Sachin KS

[Sachinks]

Hello yohannmartineau,

Greetings for the day!

We would like to inform you that we are closing this request as no response has been received from our previous follow-ups. 

Please don't hesitate to ask any further questions in the future. Feel free to start a new conversation, as this thread will no longer be monitored.

Regards,

Sachin KS 

[yohannmartineau]

hello,

sorry for the delay;

1) The system model details ( motherboard)

which detail are you looking for? mother board product number? output of lshw? dmidecode? other details? The issue is happening at customer premises, so I prefer to ask customer the right details first and all at once.

2) Kindly let us know the application you are using. Is it a custom application?

This is a custom application developed by my company

3) Is the ethernet adapter built in with the motherboard or was it manually added?

I think it is manually added.

Thank you