iavf_execute_cmd(): No response for cmd 15 (follow-up)

[yohannmartineau]

hello,

sorry for the new thread, I was not sure previous ticket was closed or not, so I post a new ticket:

https://community.intel.com/t5/Ethernet-Products/iavf-execute-cmd-No-response-for-cmd-15/m-p/1622853

Hello,

I have a load balancer application relying on DPDK 21.11 and I'm using Intel XXV710 boards. This is an application running in a container in a POD in k8s. The k8s worker node node hosting this POD is a VM. The access to the ports from the application is done through SR-IOV Virtual Functions.

After some days (sporadic issue) I have the following error message:

Failed to get Ethernet device stats for port ID 2 : RTE returned code -5
iavf_execute_cmd(): No response for cmd 15
iavf_query_stats(): fail to execute command OP_GET_STATS
iavf_dev_stats_get(): Get statistics failed

This application relies on DPDK pipeline model, so I have cores dedicated to Rx, other for "workers" and other for Tx.

The application is reading packets from the network using two ports (VF), one Rx core is reading from one Rx VF and another Rx core is reading from the second Rx VF, then I have a Tx core writing packets to two Tx ports (VFs).

This error message is only visible for Tx port, and packets can still be received but not sent.

Here is the firmware version used on the hypervisor hosting the VM:

driver: i40e
version: 2.12.6.5
firmware-version: 7.10 0x800075e6 19.5.12
expansion-rom-version:
bus-info: 0000:87:00.1
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes

From the intel i40e DPDK documentation, I can see that the recommended minimum version for DPDK21.11 is 8.30 and the customer is using 7.10.

DPDK version Kernel driver version Firmware version

24.03	2.24.6	9.40
23.11	2.23.17	9.30
23.07	2.22.20	9.20
23.03	2.22.18	9.20
22.11	2.20.12	9.01
22.07	2.19.3	8.70
22.03	2.17.15	8.30
21.11	2.17.4	8.30
21.08	2.15.9	8.30
21.05	2.15.9	8.30
21.02	2.14.13	8.00
20.11	2.14.13	8.00
20.08	2.12.6	7.30
20.05	2.11.27	7.30
20.02	2.10.19	7.20
19.11	2.9.21	7.00
19.08	2.8.43	7.00

So I suspect there may be a compatibility issue between the 7.10 firmware used at customer premises and my DPDK21.11 application, but I'm not sure.

What could possibly be wrong?

I'm trying to find the kernel version which is used from the i40e driver version, but when I run modinfo i40e, I have an srcversion but not a  x.y.z version. How could I find the mapping?

1) The system model details ( motherboard)

which detail are you looking for? mother board product number? output of lshw? dmidecode? other details? The issue is happening at customer premises, so I prefer to ask customer the right details first and all at once.

2) Kindly let us know the application you are using. Is it a custom application?

This is a custom application developed by my company

3) Is the ethernet adapter built in with the motherboard or was it manually added?

It is manually added.

Thank  you

[yohannmartineau]

for your information the model name is Dell R740xd