Flow director configuration not working. (Need help in identifying the issue)

[PFern14]

Hi,

We are trying to use flow-director to steer a flow to a VF in X710 NIC and we are facing issues with it, the packets are not redirected to the VF instead it is directed to the PF.

Have listed down the steps followed, can your NIC driver development team please let us know on what configuration step we might be missing ?

• Create VFs

#echo 2 > /sys/class/net/p3p4/device/sriov_numvfs

• Disable rx-hash

#ethtool -K p3p4 rxhash off

• Check if packets are rcvd in rx-0

# ethtool -S p3p4 | grep rx-0

     rx-0.packets: 108

     rx-0.bytes: 13636

• I tried the following rule to direct flow to a particular queue in a PF port, it was working.

# ethtool -N p3p4 flow-type udp4 src-ip 66.110.22.99 dst-ip 192.168.50.108 action 20 loc 1

# ethtool -n p3p4

64 RX rings available

Total 1 rules

Filter: 1

       Rule Type: UDP over IPv4

       Src IP addr: 66.110.22.99 mask: 0.0.0.0

       Dest IP addr: 192.168.50.108 mask: 0.0.0.0

       TOS: 0x0 mask: 0xff

       Src port: 0 mask: 0xffff

       Dest port: 0 mask: 0xffff

       Action: Direct to queue 20

• Send Traffic and check status, flow director seems to work fine if packets are directed to a queue within a PF.

#ethtool -S p3p4 | grep rx-0

    rx-0.packets: 128

    rx-0.bytes: 20476

# ethtool -S p3p4 | grep rx-20

    rx-20.packets: 100

    rx-20.bytes: 10900

• Delete the rule and add a new rule to direct the packet to a VF. (have calculated the queue index using the logic ($queue_index_in_VF0 = (0x1 && 0xFF) << 32 + [queue_index])

#ethtool -N p3p4 flow-type udp4 src-ip 66.110.22.99 dst-ip 192.168.50.108 action 4294967296 loc 1

And tried this rule also

ethtool -N p3p4 flow-type udp4 src-ip 66.110.22.99 dst-ip 192.168.50.108 user-def 0xffffffff00000000 action 1 loc 8

• Send traffic and check of packets are directed to VF-0, packets still go to q0 of VF.

# ethtool -S p3p4 | grep rx-0

     rx-0.packets: 607

     rx-0.bytes: 89966

Firmware Details:

ethtool -i p3p4

driver: i40e

version: 2.8.10-k

firmware-version: 7.10 0x800051a6 19.0.12

expansion-rom-version:

bus-info: 0000:5e:00.3

supports-statistics: yes

supports-test: yes

supports-eeprom-access: yes

supports-register-dump: yes

supports-priv-flags: yes

# ethtool -i p3p4_0

driver: iavf

version: 3.2.3-k

firmware-version: N/A

expansion-rom-version:

bus-info: 0000:5e:0e.0

supports-statistics: yes

supports-test: no

supports-eeprom-access: no

supports-register-dump: no

supports-priv-flags: yes

OS: CentOS 7

uname -r

3.10.0-1062.4.3.el7.x86_64

Tks,

Prashanth

[Caguicla_Intel]

Hello PFern14,

Thank you for posting in Intel Ethernet Communities. Please provide the following information for us to check on your query.

1.) Have you tried using the latest PF and VF driver available in the Intel download center?

https://downloadcenter.intel.com/

2.) Please share the exact model of the Ethernet card. You may provide the PBA markings of the card for us to double check on it. Please refer to the link below on where to find the markings.

Product Label Description for Intel® Ethernet Adapters

https://www.intel.com/content/www/us/en/support/articles/000007060/network-and-i-o/ethernet-products.html

We look forward to your response.

Best regards,

Crisselle C

Intel® Customer Support

A Contingent Worker at Intel

[PFern14]

Hi Crisselle,

We did upgrade to latest drivers

# ethtool -i p3p4

driver: i40e

version: 2.10.19.30

firmware-version: 7.10 0x800051a6 19.0.12

#ethtool -i p3p4_0

driver: iavf

version: 3.7.61.20

firmware-version: N/A

After the driver software upgrade both the commands returns an error.

#ethtool -N p3p4 flow-type udp4 src-ip 66.110.22.99 dst-ip 192.168.50.108 action 4294967296 loc 1

#ethtool -N p3p4 flow-type udp4 src-ip 66.110.22.99 dst-ip 192.168.50.108 user-def 0xffffffff00000000 action 1 loc 8

We use X710-TM4 NIC.

Thanks,

Prashanth

[Caguicla_Intel]

Hello PFern14,

Thank you for the reply.

While we are checking on this, please provide the brand and model of the motherboard where the X710-TM4 was integrated to. Please also share the PF and VF version used prior to the update.

Hoping to hear from you soon.

Best regards,

Crisselle C

Intel® Customer Support

A Contingent Worker at Intel

[PFern14]

Hi Crisselle,

The baseboard information

Base Board Information

    Manufacturer: Dell Inc.

    Product Name: 01YM03

    Version: A02

The driver version I used earlier is

# ethtool -i p3p4_0

driver: iavf

version: 3.2.3-k

ethtool -i p3p4

driver: i40e

version: 2.8.10-k

firmware-version: 7.10 0x800051a6 19.0.12

Tks,

Prashanth

[Caguicla_Intel]

Hello Prashanth,

Appreciate your swift response.

Please allow us to check on this request. Rest assured that we will get back to you within 1-3 business days.

Hoping for your patience.

Best regards,

Crisselle C

Intel® Customer Support

A Contingent Worker at Intel

[Caguicla_Intel]

Hello Prashanth,

Good day!

Please be informed that we are still checking this request. We will get back to you to provide an update as soon as possible but no later than 3 business days.

Best regards,

Crisselle Franz

Intel® Customer Support Technician

A Contingent Worker at Intel

[Caguicla_Intel]

Hello Prashanth,

We appreciate your patience on this matter.

If you are using ethtool version 4.11 and later, we would suggest to use "vf" and "queue" parameters instead of the "action' parameter stated in the readme file of the driver.

Sharing this link with you for the read me file of i40e Linux* Base Driver for the Intel(R) Ethernet Controller 700 Series

https://downloadmirror.intel.com/24411/eng/readme.txt

Looking forward to your response.

In case we don't hear from you, we'll reach out after 3 business days.

Best regards,

Crisselle Franz

Intel® Customer Support Technician

A Contingent Worker at Intel

[Caguicla_Intel]

Hello Prashanth,

Good day!

We'd like to check if you were able to try out the recommended action above. We would highly appreciate if you can share an update with us.

Hoping to hear from you.

We'll follow up after 3 business days in case we don't receive a reply from you.

Best regards,

Crisselle Franz

Intel® Customer Support Technician

A Contingent Worker at Intel

[Caguicla_Intel]

Hello Prashanth,

How are you today?

Please be informed that we will now close this request since we haven't received any response from our previous follow ups. Should you have any other concerns or assistance needed in the future, feel free to post a new question.

Have a lovely day!

Best regards,

Crisselle Franz

Intel® Customer Support