Intel X710 SFP+ Asymmetric Performance Issue: Upload/Download Inconsistency while SR-IOV Functions N

[cokes]

Content:
I'm experiencing an unusual performance issue with Intel X710 SFP+ NICs in a 10GbE setup. The problem shows a consistent pattern of unidirectional performance degradation, while SR-IOV operations remain fully functional.

Environment Setup:

• Windows 10 PC with Intel X710 SFP+ NIC
• Proxmox VE Server with Intel X710 SFP+ NIC
• Both using optical modules
• Direct connection through fiber optic cable

Observed Behavior:

1. On Windows 10 PC:

• Download from server: Stable 10GbE performance
• Upload to server: Unstable (50-90MB/s)
• iperf3 test shows ~9.4Gbps download but only ~800Mbps upload
• Similar asymmetric performance when communicating with 1GbE clients

1. On Proxmox VE Server:

• Upload: Stable 10GbE performance
• Download: Unstable performance similar to Windows upload
• VMs with SR-IOV: Stable 10GbE performance in both directions
• VMs with vmbr (bridge): Shows same asymmetric performance as host

1. 1GbE clients connecting to both systems show similar patterns:

• Stable 113MB/s when downloading
• Unstable 40-90MB/s when uploading to non-SR-IOV interfaces
• Stable 113MB/s in both directions with SR-IOV VFs

Troubleshooting Steps Attempted:

• Tested multiple firmware versions on both NICs
• Updated/tested different driver versions on Windows
• Compiled latest drivers on Proxmox
• Modified various NIC configurations
• Replaced cables
• None of these resolved the issue

Key Observations:

1. The problem is consistently directional on each system
2. SR-IOV virtual functions perform perfectly in both directions
3. The issue affects both 10GbE and 1GbE communications
4. The problem persists across different firmware and driver versions

Looking for insights into what might cause this asymmetric performance issue, particularly given that SR-IOV functions work perfectly.

[cokes]

I'm experiencing an unusual performance issue with Intel X710-DA2 (Retail) SFP+ NICs in a 10GbE setup. The problem shows a consistent pattern of unidirectional performance degradation, while SR-IOV operations remain fully functional.

Environment Setup:

• Windows 10 PC with Intel X710-DA2 SFP+ NIC (Retail version)
• Proxmox VE Server with Intel X710-DA2 SFP+ NIC (Retail version)
• 10GbE Switch in between
• Connection topology:
  • Windows PC: Using AQR113C optical-to-electrical module -> 10GbE Switch (with AQR113C module)
  • Proxmox Server: Direct SFP+ DAC cable -> 10GbE Switch

[Previous Observed Behavior section remains the same...]

[Previous Troubleshooting Steps section remains the same...]

Key Observations:

1. The problem is consistently directional on each system
2. SR-IOV virtual functions perform perfectly in both directions
3. The issue affects both 10GbE and 1GbE communications
4. The problem persists across different firmware and driver versions
5. The issue exists with both optical (AQR113C) and DAC cable connections

Looking for insights into what might cause this asymmetric performance issue, particularly given that SR-IOV functions work perfectly and the problem persists across different connection methods (optical modules and DAC).

[EvilAlchemist]

I just encountered a very similar issue today with one of our Dell servers. I put the server in performance mode meaning all C States are disabled and turbo is on.

Basically, the CPU was running at 0.80 GHZ to save power. Once I ramped it up to 3.00Ghz, 10GB each way, no issues.

Also, set send and receive buffers to 2048. (Some say 4096 but the Intel docs say that is too high, but feel free to try.

If for some reason you have a dual CPU system, make sure you set the Nic to use the closest CPU on the PCIE bus.

[cokes]

Thank you for your guidance. I have found a solution.
I am using a PVE system and experienced unstable download speeds. I only needed to execute a command to turn off hardware transmit checksum (no need to turn off rx), which allowed my PVE server's download speed to return to normal.
ethtool -K enp1s0f0np0 tx off

[Vik3]

Hello cokes,

Greetings from Intel!

Thank you for posting on Intel Community.

To assist you better, please provide the following details:

• Provide the complete system details.
• Please confirm if the NIC was purchased separately or pre-installed.
• Kindly provide us with the complete front and back pictures of the part with the label visible.
• Kindly share the current driver and firmware details

Best regards,  

Vikas 

Intel Customer Support Technician 

[Fikri_Intel · Accepted solution]

Hi cokes,

Thank you for your updates and we are glad that you have found the solution.

Kindly let us know if you have any further concerns or we can proceed to close this thread.

Looking forward to your response.

Regards,

Fikri O.

[cokes]

The thread can be closed now, thank you~

[Poojitha]

Hi cokes,

Greetings for the day!

Thank you for your confirmation. We will proceed with the case closure.

If you have any questions or concerns, please reach out to us, we are happy to assist you!

Best regards,

Poojitha N

Intel Customer Support Technician