X710-DA2 no link with SFP+, works with SFP

[EMIGUS]

Hello,


I've recently bought multiple X710-DA2 network adapters.

The adapters work with 1 gbps SFP-modules, but with 10 gbps SFP+ LR adapters I do not get a link connected to a 10 gbps switch.


I've tested both multimode and single mode SFP+ modules that are known-good as they work in other network cards just fine.

I am using these for example: https://portal.prooptix.se/en/fiber-optical-transceivers/146-sfp-10g-lr-o-cisco-sfp

I've tried updating the latest firmware using this:
https://www.intel.com/content/www/us/en/download/18190/24769/non-volatile-memory-nvm-update-utility-for-intel-ethernet-network-adapter-700-series.html


I've tried both Debian Linux 12.4 and Windows Server 2022 (Fully updated of course).

The network cards show up in both operating systems just fine, but they refuse to establish a link between the systems.

I've also tried installing the latest drivers on Windows from here: https://www.intel.com/content/www/us/en/download/706171/intel-network-adapter-driver-for-windows-server-2022.html

The Network Adapters Serial Number is:40A6B7C3DAA00043023ADJ11367005 from batch MYAD37QEJ


Please advice on what I am doing wrong

[IntelSupport]

Hi Emigus,

Hope you are doing well!

Thank you for posting on Intel Community.

Could you please help me with the below details to proceed further.

1.which server board you are using to establish the connectivity.

2.Switch details.

3.Latest Firmware versions installed.

Thanks,

Poojitha

[EMIGUS]

Hi!

Thanks for the quick response, first let me give you some more troubleshooting I did last night.

I was able to establish connectivity with a DAC cable of type : https://portal.prooptix.se/sv/dac-aoc-kablar/1949-hw-sfp-pc2-p

HOWEVER.

I have 2 of these cables.

One of them works perfectly fine in _ONE PORT_ of the network cards. This can be reproduced across multiple cards.

The other cable works perfectly fine in BOTH ports of the network cards. Also reproduced across multiple cards.

In both cases I've tried putting it in into differnet switch ports and different switches.

The switches I've tried are Zyxel XS1930-12F and XS1930-10 10 gbps switches.

In ONE of the cards I got an SFP+ module working, namely this one: https://portal.prooptix.se/sv/optiska-transceivrar/142-sfp-10g-sr-o-cisco-sfp

But it only works in one port of that card. Doesn't work at all in other NICs.



1. I've tried this in 3 different boards.

A gigabyte server: https://www.gigabyte.com/Enterprise/Rack-Server/R183-Z93-rev-AAD1

Using this motherboard: MZ93-FS1

I've tried it in a Threadripper system using ASUS ROG ZENITH II EXTREME ALPHA

And lastly in my home nas running an MSI Pro X670-P WIFI motherboard.


The breakdown of what works is:

Gigabyte server: One of the DAC cables work in 1 port. The other DAC cable works in both ports. No SFP+ modules works whatsoever. Multiple cards tested in this machine.


ASUS ROG Zenith: Can't get any SFP+ module to work.


MSI Motherboard: One SFP+ module works. The DAC cable that works in both ports works in both ports, the other DAC cable works in one port only.



I've also tried connecting the Gigabyte Motherboard and the Zenith motherboard together with SFP and SFP+ modules. Both systems running updated WinServer2022


I get a link with SFP module. No link with SFP+ modules.




2. XS1930-12F & XS1930-10

As mentioned, I've also tried hooking 2 systems up with each other with sfp+ modules. No link.


3. How do I check firmware version in Windows Server? (The system does not have a GUI)

[IntelSupport]

Hi Emigus,

Good Day!

Please note that the X710-DA2 will support SFP+, but the below motherboard is not compatible. Please find the technical specification for the below motherboard:

Gigabyte:

https://www.gigabyte.com/Enterprise/Rack-Server/R183-Z93-rev-AAD1#Specifications

ASUS ROG ZENITH II EXTREME ALPHA:

https://rog.asus.com/motherboards/rog-zenith/rog-zenith-ii-extreme-alpha-model/spec/

The MSI motherboard, the X710-DA2, will work as per the specification provided below:

https://www.msi.com/Motherboard/PRO-X670-P-WIFI/Specification

XS1930-12F switch It will support SFP +

https://www.zyxelguard.com/XS1930-12F.asp

Please find the below link firmware for X710-DA2:

https://www.intel.com/content/www/us/en/download/18190/non-volatile-memory-nvm-update-utility-for-intel-ethernet-network-adapter-700-series.html

Thank you

Regards,

Poojitha.N

[EMIGUS]

Hello,

Why wouldn't the motherboards be supported? It's a PCI-E card and the card shows up perfectly across both Linux and Windows. 
A motherboard doesn't affect support of PCI-E card as long as the PCI-E Generations match, which they do.
This has nothing to do with the motherboard, please don't bother with such lazy responses.

If you would've read the post properly, you would've also realized that the issue present itself on the motherboard you claim to be supported, and that a cable that works perfectly fine in one slot, does NOT work in the other.



I've tried updating to the firmware you attached. The behaviour still exists across multiple cards, across multiple switches, across multiple motherboards.



This is CLEARLY an issue with the firmware on the card. Not with the surrounding equipment.

[IntelSupport]

Hi Emigus,

Good Day!

Thank you for providing the details.

Could you please help us with the Adapter front and back complete picture. This information will help us to assist you further.

Regards,

Poojitha

[EMIGUS]

Absolutely.

Here you can see a working setup:

 

Using one 1gbit SFP adapter and one direct attach cable, namely this one:
Both have links which is clearly visible.


Now, if I take the SAME direct attach cable and put it in the other NIC slot, using THE SAME SLOT IN THE SWITCH?

No link:

We can also try this SFP+:

And we get no link:

We can then use an SFP+ that's coded for INTEL by Pro Optix:

And it'll work

This is all using the MSI X670 motherboard you claimed to be supported.



So the DAC cable works, but only in one slot.

The multimode SFP+s (SFP-10G-SR-O) works in ANOTHER system with another NIC of the same model, but not in this one.

The intel coded SFP+ works.



This is CLEARLY a firmware issue.

[IntelSupport]

Hi Emigus,

Good Day!

Thank you for sharing the details.

Could you please share the Ethernet adapter Front and Back pictures that really helps us to find and validate the exact model to provide firmware package that helps to fix the issue.

Regards,

poojitha.N

[EMIGUS]

Absolutely. Attached

On the backside (So, not the part with the heatsink) there are ash grey text; no clue if it's relevant for you, but kinda hard to read on pictures.

These are:


PB H92429-002
MP H92430-002

Here's the other stuff for easy copy paste:

Back side QR CODE: 368395169728

Bar code back side: 933206

Front side QR Code: 40A6B7C3DAA0
004 3023AD
J11367-005

[IntelSupport]

Hi Emigus,

Appretiate your efforts!

We have verified the provided details.Kindly provide the few more details please that would help us to fix the issue.

Could you please provide the current firmware details.Follow the steps below to get the firmware version of Intel® Ethernet Adapters:

* Open a terminal window.

* Type the ethtool -i <Device Name> command:

* Example: ethtool -i ens801f0

Thank you for choosing Intel Support

Regards,

poojitha.N

[EMIGUS]

Hey!


This is the output:

root@TRUENAS[/root]# ethtool -i enp193s0f0
driver: i40e
version: 5.15.79+truenas
firmware-version: 9.40 0x8000ece0 1.1747.0
expansion-rom-version:
bus-info: 0000:c1:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes

[IntelSupport]

Hi Emigus,

Good day!

Thank you for the details.

Could you please update the latest Adapter firmware and kindly let us know the status.

https://www.intel.com/content/www/us/en/download/18635/non-volatile-memory-nvm-update-utility-for-intel-ethernet-adapters-700-series-linux.html

Regards,

Poojitha.N

[EMIGUS]

Hello,


That is the firmware I am running:

root@TRUENAS[~/700Series/Linux_x64]# ./nvmupdate64e

Intel(R) Ethernet NVM Update Tool
NVMUpdate version 1.40.5.5
Copyright(C) 2013 - 2023 Intel Corporation.


WARNING: To avoid damage to your device, do not stop the update or reboot or power off the system during this update.
Inventory in progress. Please wait [.........|]


Num Description                          Ver.(hex)  DevId S:B    Status
=== ================================== ============ ===== ====== ==============
01) Intel(R) I350 Gigabit Network         N/A(N/A)   1521 00:098 Update not
    Connection                                                   available
02) Intel(R) Ethernet Converged         9.64(9.40)   1572 00:193 Up to date
    Network Adapter X710-2


Tool execution completed with the following status: All operations completed successfully.
Press any key to exit.

[IntelSupport]

Hi Emigus,

Please allow us some time to review the details and we will get back with an update shortly.

Thanks & Regards,

Poojitha.N

[Poojitha]

Hi EMIGUS,

Apologize for the delay in response. we appreciate your patience.

X710 cards require the use of Intel optic modules. We request you to check the below link to get the complete details on Compatible SFP+ Modules and Cables for Intel® Ethernet Server Adapter X710 Series.

https://www.intel.com/content/www/us/en/support/articles/000007045/ethernet-products/700-series-network-adapters-up-to-40gbe.html.

Kindly let us know any other doubts or details required, we are very happy to assist you.

Thank you for your cooperation.

Regards,

Poojitha

[EMIGUS]

So after 3 weeks and all that troubleshooting and details you asked for you're returning to the lazy response of "Not approved adapter".


Also, clearly it DOESN'T "require" the use of intel optic modules because they work in some cards and some not, and there's plenty of non-intel modules that work.

However, you clearly state passive DAC cables are supported - Yet the cable works in one port, and not the other.


You gonna hide behind a lazy EULA on that too because you're not interested in providing proper firmware for your products?


What a garbage customer experience. If Intel wonders why it's stock has crashed in recent years and why you're losing customers across all your product lines because, this is a prime example.


We've sent NIC's back and will be buying other brands. Thanks for confirming the choice of EPYC servers was the right one too. Have a good one - cheers!

[Poojitha]

Hi EMIGUS,

Our Sincerely apologize for inconvenience caused.

We are actively checking for necessary details you requested.

Regards,

Poojitha

[Poojitha]

Hi EMIGUS,

Greetings for the day!

I hope email finds you well. Please note most of the X710 adapter require Intel optic modules to perform the test. We recommend you to acquire couple of Intel optics and perform the test.

Regards,

Poojitha

[Poojitha]

Hi EMIGUS,

Greetings for the day!

I hope email finds you well. Please note most of the X710 adapter require Intel optic modules to perform the test. We recommend you to acquire couple of Intel optics and perform the test.

Regards,

Poojitha

[Poojitha]

Hi EMIGUS,

Greetings for the day!

I hope email finds you well. Please note most of the X710 adapter require Intel optic modules to perform the test. We recommend you to acquire couple of Intel optics and perform the test.

Kindly confirm to proceed further.

Regards,

Poojitha