Ethernet Products
Determine ramifications of Intel® Ethernet products and technologies
4894 Discussions

Inte X553 on Atom C3758R unsupported SFP+ or QSFP module on ixgbe driver loading

EasyNet
New Contributor I
‎03-30-2024 07:09 PM
446 Views

Hi,

I'm facing a strange behavior of the Linux driver ixgbe.
I'm running Debian Trixie with kernel 6.6.15.
The problem is if I'm using a RJ45 1Gbit SFP in any of these ports or an SFP from StarBit / UBNT  vendor, on driver loading I'm getting this message:

 

[ 1033.656870] ixgbe 0000:0c:00.0: failed to load because an unsupported SFP+ or QSFP module type was detected.
[ 1033.657212] ixgbe 0000:0c:00.0: Reload the driver after installing a supported module.

 

But the funny part comes if I'm reloading the driver with the SFP unplugged or just add the PCIe device under the driver for the specific interface without SFP inserted and then plug the SFP back. Now everything is working perfect:

 

# echo "0000:0c:00.0" > /sys/module/ixgbe/drivers/pci\:ixgbe/bind
# dmesg | grep 0000:0c:00.0
[ 1835.055534] ixgbe 0000:0c:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0
[ 1835.184651] ixgbe 0000:0c:00.0: MAC: 6, PHY: 0, PBA No: 000700-000
[ 1835.184662] ixgbe 0000:0c:00.0: 20:7c:14:XX:XX:XX
[ 1835.450818] ixgbe 0000:0c:00.0 eno3: renamed from eth0
[ 1835.457961] ixgbe 0000:0c:00.0: Intel(R) 10 Gigabit Network Connection
# ip a l eno3
24: eno3: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 20:7c:14:XX:XX:XX brd ff:ff:ff:ff:ff:ff
    altname enp12s0f0

 

The interface is active in the system.
Replug the SFP, no errors. Checking the SFP parameters:

 

/# ethtool -m eno3
        Identifier                                : 0x03 (SFP)
        Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
        Connector                                 : 0x00 (unknown or unspecified)
        Transceiver codes                         : 0x00 0x00 0x00 0x08 0x00 0x00 0x00 0x00 0x00
        Transceiver type                          : Ethernet: 1000BASE-T
        Encoding                                  : 0x01 (8B/10B)
        BR, Nominal                               : 1300MBd
        Rate identifier                           : 0x00 (unspecified)
        Length (SMF,km)                           : 0km
        Length (SMF)                              : 0m
        Length (50um)                             : 0m
        Length (62.5um)                           : 0m
        Length (Copper)                           : 100m
        Length (OM3)                              : 0m
        Laser wavelength                          : 0nm
        Vendor name                               : UBNT
        Vendor OUI                                : 00:00:00
        Vendor PN                                 : UF-RJ45-1G
        Vendor rev                                : 1.0
        Option values                             : 0x00 0x00
        BR margin, max                            : 0%
        BR margin, min                            : 0%
        Vendor SN                                 : XXXXXXXXXXXXX
        Date code                                 : 200914

 

Or another SFP:

        Identifier                                : 0x03 (SFP)
        Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
        Connector                                 : 0x07 (LC)
        Transceiver codes                         : 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
        Encoding                                  : 0x01 (8B/10B)
        BR, Nominal                               : 1300MBd
        Rate identifier                           : 0x00 (unspecified)
        Length (SMF,km)                           : 20km
        Length (SMF)                              : 20000m
        Length (50um)                             : 0m
        Length (62.5um)                           : 0m
        Length (Copper)                           : 0m
        Length (OM3)                              : 0m
        Laser wavelength                          : 1310nm
        Vendor name                               : OEM
        Vendor OUI                                : 00:90:65
        Vendor PN                                 : SBN-SF-WC04-020D
        Vendor rev                                : A0
        Option values                             : 0x00 0x1a
        Option                                    : RX_LOS implemented
        Option                                    : TX_FAULT implemented
        Option                                    : TX_DISABLE implemented
        BR margin, max                            : 0%
        BR margin, min                            : 0%
        Vendor SN                                 : XXXXXXXXXXXXXXXXXXXX
        Date code                                 : 171129
        Optical diagnostics support               : Yes
        Laser bias current                        : 15.990 mA
        Laser output power                        : 0.2425 mW / -6.15 dBm
        Receiver signal average optical power     : 0.0001 mW / -40.00 dBm
        Module temperature                        : 27.82 degrees C / 82.08 degrees F
        Module voltage                            : 3.1592 V
        Alarm/warning flags implemented           : Yes
        Laser bias current high alarm             : Off
        Laser bias current low alarm              : Off
        Laser bias current high warning           : Off
        Laser bias current low warning            : Off
        Laser output power high alarm             : Off
        Laser output power low alarm              : Off
        Laser output power high warning           : Off
        Laser output power low warning            : Off
        Module temperature high alarm             : Off
        Module temperature low alarm              : Off
        Module temperature high warning           : Off
        Module temperature low warning            : Off
        Module voltage high alarm                 : Off
        Module voltage low alarm                  : Off
        Module voltage high warning               : Off
        Module voltage low warning                : Off
        Laser rx power high alarm                 : Off
        Laser rx power low alarm                  : On
        Laser rx power high warning               : Off
        Laser rx power low warning                : On
        Laser bias current high alarm threshold   : 80.000 mA
        Laser bias current low alarm threshold    : 1.000 mA
        Laser bias current high warning threshold : 70.000 mA
        Laser bias current low warning threshold  : 2.000 mA
        Laser output power high alarm threshold   : 0.6310 mW / -2.00 dBm
        Laser output power low alarm threshold    : 0.1000 mW / -10.00 dBm
        Laser output power high warning threshold : 0.5012 mW / -3.00 dBm
        Laser output power low warning threshold  : 0.1259 mW / -9.00 dBm
        Module temperature high alarm threshold   : 100.00 degrees C / 212.00 degrees F
        Module temperature low alarm threshold    : -40.00 degrees C / -40.00 degrees F
        Module temperature high warning threshold : 95.00 degrees C / 203.00 degrees F
        Module temperature low warning threshold  : -35.00 degrees C / -31.00 degrees F
        Module voltage high alarm threshold       : 3.6000 V
        Module voltage low alarm threshold        : 2.8000 V
        Module voltage high warning threshold     : 3.5000 V
        Module voltage low warning threshold      : 2.9000 V
        Laser rx power high alarm threshold       : 1.9953 mW / 3.00 dBm
        Laser rx power low alarm threshold        : 0.0020 mW / -26.99 dBm
        Laser rx power high warning threshold     : 1.0000 mW / 0.00 dBm
        Laser rx power low warning threshold      : 0.0040 mW / -23.98 dBm

With Linux kernel 6.1 for example if I'm connecting a SFP that is not supported by the driver is automatically unload the interface from the system. But with 6.6.15 is just on boot time.

I tried to use allow_unsupported_sfp=1 but still without success.

Looking in the ixgbe code I'm seeing a similar code twice:

 

	/* Verify supported 1G SFP modules */
	if (comp_codes_10g == 0 &&
	    !(hw->phy.sfp_type == ixgbe_sfp_type_1g_cu_core1 ||
	      hw->phy.sfp_type == ixgbe_sfp_type_1g_cu_core0 ||
	      hw->phy.sfp_type == ixgbe_sfp_type_1g_lx_core0 ||
	      hw->phy.sfp_type == ixgbe_sfp_type_1g_lx_core1 ||
	      hw->phy.sfp_type == ixgbe_sfp_type_1g_sx_core0 ||
	      hw->phy.sfp_type == ixgbe_sfp_type_1g_sx_core1)) {
		hw->phy.type = ixgbe_phy_sfp_unsupported;
		return -EOPNOTSUPP;
	}

	/* Anything else 82598-based is supported */
	if (hw->mac.type == ixgbe_mac_82598EB)
		return 0;

	hw->mac.ops.get_device_caps(hw, &enforce_sfp);
	if (!(enforce_sfp & IXGBE_DEVICE_CAPS_ALLOW_ANY_SFP) &&
	    !(hw->phy.sfp_type == ixgbe_sfp_type_1g_cu_core0 ||
	      hw->phy.sfp_type == ixgbe_sfp_type_1g_cu_core1 ||
	      hw->phy.sfp_type == ixgbe_sfp_type_1g_lx_core0 ||
	      hw->phy.sfp_type == ixgbe_sfp_type_1g_lx_core1 ||
	      hw->phy.sfp_type == ixgbe_sfp_type_1g_sx_core0 ||
	      hw->phy.sfp_type == ixgbe_sfp_type_1g_sx_core1)) {
		/* Make sure we're a supported PHY type */
		if (hw->phy.type == ixgbe_phy_sfp_intel)
			return 0;
		if (hw->allow_unsupported_sfp) {
			e_warn(drv, "WARNING: Intel (R) Network Connections are quality tested using Intel (R) Ethernet Optics.  Using untested modules is not supported and may cause unstable operation or damage to the module or the adapter.  Intel Corporation is not responsible for any harm caused by using untested modules.\n");
			return 0;
		}
		hw_dbg(hw, "SFP+ module not supported\n");
		hw->phy.type = ixgbe_phy_sfp_unsupported;
		return -EOPNOTSUPP;
	}
	return 0;

 


What I don't understand how allow_unsupported_sfp is ignored by the driver? And how is passing the checks after the driver is loaded?

Does anybody have any idea?

The StarBit SFPs are having EEPROM for Cisco switches.

0 Kudos

Link Copied

7 Replies
Dineshbabu
Employee
‎04-07-2024 01:02 AM
395 Views

Hi EasyNet,


Greetings!


Thank you for posting Intel Community. Please help us with the system information.


Please help us with the SFP and switch model that you are using?


Please help us with the complete model of the Ethernet adapter?


Regards,

Dinesh


0 Kudos
Copy link
EasyNet
New Contributor I
‎04-08-2024 01:25 AM
357 Views
In response to Dineshbabu

Hi Dinesh,

 

Here the 4 SFPs that I was using on a mini PC with i210 SFP NIC without issues but I have issues on x553:

 

StartBit SC 20Km, TX1310/RX1550:

# ethtool -m eth3
        Identifier                                : 0x03 (SFP)
        Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
        Connector                                 : 0x07 (LC)
        Transceiver codes                         : 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
        Encoding                                  : 0x01 (8B/10B)
        BR, Nominal                               : 1300MBd
        Rate identifier                           : 0x00 (unspecified)
        Length (SMF,km)                           : 10km
        Length (SMF)                              : 10000m
        Length (50um)                             : 0m
        Length (62.5um)                           : 0m
        Length (Copper)                           : 0m
        Length (OM3)                              : 0m
        Laser wavelength                          : 1310nm
        Vendor name                               : OEM
        Vendor OUI                                : 00:90:65
        Vendor PN                                 : SFP-WDM1.25G-31D
        Vendor rev                                : A0
        Option values                             : 0x00 0x1a
        Option                                    : RX_LOS implemented
        Option                                    : TX_FAULT implemented
        Option                                    : TX_DISABLE implemented
        BR margin, max                            : 0%
        BR margin, min                            : 0%
        Vendor SN                                 : SHXXXXXXXX
        Date code                                 : 171009
        Optical diagnostics support               : Yes
        Laser bias current                        : 17.296 mA
        Laser output power                        : 0.3102 mW / -5.08 dBm
        Receiver signal average optical power     : 0.0000 mW / -inf dBm
        Module temperature                        : 17.14 degrees C / 62.85 degrees F
        Module voltage                            : 3.3011 V
        Alarm/warning flags implemented           : Yes
        Laser bias current high alarm             : Off
        Laser bias current low alarm              : Off
        Laser bias current high warning           : Off
        Laser bias current low warning            : Off
        Laser output power high alarm             : Off
        Laser output power low alarm              : Off
        Laser output power high warning           : Off
        Laser output power low warning            : Off
        Module temperature high alarm             : Off
        Module temperature low alarm              : Off
        Module temperature high warning           : Off
        Module temperature low warning            : Off
        Module voltage high alarm                 : Off
        Module voltage low alarm                  : Off
        Module voltage high warning               : Off
        Module voltage low warning                : Off
        Laser rx power high alarm                 : Off
        Laser rx power low alarm                  : On
        Laser rx power high warning               : Off
        Laser rx power low warning                : On
        Laser bias current high alarm threshold   : 80.000 mA
        Laser bias current low alarm threshold    : 2.000 mA
        Laser bias current high warning threshold : 70.000 mA
        Laser bias current low warning threshold  : 3.000 mA
        Laser output power high alarm threshold   : 0.7943 mW / -1.00 dBm
        Laser output power low alarm threshold    : 0.1000 mW / -10.00 dBm
        Laser output power high warning threshold : 0.6310 mW / -2.00 dBm
        Laser output power low warning threshold  : 0.1259 mW / -9.00 dBm
        Module temperature high alarm threshold   : 110.00 degrees C / 230.00 degrees F
        Module temperature low alarm threshold    : -45.00 degrees C / -49.00 degrees F
        Module temperature high warning threshold : 95.00 degrees C / 203.00 degrees F
        Module temperature low warning threshold  : -42.00 degrees C / -43.60 degrees F
        Module voltage high alarm threshold       : 3.6000 V
        Module voltage low alarm threshold        : 3.0000 V
        Module voltage high warning threshold     : 3.5000 V
        Module voltage low warning threshold      : 3.0500 V
        Laser rx power high alarm threshold       : 0.6310 mW / -2.00 dBm
        Laser rx power low alarm threshold        : 0.0050 mW / -23.01 dBm
        Laser rx power high warning threshold     : 0.5012 mW / -3.00 dBm
        Laser rx power low warning threshold      : 0.0063 mW / -22.01 dBm

UBIQUITI 10/100/1000 SFP-T RJ45 100m:

# ethtool -m eth3
        Identifier                                : 0x03 (SFP)
        Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
        Connector                                 : 0x00 (unknown or unspecified)
        Transceiver codes                         : 0x00 0x00 0x00 0x08 0x00 0x00 0x00 0x00 0x00
        Transceiver type                          : Ethernet: 1000BASE-T
        Encoding                                  : 0x01 (8B/10B)
        BR, Nominal                               : 1300MBd
        Rate identifier                           : 0x00 (unspecified)
        Length (SMF,km)                           : 0km
        Length (SMF)                              : 0m
        Length (50um)                             : 0m
        Length (62.5um)                           : 0m
        Length (Copper)                           : 100m
        Length (OM3)                              : 0m
        Laser wavelength                          : 0nm
        Vendor name                               : UBNT
        Vendor OUI                                : 00:00:00
        Vendor PN                                 : UF-RJ45-1G
        Vendor rev                                : 1.0
        Option values                             : 0x00 0x00
        BR margin, max                            : 0%
        BR margin, min                            : 0%
        Vendor SN                                 : X201XXXXXXXX
        Date code                                 : 200914

 

StartBit Copper SFP Transceiver 10/100/1000BASE-T:

# ethtool -m eth3
        Identifier                                : 0x03 (SFP)
        Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
        Connector                                 : 0x00 (unknown or unspecified)
        Transceiver codes                         : 0x00 0x00 0x00 0x08 0x00 0x00 0x00 0x00 0x01
        Transceiver type                          : Ethernet: 1000BASE-T
        Transceiver type                          : Extended: 100G AOC or 25GAUI C2M AOC with worst BER of 5x10^(-5)
        Encoding                                  : 0x01 (8B/10B)
        BR, Nominal                               : 1300MBd
        Rate identifier                           : 0x00 (unspecified)
        Length (SMF,km)                           : 0km
        Length (SMF)                              : 0m
        Length (50um)                             : 0m
        Length (62.5um)                           : 0m
        Length (Copper)                           : 100m
        Length (OM3)                              : 0m
        Laser wavelength                          : 16652nm
        Vendor name                               : OEM
        Vendor OUI                                : 00:00:00
        Vendor PN                                 : SP7041-E
        Vendor rev                                : E
        Option values                             : 0x00 0x10
        Option                                    : TX_DISABLE implemented
        BR margin, max                            : 0%
        BR margin, min                            : 0%
        Vendor SN                                 : TC5NXXXXXX
        Date code                                 : 120524

 

StartBit SFP 1.25G TX1310/RX1550 20KM DOM LC:

# ethtool -m eth3
        Identifier                                : 0x03 (SFP)
        Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
        Connector                                 : 0x07 (LC)
        Transceiver codes                         : 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
        Encoding                                  : 0x01 (8B/10B)
        BR, Nominal                               : 1300MBd
        Rate identifier                           : 0x00 (unspecified)
        Length (SMF,km)                           : 20km
        Length (SMF)                              : 20000m
        Length (50um)                             : 0m
        Length (62.5um)                           : 0m
        Length (Copper)                           : 0m
        Length (OM3)                              : 0m
        Laser wavelength                          : 1310nm
        Vendor name                               : OEM
        Vendor OUI                                : 00:90:65
        Vendor PN                                 : SBN-SF-WC04-020D
        Vendor rev                                : A0
        Option values                             : 0x00 0x1a
        Option                                    : RX_LOS implemented
        Option                                    : TX_FAULT implemented
        Option                                    : TX_DISABLE implemented
        BR margin, max                            : 0%
        BR margin, min                            : 0%
        Vendor SN                                 : S12352XXXXXXXX
        Date code                                 : 171129
        Optical diagnostics support               : Yes
        Laser bias current                        : 15.374 mA
        Laser output power                        : 0.2425 mW / -6.15 dBm
        Receiver signal average optical power     : 0.0001 mW / -40.00 dBm
        Module temperature                        : 17.88 degrees C / 64.18 degrees F
        Module voltage                            : 3.1720 V
        Alarm/warning flags implemented           : Yes
        Laser bias current high alarm             : Off
        Laser bias current low alarm              : Off
        Laser bias current high warning           : Off
        Laser bias current low warning            : Off
        Laser output power high alarm             : Off
        Laser output power low alarm              : Off
        Laser output power high warning           : Off
        Laser output power low warning            : Off
        Module temperature high alarm             : Off
        Module temperature low alarm              : Off
        Module temperature high warning           : Off
        Module temperature low warning            : Off
        Module voltage high alarm                 : Off
        Module voltage low alarm                  : Off
        Module voltage high warning               : Off
        Module voltage low warning                : Off
        Laser rx power high alarm                 : Off
        Laser rx power low alarm                  : On
        Laser rx power high warning               : Off
        Laser rx power low warning                : On
        Laser bias current high alarm threshold   : 80.000 mA
        Laser bias current low alarm threshold    : 1.000 mA
        Laser bias current high warning threshold : 70.000 mA
        Laser bias current low warning threshold  : 2.000 mA
        Laser output power high alarm threshold   : 0.6310 mW / -2.00 dBm
        Laser output power low alarm threshold    : 0.1000 mW / -10.00 dBm
        Laser output power high warning threshold : 0.5012 mW / -3.00 dBm
        Laser output power low warning threshold  : 0.1259 mW / -9.00 dBm
        Module temperature high alarm threshold   : 100.00 degrees C / 212.00 degrees F
        Module temperature low alarm threshold    : -40.00 degrees C / -40.00 degrees F
        Module temperature high warning threshold : 95.00 degrees C / 203.00 degrees F
        Module temperature low warning threshold  : -35.00 degrees C / -31.00 degrees F
        Module voltage high alarm threshold       : 3.6000 V
        Module voltage low alarm threshold        : 2.8000 V
        Module voltage high warning threshold     : 3.5000 V
        Module voltage low warning threshold      : 2.9000 V
        Laser rx power high alarm threshold       : 1.9953 mW / 3.00 dBm
        Laser rx power low alarm threshold        : 0.0020 mW / -26.99 dBm
        Laser rx power high warning threshold     : 1.0000 mW / 0.00 dBm
        Laser rx power low warning threshold      : 0.0040 mW / -23.98 dBm

 

In response to Dineshbabu
0 Kudos
Copy link
EasyNet
New Contributor I
‎04-08-2024 01:28 AM
356 Views
In response to EasyNet

Also I've notice when I'm trying to bring the interface up with such SFP the driver is removing the device interface from system with error unsupported SFP.

In response to EasyNet
0 Kudos
Copy link
Dineshbabu
Employee
‎04-08-2024 07:57 AM
344 Views

Hi Easynet,


Please help us with complete Ethernet adapter model that you are using.


Regards,

Dinesh


0 Kudos
Copy link
EasyNet
New Contributor I
‎04-08-2024 12:31 PM
324 Views
In response to Dineshbabu

Hi @Dineshbabu 

 

Is already mentioned in the title: Intel X553 on Atom C3758R. This CPU has 4x 10GbE X553 NICs builtin. Check the specs of the Atom C3000 series.

EasyNet_0-1712604679524.png

 

https://www.intel.com/content/www/us/en/developer/articles/technical/intel-atom-processor-c3000-family-technical-overview.html

 

In response to Dineshbabu
0 Kudos
Copy link
IntelSupport
Community Manager
‎04-09-2024 04:37 AM
289 Views

Hello EasyNet,


Thank you for the details provided.


We will check the details and get back to you with an update at the earliest.


Regards,

Sachin KS


0 Kudos
Copy link
Dineshbabu
Employee
‎04-24-2024 02:02 AM
100 Views

Hi Adrian,


Since your query is related to X550 supported with Atom C processor. Kindly request you to post your query to our embedded community.

 

https://community.intel.com/t5/Embedded-Products/ct-p/embedded-products

 

Regards,

Dinesh


0 Kudos
Copy link
Reply

Community support is provided during standard business hours (Monday to Friday 7AM - 5PM PST). Other contact methods are available here.

Intel does not verify all solutions, including but not limited to any file transfers that may appear in this community. Accordingly, Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade.

For more complete information about compiler optimizations, see our Optimization Notice.