Re: Re:Intel(R) Atom(TM) CPU C3758R with 5x I226V - Hardware error from APEI Generic Hardware Error

EasyNet · ‎04-15-2024

Hello,

I have a strange behavior with I226V NICs on a QOTOM QDNV01 device. I don't know if is a real issue or not, but maybe somebody from Intel can give me some advices.

dmidecode:

# dmidecode 3.5
Getting SMBIOS data from sysfs.
SMBIOS 3.0.0 present.
Table at 0x7F2FF000.

Handle 0x0000, DMI type 0, 24 bytes
BIOS Information
        Vendor: American Megatrends Inc.
        Version: 5.13
        Release Date: 02/21/2024
        Address: 0xF0000
        Runtime Size: 64 kB
        ROM Size: 8 MB
        Characteristics:
                PCI is supported
                BIOS is upgradeable
                BIOS shadowing is allowed
                Boot from CD is supported
                Selectable boot is supported
                BIOS ROM is socketed
                EDD is supported
                5.25"/1.2 MB floppy services are supported (int 13h)
                3.5"/720 kB floppy services are supported (int 13h)
                3.5"/2.88 MB floppy services are supported (int 13h)
                Print screen service is supported (int 5h)
                Serial services are supported (int 14h)
                Printer services are supported (int 17h)
                ACPI is supported
                USB legacy is supported
                BIOS boot specification is supported
                Targeted content distribution is supported
                UEFI is supported
        BIOS Revision: 5.13

Handle 0x0001, DMI type 1, 27 bytes
System Information
        Manufacturer: Default string
        Product Name: QDNV01
        Version: Default string
        Serial Number: Default string
        UUID: 03000200-0400-0500-0006-000700080009
        Wake-up Type: Power Switch
        SKU Number: Default string
        Family: Default string

Handle 0x0002, DMI type 2, 15 bytes
Base Board Information
        Manufacturer: Default string
        Product Name: QDNV01
        Version: Default string
        Serial Number: Default string
        Asset Tag: Default string
        Features:
                Board is a hosting board
                Board is replaceable
        Location In Chassis: Default string
        Chassis Handle: 0x0003
        Type: Motherboard
        Contained Object Handles: 0

Handle 0x0003, DMI type 3, 22 bytes
Chassis Information
        Manufacturer: Default string
        Type: Desktop
        Lock: Not Present
        Version: Default string
        Serial Number: Default string
        Asset Tag: Default string
        Boot-up State: Safe
        Power Supply State: Safe
        Thermal State: Safe
        Security Status: None
        OEM Information: 0x00000000
        Height: Unspecified
        Number Of Power Cords: 1
        Contained Elements: 0
        SKU Number: Default string

Handle 0x0004, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J1A1
        Internal Connector Type: None
        External Reference Designator: PS2Mouse
        External Connector Type: PS/2
        Port Type: Mouse Port

Handle 0x0005, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J1A1
        Internal Connector Type: None
        External Reference Designator: Keyboard
        External Connector Type: PS/2
        Port Type: Keyboard Port

Handle 0x0006, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J2A1
        Internal Connector Type: None
        External Reference Designator: TV Out
        External Connector Type: Mini Centronics Type-14
        Port Type: Other

Handle 0x0007, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J2A2A
        Internal Connector Type: None
        External Reference Designator: COM A
        External Connector Type: DB-9 male
        Port Type: Serial Port 16550A Compatible

Handle 0x0008, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J2A2B
        Internal Connector Type: None
        External Reference Designator: Video
        External Connector Type: DB-15 female
        Port Type: Video Port

Handle 0x0009, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J3A1
        Internal Connector Type: None
        External Reference Designator: USB1
        External Connector Type: Access Bus (USB)
        Port Type: USB

Handle 0x000A, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J3A1
        Internal Connector Type: None
        External Reference Designator: USB2
        External Connector Type: Access Bus (USB)
        Port Type: USB

Handle 0x000B, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J3A1
        Internal Connector Type: None
        External Reference Designator: USB3
        External Connector Type: Access Bus (USB)
        Port Type: USB

Handle 0x000C, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J9A1 - TPM HDR
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x000D, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J9C1 - PCIE DOCKING CONN
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x000E, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J2B3 - CPU FAN
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x000F, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J6C2 - EXT HDMI
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0010, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J3C1 - GMCH FAN
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0011, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J1D1 - ITP
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0012, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J9E2 - MDC INTPSR
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0013, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J9E4 - MDC INTPSR
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0014, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J9E3 - LPC HOT DOCKING
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0015, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J9E1 - SCAN MATRIX
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0016, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J9G1 - LPC SIDE BAND
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0017, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J8F1 - UNIFIED
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0018, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J6F1 - LVDS
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0019, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J2F1 - LAI FAN
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x001A, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J2G1 - GFX VID
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x001B, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J1G6 - AC JACK
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x001C, DMI type 9, 17 bytes
System Slot Information
        Designation: Slot1
        Type: x8 PCI Express 3 x8
        Current Usage: In Use
        Length: Long
        ID: 1
        Characteristics:
                3.3 V is provided
                PME signal is supported
        Bus Address: 0000:00:09.0

Handle 0x001D, DMI type 9, 17 bytes
System Slot Information
        Designation: Slot2
        Type: x4 PCI Express 3 x4
        Current Usage: In Use
        Length: Long
        ID: 2
        Characteristics:
                3.3 V is provided
                PME signal is supported
        Bus Address: 0000:00:0e.0

Handle 0x001E, DMI type 9, 17 bytes
System Slot Information
        Designation: Slot3
        Type: x4 PCI Express 3 x4
        Current Usage: In Use
        Length: Long
        ID: 3
        Characteristics:
                3.3 V is provided
                PME signal is supported
        Bus Address: 0000:00:10.0

Handle 0x001F, DMI type 10, 6 bytes
On Board Device Information
        Type: Video
        Status: Enabled
        Description:    To Be Filled By O.E.M.

Handle 0x0020, DMI type 11, 5 bytes
OEM Strings
        String 1: Default string

Handle 0x0021, DMI type 12, 5 bytes
System Configuration Options
        Option 1: Default string

Handle 0x0022, DMI type 32, 20 bytes
System Boot Information
        Status: No errors detected

Handle 0x0023, DMI type 41, 11 bytes
Onboard Device
        Reference Designation: Onboard Video
        Type: Video
        Status: Enabled
        Type Instance: 1
        Bus Address: 0000:0b:00.0

Handle 0x0024, DMI type 15, 73 bytes
System Event Log
        Area Length: 65535 bytes
        Header Start Offset: 0x0000
        Header Length: 16 bytes
        Data Start Offset: 0x0010
        Access Method: Memory-mapped physical 32-bit address
        Access Address: 0xFF850000
        Status: Valid, Not Full
        Change Token: 0x0000013B
        Header Format: Type 1
        Supported Log Type Descriptors: 25
        Descriptor 1: Single-bit ECC memory error
        Data Format 1: Multiple-event handle
        Descriptor 2: Multi-bit ECC memory error
        Data Format 2: Multiple-event handle
        Descriptor 3: Parity memory error
        Data Format 3: None
        Descriptor 4: Bus timeout
        Data Format 4: None
        Descriptor 5: I/O channel block
        Data Format 5: None
        Descriptor 6: Software NMI
        Data Format 6: None
        Descriptor 7: POST memory resize
        Data Format 7: None
        Descriptor 8: POST error
        Data Format 8: POST results bitmap
        Descriptor 9: PCI parity error
        Data Format 9: Multiple-event handle
        Descriptor 10: PCI system error
        Data Format 10: Multiple-event handle
        Descriptor 11: CPU failure
        Data Format 11: None
        Descriptor 12: EISA failsafe timer timeout
        Data Format 12: None
        Descriptor 13: Correctable memory log disabled
        Data Format 13: None
        Descriptor 14: Logging disabled
        Data Format 14: None
        Descriptor 15: System limit exceeded
        Data Format 15: None
        Descriptor 16: Asynchronous hardware timer expired
        Data Format 16: None
        Descriptor 17: System configuration information
        Data Format 17: None
        Descriptor 18: Hard disk information
        Data Format 18: None
        Descriptor 19: System reconfigured
        Data Format 19: None
        Descriptor 20: Uncorrectable CPU-complex error
        Data Format 20: None
        Descriptor 21: Log area reset/cleared
        Data Format 21: None
        Descriptor 22: System boot
        Data Format 22: None
        Descriptor 23: End of log
        Data Format 23: None
        Descriptor 24: OEM-specific
        Data Format 24: OEM-specific
        Descriptor 25: OEM-specific
        Data Format 25: OEM-specific

Handle 0x0025, DMI type 16, 23 bytes
Physical Memory Array
        Location: System Board Or Motherboard
        Use: System Memory
        Error Correction Type: None
        Maximum Capacity: 128 GB
        Error Information Handle: Not Provided
        Number Of Devices: 4

Handle 0x0026, DMI type 19, 31 bytes
Memory Array Mapped Address
        Starting Address: 0x00000000000
        Ending Address: 0x001FFFFFFFF
        Range Size: 8 GB
        Physical Array Handle: 0x0025
        Partition Width: 1

Handle 0x0027, DMI type 17, 40 bytes
Memory Device
        Array Handle: 0x0025
        Error Information Handle: Not Provided
        Total Width: 64 bits
        Data Width: 64 bits
        Size: 8 GB
        Form Factor: DIMM
        Set: None
        Locator: DIMM0
        Bank Locator: BANK 0
        Type: DDR4
        Type Detail: Synchronous Unbuffered (Unregistered)
        Speed: 2400 MT/s
        Manufacturer: Crucial
        Serial Number: XXXXXXXX
        Asset Tag: BANK 0 DIMM0 AssetTag
        Part Number: CT8G4SFS824A.C8FE
        Rank: 1
        Configured Memory Speed: 2400 MT/s
        Minimum Voltage: 1.2 V
        Maximum Voltage: 1.2 V
        Configured Voltage: 1.2 V

Handle 0x0028, DMI type 20, 35 bytes
Memory Device Mapped Address
        Starting Address: 0x00000000000
        Ending Address: 0x001FFFFFFFF
        Range Size: 8 GB
        Physical Device Handle: 0x0027
        Memory Array Mapped Address Handle: 0x0026
        Partition Row Position: Unknown

Handle 0x0029, DMI type 17, 40 bytes
Memory Device
        Array Handle: 0x0025
        Error Information Handle: Not Provided
        Total Width: Unknown
        Data Width: Unknown
        Size: No Module Installed
        Form Factor: DIMM
        Set: None
        Locator: DIMM0
        Bank Locator: BANK 1
        Type: Unknown
        Type Detail: Unknown

Handle 0x002A, DMI type 17, 40 bytes
Memory Device
        Array Handle: 0x0025
        Error Information Handle: Not Provided
        Total Width: Unknown
        Data Width: Unknown
        Size: No Module Installed
        Form Factor: DIMM
        Set: None
        Locator: DIMM1
        Bank Locator: BANK 0
        Type: Unknown
        Type Detail: Unknown

Handle 0x002B, DMI type 17, 40 bytes
Memory Device
        Array Handle: 0x0025
        Error Information Handle: Not Provided
        Total Width: Unknown
        Data Width: Unknown
        Size: No Module Installed
        Form Factor: DIMM
        Set: None
        Locator: DIMM1
        Bank Locator: BANK 1
        Type: Unknown
        Type Detail: Unknown

Handle 0x002C, DMI type 7, 19 bytes
Cache Information
        Socket Designation: L1-Cache
        Configuration: Enabled, Not Socketed, Level 1
        Operational Mode: Write Back
        Location: Internal
        Installed Size: 56 kB
        Maximum Size: 56 kB
        Supported SRAM Types:
                Synchronous
        Installed SRAM Type: Synchronous
        Speed: Unknown
        Error Correction Type: Single-bit ECC
        System Type: Instruction
        Associativity: 8-way Set-associative

Handle 0x002D, DMI type 7, 19 bytes
Cache Information
        Socket Designation: L2-Cache
        Configuration: Enabled, Not Socketed, Level 2
        Operational Mode: Write Back
        Location: Internal
        Installed Size: 2 MB
        Maximum Size: 2 MB
        Supported SRAM Types:
                Synchronous
        Installed SRAM Type: Synchronous
        Speed: Unknown
        Error Correction Type: Single-bit ECC
        System Type: Unified
        Associativity: 16-way Set-associative

Handle 0x002E, DMI type 4, 48 bytes
Processor Information
        Socket Designation: CPU0
        Type: Central Processor
        Family: Pentium 4
        Manufacturer: Intel(R) Corporation
        ID: F1 06 05 00 FF FB EB BF
        Signature: Type 0, Family 6, Model 95, Stepping 1
        Flags:
                FPU (Floating-point unit on-chip)
                VME (Virtual mode extension)
                DE (Debugging extension)
                PSE (Page size extension)
                TSC (Time stamp counter)
                MSR (Model specific registers)
                PAE (Physical address extension)
                MCE (Machine check exception)
                CX8 (CMPXCHG8 instruction supported)
                APIC (On-chip APIC hardware supported)
                SEP (Fast system call)
                MTRR (Memory type range registers)
                PGE (Page global enable)
                MCA (Machine check architecture)
                CMOV (Conditional move instruction supported)
                PAT (Page attribute table)
                PSE-36 (36-bit page size extension)
                CLFSH (CLFLUSH instruction supported)
                DS (Debug store)
                ACPI (ACPI supported)
                MMX (MMX technology supported)
                FXSR (FXSAVE and FXSTOR instructions supported)
                SSE (Streaming SIMD extensions)
                SSE2 (Streaming SIMD extensions 2)
                SS (Self-snoop)
                HTT (Multi-threading)
                TM (Thermal monitor supported)
                PBE (Pending break enabled)
        Version: Intel(R) Atom(TM) CPU C3758R @ 2.40GHz
        Voltage: 1.6 V
        External Clock: 100 MHz
        Max Speed: 3800 MHz
        Current Speed: 2400 MHz
        Status: Populated, Enabled
        Upgrade: Socket LGA775
        L1 Cache Handle: 0x002C
        L2 Cache Handle: 0x002D
        L3 Cache Handle: Not Provided
        Serial Number: Not Specified
        Asset Tag: UNKNOWN
        Part Number: Not Specified
        Core Count: 8
        Core Enabled: 8
        Thread Count: 8
        Characteristics:
                64-bit capable
                Multi-Core
                Hardware Thread
                Execute Protection
                Enhanced Virtualization
                Power/Performance Control

Handle 0x0035, DMI type 41, 11 bytes
Onboard Device
        Reference Designation: Onboard SATA
        Type: SATA Controller
        Status: Enabled
        Type Instance: 1
        Bus Address: 0000:00:13.0

Handle 0x0037, DMI type 41, 11 bytes
Onboard Device
        Reference Designation: Onboard SATA
        Type: SATA Controller
        Status: Enabled
        Type Instance: 2
        Bus Address: 0000:00:14.0

Handle 0x0039, DMI type 41, 11 bytes
Onboard Device
        Reference Designation: Onboard LAN
        Type: Ethernet
        Status: Enabled
        Type Instance: 1
        Bus Address: 0000:0c:00.0

Handle 0x003B, DMI type 41, 11 bytes
Onboard Device
        Reference Designation: Onboard LAN
        Type: Ethernet
        Status: Enabled
        Type Instance: 2
        Bus Address: 0000:0c:00.1

Handle 0x003D, DMI type 41, 11 bytes
Onboard Device
        Reference Designation: Onboard LAN
        Type: Ethernet
        Status: Enabled
        Type Instance: 3
        Bus Address: 0000:0e:00.0

Handle 0x003F, DMI type 41, 11 bytes
Onboard Device
        Reference Designation: Onboard LAN
        Type: Ethernet
        Status: Enabled
        Type Instance: 4
        Bus Address: 0000:0e:00.1

Handle 0x0041, DMI type 127, 4 bytes
End Of Table

lspci:

00:00.0 Host bridge: Intel Corporation Atom Processor C3000 Series System Agent (rev 11)
00:04.0 Host bridge: Intel Corporation Atom Processor C3000 Series Error Registers (rev 11)
00:05.0 Generic system peripheral [0807]: Intel Corporation Atom Processor C3000 Series Root Complex Event Collector (rev 11)
00:06.0 PCI bridge: Intel Corporation Atom Processor C3000 Series Integrated QAT Root Port (rev 11)
00:09.0 PCI bridge: Intel Corporation Atom Processor C3000 Series PCI Express Root Port #0 (rev 11)
00:0a.0 PCI bridge: Intel Corporation Atom Processor C3000 Series PCI Express Root Port #1 (rev 11)
00:0b.0 PCI bridge: Intel Corporation Atom Processor C3000 Series PCI Express Root Port #2 (rev 11)
00:0c.0 PCI bridge: Intel Corporation Atom Processor C3000 Series PCI Express Root Port #3 (rev 11)
00:0e.0 PCI bridge: Intel Corporation Atom Processor C3000 Series PCI Express Root Port #4 (rev 11)
00:0f.0 PCI bridge: Intel Corporation Atom Processor C3000 Series PCI Express Root Port #5 (rev 11)
00:10.0 PCI bridge: Intel Corporation Atom Processor C3000 Series PCI Express Root Port #6 (rev 11)
00:11.0 PCI bridge: Intel Corporation Atom Processor C3000 Series PCI Express Root Port #7 (rev 11)
00:12.0 System peripheral: Intel Corporation Atom Processor C3000 Series SMBus Contoller - Host (rev 11)
00:13.0 SATA controller: Intel Corporation Atom Processor C3000 Series SATA Controller 0 (rev 11)
00:14.0 SATA controller: Intel Corporation Atom Processor C3000 Series SATA Controller 1 (rev 11)
00:15.0 USB controller: Intel Corporation Atom Processor C3000 Series USB 3.0 xHCI Controller (rev 11)
00:16.0 PCI bridge: Intel Corporation Atom Processor C3000 Series Integrated LAN Root Port #0 (rev 11)
00:17.0 PCI bridge: Intel Corporation Atom Processor C3000 Series Integrated LAN Root Port #1 (rev 11)
00:18.0 Communication controller: Intel Corporation Atom Processor C3000 Series ME HECI 1 (rev 11)
00:1a.0 Serial controller: Intel Corporation Atom Processor C3000 Series HSUART Controller (rev 11)
00:1f.0 ISA bridge: Intel Corporation Atom Processor C3000 Series LPC or eSPI (rev 11)
00:1f.2 Memory controller: Intel Corporation Atom Processor C3000 Series Power Management Controller (rev 11)
00:1f.4 SMBus: Intel Corporation Atom Processor C3000 Series SMBus controller (rev 11)
00:1f.5 Serial bus controller: Intel Corporation Atom Processor C3000 Series SPI Controller (rev 11)
01:00.0 Co-processor: Intel Corporation Atom Processor C3000 Series QuickAssist Technology (rev 11)
02:00.0 Non-Volatile memory controller: Hosin Global Electronics Device 2283
05:00.0 Ethernet controller: Intel Corporation Ethernet Controller I226-V (rev 04)
06:00.0 Ethernet controller: Intel Corporation Ethernet Controller I226-V (rev 04)
07:00.0 Ethernet controller: Intel Corporation Ethernet Controller I226-V (rev 04)
08:00.0 Ethernet controller: Intel Corporation Ethernet Controller I226-V (rev 04)
09:00.0 Ethernet controller: Intel Corporation Ethernet Controller I226-V (rev 04)
0a:00.0 PCI bridge: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge (rev 03)
0b:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 30)
0c:00.0 Ethernet controller: Intel Corporation Ethernet Connection X553 10 GbE SFP+ (rev 11)
0c:00.1 Ethernet controller: Intel Corporation Ethernet Connection X553 10 GbE SFP+ (rev 11)
0e:00.0 Ethernet controller: Intel Corporation Ethernet Connection X553 10 GbE SFP+ (rev 11)
0e:00.1 Ethernet controller: Intel Corporation Ethernet Connection X553 10 GbE SFP+ (rev 11)

Linux: Debian Trixie with Kernel 6.6.15-amd64

All I226-V Ethernet controllers are working fine if I'm using iperf3 on one direction: upload or download.

When I'm using iperf3 -s 10.10.10.1 --bidir then I'm getting these messages in dmesg just few times and then no messages anymore:

[ 3138.590555] ixgbe 0000:0e:00.1 eth4: detected SFP+: 6
[ 3139.506623] ixgbe 0000:0e:00.0 eth3: NIC Link is Down
[ 3139.734453] ixgbe 0000:0e:00.1 eth4: NIC Link is Up 10 Gbps, Flow Control: RX/TX
[ 3140.306450] ixgbe 0000:0e:00.0 eth3: NIC Link is Up 10 Gbps, Flow Control: RX/TX
[ 3141.418810] igc 0000:08:00.0 eth5: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
[ 3141.418813] igc 0000:06:00.0 eth6: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
[ 3141.530803] igc 0000:05:00.0 eth8: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
[ 3141.530804] igc 0000:07:00.0 eth7: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
[ 3355.115211] {1}[Hardware Error]: Hardware error from APEI Generic Hardware Error Source: 0
[ 3355.127649] {1}[Hardware Error]: It has been corrected by h/w and requires no further action
[ 3355.140277] {1}[Hardware Error]: event severity: corrected
[ 3355.150000] {1}[Hardware Error]:  Error 0, type: corrected
[ 3355.159682] {1}[Hardware Error]:   section_type: PCIe error
[ 3355.169350] {1}[Hardware Error]:   port_type: 4, root port
[ 3355.178856] {1}[Hardware Error]:   version: 1.16
[ 3355.187396] {1}[Hardware Error]:   command: 0x0010, status: 0x0546
[ 3355.197496] {1}[Hardware Error]:   device_id: 0000:06:00.0
[ 3355.206816] {1}[Hardware Error]:   slot: 0
[ 3355.214643] {1}[Hardware Error]:   secondary_bus: 0x00
[ 3355.223580] {1}[Hardware Error]:   vendor_id: 0x8086, device_id: 0x125c
[ 3355.234027] {1}[Hardware Error]:   class_code: 000200
[ 3355.243159] igc 0000:06:00.0: AER: aer_status: 0x00002000, aer_mask: 0x00002000
[ 3355.254359] igc 0000:06:00.0: AER: aer_layer=Transaction Layer, aer_agent=Receiver ID
[ 3360.590158] igc 0000:06:00.0: AER: aer_status: 0x00002000, aer_mask: 0x00002000
[ 3360.601628] igc 0000:06:00.0: AER: aer_layer=Transaction Layer, aer_agent=Receiver ID
[ 3360.784137] {2}[Hardware Error]: Hardware error from APEI Generic Hardware Error Source: 0
[ 3360.796847] {2}[Hardware Error]: It has been corrected by h/w and requires no further action
[ 3360.809883] {2}[Hardware Error]: event severity: corrected
[ 3360.820031] {2}[Hardware Error]:  Error 0, type: corrected
[ 3360.830113] {2}[Hardware Error]:   section_type: PCIe error
[ 3360.840212] {2}[Hardware Error]:   port_type: 4, root port
[ 3360.850177] {2}[Hardware Error]:   version: 1.16
[ 3360.859177] {2}[Hardware Error]:   command: 0x0010, status: 0x0546
[ 3360.869845] {2}[Hardware Error]:   device_id: 0000:08:00.0
[ 3360.879663] {2}[Hardware Error]:   slot: 0
[ 3360.887982] {2}[Hardware Error]:   secondary_bus: 0x00
[ 3360.897291] {2}[Hardware Error]:   vendor_id: 0x8086, device_id: 0x125c
[ 3360.908091] {2}[Hardware Error]:   class_code: 000200
[ 3360.917457] igc 0000:08:00.0: AER: aer_status: 0x00002000, aer_mask: 0x00002000
[ 3360.929080] igc 0000:08:00.0: AER: aer_layer=Transaction Layer, aer_agent=Receiver ID
[ 3362.172784] igc 0000:06:00.0: AER: aer_status: 0x00002000, aer_mask: 0x00002000
[ 3362.184536] igc 0000:06:00.0: AER: aer_layer=Transaction Layer, aer_agent=Receiver ID
[ 3363.313749] igc 0000:06:00.0: AER: aer_status: 0x00002000, aer_mask: 0x00002000
[ 3363.325663] igc 0000:06:00.0: AER: aer_layer=Transaction Layer, aer_agent=Receiver ID
[ 3369.411711] igc 0000:08:00.0: AER: aer_status: 0x00002000, aer_mask: 0x00002000
[ 3369.423719] igc 0000:08:00.0: AER: aer_layer=Transaction Layer, aer_agent=Receiver ID
[ 3371.361921] {3}[Hardware Error]: Hardware error from APEI Generic Hardware Error Source: 0
[ 3371.374855] {3}[Hardware Error]: It has been corrected by h/w and requires no further action
[ 3371.388152] {3}[Hardware Error]: event severity: corrected
[ 3371.398433] {3}[Hardware Error]:  Error 0, type: corrected
[ 3371.408691] {3}[Hardware Error]:   section_type: PCIe error
[ 3371.419038] {3}[Hardware Error]:   port_type: 4, root port
[ 3371.429281] {3}[Hardware Error]:   version: 1.16
[ 3371.438614] {3}[Hardware Error]:   command: 0x0010, status: 0x0546
[ 3371.449575] {3}[Hardware Error]:   device_id: 0000:06:00.0
[ 3371.459845] {3}[Hardware Error]:   slot: 0
[ 3371.468646] {3}[Hardware Error]:   secondary_bus: 0x00
[ 3371.478475] {3}[Hardware Error]:   vendor_id: 0x8086, device_id: 0x125c
[ 3371.489760] {3}[Hardware Error]:   class_code: 000200
[ 3371.499494] igc 0000:06:00.0: AER: aer_status: 0x00002000, aer_mask: 0x00002000
[ 3371.511511] igc 0000:06:00.0: AER: aer_layer=Transaction Layer, aer_agent=Receiver ID
[ 3375.864209] {4}[Hardware Error]: Hardware error from APEI Generic Hardware Error Source: 0
[ 3375.877210] {4}[Hardware Error]: It has been corrected by h/w and requires no further action
[ 3375.890399] {4}[Hardware Error]: event severity: corrected
[ 3375.900543] {4}[Hardware Error]:  Error 0, type: corrected
[ 3375.910682] {4}[Hardware Error]:   section_type: PCIe error
[ 3375.920915] {4}[Hardware Error]:   port_type: 4, root port
[ 3375.931062] {4}[Hardware Error]:   version: 1.16
[ 3375.940315] {4}[Hardware Error]:   command: 0x0010, status: 0x0546
[ 3375.951193] {4}[Hardware Error]:   device_id: 0000:08:00.0
[ 3375.961354] {4}[Hardware Error]:   slot: 0
[ 3375.970116] {4}[Hardware Error]:   secondary_bus: 0x00
[ 3375.979926] {4}[Hardware Error]:   vendor_id: 0x8086, device_id: 0x125c
[ 3375.991246] {4}[Hardware Error]:   class_code: 000200
[ 3376.001048] igc 0000:08:00.0: AER: aer_status: 0x00002000, aer_mask: 0x00002000
[ 3376.013092] igc 0000:08:00.0: AER: aer_layer=Transaction Layer, aer_agent=Receiver ID

iperf3 shows few retries in the begging but that's it. Once any of the NICs gives this error then all NICs looks that are working fine. If I'm rebooting the system, then this message appears again few times and then everything is fine.

Even with these messages logged into dmesg the NICs reports a bandwidth of 2.34 - 2.40 Gbits/sec, which is normal for a MTU of 1500.

Should I be worried? There is any issues with the hardware?

IntelSupport · ‎04-16-2024

Hello Adrian,

Greetings for the day !

Can you please provide the system information and ethernet model ?

Regards,

Varsha

EasyNet · ‎04-16-2024

Hi Varsha,

As I mention in the title and in the description: the system is based on Intel(R) Atom(TM) CPU C3758R CPU and it has 5x i226-V NICs additionally. All NICs are onboard, there is no PCIe slot. Is a mini PC passive cooled. It has 2x M.2 SSD NVMe slots + 1x M.2 Key B.

Check my lspci and dmidecode command.

Here is the link to the product: https://www.qotom.net/product/RouterPC_Q20331G9S10.html

Sachinks · ‎04-17-2024

Hello EasyNet,

Good day!

Thank you for the details provided.

We see that you are getting few error messages on dmesg while rebooting the server and you are not experiencing any other issues.
May I know if you have made any changes related to the NIC or have you been seeing these errors from the start?

Also we see that you have 5 NIC's onboard. Are all of these NIC's getting the same errors after the restart?

Regards,
Sachin KS

EasyNet · ‎04-19-2024

Hi Sachin,

I will check all of the NICs these days with NVMe SSD installed and without NVMe installed. But at leas 4 of them I got the same error.

I will comeback in few days with the tests.

Sachinks · ‎04-19-2024

Hello EasyNet,

Thank you for the update. We will keep this thread open.

Regards,
Sachin KS

EasyNet · ‎04-21-2024

Hi Sachinks,

I did tests with bidirectional traffic on all 5x I226-V interfaces and all of them are outputing from time to time, on Linux Kernel 6.6.15,

igc 0000:XX:00.0: AER: aer_status: 0x00002000, aer_mask: 0x00002000

warning / error in Kernel.

Do you want to make a video with all tests? I didn't had time to do it, but tomorrow I will can do it.

For me is pretty strange that all NICs have the same behavior. If it was one or two I could said that is an issue with the hardware, but all of them ..

Varsha11 · ‎04-22-2024

Hello EasyNet,

Thankyou for your Information,

As you have informed that all the NICs have the same behavior ,

I would request you to please allow me some time .

Meanwhile i will check with the Internal Team and provide you with an update.

Regards,

Varsha

EasyNet · ‎04-22-2024

Hi Varsha,

I set this device in routing mode and I did a test between 2 I226-V ports and I got a crash of the driver depending in which direction I'm doing the download:

[  575.058871] ------------[ cut here ]------------
[  575.063794] NETDEV WATCHDOG: enp6s0 (igc): transmit queue 2 timed out 7088 ms
[  575.071322] WARNING: CPU: 1 PID: 0 at net/sched/sch_generic.c:525 dev_watchdog+0x232/0x240
[  575.085480] Modules linked in: lz4 lz4_compress zram zsmalloc intel_rapl_msr intel_rapl_common binfmt_misc x86_pkg_temp_thermal intel_powerclamp kvm_inten
[  575.170823] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 6.6.15-amd64 #1  Debian 6.6.15-2
[  575.182206] Hardware name: Default string QDNV01/QDNV01, BIOS 5.13 02/21/2024
[  575.195002] RIP: 0010:dev_watchdog+0x232/0x240
[  575.205048] Code: ff ff ff 48 89 df c6 05 6e e1 3f 01 01 e8 86 32 fa ff 45 89 f8 44 89 f1 48 89 de 48 89 c2 48 c7 c7 98 5f 92 9c e8 be 97 6a ff <0f> 0b e0
[  575.229978] RSP: 0018:ffffc9000012ce78 EFLAGS: 00010286
[  575.240433] RAX: 0000000000000000 RBX: ffff88810e1bc000 RCX: 000000000000083f
[  575.253343] RDX: 0000000000000000 RSI: 00000000000000f6 RDI: 000000000000083f
[  575.266163] RBP: ffff88810e1bc4c8 R08: 0000000000000000 R09: ffffc9000012cd00
[  575.278984] R10: 0000000000000003 R11: ffffffff9d0d20e8 R12: ffff8881015dea80
[  575.291804] R13: ffff88810e1bc41c R14: 0000000000000002 R15: 0000000000001bb0
[  575.304624] FS:  0000000000000000(0000) GS:ffff888277c40000(0000) knlGS:0000000000000000
[  575.318433] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  575.329788] CR2: 00007f625edfcd78 CR3: 000000010359c000 CR4: 00000000003506e0
[  575.342655] Call Trace:
[  575.350614]  <IRQ>
[  575.358377]  ? dev_watchdog+0x232/0x240
[  575.375156]  ? __warn+0x81/0x130
[  575.389812]  ? dev_watchdog+0x232/0x240
[  575.405136]  ? report_bug+0x171/0x1a0
[  575.420090]  ? handle_bug+0x3c/0x80
[  575.434801]  ? exc_invalid_op+0x17/0x70
[  575.449938]  ? asm_exc_invalid_op+0x1a/0x20
[  575.465656]  ? dev_watchdog+0x232/0x240
[  575.480778]  ? dev_watchdog+0x232/0x240
[  575.495902]  ? __pfx_dev_watchdog+0x10/0x10
[  575.511408]  call_timer_fn+0x27/0x130
[  575.526344]  ? __pfx_dev_watchdog+0x10/0x10
[  575.541805]  __run_timers+0x222/0x2c0
[  575.556722]  run_timer_softirq+0x1d/0x40
[  575.571918]  __do_softirq+0xca/0x2ae
[  575.580993]  __irq_exit_rcu+0x96/0xb0
[  575.590147]  sysvec_apic_timer_interrupt+0x72/0x90
[  575.600517]  </IRQ>
[  575.608079]  <TASK>
[  575.615698]  asm_sysvec_apic_timer_interrupt+0x1a/0x20
[  575.626539] RIP: 0010:cpuidle_enter_state+0xcc/0x440
[  575.637100] Code: 1a 6d 53 ff e8 35 f4 ff ff 8b 53 04 49 89 c5 0f 1f 44 00 00 31 ff e8 23 79 52 ff 45 84 ff 0f 85 56 02 00 00 fb 0f 1f 44 00 00 <45> 85 fd
[  575.671047] RSP: 0018:ffffc900000bfe90 EFLAGS: 00000246
[  575.683925] RAX: ffff888277c73440 RBX: ffffe8ffffc7f900 RCX: 000000000000001f
[  575.696838] RDX: 0000000000000001 RSI: 0000000035555555 RDI: 0000000000000000
[  575.709621] RBP: 0000000000000002 R08: 0000000000000000 R09: 0000000000020501
[  575.722449] R10: 0000000000000018 R11: ffff888277c71fe4 R12: ffffffff9d19a500
[  575.735286] R13: 00000085e42dd7ae R14: 0000000000000002 R15: 0000000000000000
[  575.748110]  cpuidle_enter+0x2d/0x40
[  575.757302]  do_idle+0x20d/0x270
[  575.766061]  cpu_startup_entry+0x2a/0x30
[  575.775602]  start_secondary+0x11e/0x140
[  575.785129]  secondary_startup_64_no_verify+0x18f/0x19b
[  575.796031]  </TASK>
[  575.803893] ---[ end trace 0000000000000000 ]---
[  575.814377] igc 0000:06:00.0 enp6s0: Register Dump
[  575.824836] igc 0000:06:00.0 enp6s0: Register Name   Value
[  575.836000] igc 0000:06:00.0 enp6s0: CTRL            181c0641
[  575.847428] igc 0000:06:00.0 enp6s0: STATUS          00680683
[  575.858856] igc 0000:06:00.0 enp6s0: CTRL_EXT        100000c0
[  575.870251] igc 0000:06:00.0 enp6s0: MDIC            1805dde1
[  575.881648] igc 0000:06:00.0 enp6s0: ICR             00000081
[  575.893038] igc 0000:06:00.0 enp6s0: RCTL            04408022
[  575.904497] igc 0000:06:00.0 enp6s0: RDLEN[0-3]      00001000 00001000 00001000 00001000
[  575.918387] igc 0000:06:00.0 enp6s0: RDH[0-3]        0000007e 00000000 0000000b 00000007
[  575.932124] igc 0000:06:00.0 enp6s0: RDT[0-3]        0000007d 000000ff 0000000a 00000006
[  575.945837] igc 0000:06:00.0 enp6s0: RXDCTL[0-3]     02040808 02040808 02040808 02040808
[  575.959620] igc 0000:06:00.0 enp6s0: RDBAL[0-3]      ffffb000 ffffa000 ffff9000 ffff8000
[  575.973435] igc 0000:06:00.0 enp6s0: RDBAH[0-3]      00000000 00000000 00000000 00000000
[  575.987199] igc 0000:06:00.0 enp6s0: TCTL            a503f0fa
[  575.998615] igc 0000:06:00.0 enp6s0: TDBAL[0-3]      fffff000 ffffe000 ffffd000 ffffc000
[  576.012477] igc 0000:06:00.0 enp6s0: TDBAH[0-3]      00000000 00000000 00000000 00000000
[  576.026219] igc 0000:06:00.0 enp6s0: TDLEN[0-3]      00001000 00001000 00001000 00001000
[  576.040009] igc 0000:06:00.0 enp6s0: TDH[0-3]        00000010 0000000e 000000e3 00000000
[  576.053716] igc 0000:06:00.0 enp6s0: TDT[0-3]        00000010 0000000e 000000e3 00000000
[  576.067388] igc 0000:06:00.0 enp6s0: TXDCTL[0-3]     02100108 02100108 02100108 02100108
[  576.081031] igc 0000:06:00.0 enp6s0: Reset adapter
[  579.327272] igc 0000:06:00.0 enp6s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
[  614.994913] igc 0000:06:00.0 enp6s0: Register Dump
[  615.003675] igc 0000:06:00.0 enp6s0: Register Name   Value
[  615.013030] igc 0000:06:00.0 enp6s0: CTRL            181c0641
[  615.024795] igc 0000:06:00.0 enp6s0: STATUS          00680683
[  615.036208] igc 0000:06:00.0 enp6s0: CTRL_EXT        100000c0
[  615.047607] igc 0000:06:00.0 enp6s0: MDIC            1805dde1
[  615.058964] igc 0000:06:00.0 enp6s0: ICR             00000081
[  615.070243] igc 0000:06:00.0 enp6s0: RCTL            04408022
[  615.081651] igc 0000:06:00.0 enp6s0: RDLEN[0-3]      00001000 00001000 00001000 00001000
[  615.095534] igc 0000:06:00.0 enp6s0: RDH[0-3]        00000005 00000007 00000000 00000006
[  615.109255] igc 0000:06:00.0 enp6s0: RDT[0-3]        00000004 00000006 000000ff 00000005
[  615.122949] igc 0000:06:00.0 enp6s0: RXDCTL[0-3]     02040808 02040808 02040808 02040808
[  615.136692] igc 0000:06:00.0 enp6s0: RDBAL[0-3]      ffffb000 ffffa000 ffff9000 ffff8000
[  615.150482] igc 0000:06:00.0 enp6s0: RDBAH[0-3]      00000000 00000000 00000000 00000000
[  615.164214] igc 0000:06:00.0 enp6s0: TCTL            a503f0fa
[  615.175660] igc 0000:06:00.0 enp6s0: TDBAL[0-3]      fffff000 ffffe000 ffffd000 ffffc000
[  615.189567] igc 0000:06:00.0 enp6s0: TDBAH[0-3]      00000000 00000000 00000000 00000000
[  615.203372] igc 0000:06:00.0 enp6s0: TDLEN[0-3]      00001000 00001000 00001000 00001000
[  615.217136] igc 0000:06:00.0 enp6s0: TDH[0-3]        0000000c 00000002 00000046 00000000
[  615.230921] igc 0000:06:00.0 enp6s0: TDT[0-3]        0000000c 00000002 00000046 00000000
[  615.244673] igc 0000:06:00.0 enp6s0: TXDCTL[0-3]     02100108 02100108 02100108 02100108
[  615.258493] igc 0000:06:00.0 enp6s0: Reset adapter
[  618.507280] igc 0000:06:00.0 enp6s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
[  633.938902] igc 0000:08:00.0 enp8s0: Register Dump
[  633.947480] igc 0000:08:00.0 enp8s0: Register Name   Value
[  633.956697] igc 0000:08:00.0 enp8s0: CTRL            181c0641
[  633.968441] igc 0000:08:00.0 enp8s0: STATUS          00680683
[  633.979837] igc 0000:08:00.0 enp8s0: CTRL_EXT        100000c0
[  633.991185] igc 0000:08:00.0 enp8s0: MDIC            1805dde1
[  634.002543] igc 0000:08:00.0 enp8s0: ICR             00000081
[  634.013915] igc 0000:08:00.0 enp8s0: RCTL            04408022
[  634.025351] igc 0000:08:00.0 enp8s0: RDLEN[0-3]      00001000 00001000 00001000 00001000
[  634.039268] igc 0000:08:00.0 enp8s0: RDH[0-3]        00000031 0000000e 00000098 00000008
[  634.053092] igc 0000:08:00.0 enp8s0: RDT[0-3]        00000030 0000000d 00000097 00000007
[  634.066803] igc 0000:08:00.0 enp8s0: RXDCTL[0-3]     02040808 02040808 02040808 02040808
[  634.080549] igc 0000:08:00.0 enp8s0: RDBAL[0-3]      ffffb000 ffffa000 ffff9000 ffff8000
[  634.094289] igc 0000:08:00.0 enp8s0: RDBAH[0-3]      00000000 00000000 00000000 00000000
[  634.107957] igc 0000:08:00.0 enp8s0: TCTL            a503f0fa
[  634.119401] igc 0000:08:00.0 enp8s0: TDBAL[0-3]      fffff000 ffffe000 ffffd000 ffffc000
[  634.133307] igc 0000:08:00.0 enp8s0: TDBAH[0-3]      00000000 00000000 00000000 00000000
[  634.147111] igc 0000:08:00.0 enp8s0: TDLEN[0-3]      00001000 00001000 00001000 00001000
[  634.160871] igc 0000:08:00.0 enp8s0: TDH[0-3]        00000090 0000008d 00000025 0000000e
[  634.174661] igc 0000:08:00.0 enp8s0: TDT[0-3]        00000090 0000008d 00000025 0000000e
[  634.188409] igc 0000:08:00.0 enp8s0: TXDCTL[0-3]     02100108 02100108 02100108 02100108
[  634.202234] igc 0000:08:00.0 enp8s0: Reset adapter
[  637.451270] igc 0000:08:00.0 enp8s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX

Here is the video:

https://youtu.be/11xNanngzz4

EasyNet · ‎04-22-2024

I switch from Kernel 6.6.18 to 6.7.9 and I have also a crash:

[   50.279184] igc 0000:06:00.0 enp6s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
[   57.731158] igc 0000:08:00.0 enp8s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
[   59.639168] igc 0000:09:00.0 enp9s0: NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
[  173.292878] ------------[ cut here ]------------
[  173.297797] NETDEV WATCHDOG: enp6s0 (igc): transmit queue 3 timed out 7724 ms
[  173.305343] WARNING: CPU: 3 PID: 0 at net/sched/sch_generic.c:525 dev_watchdog+0x232/0x240
[  173.319467] Modules linked in: lz4 lz4_compress zram intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp kvm_intel binfmt_misc kvm irqn
[  173.406064] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 6.7.9-amd64 #1  Debian 6.7.9-2
[  173.417334] Hardware name: Default string QDNV01/QDNV01, BIOS 5.13 02/21/2024
[  173.430211] RIP: 0010:dev_watchdog+0x232/0x240
[  173.440310] Code: ff ff ff 48 89 df c6 05 bd 3b 3f 01 01 e8 06 2e fa ff 45 89 f8 44 89 f1 48 89 de 48 89 c2 48 c7 c7 30 7d 13 8f e8 2e fa 69 ff <0f> 0b e0
[  173.465335] RSP: 0018:ffffa164c0194e78 EFLAGS: 00010286
[  173.475826] RAX: 0000000000000000 RBX: ffff94b5ceba2000 RCX: 000000000000083f
[  173.488809] RDX: 0000000000000000 RSI: 00000000000000f6 RDI: 000000000000083f
[  173.501634] RBP: ffff94b5ceba24c8 R08: 0000000000000000 R09: ffffa164c0194d00
[  173.514528] R10: 0000000000000003 R11: ffffffff8f8d2448 R12: ffff94b5ce09f3c0
[  173.527435] R13: ffff94b5ceba241c R14: 0000000000000003 R15: 0000000000001e2c
[  173.540339] FS:  0000000000000000(0000) GS:ffff94b737cc0000(0000) knlGS:0000000000000000
[  173.554204] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  173.565563] CR2: 00007f2fb8012da8 CR3: 0000000108fec000 CR4: 00000000003506f0
[  173.578504] Call Trace:
[  173.586519]  <IRQ>
[  173.601563]  ? dev_watchdog+0x232/0x240
[  173.616959]  ? __warn+0x81/0x130
[  173.631693]  ? dev_watchdog+0x232/0x240
[  173.646921]  ? report_bug+0x171/0x1a0
[  173.661953]  ? handle_bug+0x3c/0x80
[  173.676780]  ? exc_invalid_op+0x17/0x70
[  173.692204]  ? asm_exc_invalid_op+0x1a/0x20
[  173.707789]  ? dev_watchdog+0x232/0x240
[  173.723053]  ? dev_watchdog+0x232/0x240
[  173.738202]  ? __pfx_dev_watchdog+0x10/0x10
[  173.753785]  call_timer_fn+0x24/0x130
[  173.768790]  ? __pfx_dev_watchdog+0x10/0x10
[  173.784351]  __run_timers+0x222/0x2c0
[  173.799317]  run_timer_softirq+0x1d/0x40
[  173.814597]  __do_softirq+0xc2/0x2ae
[  173.823782]  __irq_exit_rcu+0x96/0xb0
[  173.833055]  sysvec_apic_timer_interrupt+0x72/0x90
[  173.843530]  </IRQ>
[  173.851177]  <TASK>
[  173.858872]  asm_sysvec_apic_timer_interrupt+0x1a/0x20
[  173.869816] RIP: 0010:cpuidle_enter_state+0xcc/0x440
[  173.880484] Code: 3a a2 52 ff e8 35 f4 ff ff 8b 53 04 49 89 c5 0f 1f 44 00 00 31 ff e8 93 ad 51 ff 45 84 ff 0f 85 56 02 00 00 fb 0f 1f 44 00 00 <45> 85 fd
[  173.914633] RSP: 0018:ffffa164c00cfe90 EFLAGS: 00000246
[  173.927493] RAX: ffff94b737cf3500 RBX: ffffc164bfcff940 RCX: 000000000000001f
[  173.940494] RDX: 0000000000000003 RSI: 0000000035555555 RDI: 0000000000000000
[  173.953319] RBP: 0000000000000002 R08: 0000000000000000 R09: 0000000000004001
[  173.966217] R10: 0000000000000018 R11: ffff94b737cf20a4 R12: ffffffff8f99a8a0
[  173.979090] R13: 00000028590f4a9e R14: 0000000000000002 R15: 0000000000000000
[  173.991941]  cpuidle_enter+0x2d/0x40
[  174.001171]  do_idle+0x20d/0x270
[  174.010041]  cpu_startup_entry+0x2a/0x30
[  174.019694]  start_secondary+0x11e/0x140
[  174.029328]  secondary_startup_64_no_verify+0x18f/0x19b
[  174.040344]  </TASK>
[  174.048316] ---[ end trace 0000000000000000 ]---
[  174.058882] igc 0000:06:00.0 enp6s0: Register Dump
[  174.069484] igc 0000:06:00.0 enp6s0: Register Name   Value
[  174.080666] igc 0000:06:00.0 enp6s0: CTRL            181c0641
[  174.092091] igc 0000:06:00.0 enp6s0: STATUS          00680683
[  174.103520] igc 0000:06:00.0 enp6s0: CTRL_EXT        100000c0
[  174.114916] igc 0000:06:00.0 enp6s0: MDIC            1805dde1
[  174.126281] igc 0000:06:00.0 enp6s0: ICR             00000081
[  174.137668] igc 0000:06:00.0 enp6s0: RCTL            04408022
[  174.149128] igc 0000:06:00.0 enp6s0: RDLEN[0-3]      00001000 00001000 00001000 00001000
[  174.163013] igc 0000:06:00.0 enp6s0: RDH[0-3]        00000004 000000df 00000002 00000000
[  174.176756] igc 0000:06:00.0 enp6s0: RDT[0-3]        00000003 000000de 00000001 000000ff
[  174.190472] igc 0000:06:00.0 enp6s0: RXDCTL[0-3]     02040808 02040808 02040808 02040808
[  174.204256] igc 0000:06:00.0 enp6s0: RDBAL[0-3]      ffffb000 ffffa000 ffff9000 ffff8000
[  174.218075] igc 0000:06:00.0 enp6s0: RDBAH[0-3]      00000000 00000000 00000000 00000000
[  174.231840] igc 0000:06:00.0 enp6s0: TCTL            a503f0fa
[  174.243253] igc 0000:06:00.0 enp6s0: TDBAL[0-3]      fffff000 ffffe000 ffffd000 ffffc000
[  174.257114] igc 0000:06:00.0 enp6s0: TDBAH[0-3]      00000000 00000000 00000000 00000000
[  174.270851] igc 0000:06:00.0 enp6s0: TDLEN[0-3]      00001000 00001000 00001000 00001000
[  174.284637] igc 0000:06:00.0 enp6s0: TDH[0-3]        0000000e 00000005 00000000 00000083
[  174.298355] igc 0000:06:00.0 enp6s0: TDT[0-3]        0000000e 00000005 00000000 00000083
[  174.312025] igc 0000:06:00.0 enp6s0: TXDCTL[0-3]     02100108 02100108 02100108 02100108
[  174.325672] igc 0000:06:00.0 enp6s0: Reset adapter
[  177.569208] igc 0000:06:00.0 enp6s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
[  188.140726] igc 0000:06:00.0 enp6s0: Register Dump
[  188.149450] igc 0000:06:00.0 enp6s0: Register Name   Value
[  188.158765] igc 0000:06:00.0 enp6s0: CTRL            181c0641
[  188.168310] igc 0000:06:00.0 enp6s0: STATUS          00680683
[  188.177828] igc 0000:06:00.0 enp6s0: CTRL_EXT        100000c0
[  188.187288] igc 0000:06:00.0 enp6s0: MDIC            1805dde1
[  188.196690] igc 0000:06:00.0 enp6s0: ICR             00000081
[  188.205936] igc 0000:06:00.0 enp6s0: RCTL            04408022
[  188.215138] igc 0000:06:00.0 enp6s0: RDLEN[0-3]      00001000 00001000 00001000 00001000
[  188.226788] igc 0000:06:00.0 enp6s0: RDH[0-3]        00000002 0000000d 00000000 00000000
[  188.238402] igc 0000:06:00.0 enp6s0: RDT[0-3]        00000001 0000000c 000000ff 000000ff
[  188.249921] igc 0000:06:00.0 enp6s0: RXDCTL[0-3]     02040808 02040808 02040808 02040808
[  188.261416] igc 0000:06:00.0 enp6s0: RDBAL[0-3]      ffffb000 ffffa000 ffff9000 ffff8000
[  188.272929] igc 0000:06:00.0 enp6s0: RDBAH[0-3]      00000000 00000000 00000000 00000000
[  188.284401] igc 0000:06:00.0 enp6s0: TCTL            a503f0fa
[  188.293549] igc 0000:06:00.0 enp6s0: TDBAL[0-3]      fffff000 ffffe000 ffffd000 ffffc000
[  188.305169] igc 0000:06:00.0 enp6s0: TDBAH[0-3]      00000000 00000000 00000000 00000000
[  188.316819] igc 0000:06:00.0 enp6s0: TDLEN[0-3]      00001000 00001000 00001000 00001000
[  188.328446] igc 0000:06:00.0 enp6s0: TDH[0-3]        00000002 00000002 00000000 000000f2
[  188.340085] igc 0000:06:00.0 enp6s0: TDT[0-3]        00000002 00000002 00000000 000000f2
[  188.351700] igc 0000:06:00.0 enp6s0: TXDCTL[0-3]     02100108 02100108 02100108 02100108
[  188.363356] igc 0000:06:00.0 enp6s0: Reset adapter
[  191.609048] igc 0000:06:00.0 enp6s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
[  205.728699] igc 0000:08:00.0 enp8s0: NIC Link is Down
[  208.048946] igc 0000:08:00.0 enp8s0: NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
[  223.312627] igc 0000:06:00.0 enp6s0: NIC Link is Down
[  225.632877] igc 0000:06:00.0 enp6s0: NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX

EasyNet · ‎04-22-2024

After I force the links in 1GbE I don't have a crash. But the the bidirectional traffic (--bidir) is still triggering the APEI Generic Hardware Error / AER errors, but less often.

Is this driver somehow buggy in Linux with link 2.5GbE?

Simon-Intel · ‎04-23-2024

Hi EasyNet,

I hope this email finds you well.

Thank you for reaching out to Intel Community. We appreciate your engagement with our platform. However, as your inquiry pertains to Intel(R) Atom(TM) CPU, we recommend seeking further assistance on our dedicated forum.

To ensure your query receives the attention it deserves, please submit all relevant details to our team through the following link: Intel Embedded Connectivity Forum.

Should you require any additional support or have further questions, please do not hesitate to contact us. We are here to assist you.

Thank you for choosing Intel products and services.

Best regards,

Simon

Intel(R) Atom(TM) CPU C3758R with 5x I226V - Hardware error from APEI Generic Hardware Error Source: