Community
cancel
Showing results for 
Search instead for 
Did you mean: 
MMura11
Beginner
3,218 Views

Random BSOD in Windows Server 2008 R2 due to elr62x64.sys

Hi,

While running our application in windows 2008 R2 server some random BSOD are happening.

On analyzing the dump it points to a call from elr62x64.sys and then fails in tcpip.sys. Since tcpip.sys is a system file, we would like to understand if there is any known bug from NIC card driver.

the NIC card details:

Intel R Gigabit 2P I350-t Adapter.

The current driver version details in the server machine where BSOD's surfaced :

1) erl62x64.sys - 12.13.27.0 (Date : 6/5/2015)

2) tcpip.sys - 6.1.7601.22950 (Date: 2/5/2015)

3) NDIS.sys - 6.1.7601.23235 (Date : 10/13/2015)

4) ad.sys - 6.1.7601.23237 (Date: 10/14/2015)

Also the call stack obtained from dump file is as follows:

STACK_TEXT:

fffff800`03650158 fffff800`01e80e69 : 00000000`0000000a 00000000`00000000 00000000`00000002 00000000`00000000 : nt!KeBugCheckEx

fffff800`03650160 fffff800`01e7fae0 : 00000000`00000000 00000000`00000000 fffffa80`481a2000 fffff800`03650640 : nt!KiBugCheckDispatch+0x69

fffff800`036502a0 fffff880`01a6606b : 00000000`00000716 fffff800`03650640 fffffa80`2138dcf0 fffff800`03650640 : nt!KiPageFault+0x260

fffff800`03650430 fffff880`01a643c6 : 00000000`71f8da89 fffffa80`2aaced70 00000000`00000000 fffffa80`2aacee38 : tcpip!TcpSegmentTcbSend+0x17b

fffff800`03650530 fffff880`01a685d9 : fffffa80`2a9d5360 fffff880`01a8c89b fffffa80`1d81ad30 00000000`000025bc : tcpip!TcpBeginTcbSend+0xa66

fffff800`036507b0 fffff880`01a69450 : fffffa80`000000ba 00060000`00000006 00000000`00000000 00000000`00004800 : tcpip!TcpTcbSend+0x1d9

fffff800`03650a30 fffff880`01a681a8 : 00000000`00000000 00000000`00000000 fffff800`03650c50 fffff800`03650d30 : tcpip!TcpEnqueueTcbSendOlmNotifySendComplete+0xa0

fffff800`03650a60 fffff880`01a6836b : fffffa80`00000004 fffffa80`1cc0a924 00000000`00004800 fffff800`03650ba0 : tcpip!TcpEnqueueTcbSend+0x258

fffff800`03650b10 fffff800`01e8e1f8 : fffff800`03650bd8 00000000`00000000 fffffa80`1d1ed7b8 fffff800`03650bd8 : tcpip!TcpTlConnectionSendCalloutRoutine+0x1b

fffff800`03650b40 fffff880`01a6922a : fffff880`01a68350 fffffa80`1d81af20 00000000`00000502 fffff880`01a68e00 : nt!KeExpandKernelStackAndCalloutEx+0xd8

fffff800`03650c20 fffff880`0436b7be : fffffa80`3934f3e0 fffffa80`1fd537e0 fffffa80`1fd537e0 fffffa80`1fd537e0 : tcpip!TcpTlConnectionSend+0x7a

fffff800`03650c90 fffff880`0436f7b4 : fffffa80`1ffa4b50 fffff880`01a70000 fffffa80`389cc280 fffff800`03650f00 : afd!AfdTLTPacketsSend+0x47e

fffff800`03650e20 fffff880`0436fe83 : fffffa80`48c0b110 00000000`00000001 fffffa80`1c78a380 fffffa80`1ffa4cf8 : afd!AfdTPacketsSend+0x64

fffff800`03650e90 fffff880`01a4e9c0 : 00000000`00010000 fffffa80`1b4930a0 fffffa80`1f705e90 fffff800`03651158 : afd!AfdCommonRestartTPacketsSend+0x173

fffff800`03650ec0 fffff880`01a64fa8 : 00000000`00000000 fffff800`03651158 fffffa80`1b4930a0 fffff880`00000000 : tcpip!TcpCompleteTcbSend+0x40

fffff800`03650ef0 fffff880`01a6299a : fffffa80`2138dcf0 fffffa80`38854000 fffffa80`1b0a3400 fffffa80`1b6202a0 : tcpip!TcpTcbReceive+0x3ec

fffff800`03651000 fffff880`01a637fc : fffffa80`1cc457ac fffffa80`1b4930a0 fffffa80`1b4930a0 00000000`00000000 : tcpip!TcpMatchReceive+0x1fa

fffff800`03651150 fffff880`01a4667c : fffffa80`1b4946f0 00000000`00000000 fffffa80`00000004 fffffa80`1c745740 : tcpip!TcpPreValidatedReceive+0x49c

fffff800`03651220 fffff880`01a57712 : fffffa80`1c7c3010 fffffa80`1c783ba0 fffffa80`1c780006 00000000`00000006 : tcpip!IpFlcReceivePreValidatedPackets+0x5bc

fffff800`03651380 fffff800`01e8e1f8 : 00000000`00000000 00000000`00004800 fffff800`0200ecc0 00000000`00000000 : tcpip!FlReceiveNetBufferListChainCalloutRoutine+0xa2

fffff800`036513d0 fffff880`01a57e42 : fffff880`01a57670 fffff880`01a6959a 00000000`00000002 fffffa80`1b0c0d00 : nt!KeExpandKernelStackAndCalloutEx+0xd8

fffff800`036514b0 fffff880`00ee20eb : fffffa80`1c773010 00000000`00000000 fffffa80`1c6bd1a0 00000000`0000f800 : tcpip!FlReceiveNetBufferListChain+0xb2

fffff800`03651520 fffff880`00eabad6 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : NDIS!ndisMIndicateNetBufferListsToOpen+0xdb

fffff800`03651590 fffff880`00e25ac1 : fffffa80`1c6bd1a0 00000000`00000002 00000000`00000004 00000000`00000000 : NDIS!ndisMDispatchReceiveNetBufferLists+0x1d6

fffff800`03651a10 fffff880`05382f33 : fffffa80`481a2000 00000000`00000004 fffffa80`1a00caa0 fffffa80`481a2dc0 : NDIS!NdisMIndicateReceiveNetBufferLists+0xc1

fffff800`03651a60 fffff880`05383101 : 00000000`00000001 fffffa80`1a00caa0 fffffa80`1c6c3e20 fffffa80`481a2000 : e1r62x64+0x23f33

fffff800`03651aa0 fffff880`053746e6 : 00000000`00000000 fffffa80`481a2040 00000000`00008000 ffff821b`00000000 : e1r62x64+0x24101

fffff800`03651b20 fffff880`053744a0 : fffffa80`1b8b7730 ffff0001`00000000 ffff0001`00000000 fffff880`00eab488 : e1r62x64+0x156e6

fffff800`03651b90 fffff880`05376628 : 00000000`00000000 ffff0001`00000000 00000000`00000000 00000000`00000000 : e1r62x64+0x154a0

fffff800`03651c00 fffff880`00e25951 : 00000000`001bbf1e 00000000`00000000 00000000`00000000 fffff800`0364b080 : e1r62x64+0x17628

fffff800`03651c40 fffff800`01e8d1dc : fffffa80`1cbb9918 00000023`00000000 00000000`00000000 fffff800`02000e80 : NDIS!ndisInterruptDpc+0x151

fffff800`03651cd0 fffff800`01e795ca : fffff800`02000e80 fffff800`0200ecc0 00000000`00000000 fffff880`00e25800 : nt!KiRetireDpcList+0x1bc

fffff800`03651d80 00000000`00000000 : fffff800`03652000 fffff800`0364c000 fffff800`03651d40 00000000`00000000 : nt!KiIdleLoop+0x5a

Please let us know if we were using older version of driver which leads to this error. If so please specify where to get the latest.

Also from the windows event viewer we got event as Microsoft.WIndows.Kernal.General with event ID as 12 sometimes and 41 sometimes and even 1 sometimes.

thanks.

Muralidhar

0 Kudos
12 Replies
idata
Community Manager
274 Views

Hi Muralidhar,

 

 

Thank you for contacting Intel.

 

 

Please try the using the latest driver. You may download from the link below

 

Latest: 21.0

 

https://downloadcenter.intel.com/product/59061/Intel-Ethernet-Server-Adapter-I350-Series

 

 

Sincerely,

 

Sandy
MMura11
Beginner
274 Views

The driver is already updated with latest driver version. Still BSOD is happening.

Checked the current version of driver "elr62x64.sys" for Intel(R) Ethernet server Adapter I350-T2 NDIS 6.x driver.

file version is 12.13.27.0

Call stack still indicate the failure at this driver.

Do this also mean that any third party drivers using this driver might cause this BSOD.

The event viewer show the bug check code 0x1D

The event logs had the error ( Event ID 41) – Kernel power error code.

Also we saw some connection problems in the SAN dick due to faulty cables.

Since the DB is present in SAN ,we observe some connection errors in DB calls,followed by application calls which after sometime leads to this BSOD due to tcpip.sys.

Do you have any clue on this? Where do i need to looks further on this?

I have the list of the driver installed.

Created by using http://www.nirsoft.net/ DriverView

Driver Name Address End Address Size Load Count Index File Type Description Version Company Product Name Modified Date Created Date Filename File Attributes Service Name Service Display Name Digital Signature ACPI.sys00000000`011A500000000000`011FC0000x00057000112System DriverACPI Driver for NT6.1.7601.17514Microsoft CorporationMicrosoft® Windows® Operating System11/21/2010 11:24:00 AM11/21/2010 11:24:00 AMC:\Windows\system32\drivers\ACPI.sysAACPIMicrosoft ACPI Driver afd.sys00000000`05CE000000000000`05D690000x00089000188System DriverAncillary Function Driver for WinSock6.1.7601.23237Microsoft CorporationMicrosoft® Windows® Operating System10/14/2015 8:50:39 AM7/8/2016 4:10:00 PMC:\Windows\system32\drivers\afd.sysAAFDAncillary Function Driver for Winsock AgileVpn.sys00000000`05C8700000000000`05C9D0000x00016000196Network DriverRAS Agile Vpn Miniport Call Manager6.1.7600.16385Microsoft CorporationMicrosoft® Windows® Operating System7/14/2009 8:10:24 AM7/14/2009 8:10:24 AMC:\Windows\system32\DRIVERS\AgileVpn.sysARasAgileVpnWAN Miniport (IKEv2) amdxata.sys00000000`0138900000000000`013940000x0000b000144System DriverStorage Filter Driver1.1.2.5Advanced Micr...
idata
Community Manager
274 Views

Hi Muralidhar,

 

 

Please provide your specific network card model. Is it integrated to the motherboard or a separate card? Kindly provide the motherboard/system model.

 

 

Thanks.

 

 

Sincerely,

 

Sandy
MMura11
Beginner
274 Views

The network card model is Intel R Gigabit 2P I350-t Adapter The server type is IBM server 350 xseries

MMura11
Beginner
274 Views

OS Name Microsoft Windows Server 2008 R2 Enterprise Version 6.1.7601 Service Pack 1 Build 7601 Other OS Description Not Available OS Manufacturer Microsoft Corporation System Name PLAZA1 System Manufacturer IBM System Model System x3850 X5 -[7143XEF]- System Type x64-based PC Processor Intel(R) Xeon(R) CPU E7- 4807 @ 1.87GHz, 1862 Mhz, 6 Core(s), 12 Logical Processor(s) Processor Intel(R) Xeon(R) CPU E7- 4807 @ 1.87GHz, 1862 Mhz, 6 Core(s), 12 Logical Processor(s) Processor Intel(R) Xeon(R) CPU E7- 4807 @ 1.87GHz, 1862 Mhz, 6 Core(s), 12 Logical Processor(s) Processor Intel(R) Xeon(R) CPU E7- 4807 @ 1.87GHz, 1862 Mhz, 6 Core(s), 12 Logical Processor(s) BIOS Version/Date IBM Corp. -[G0E185AUS-1.85]-, 4/22/2015 SMBIOS Version 2.7 Windows Directory C:\Windows System Directory C:\Windows\system32 Boot Device \Device\HarddiskVolume1 Locale United States Hardware Abstraction Layer Version = "6.1.7601.17514" User Name Not Available Time Zone China Standard Time Installed Physical Memory (RAM) 32.0 GB Total Physical Memory 32.0 GB Available Physical Memory 16.1 GB Total Virtual Memory 80.8 GB Available Virtual Memory 64.0 GB Page File Space 48.8 GB Page File C:\pagefile.sys

MMura11
Beginner
274 Views

Some more information regarding the network card and Winsock from System Info. [Network] [Adapter] Item Value Name [00000000] WAN Miniport (SSTP) Adapter Type Not Available Product Type WAN Miniport (SSTP) Installed Yes PNP Device ID ROOT\MS_SSTPMINIPORT\0000 Last Reset 7/18/2016 11:19 PM Index 0 Service Name RasSstp IP Address Not Available IP Subnet Not Available Default IP Gateway Not Available DHCP Enabled No DHCP Server Not Available DHCP Lease Expires Not Available DHCP Lease Obtained Not Available MAC Address Not Available Driver c:\windows\system32\drivers\rassstp.sys (6.1.7600.16385, 82.00 KB (83,968 bytes), 7/14/2009 8:10 AM) Name [00000001] WAN Miniport (IKEv2) Adapter Type Not Available Product Type WAN Miniport (IKEv2) Installed Yes PNP Device ID ROOT\MS_AGILEVPNMINIPORT\0000 Last Reset 7/18/2016 11:19 PM Index 1 Service Name RasAgileVpn IP Address Not Available IP Subnet Not Available Default IP Gateway Not Available DHCP Enabled No DHCP Server Not Available DHCP Lease Expires Not Available DHCP Lease Obtained Not Available MAC Address Not Available Driver c:\windows\system32\drivers\agilevpn.sys (6.1.7600.16385, 59.00 KB (60,416 bytes), 7/14/2009 8:10 AM) Name [00000002] WAN Miniport (L2TP) Adapter Type Not Available Product Type WAN Miniport (L2TP) Installed Yes PNP Device ID ROOT\MS_L2TPMINIPORT\0000 Last Reset 7/18/2016 11:19 PM Index 2 Service Name Rasl2tp IP Address Not Available IP Subnet Not Available Default IP Gateway Not Available DHCP Enabled No DHCP Server Not Available DHCP Lease Expires Not Available DHCP Lease Obtained Not Available MAC Address Not Available Driver c:\windows\system32\drivers\rasl2tp.sys (6.1.7601.17514, 126.50 KB (129,536 bytes), 11/21/2010 11:24 AM) Name [00000003] WAN Miniport (PPTP) Adapter Type Not Available Product Type WAN Miniport (PPTP) Installed Yes PNP Device ID ROOT\MS_PPTPMINIPORT\0000 Last Reset 7/18/2016 11:19 PM Index 3 Service Name PptpMiniport IP Address Not Available IP Subnet Not Available Default IP Gateway Not Available DHCP Enabled No DHCP Server Not Available DHCP Lease Expires Not Available DHCP Lease Obtained Not Available MAC Address Not Available Driver c:\windows\system32\drivers\raspptp.sys (6.1.7601.17514, 108.50 KB (111,104 bytes), 11/21/2010 11:24 AM) Name [00000004] WAN Miniport (PPPOE) Adapter Type Not Available Product Type WAN Miniport (PPPOE) Installed Yes PNP Device ID ROOT\MS_PPPOEMINIPORT\0000 Last Reset 7/18/2016 11:19 PM Index 4 Service Name RasPppoe IP Address Not Available IP Subnet Not Available Default IP Gateway Not Available DHCP Enabled No DHCP Server Not Available DHCP Lease Expires Not Available DHCP Lease Obtained Not Available MAC Address Not Available Driver c:\windows\system32\drivers\raspppoe.sys (6.1.7600.16385, 90.50 KB (92,672 bytes), 7/14/2009 8:10 AM) Name [00000005] WAN Miniport (IPv6) Adapter Type Not Available Product Type WAN Miniport (IPv6) Installed Yes PNP Device ID ROOT\MS_NDISWANIPV6\0000 Last Reset 7/18/2016 11:19 PM Index 5 Service Name NdisWan IP Address Not Available IP Subnet Not Available Default IP Gateway Not Available DHCP Enabled No DHCP Server Not Available DHCP Lease Expires Not Available DHCP Lease Obtained Not Available MAC Address Not Available Driver c:\windows\system32\drivers\ndiswan.sys (6.1.7601.17514, 160.50 KB (164,352 bytes), 11/21/2010 11:24 AM) Name [00000006] WAN Miniport (Network Monitor) Adapter Type Not Available Product Type WAN Miniport (Network Monitor) Installed Yes PNP Device ID ROOT\MS_NDISWANBH\0000 Last Reset 7/18/2016 11:19 PM Index 6 Service Name NdisWan IP Address Not Available IP Subnet Not Available Default IP Gateway Not Available DHCP Enabled No DHCP Server Not Available DHCP Lease Expires Not Available DHCP Lease Obtained Not Available MAC Address Not Available Driver c:\windows\system32\drivers\ndiswan.sys (6.1.7601.17514, 160.50 KB (164,352 bytes), 11/21/2010 11:24 AM) Name [00000007] QLogic BCM5709C Gigabit Ethernet (NDIS VBD Client) Adapter Type Not Available Product Type QLogic BCM5709C Gigabit Ethernet (NDIS VBD Client) Installed Yes PNP Device ID B06BDRV\L2ND&PCI_163914E4&SUBSYS_03B51014&REV_20\5&2DBE003&0&20050400 Last Reset 7/18/2016 11:19 PM Index 7 Service Name l2nd IP Address Not Available IP Subnet Not Available Default IP Gateway Not Available DHCP Enabled No DHCP Server Not Available DHCP Lease Expires Not Available DHCP Lease Obtained Not Available MAC Address Not Available Driver c:\windows\system32\drivers\bxnd60a.sys (7.12.3.0, 131.73 KB (134,896 bytes), 2/12/2015 2:48 AM) Name [00000008] QLogic BCM5709C Gigabit Ethernet (NDIS VBD Client) Adapter Type Not Available Product Type QLogic BCM5709C Gigabit Ethernet (NDIS VBD Client) Installed Yes PNP Device ID B06BDRV\L2ND&PCI_163914E4&SUBSYS_03B51014&REV_20\5&2D319690&0&20050400 Last Reset 7/18/2016 11:19 PM Index 8 Service Name l2nd IP Address Not Available IP Subnet Not Available Default IP Gateway Not Available DHCP Enabled Yes DHCP Server Not Available DHCP Lease Expires Not Available DHCP Lease Obtained Not Available MAC Address Not Available Driver c:\windows\system32\drivers\bxnd60a.sys (7.12.3.0, 131.73 KB (134,896 bytes), 2/12/2015 2:48 AM) Name [00000009] WAN Miniport (IP) Adapter Type Not Available Product Type WAN Miniport (IP) Installed Yes PNP Device ID ROOT\MS_NDISWANIP\0000 Last Reset 7/18/2016 11:19 PM Index 9 Service Name NdisWan IP Address Not Available IP Subnet Not Available Default IP Gateway Not Available DHCP Enabled No DHCP Server Not Available DHCP Lease Expires Not Available DHCP Lease Obtained Not Available MAC Address Not Available Driver c:\windows\system32\drivers\ndiswan.sys (6.1.7601.17514, 160.50 KB (164,352 bytes), 11/21/2010 11:24 AM) Name [00000010] Remote NDIS based Internet Sharing Device Adapter Type Not Available Product Type Remote NDIS based Internet Sharing Device Installed Yes PNP Device ID Not Available Last Reset 7/18/2016 11:19 PM Index 10 Service Name usb_rndisx IP Address Not Available IP Subnet Not Available Default IP Gateway Not Available DHCP Enabled Yes DHCP Server Not Available DHCP Lease Expires Not Available DHCP Lease Obtained Not Available MAC Address Not Available Name [00000011] RAS Async Adapter Adapter Type Not Available Product Type RAS Async Adapter Installed Yes PNP Device ID Not Available Last Reset 7/18/2016 11:19 PM Index 11 Service Name AsyncMac IP Address Not Available IP Subnet Not Available Default IP Gateway Not Available DHCP Enabled No DHCP Server Not Available DHCP Lease Expires Not Available DHCP Lease Obtained Not Available MAC Address Not Available Name [00000012] Microsoft ISATAP Adapter Adapter Type Tunnel Product Type Microsoft ISATAP Adapter Installed Yes PNP Device ID ROOT\*ISATAP\0000 Last Reset 7/18/2016 11:19 PM Index 12 Service Name tunnel IP Address Not Available IP Subnet Not Available Default IP Gateway Not Available DHCP Enabled No DHCP Server Not Available DHCP Lease Expires Not Available DHCP Lease Obtained Not Available MAC Address Not Available Driver c:\windows\system32\drivers\tunnel.sys (6.1.7601.17514, 122.50 KB (125,440 bytes), 11/21/2010 11:24 AM) Name [00000013] IBM USB Remote NDIS Network Device Adapter Type Not Available Product Type IBM USB Remote NDIS Network Device Installed Yes PNP Device ID USB\VID_04B3&PID_4010\5&25638ACF&0&2 Last Reset 7/18/2016 11:19 PM Index 13 Service Name usbrndis6 IP Address Not Available IP Subnet Not Available Default IP Gateway Not Available DHCP Enabled Yes DHCP Server Not Available DHCP Lease Expires Not Available DHCP Lease Obtained Not Available MAC Address Not Available Driver c:\windows\system32\drivers\usb80236.sys (6.1.7601.18076, 19.50 KB (19,968 bytes), 8/10/2015 8:18 PM) Name [00000014] Microsoft ISATAP Adapter Adapter Type Tunnel Product Type Microsoft ISATAP Adapter Installed Yes PNP Device ID ROOT\*ISATAP\0001 Last Reset 7/18/2016 11:19 PM Index 14 Service Name tunnel IP Address Not Available IP Subnet Not Available Default IP Gateway Not Available DHCP Enabled No DHCP Server Not Available DHCP Lease Expires Not Available DHCP Lease Obtained Not Available MAC Address Not Available Driver c:\windows\system32\drivers\tunnel.sys (6.1.7601.17514, 122.50 KB (125,440 bytes), 11/21/2010 11:24 AM) Name [00000015] Intel(R) Gigabit 2P I350-t Adapter Adapter Type Ethernet 802.3 Product Type Intel(R) Gigabit 2P I350-t Adapter Installed Yes PNP Device ID PCI\VEN_8086&DEV_1521&SUBSYS_50028086&REV_01\A0369FFFFF5E2E4C00 Last Reset 7/18/2016 11:19 PM Index 15 Service Name e1rexpress IP Address 172.17.0.48, 172.17.0.47, 172.17.0.41, 172.17.0.45 IP Subnet 255.255.255.0, 255.255.255.0, 255.255.255.0, 255.255.255.0 Default IP Gateway 172.17.0.254 DH...

MMura11
Beginner
274 Views

If you need dump file and full system information ,we can upload based if you provide a link for the same.

SYeo3
Valued Contributor I
274 Views

Hello Yack123,

Thank you for providing the details. We'll be looking into the dumps you've provided.

While we are checking on this, please provide the serial number of your adapter. Sample picture of serial number below:

Sincerely,

Sandy

MMura11
Beginner
274 Views

Hi Sandy it is taking some time to get the Serial number from the site. till we get the serial number , would it be possible to analyse the dumps? please let us know how to share the dumps to you? thanks

MMura11
Beginner
274 Views

Above screenshots contains the serial number of NIC cards.

Can you please let us know what could be the problem that leads to random BSOD's

Regards,

Yack

idata
Community Manager
274 Views

Hi Muralidhar,

 

 

Thank you for providing the serial # and apologize for the delay. we will look into this.

 

 

rgds,

 

wb

 

idata
Community Manager
274 Views

Hi Muralidhar,

 

 

Please provide further information for investigation:

 

1) As mentioned BSOD occurs while running certain application, does it have the same issue if the application is not activated on his win2k8 system?

 

 

2. if the IBM system x3850 X5 comes with onboard network adapter, does it have the same issue when running the application?

 

 

3. Please send us the SSU output. You may download the SSU from

 

https://downloadcenter.intel.com/download/25293/Intel-System-Support-Utility

 

 

 

4. We have lower version of driver version 12.11.97.0 in package 19.5, in case you want to try

 

this lower version to test

 

 

https://downloadcenter.intel.com/download/24766/Intel-Network-Adapter-Driver-for-Windows-Server-2008...

 

 

 

Looking forward to your update.

 

 

rgds,

 

wb
Reply