Ethernet Products
Determine ramifications of Intel® Ethernet products and technologies
5575 Discussions

TX driver issue detected, PF reset issued

doordie
Novice
5,204 Views

 

Hi, guys:

      We encountered a PF reset issue at production environtment.  The messages (Debian Linux) is like as below:

doordie_0-1681491181551.png

The driver/Nvm is like this 6.01/2.4.10:

331681491002_.pic.jpg

According to intel, it is supposed to work well. But we have no luck.

341681491013_.pic.jpg

Then we try to upgrade the driver to 2.14.13.

351681491034_.pic.jpg

 

After running roughly one day, we got the error below.

doordie_0-1681516940516.png

 

Why did this happen?!

 

Any help or clue will be appreciated! Thank you.

 

Best wishes.

 

0 Kudos
10 Replies
Irwan_Intel
Moderator
5,132 Views

Hi doordie,


Thank you for posting in Intel Ethernet Communities.


In order for us to further investigate the issue, we would like addtional info such as below:


1) What is your system model and Debian version, kernel version?

2) Can you provide us more details of the NIC card model, please provide picture of the NIC card focusing on the markings on board.


The latest Intel generic firmware is V9.20 and the driver version 2.22.18. Have you try updating the drivers and firmware and see if the issues persist.

https://www.intel.com/content/www/us/en/products/details/ethernet/700-network-adapters/x710-network-adapters/downloads.html


Notes: From your screenshot, NVM i40e (Linux)*1

*1 = These are out-of-tree versions.


Looking forward to your reply.


Thanks,

Irwan_Intel


0 Kudos
doordie
Novice
5,124 Views

Hi Irwan_intel:

       Thank you for your reply. 

 

      1),  We use brctl to create a virtual bridge consisting of two x710 ports to forward packets(No lacp).  It's Debian 10.6 with kernel 4.20.1.

      2),  The Nic is this: "Ethernet Converged Network Adapter X710"

doordie_4-1681712697318.png

doordie_5-1681712787190.png

 

doordie_0-1681711608008.png

doordie_1-1681711766734.png

https://pci-ids.ucw.cz/read/PC/8086/1572

 

I tried the latest driver (2.22.18),but it's not supported by the kernel. See below:

doordie_2-1681712127684.png

 

Again, NVM/driver: 6.01/2.14.13.  Here is some the messages.

企业微信截图_c6eeb0df-e3c0-4c57-893f-7d3a93dfbb57.png

I'm not sure if the mismatch of nvm&driver will still cause the up/down issue. Perhaps I should give it a try later.

 

Waiting for your reply.

Thank you.

 

0 Kudos
Irwan_Intel
Moderator
4,340 Views

Hi doordie,


According to our next level, I40e driver doesn't support Debian 10, and it's possible that the newest driver may not work as expected. 

However, we suggest that you use the in-kernel Debian driver instead.


We also noticed that the NVM version you are currently using is quite old. Have you tried updating the NVM to see if that makes a difference? An updated NVM version can often resolve compatibility issues with newer drivers.


https://www.intel.com/content/www/us/en/download/18190/non-volatile-memory-nvm-update-utility-for-intel-ethernet-network-adapter-700-series.html


Please let us know if updating the NVM helps resolve your issue or if you have any further questions or concerns.


Regards,

Irwan_Intel 


0 Kudos
doordie
Novice
4,329 Views

Hi Irwan_Intel,

         Thanks a lot for your help. Last night we updated the NVM and everything looks fine until now. But what worries me is that the root cause of all the issues. 

         First of all,  the nvm/driver should match each other according to the table  offered by intel. It is not easy for me to know if it's a chip bug or not.  Do you guys have methods to help us deal with these problems?  Any analysing tools?   At the very begining, we changed the wire and sfp modules.

         BTW, there is anything new, we will let you know. 

   

 Thank you.

  Regards,

  doordie.

0 Kudos
Irwan_Intel
Moderator
4,301 Views

Hi doordie,


We're glad to hear that updating the NVM helped resolve the issues you were experiencing. 

However, we understand your concern about the NVM/driver compatibility in the list.

I will check with our next level to see if there is any method or tools that can help to rectify the issue.


Also, we appreciate your updates and please don't hesitate to reach out to us if anything changes.


Regards,

Irwan_Intel


doordie
Novice
4,257 Views

Hi, Irwan_intel:

       Bad news!    The port  went down again.

       

doordie_0-1682065810069.png

 

     I'm working on it!

 

 

     Thank you.

0 Kudos
Irwan_Intel
Moderator
4,162 Views

Hi doordie,


I'm sorry to hear that the port went down again. Can you provide some more information about the situation? Have you tried any troubleshooting steps?


Look forward to your reply.


Regards,

Irwan_Intel


0 Kudos
doordie
Novice
4,159 Views

Hi, Irwan_Intel:  

                    Thank you for asking. Actually we don't have any clue. But I did below on 21, April.   

                /sbin/ethtool -K ens1f0 tso off gro off gso off
                /sbin/ethtool -K ens1f1 tso off gro off gso off
                /sbin/ethtool -G ens1f0 rx 4096 tx 4096
                /sbin/ethtool -G ens1f1 rx 4096 tx 4096

                     Don't know exactly the root cause, just try it. Everything is fine since then, we'll let you know if there is anythin new.  

           

         Regards.

         doordie

0 Kudos
Irwan_Intel
Moderator
4,106 Views

Hi doordie,


I hope this message finds you well. I wanted to follow up with you regarding this issue. I wanted to see if there have been any updates or if there is anything I can assist with.


Please let me know if there is anything I can do to help or if you have any new information to share. Thank you and have a great day!


Best regards,

Irwan_Intel


0 Kudos
Irwan_Intel
Moderator
3,965 Views

Dear doordie,


I hope this message finds you well.


Regarding your issue, I would like to inform you that I have reviewed your issue and it seems that the matter has been resolved.

If you have any further questions or concerns, please don't hesitate to reach out to me. Otherwise, I will be closing this ticket now.


Thank you for your time and have a great day!


Best regards,

Irwan_Intel


0 Kudos
Reply