topic Queue issue about XL710 in Ethernet Products

Queue issue about XL710

JWang113 — Wed, 24 Feb 2016 04:34:03 GMT

Hi,

I met some issues with XL710 NIC on FreeBSD10.1.

The NIC is a dual-port 40G card with the latest NVM image. CPU is 2690 V2 with hyperthreading to 40 logical cores.

Part number as XL710-QDA2 932587.

Firmware info: f5.0 a1.5 n05.02 e80002285

Driver info: 1.4.8.

Issue1:

Within 20 queues only 16 of them are receiving packets (que0 - que15),

Que16-que19 are generating interrupt but no packet available, status/error register value are all 0.

AN# sysctl dev.ixl.2 | grep rx_packet

dev.ixl.2.pf.que0.rx_packets: 8805610

dev.ixl.2.pf.que1.rx_packets: 9348787

dev.ixl.2.pf.que2.rx_packets: 8505388

dev.ixl.2.pf.que3.rx_packets: 9928934

dev.ixl.2.pf.que4.rx_packets: 3879181

dev.ixl.2.pf.que5.rx_packets: 5579101

dev.ixl.2.pf.que6.rx_packets: 4322241

dev.ixl.2.pf.que7.rx_packets: 5788389

dev.ixl.2.pf.que8.rx_packets: 5575891

dev.ixl.2.pf.que9.rx_packets: 3743182

dev.ixl.2.pf.que10.rx_packets: 4127868

dev.ixl.2.pf.que11.rx_packets: 3878214

dev.ixl.2.pf.que12.rx_packets: 4013070

dev.ixl.2.pf.que13.rx_packets: 5146686

dev.ixl.2.pf.que14.rx_packets: 4024729

dev.ixl.2.pf.que15.rx_packets: 4736103

dev.ixl.2.pf.que16.rx_packets: 0

dev.ixl.2.pf.que17.rx_packets: 0

dev.ixl.2.pf.que18.rx_packets: 0

dev.ixl.2.pf.que19.rx_packets: 0

Issue2:

The NIC may hang under heavy stress, like putting 60Gbps traffic into it.

It may stop generating interrupt in such case.

Could you please help check the above issues?

Great thanks.

Regards,

Jingxun

Re: Queue issue about XL710

st4 — Wed, 24 Feb 2016 08:33:48 GMT

Hi Jingxun

Let me look into this.

rgds,

Re: Queue issue about XL710

JWang113 — Wed, 24 Feb 2016 10:50:06 GMT

Thanks, wb_Intel.

I think I have resolved issue1, the HASHLUTSIZE is set as 128 in driver 1.4.8.

Now only issue2 need a fix, about NIC hang in overload status.

Thanks.

Re: Queue issue about XL710

st4 — Fri, 04 Mar 2016 09:44:55 GMT

Hi fishingbear2,

Just to double check what is the connection you have for this NICS? direct attach cable or fiber optic cable LR , SR or CR?

thanks,

Re: Queue issue about XL710

st4 — Fri, 11 Mar 2016 00:57:00 GMT

HI fishingbear2,

Can you also provide me the steps how you reproduce the issue. e.g the connection, the switch and how you send and data, need more detail to check on this.

thanks,

Re: Queue issue about XL710

JWang113 — Fri, 20 May 2016 07:39:34 GMT

Hi wb_intel,

This issue has been fixed by seting correct tc_mapping.

Thanks for your support.

Regards,