topic I219-LM UDP Transport Issue in Ethernet Products

I219-LM UDP Transport Issue

JPhil5 — Wed, 13 Dec 2017 21:31:37 GMT

We have procured over a dozen NUC6i7KYK (mfg 07/2017) to act as a receiver of a moderate rate (~320Mbps) UDP stream of data. We have found that the I219-LM adapter is dropping packets. We have been able to replicate the issue using the iperf tool. For the application (and for my troubleshooting tests) the NUC will be direct connected to the data source via a new, short (~1m), patch cord.

We have the latest BIOS (KYSKLi70.86A.0050.2017.0831.1924) and we are using Ubuntu 16.04.3. We have also tried Ubuntu 16.04.2 and 17.10. We have tried the distro provided e1000e 3.2.6-k driver as well as the latest e1000e 3.3.6 driver.

We have set net.core.rmem_max to 33554432 and net.core.wmem_max to 576000.

We have set coalescence to zero: ethtool -C eno1 rx-usecs 0.

We have maxed the receive ring buffer: ethtool -G eno1 rx 4096.

We have ensured max CPU frequency via cpufreq setting it to "performance".

Data loss is non-deterministic and sometimes happens immediately, after several minutes, or several hours. Typically it is a single missing packet. We can not afford any lost data.

I had a ZBOX-CI323NANO with openSuSE 42.3 on it. This low performance device has Realtek RTL8111/8168/8411 PCIe GbE adapters. It received UDP data with zero losses. That's the sort of results I expect from this NUC.

It has net.core.rmem_max and net.core.wmem_max set to 16777216.

We also have used a Pluggable USB3.0 GbE adapter. It also runs with no lost data - however, it tends to "go away" after indeterminate periods of time - not sure if that's a NUC, OS, or pluggable issue.

I saw this thread that looks familiar to my problem:

When I run wireshark, occasionally I see the interpacket gap be ~10ms instead of the typical handful of microseconds.

Re: I219-LM UDP Transport Issue

idata — Thu, 14 Dec 2017 03:43:20 GMT

Hi Jgplmco,

Thank you for posting in Wired Communities. Please try use this driver from sourceforge to see if this will be of help. Please feel free to update me.

https://sourceforge.net/projects/e1000/files/e1000e%20stable/3.4.0.2/

Thanks,

Sharon

Re: I219-LM UDP Transport Issue

JPhil5 — Thu, 14 Dec 2017 19:15:07 GMT

Thanks, Sharon.

I tried driver version 3.4.0.2 and got the same results - dropped packets.

Sincerely,

Jason

Re: I219-LM UDP Transport Issue

idata — Fri, 15 Dec 2017 04:14:14 GMT

Hi Jgplmco,

Thank you for the update. I will further check.

Regards,

Sharon

Re: I219-LM UDP Transport Issue

idata — Mon, 18 Dec 2017 09:20:49 GMT

Hi Jgplmco,

Please try updating the driver to 3.4.0.2 at https://sourceforge.net/projects/e1000/files/e1000e%20stable/3.4.0.2/, if problem still persists, please provide ethtool -k output.Thank you.

Regards,

Sharon

Re: I219-LM UDP Transport Issue

idata — Tue, 26 Dec 2017 08:40:44 GMT

Hi Jgplmco,

Please feel free to update me. Thanks.

Regards,

Sharon

Re: I219-LM UDP Transport Issue

JPhil5 — Mon, 08 Jan 2018 17:04:12 GMT

Sharon,

Apologies...I was out for a couple weeks. As I indicated earlier, that driver did not solve the issue. I will upload the output of ethtool when I get a chance.

Thanks,

Jason

Re: I219-LM UDP Transport Issue

idata — Tue, 09 Jan 2018 01:35:02 GMT

HI Jgplmco,

Thank you for the update. Please feel free to provide the ethtool output when it is available.

Thanks,

Sharon T

Re: I219-LM UDP Transport Issue

JPhil5 — Wed, 10 Jan 2018 21:52:50 GMT

output attached

Re: I219-LM UDP Transport Issue

idata — Thu, 11 Jan 2018 03:18:39 GMT

Hi Jgplmco,

Thank you for the information. I will check on this.

Regards,

Sharon T

Re: I219-LM UDP Transport Issue

idata — Wed, 17 Jan 2018 02:55:00 GMT

Hi Jgplmco,

Please try to change the InterruptThrottleRate to "0" by using the following command:

modprobe e1000e InterruptThrottleRate=0

Thanks,

Sharon T

Re: I219-LM UDP Transport Issue

idata — Thu, 25 Jan 2018 03:48:05 GMT

Hi Jgplmco,

Please feel free to update me the result. Thanks.

Regards,

Sharon T

Re: I219-LM UDP Transport Issue

JPhil5 — Thu, 25 Jan 2018 20:04:07 GMT

I performed that action and still see dropped packets using iperf.

Re: I219-LM UDP Transport Issue

idata — Fri, 26 Jan 2018 09:26:06 GMT

Hi Jgplmco,

Thank you for the update. I will further check.

Regards,

Sharon T

Re: I219-LM UDP Transport Issue

idata — Wed, 31 Jan 2018 09:40:41 GMT

Hi Jgplmco,

Can you try disabling the TCP checksums setting?

Thanks,

Sharon T

Re: I219-LM UDP Transport Issue

idata — Wed, 07 Feb 2018 03:37:50 GMT

Hi Jgplmco,

Please feel free to update me if you have tried the command.

Regards,

Sharon T