[X710] Secondary ip address doesn't answer arp anymore

[bgorz]

Hello.

We have 2 servers using X70 nics (Debian Jessie, Kernel 4.14.15).

On each interface we have two ip on same subnet.

Randomly, the secondary ip address doesn't answer to arp request anymore.

The only solution we have to fix the problem is to manually send arp announcements over the network using a script (while true, sendarp).

There is no proxy arp on neighbors.

# ethtool -i eth0

driver: i40e

version: 2.1.14-k

firmware-version: 6.01 0x80003485 1.1747.0

bus-info: 0000:82:00.0

supports-statistics: yes

supports-test: yes

supports-eeprom-access: yes

supports-register-dump: yes

supports-priv-flags: yes

This issue occurs on both servers, and we have same software configuration on a lot sites, and the problem appear only when there is X710 nics.

Anyone already had this problem ?

Kind regards

[idata]

Hi Vesla,

Thank you for posting in Wired Communities. Please confirm if the X710 NIC is a standalone network adapter installed on the system or embedded NIC? When you run the arp-an command, are you referring to the result will show you only one IP address (the first IP) or the same IP address for both port?Thanks,Sharon T

[bgorz]

Hi thanks for your answer and sorry for my english.

It's a standalone on PCIe board.

This is a layer 2 issue so i cant see mac corresponding to secondary address.

When we add arp -s from another server, we are able to join the address.

When we remove arp -d from another server, we can't join the address.

There is no more arp answer from the server.

[idata]

Hi Vesla,

Thank you for the information. In order to better assist you, please provide further information for clarification :1) Are you using a Dual port X710 NIC? e.g X710-DA2? 2) For port 1 and port 2 on the same NIC, you assigned two respective IP. e.g. port 1=192.168.1.1 port 2=192.168.1.2. When you try arp command, you were only able to obtain the MAC for port 1 (192.168.1.1) but not port 24) Are you able to ping both ports? If yes, what is the reply from the port 1 and port 2?5) What you mean is when you run arp-s to add the IP and MAC in the arp table, you are able to get the MAC if you run the arp command. However after you run the arp-d to delete the entry, you will not obtain the MAC address of port 2. Please confirm if the above information are correct. Thanks,Sharon T

[bgorz]

Hi thanks for your answer.

Sorry i didn't explained clearly.

The card have 4 ports : X710T4.

The problem occurs on only one port at same time.

There is a primary IP on port 1 (192.168.0.1) and a Virtual IP (same mac, not vrrp) still on port 1 (192.168.0.3).

The two IP are assigned on same interface.

From an other server on same vlan during problem :

I try to ping the VIP 192.168.0.3 -> no response, no dynamic arp entry.

If I fix arp entry : arp -s 00:00:00:00:01 192.168.0.3 -> Ping working

Sometimes, the problem can happen on the primary ip too.

Generally :

I known there is a lot of features on this NIC eg I had an lldp problem solved by this

echo lldp stop > /sys/kernel/debug/i40e//command

I need a complete documentation about features enabled by default or other feature I can enable.

This documentation isn't enough (nothing about debug/command or lldp) https://downloadmirror.intel.com/24411/eng/readme.txt https://downloadmirror.intel.com/24411/eng/readme.txt

Do you know where I can find a real documentation to solve my problem ?

[idata]

HI Vesla,

Thank you for the additional information. Just to double check if you are using KVM thus there is virtual IP assigned to the port.Thanks,Sharon T

[bgorz]

Hello,

No, i dont use KVM. This server is used as a router.

Regards

[idata]

Hi Vesla,

Thank you for the clarification. Can you share how you set up the Virtual IP? Please provide the detail. Another thing is have you contact Debian support to check on this? Thanks,Sharon T

[idata]

Hi Vesla,

Please feel free to provide the information.Thanks,Sharon T