X/L710, FreeBSD VF per VF performance

cheta · ‎06-08-2016

Hello All,

I have 4 port X710 card

[root@localhost vcr]# lsmod | grep i40e

i40evf 73728 0

i40e 315392 0

geneve 28672 1 i40e

vxlan 40960 2 i40e,ixgbe

ptp 20480 3 igb,i40e,ixgbe

[root@localhost vcr]# modinfo i40e

filename: /lib/modules/4.5.5-201.fc23.x86_64/kernel/drivers/net/ethernet/intel/i40e/i40e.ko.xz

version: 1.5.16

license: GPL

description: Intel(R) 40-10 Gigabit Ethernet Connection Network Driver

author: Intel Corporation, <</span>mailto:e1000-devel@lists.sourceforge.net e1000-devel@lists.sourceforge.net>

srcversion: D50DB0062A90F6C369842D1

alias: pci:v00008086d00001588sv*sd*bc*sc*i*

alias: pci:v00008086d00001587sv*sd*bc*sc*i*

alias: pci:v00008086d00001589sv*sd*bc*sc*i*

alias: pci:v00008086d00001586sv*sd*bc*sc*i*

alias: pci:v00008086d00001585sv*sd*bc*sc*i*

alias: pci:v00008086d00001584sv*sd*bc*sc*i*

alias: pci:v00008086d00001583sv*sd*bc*sc*i*

alias: pci:v00008086d00001581sv*sd*bc*sc*i*

alias: pci:v00008086d00001580sv*sd*bc*sc*i*

alias: pci:v00008086d00001574sv*sd*bc*sc*i*

alias: pci:v00008086d00001572sv*sd*bc*sc*i*

depends: geneve,ptp,vxlan

vermagic: 4.5.5-201.fc23.x86_64 SMP mod_unload

parm: debug:Debug level (0=none,...,16=all) (int)

[root@localhost vcr]# modinfo i40evf

filename: /lib/modules/4.5.5-201.fc23.x86_64/kernel/drivers/net/ethernet/intel/i40evf/i40evf.ko.xz

version: 1.5.14

license: GPL

description: Intel(R) 40-10 Gigabit Ethernet Virtual Function Driver

author: Intel Corporation, <</span>mailto:linux.nics@intel.com linux.nics@intel.com>

srcversion: 522158BAB323575B03D48C8

alias: pci:v00008086d0000154Csv*sd*bc*sc*i*

depends:

vermagic: 4.5.5-201.fc23.x86_64 SMP mod_unload

host - fedora 23 kernel 4.5.5

guest OS is FreeBSD9.3 and VF driver for FreeBSD is 1.2.11(latest).

ixlv0: mem 0xfeb60000-0xfeb6ffff,0xfebe0000-0xfebe3fff at device 9.0 on pci0

ixlv1: mem 0xfeb70000-0xfeb7ffff,0xfebe4000-0xfebe7fff at device 11.0 on pci0

ixlv2: mem 0xfeb80000-0xfeb8ffff,0xfebe8000-0xfebebfff at device 12.0 on pci0

ixlv3: mem 0xfeb90000-0xfeb9ffff,0xfebec000-0xfebeffff at device 13.0 on pci0

ixlv4: mem 0xfeba0000-0xfebaffff,0xfebf0000-0xfebf3fff at device 14.0 on pci0

ixlv5: mem 0xfebb0000-0xfebbffff,0xfebf4000-0xfebf7fff at device 15.0 on pci0

ixlv6: mem 0xfebc0000-0xfebcffff,0xfebf8000-0xfebfbfff at device 16.0 on pci0

ixlv7: mem 0xfebd0000-0xfebdffff,0xfebfc000-0xfebfffff at device 17.0 on pci0

I have configured 2 ports each with 4 VF so in total i am getting only ~100Mbps which way less than what i get from virtio.

My performance per VF is ~10Mbps and 4 VFs are getting only 40Mbps/port however i am providing close to 2.5Gbps pcap

Also i have upgraded firmware to latest, 5.04

[73053.043664] i40e 0000:aa:00.3: fw 5.0.40043 api 1.5 nvm 5.04 0x800024da 0.0.0

is there anything i am doing wrong? What's official/profiled per VF performance in the guest.

Thank you in advance

-chintu-

idata · ‎06-08-2016

Hi Chintu,

Thank you forr the post. I can see you are using the latest VF 1.2.11 at https://downloadcenter.intel.com/download/25161/Network-Adapter-Virtual-Function-Driver-for-40-Gigabit-Network-Connections-under-FreeBSD-

What is the switch model used? Have you check also on the switch setting?

I will further check on your inquiry.

rgds,

wb

cheta · ‎06-09-2016

Wb,

What do you mean by switch version?

-chintu-

idata · ‎06-12-2016

Hi Chintu,

Please help confirm if you are using X710 or XL710 network adapter?

You may refer to the correct driver for X710 server adapter under FreeBSD*:

Network Adapter Driver for PCI-E* 10 Gigabit Network Connections under FreeBSD*:

https://downloadcenter.intel.com/download/26004 (Virtual function)

version 1.4.6

https://downloadcenter.intel.com/download/14688

version: 3.1.14

What is the switch model ?

Thanks,

wb

cheta · ‎06-13-2016

Thanks for the reply wb.

I have both 4 port X710 and 2 port XL710 adapters.

-chintu-

cheta · ‎06-13-2016

wb,

for X710 cards,

i tried using if_ixv.ko in FreeBSD guest.

8 1 0xffffffff81a6d000 1baa0 mrsas.ko

9 1 0xffffffff81a89000 390c8 if_ixv.ko

and KVM host has

[root@localhost vcr]# modinfo i40evf

filename: /lib/modules/4.5.5-201.fc23.x86_64/kernel/drivers/net/ethernet/intel/i40evf/i40evf.ko.xz

version: 1.5.14

after that i can't even see any interface detected in my VM.

[root@App46005 ~]# ifconfig

vtnet0: flags=8843 metric 0 mtu 1500

options=6c03bb

ether 52:54:00:30:a0:c0

inet 192.168.63.50 netmask 0xffffff00 broadcast 192.168.63.255

nd6 options=29

media: Ethernet 10Gbase-T

status: active

lo0: flags=8049 metric 0 mtu 16384

options=600003

inet6 ::1 prefixlen 128

inet6 fe80::1%lo0 prefixlen 64 scopeid 0x6

inet 127.0.0.1 netmask 0xff000000

nd6 options=21

ipfw0: flags=8801 metric 0 mtu 65536

nd6 options=21

pflog0: flags=100 metric 0 mtu 33152

nd6 options=29

this is my interface configuration

-chintu-

cheta · ‎06-13-2016

wb,

how do i get the switch version?

What exactly is the switch version?

-chintu-

idata · ‎06-14-2016

Hi Chintu,

What is the brand or model of your switch? (example is it a Cisco switch, what model?)

Thanks,

wb

idata · ‎06-20-2016

Hi Chintu,

Please confirm if you have updated the VF driver to the version on our website below:

version 1.4.6

https://downloadcenter.intel.com/download/26004/Intel-Network-Adapter-Virtual-Function-Driver-for-PCI-E-10-Gigabit-Network-Connections-under-FreeBSD-

thanks,

wb

idata · ‎06-27-2016

Hi Chintu,

I would like to follow up if you have updated the VF driver version 1.4.6 on our website below:

https://downloadcenter.intel.com/download/26004/Intel-Network-Adapter-Virtual-Function-Driver-for-PCI-E-10-Gigabit-Network-Connections-under-FreeBSD-

Looking forward to your update.

Thanks,

wb