120. Sample Application Tests: Vxlan Example¶

Vxlan sample simulates a VXLAN Tunnel Endpoint (VTEP) termination in DPDK. It is used to demonstrate the offload and filtering capabilities of i40 NIC for VXLAN packet.

Vxlan sample uses the basic virtio devices management function from vHOST example, and the US-vHost interface and tunnel filtering mechanism to direct the traffic to/from a specific VM.

Vxlan sample is also designed to show how tunneling protocols can be handled.

120.1. Prerequisites¶

1x Intel® X710 (Fortville) NICs (2x 40GbE full duplex optical ports per NIC) plugged into the available PCIe Gen3 8-lane slot.

2x Intel® XL710-DA4 (Eagle Fountain) (1x 10GbE full duplex optical ports per NIC) plugged into the available PCIe Gen3 8-lane slot.

DUT board must be two sockets system and each cpu have more than 8 lcores.

Update qemu-system-x86_64 to version 2.2.0 which support hugepage based memory. Prepare vhost-use requested modules:

modprobe fuse
modprobe cuse
insmod lib/librte_vhost/eventfd_link/eventfd_link.ko

Allocate 4096*2M hugepages for vm and dpdk:

echo 4096 > /sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages

120.2. Test Case: Vxlan Sample Encap packet¶

Start vxlan sample with only encapsulation enable:

tep_termination -c 0xf -n 3 --socket-mem 2048,2048 -- -p 0x1 \
    --udp-port 4789 --nb-devices 2 --filter-type 3 --tx-checksum 0 \
    --encap 1 --decap 0

Wait for vhost-net socket device created and message dumped:

VHOST_CONFIG: bind to vhost-net

Start virtual machine with hugepage based memory and two vhost-user devices:

qemu-system-x86_64 -name vm0 -enable-kvm -daemonize \
  -cpu host -smp 4 -m 4096 \
  -object memory-backend-file,id=mem,size=4096M,mem-path=/mnt/huge,share=on \
  -numa node,memdev=mem -mem-prealloc \
  -chardev socket,id=char0,path=./dpdk/vhost-net \
  -netdev type=vhost-user,id=netdev0,chardev=char0,vhostforce \
  -device virtio-net-pci,netdev=netdev0,mac=00:00:20:00:00:20 \
  -chardev socket,id=char1,path=./dpdk/vhost-net \
  -netdev type=vhost-user,id=netdev1,chardev=char1,vhostforce \
  -device virtio-net-pci,netdev=netdev1,mac=00:00:20:00:00:21 \
  -drive file=/storage/vm-image/vm0.img -vnc :1

Login into virtual machine and start testpmd with additional arguments:

testpmd -c f -n 3 -- -i --tx-offloads=0x8000 --disable-hw-vlan

Start packet forward of testpmd and transit several packets for mac learning:

testpmd> set fwd mac
testpmd> start tx_first

Make sure virtIO port registered normally:

VHOST_CONFIG: virtio is now ready for processing.
VHOST_DATA: (1) Device has been added to data core 56
VHOST_DATA: (1) MAC_ADDRESS 00:00:20:00:00:21 and VNI 1000 registered
VHOST_DATA: (0) MAC_ADDRESS 00:00:20:00:00:20 and VNI 1000 registered

Send normal udp packet to PF device and packet dmac match PF device Verify packet has been received in virtIO port0 and forwarded by port1:

testpmd> show port stats all

Verify encapsulated packet received on PF device

120.3. Test Case: Vxlan Sample Decap packet¶

Start vxlan sample with only decapsulation enable:

tep_termination -c 0xf -n 3 --socket-mem 2048,2048 -- -p 0x1 \
  --udp-port 4789 --nb-devices 2 --filter-type 3 --tx-checksum 0 \
  --encap 0 --decap 1

Start vhost-user test environment like case vxlan_sample_encap.

Send vxlan packet to PF the device:

Ether(dst=PF mac)/IP/UDP/vni(1000)/Ether(dst=virtIO port0)/IP/UDP

Verify that packet received by virtIO port0 and forwarded by virtIO port1:

testpmd> show port stats all

Verify that PF received packet just the same as inner packet

Send vxlan packet to the PF device:

Ether(dst=PF mac)/IP/UDP/vni(1000)/Ether(dst=virtIO port1)/IP/UDP

Verify that packet received by virtIO port1 and forwarded by virtIO port0:

testpmd> show port stats all

Make sure PF received packet received inner packet with mac reversed.

120.4. Test Case: Vxlan Sample Encap and Decap¶

Start vxlan sample with only decapsulation enable:

tep_termination -c 0xf -n 3 --socket-mem 2048,2048 -- -p 0x1 \
  --udp-port 4789 --nb-devices 2 --filter-type 3 --tx-checksum 0 \
  --encap 1 --decap 1

Start vhost-user test environment like case vxlan_sample_encap

Send vxlan packet to the PF device:

Ether(dst=PF mac)/IP/UDP/vni(1000)/Ether(dst=virtIO port0)/IP/UDP

Verify that packet received by virtIO port0 and forwarded by virtIO port1:

testpmd> show port stats all

Verify encapsulated packet received on PF device. Verify that inner packet src and dst mac address have been conversed.

120.5. Test Case: Vxlan Sample Checksum¶

Start vxlan sample with only decapsulation enable:

tep_termination -c 0xf -n 3 --socket-mem 2048,2048 -- -p 0x1 \
  --udp-port 4789 --nb-devices 2 --filter-type 3 --tx-checksum 1 \
  --encap 1 --decap 1

Start vhost-user test environment like case vxlan_sample_encap

Send vxlan packet with wrong chksum:

Ether(dst = PF mac)/IP/UDP/vni(1000)/Ether(dst = virtIO port0)/IP wrong chksum/UDP

Verify that packet received by virtIO port0 and forwarded by virtIO port1:

testpmd> show port stats all

Verify encapsulated packet received on PF device. Verify that inner packet src and dst mac address have been conversed. Verify that inner packet ip checksum and udp checksum were corrected.

Send vxlan packet with wrong chksum:

Ether(dst = PF mac)/IP/UDP/vni(1000)/Ether(dst = virtIO port0)/IP wrong chksum/TCP

Verify that packet received by virtIO port0 and forwarded by virtIO port1:

testpmd> show port stats all

Verify encapsulated packet received on PF device. Verify that inner packet src and dst mac address have been conversed. Verify that inner packet ip checksum and tcp checksum were corrected.

Send vxlan packet with wrong chksum:

Ether(dst = PF mac)/IP/UDP/vni(1000)/Ether(dst = virtIO port0)/IP wrong chksum/SCTP

Verify that packet received by virtIO port0 and forwarded by virtIO port1:

testpmd> show port stats all

Verify encapsulated packet received on PF device. Verify that inner packet src and dst mac address have been conversed. Verify that inner packet ip checksum and sctp checksum were corrected.

120.6. Test Case: Vxlan Sample TSO¶

Start vxlan sample with tso enable, tx checksum must enable too. For hardware limitation, tso segment size must be larger 256:

tep_termination -c 0xf -n 3 --socket-mem 2048,2048 -- -p 0x1 \
  --udp-port 4789 --nb-devices 2 --filter-type 3 --tx-checksum 1 \
  --encap 1 --decap 1 --tso-segsz 256

Start vhost-user test environment like case vxlan_sample_encap

Send vxlan packet with 892 Bytes data, total length will be 1000:

Ether(dst = PF mac)/IP/UDP/vni(1000)/Ether(dst = virtIO port0)/TCP

Verify that packet received by virtIO port0 and forwarded by virtIO port1:

testpmd> show port stats all

Verify that four separated vxlan packets received on PF devices. Make sure tcp packet payload is 256, 256, 256 and 124.

120.7. Test Case: Vxlan Sample Performance Benchmarking¶

The throughput is measured for different operations taken by vxlan sample. Virtio single mean there’s only one flow and forwarded by single port in vm. Virtio two mean there are two flows and forwarded by both two ports in vm.

Function	VirtIO	Mpps	% linerate
Decap	Single
Encap	Single
Decap&Encap	Single
Checksum	Single
Checksum&Decap	Single
Decap	Two Ports
Encap	Two Ports
Decap&Encap	Two Ports
Checksum	Two Ports
Checksum&Decap	Two Ports