Session ID: SFO17-109 Session Name: Containerized VNFs with Data Plane Acceleration on ARM-based NFV infrastructure - SFO17-109 Speaker: Bin Lu - Jianbo Liu Track: LNG ★ Session Summary ★ Kubernetes and DPDK are the biggest hype for NFV solution today. While container provides high scale, low latency and low startup time, and it changes the virtualization model. Also, Kubernetes is the best container orchestration platform, from the test result about containerized VNFs and the community feedback, although there still has some problems to solve. DPDK provides a fast data-path. It’s the necessary component for NFV. This presentation will show our work of leveraging lightweight, efficient modern container technology to build ARM-based NFV infrastructure. It also describes the deployment of containerized VNFs with DPDK data plane acceleration with high performance and low latency networking design. The benefits of leveraging container-based infrastructure for NFV use cases, particularly on the network edge based on ARM servers will be illustrated. --------------------------------------------------- ★ Resources ★ Event Page: http://connect.linaro.org/resource/sfo17/sfo17-109/ Presentation: Video: https://www.youtube.com/watch?v=2_fm85W-mRc --------------------------------------------------- ★ Event Details ★ Linaro Connect San Francisco 2017 (SFO17) 25-29 September 2017 Hyatt Regency San Francisco Airport --------------------------------------------------- Keyword: 'http://www.linaro.org' 'http://connect.linaro.org' --------------------------------------------------- Follow us on Social Media https://www.facebook.com/LinaroOrg https://twitter.com/linaroorg https://www.youtube.com/user/linaroorg?sub_confirmation=1 https://www.linkedin.com/company/1026961

1. © 2017 Arm Limited
September 25, 2017
Linaro Connect SFO17
Containerized VNFs
with Data Plane
AcceleraDon
On Arm plaEorm
Bin Lu, Staff SoIware Engineer
Jianbo Liu, Staff SoIware Engineer

2. © 2017 Arm Limited 2
Agenda
• Background
• Containerized VNFs on Arm
• Container networking acceleraDon with DPDK
• What we have done
• Next steps

3. © 2017 Arm Limited 3
Background
1. Infrastructure Layer
• Use ARM64 Server
2. Data Plane Layer
• Enable DPDK for Container
3. Compute VirtualizaDon Layer
• Enable Docker Container
4. Network VirtualizaDon Layer
• Enhance Kubernetes SRIOV-CNI for DPDK deployment
5. VirtualizaDon Infrastructure Manager layer
• Use Kubernetes instead of OpenStack
Source: h^ps://www.opnfv.org/soIware

4. © 2017 Arm Limited 4
Containerized VNFs on Arm
- with Data Plane Accelera=on

5. © 2017 Arm Limited 5
Container Networking
• Current status
• Linux bridge, veth pair, Network namespace, iptables …
• Docker naDve network drivers
– Host, bridge, overlay and MACVLAN
• Other container network soluDons
– flannel, calico, conDv …
• But may not be good enough for NFV
• Complicated logic costs more CPU cycles
• Low throughput and high latency for some use cases
• Handling networking outside kernel is more popular
docker0 bridge Kernel
NS1
Docker
VNF
NS2
Docker
VNF

6. © 2017 Arm Limited 6
• Data Plane Development Kit (DPDK)
• Libraries and poll-mode drivers for fast packet processing
• Kernel bypassing, core affinity, huge pages, lockless
synchronizaDon, polling, NUMA awareness …
• MulD-arch support – x86, ARM64 and PPC
• NIC passthrough and SR-IOV VF passthrough
• Device assignment by VFIO/UIO
• High throughput, low latency
• VirDo-user in container
• VirDo-user as DPDK virtual device
• Reuse exisDng vhost-user backend
Container Networking Accelera=on with DPDK
Containers
VFIO/UIO
Docker
VNF
Docker
VNF
Virtual switch
(VPP-DPDK)
Kernel
Containers
vir=o-usr
Docker
VNF
Docker
VNF
PF
VF VF

7. © 2017 Arm Limited 7
L2FWD with DPDK in Container
L2 FORWARDING
Container
Flannel/Calico
10GbE Port2 Port1
DPDK
Traffic In Traffic Out
VFIO
Traffic Generator

8. © 2017 Arm Limited 8
L2FWD Performance
• Hardware
• ARMv8 64-bit, 2.4Ghz
– 2 cores dedicated
– 1G Hugepage size
• Intel 2-port 82599ES 10Gbe
• IXIA traffic generator
• SoIware
• Linaro ERP 17.08 (Debian based)
– Kernel 4.12
• DPDK 17.08

9. © 2017 Arm Limited 9
Enhance Kubernetes CNI with Data Plane Accelera=on
• With SRIOV-CNI, each VF and PF
can be treated as a separate NIC
• AIer adding SRIOV CNI patch using
DPDK, K8s can assign VFIO/UIO
device into a specific container
K8s POD

10. © 2017 Arm Limited 10
What We Have Done
• Enabled DPDK in container on ARM64 plaEorm
• Enhanced SRIOV-CNI with DPDK acceleraDon
• Performance test with DPDK for container networking
• Enabled K8s as VIM on ARM64 plaEorm

11. © 2017 Arm Limited 11
Next Steps
• Enable VPP-DPDK for OPNFV on Arm
• Enable VPP-ODP for OPNFV on Arm
• Performance tuning of DPDK in container on Arm
• Enable new features of high performance container networking in K8s on Arm
• Resource allocaDon for DPDK in K8s: cpuset, NUMA, cache…

12. © 2017 Arm Limited 12