VSwitchPerf Release Plan

This Page will maintain the release plans for VSPERF

Kali Release Plan

Feature Details	JIRA ID	Contact	Status
VSPERF-Openstack Intel Pod10/15/18 (a) Add More Testcases (b) Add TRex Support. (c) Multi-Dimensional TestVNF Support
Kubernetes CNB - Phase2 Intel Pod12 (a) Multiple Pods. (b) Multiple Hosts (c) Containerizing vswitch (d) Containerized TGens (e) DanM (f) DPDK Version has any performance impact? (g) Different eBPF/Cilium Plugin? (h) Memif interface			Phase-1: K8S Cluster Deployment. Plugins: Multus - OVSDPDK, VPP and SRIOV. Pod: DPDK+L2/L3 FWD.
VSPERF-Xtesting Integration (a) More testcases (b) Run in Pod12. (c) K8S
Improve TRex Integration - Better Data analysis
VSPERF GUI

Jerma Release Plan

Jerma release will include CN-Benchmarking, Container Metrics and Enhanced analytics features as the main outcomes.

Feature Details	JIRA ID	Contact
Integration with X-Testing Outcome of VSPERF-594 and VSPERF-595	VSPERF-604	Sridhar Rao
Container Networking Benchmarking - Setup Automation	VSPERF-607	Emanuele Urselli, Parth Yadav
Container Networking Benchmarking - Testing	VSPERF-608	Sridhar Rao Parth Yadav
Container Metrics - agent and visualization		Parth Yadav
Enhanced Analytics.		Adarsh Yadav Aditya Srivastava
Live-Results from Ixia TGen		Ancuta Enache
Enhanced Results Container and VM		Adarsh Yadav Aditya Srivastava
TST-009 Testcases	VSPERF-583	Al Morton
VSPERF With Openstack	VSPERF-619	Sridhar Rao

Iruya Release Plan

Iruya release will include Containerization of VSPERF and Newer software versions as the main outcomes.

Feature Details	JIRA ID	Contact	Status
VSPERF Container	VSPERF-594	Sridhar Rao shailesh chauhan	COMPLETED
Results Container All 5 - Infrastructure, End-Of-Test-Results, Live-Results, Events from VSPERF/Sw-Tools, Environment details	VSPERF-595	Sridhar Rao	COMPLETED
Usability : Configuration wizard ( CLI)	VSPERF-543	Sridhar Rao	COMPLETED
VSPERF Upgrades - Python	VSPERF-605	Sridhar Rao	COMPLETED
VSPERF Upgrades - OVS, DPDK and VPP	VSPERF-606	Sridhar Rao	COMPLETED

Hunter Release Plan

Feature Details	JIRA ID	Contact	Status
Live Results: Spirent, T-Rex	VSPERF-524	Sridhar Rao	COMPLETED
Testcase: Imix (Spirent) Support	VSPERF-521	Sridhar Rao	COMPLETED
Test Case: OVS-Conntrack rules impact analysis.	VSPERF-545	Christian Trautman Bob Fubel	POSTPONED
IMIX Support : Xena Traffic Generator	VSPERF-596	Bob Fubel Christian Trautman	POSTPONED
Advanced L3-Cache management - Intel RMD	VSPERF-584 VSPERF-585	Sridhar Rao sunku ranganath	POSTPONED
Testcase: Cross-Numa Performance Benchmarking	VSPERF-597		COMPLETED
Logstash/Fluentd Writer Related to Results Container (VSPERF-595)	VSPERF-586		COMPLETED
Resolve CI Issues		Mars Toktonaliev	COMPLETED
Experience VSPERF on Virtualbox		Sridhar Rao	COMPLETED

Gambia Release Plan

Feature Details	JIRA ID	Contact	Status
Comparative Studies: CSIT, NFVBench, Yardstick, Bottlenecks	VSPERF-540, VSPERF-541	Initiated: Trevor Cooper Responsibility: Sridhar Rao Mars Toktonaliev	COMPLETED
Results Improvement : Latency Histogram (Spirent)	VSPERF-522	Sridhar Rao	COMPLETED
VSPERF-Xena Enhancements	VSPERF-575 VSPERF-582	Christian Trautman Bob Fubel	COMPLETED COMPLETED
VSPERF-OVS Enhancements	VSPERF-580 VSPERF-577 VSPERF-578 VSPERF-581 VSPERF-570	Martin Klozik Martin Klozik Martin Klozik Bob Fubel Christian Trautman @Julien Meunier	COMPLETED COMPLETED COMPLETED COMPLETED COMPLETED
VSPERF-VPP Enhancements
VSPERF-VSWITCH Architecture Enhancement	VSPERF-579	Martin Klozik	COMPLETED
TREX Enhancements: Burst traffic type, Scapy Frame Definition, Customized Scapy Version,	VSPERF-562 VSPERF-565, VSPERF-566,	Martin Klozik	COMPLETED
Testcase: Continuous Stream	VSPERF-568	@Julien Meunier	COMPLETED
Tools Enhancement: Pidstat	VSPERF-569	@Julien Meunier	COMPLETED
Testcase: Custom Statistics	VSPERF-572	Richard Elias	COMPLETED
Ixia Script enhancements	VSPERF-149	Martin Klozik	COMPLETED
Tunneling protocol support	VSPERF-573	Martin Klozik	COMPLETED
Testplans for Benchmarking vSwitch in Containerized Environments			COMPLETED
Stability Improvements		Multiple	COMPLETED
Xena - Benchmarking with Multi-flows		Bob Fubel	COMPLETED

Fraser Plan.

Feature Details	JIRA ID	Contact	Status
Tool Support: Integration of Collectd as Monitoring tool	VSPERF-505	Sridhar Rao	COMPLETED
Tool Support: Integration of RDT Cache Management tool to improve vSwitch performance under NN-conditions.	VSPERF-544	Initiated: Trevor Cooper Responsibility: Sridhar Rao	COMPLETED
Tool Support: VMs (Stress-NG and Spirent Cloudstress) as Load-generators	VSPERF-504	Sridhar Rao	COMPLETED
Test Case: Noisy Neighbor Test	VSPERF-523	Unassigned Sridhar Rao	COMPLETED
Test Case: regression tests cases DPDK, OVS	VSPERF-539	Martin Klozik	COMPLETED
Test Case: OVS-Conntrack rules impact analysis.	VSPERF-545	Christian Trautman	IN PROGRESS
Standardization Support: Back-to-Back Frame Testing - IETF.	VSPERF-549	Initiated: Al Morton	IN PROGRESS
Standardization Support: ETSI NFV TST009	VSPERF-552	Al Morton	IN PROGRESS
T-Rex Support Improvement	VSPERF-546 VSPERF-547 VSPERF-559	Christian Trautman	COMPLETED
Additional improvements	VSPERF-548	Martin Klozik	COMPLETED
Miscelleneous: Expand requirements of Soak/Long Duration Tests Updated build scripts for Centos and RHEL to python34	VSPERF-557 VSPERF-558	Christian Trautman Al Morton	COMPLETED
Testcases: T-Rex as VM	VSPERF-560	Martin Klozik	COMPLETED

Fraser Deadlines

Danube

Deliverables: VSPERF Release D JIRA Issues

Project plan per the milestones described at Danube.

Milestone	Status/Plan	Notes
(MS0) Open Intent to Participate	Done
(MS1) Planning complete (scenarios or deliverables defined)	10/25/16
(MS2) Detailed test case descriptions communicated to test project teams	11/22/16
(MS3) Installer integration with OpenStack completed	11/30/16
(MS4) Infrastructure updates completed	12/6/16
(MS5) Scenario integration and Feature Freeze completed	1/13/17
(MS6) Test cases implemented, preliminary documentation completed, and stable branch open	1/26/17
(MS7) Stable branch window close	3/10/17
(MS8) Formal test execution completed	3/20/17
(MS9) JIRA issues assigned to release closed or deferred	3/22/17
(MS10) Documentation completed	3/24/17
(MS11) Release Danube 1.0	3/27/17
(MS12) Release Danube 2.0	5/4/17
(MS13) Release Danube 3.0	6/8/17

Rel C VSPERF Sprint and Backlog

Release	Feature Detail	Jira Number
Rel C	Integration with Yardstick	VSPERF -276
Rel C	Moving to SW Traffic Generator (MoonGen)	VSPERF - 277
Rel C	Installer Integration extension of capabilities (Fuel)	VSPERF- 278
Rel C	Integration with Functest results API only	VSPERF - 279
Rel C	Installer Integration extension of capabilities (Apex)	VSPERF -280

Project Dependencies

Moongen for SW Traffic Generator (JIRA VSPERF-168)
Yardstick integration (JIRA Yardstick -109)
Fuel 9 plugin (needs to be updated) and any other requirements that are needed to run under yardstick
POD 3 ( two new servers that will be setup as sandbox and CI needs to migrated to existing servers) (JIRA Pharos- 129)

Project Timeline (these dates are tentative)

Feature Code Freeze Mid June
Test Code Freeze July
Integration Ready August

Upstream Dependencies

Release B VSPERF Scrum Board and backlog

Release	Plan	Slides
Rel B	vsperf_rel_b_highlevel_plan.xlsx	opnfv_vsperf_brahmaputra_releaseplanning.pptx

Brahmaputra Release

Goals

Our goals for the VSPERF test framework this release are:

Support our 3 base deployment scenarios: P2P, PVP and PVVP
CI Support and integration for VSPERF
Support Vanilla OVS and OVS with DPDK.
Support all RFC2544 defined tests.
Support IMIX traffic testing with RFC 2544.
Support IXIA, Spirent, Moongen and Xena.
Participate in opnfv_test_dashboard

Stretch Goal:

Support IP routing on the switch, as well as simple port forwarding
RFC2544 Scalability tests (Implementation)
LTD.Throughput.RFC2544.Profile (Implementation)
LTD.Throughput.RFC2544.SystemRecoveryTime (Implementation)

Timeline

JIRA

https://jira.opnfv.org/browse/VSPERF-75

Make sure stories reference this Epic and have the VSPERF and R2 Label

Sprints

Active Sprint

Sprint Backlog

Interaction with other OPNFV projects

We would like to collaborate with Yardstick on their vswitch performance tests and the OPNFV dashboard for Release B.

OPNFV Pre-Jerma Release Plans