...
...
...
...
...
...
...
...
VSwitchPerf Release Plan
This Page will maintain the release plans for VSPERF
Kali Release Plan
...
VSPERF-Openstack
(a) Add More Testcases
(b) Add TRex Support.
(c) Multi-Dimensional TestVNF Support
...
Kubernetes CNB - Phase2
(a) Multiple Pods.
(b) Multiple Hosts
(c) Containerizing vswitch
(d) Containerized TGens
(e) DanM
(f) DPDK Version has any performance impact?
(g) Different eBPF/Cilium Plugin?
(h) Memif interface
...
Phase-1:
K8S Cluster Deployment.
Plugins: Multus - OVSDPDK, VPP and SRIOV.
Pod: DPDK+L2/L3 FWD.
VSPERF
...
(a) More testcases
(b) Run in Pod12.
(c) K8S
...
Jerma Release Plan
Jerma release will include CN-Benchmarking, Container Metrics and Enhanced analytics features as the main outcomes.
| Feature Details | JIRA ID | Contact | Status |
|---|---|---|---|
Integration with X-Testing Outcome of VSPERF-594 and VSPERF-595 | VSPERF-604 | ||
| Container Networking Benchmarking - Setup Automation | VSPERF-607 | Emanuele Urselli, Parth Yadav | |
| Container Networking Benchmarking - Testing | VSPERF-608 | ||
| Container Metrics - agent and visualization | |||
| Enhanced Analytics. | |||
| Live-Results from Ixia TGen | Ancuta Enache | ||
| Enhanced Results Container and VM | |||
| TST-009 Testcases | VSPERF-583 | ||
| VSPERF With Openstack | VSPERF-619 |
Iruya Release Plan
Iruya release will include Containerization of VSPERF and Newer software versions as the main outcomes.
| Feature Details | JIRA ID | Contact | Status | ||||||
|---|---|---|---|---|---|---|---|---|---|
| VSPERF Container | VSPERF-594 |
| |||||||
Results Container All 5 - Infrastructure, End-Of-Test-Results, Live-Results, Events from VSPERF/Sw-Tools, Environment details | VSPERF-595 |
| |||||||
Usability : Configuration wizard ( CLI) | VSPERF-543 |
| |||||||
| VSPERF Upgrades - Python | VSPERF-605 |
| |||||||
| VSPERF Upgrades - OVS, DPDK and VPP | VSPERF-606 |
|
Hunter Release Plan
| Feature Details | JIRA ID | Contact | Status | ||||||
|---|---|---|---|---|---|---|---|---|---|
| Live Results: Spirent, T-Rex | VSPERF-524 |
| |||||||
| Testcase: Imix (Spirent) Support | VSPERF-521 |
| |||||||
Test Case: OVS-Conntrack rules impact analysis. | VSPERF-545 |
| |||||||
| IMIX Support : Xena Traffic Generator | VSPERF-596 |
| |||||||
Advanced L3-Cache management - Intel RMD | VSPERF-584 VSPERF-585 |
| |||||||
| Testcase: Cross-Numa Performance Benchmarking | VSPERF-597 |
| |||||||
Logstash/Fluentd Writer Related to Results Container (VSPERF-595) | VSPERF-586 |
| |||||||
| Resolve CI Issues |
| ||||||||
| Experience VSPERF on Virtualbox |
|
Gambia Release Plan
| Feature Details | JIRA ID | Contact | Status | ||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Comparative Studies: CSIT, NFVBench, Yardstick, Bottlenecks | VSPERF-540, VSPERF-541 |
| |||||||||||||||||||||||||||||||
Results Improvement : Latency Histogram (Spirent) | VSPERF-522 |
| |||||||||||||||||||||||||||||||
| VSPERF-Xena Enhancements | VSPERF-575 VSPERF-582 |
| |||||||||||||||||||||||||||||||
| VSPERF-OVS Enhancements | VSPERF-580 VSPERF-577 VSPERF-578 VSPERF-581 VSPERF-570 |
| |||||||||||||||||||||||||||||||
| VSPERF-VPP Enhancements | |||||||||||||||||||||||||||||||||
| VSPERF-VSWITCH Architecture Enhancement | VSPERF-579 |
| |||||||||||||||||||||||||||||||
TREX Enhancements: Burst traffic type, Scapy Frame Definition, Customized Scapy Version, | VSPERF-562 VSPERF-565, VSPERF-566, |
| |||||||||||||||||||||||||||||||
| Testcase: Continuous Stream | VSPERF-568 | @Julien Meunier |
| ||||||||||||||||||||||||||||||
Tools Enhancement: Pidstat | VSPERF-569 | @Julien Meunier |
| ||||||||||||||||||||||||||||||
| Testcase: Custom Statistics | VSPERF-572 |
| |||||||||||||||||||||||||||||||
| Ixia Script enhancements | VSPERF-149 |
| |||||||||||||||||||||||||||||||
| Tunneling protocol support | VSPERF-573 |
| |||||||||||||||||||||||||||||||
| Testplans for Benchmarking vSwitch in Containerized Environments |
| ||||||||||||||||||||||||||||||||
| Stability Improvements | Multiple |
| |||||||||||||||||||||||||||||||
| Xena - Benchmarking with Multi-flows | Bob Fubel |
|
Fraser Plan.
| Feature Details | JIRA ID | Contact | Status | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Tool Support: Integration of Collectd as Monitoring tool | VSPERF-505 |
| |||||||||
| Tool Support: Integration of RDT Cache Management tool to improve vSwitch performance under NN-conditions. | VSPERF-544 | Initiated: Trevor Cooper Responsibility: Sridhar Rao |
| ||||||||
| Tool Support: VMs (Stress-NG and Spirent Cloudstress) as Load-generators | VSPERF-504 |
| |||||||||
| Test Case: Noisy Neighbor Test | VSPERF-523 | Unassigned |
| ||||||||
| Test Case: regression tests cases DPDK, OVS | VSPERF-539 |
| |||||||||
| Test Case: OVS-Conntrack rules impact analysis. | VSPERF-545 |
| |||||||||
| Standardization Support: Back-to-Back Frame Testing - IETF. | VSPERF-549 | Initiated: Al Morton |
| ||||||||
| Standardization Support: ETSI NFV TST009 | VSPERF-552 |
| |||||||||
| T-Rex Support Improvement | VSPERF-546 VSPERF-547 VSPERF-559 |
| |||||||||
| Additional improvements | VSPERF-548 |
| |||||||||
Miscelleneous: Expand requirements of Soak/Long Duration Tests Updated build scripts for Centos and RHEL to python34 | VSPERF-557 VSPERF-558 |
| |||||||||
| Testcases: T-Rex as VM | VSPERF-560 |
|
Fraser Deadlines
Danube
Deliverables: VSPERF Release D JIRA Issues
Project plan per the milestones described at Danube.
Milestone | Status/Plan | Notes |
|---|---|---|
| (MS0) Open Intent to Participate | Done | |
| (MS1) Planning complete (scenarios or deliverables defined) | 10/25/16 | |
| (MS2) Detailed test case descriptions communicated to test project teams | 11/22/16 | |
| (MS3) Installer integration with OpenStack completed | 11/30/16 | |
| (MS4) Infrastructure updates completed | 12/6/16 | |
| (MS5) Scenario integration and Feature Freeze completed | 1/13/17 | |
| (MS6) Test cases implemented, preliminary documentation completed, and stable branch open | 1/26/17 | |
| (MS7) Stable branch window close | 3/10/17 | |
| (MS8) Formal test execution completed | 3/20/17 | |
| (MS9) JIRA issues assigned to release closed or deferred | 3/22/17 | |
| (MS10) Documentation completed | 3/24/17 | |
(MS11) Release Danube 1.0 | 3/27/17 | |
(MS12) Release Danube 2.0 | 5/4/17 | |
| (MS13) Release Danube 3.0 | 6/8/17 |
Rel C VSPERF Sprint and Backlog
| Release | Feature Detail | Jira Number |
|---|---|---|
| Rel C | Integration with Yardstick | VSPERF -276 |
| Rel C | Moving to SW Traffic Generator (MoonGen) | VSPERF - 277 |
| Rel C | Installer Integration extension of capabilities (Fuel) | VSPERF- 278 |
| Rel C | Integration with Functest results API only | VSPERF - 279 |
| Rel C | Installer Integration extension of capabilities (Apex) | VSPERF -280 |
Project Dependencies
Project Timeline (these dates are tentative)
- Feature Code Freeze Mid June
- Test Code Freeze July
- Integration Ready August
Upstream Dependencies
Release B VSPERF Scrum Board and backlog
Release | Plan | Slides |
|---|---|---|
Rel B |
Brahmaputra Release
Goals
Our goals for the VSPERF test framework this release are:
...
- Support IP routing on the switch, as well as simple port forwarding
- RFC2544 Scalability tests (Implementation)
- LTD.Throughput.RFC2544.Profile (Implementation)
- LTD.Throughput.RFC2544.SystemRecoveryTime (Implementation)
Timeline
JIRA
https://jira.opnfv.org/browse/VSPERF-75
Make sure stories reference this Epic and have the VSPERF and R2 Label
Sprints
Interaction with other OPNFV projects
We would like to collaborate with Yardstick on their vswitch performance tests and the OPNFV dashboard for Release B.