Compliance Verification Program (CVP)
The CVP is a program initiated by the OPNFV Board of Directors with the following key objectives:
- Help build the market for
- OPNFV-based infrastructure
- applications designed to run on that infrastructure
- Reduce adoption risks for end-users
- Decrease testing costs by verifying hardware and software platform interfaces and components
- Enhance interoperabilit
- Help build the market for
Dovetail is the project that delivers all the open source software toolchain, documentation, and test suite for CVP. Dovetail project meets CVP testing requirements by leveraging many OPNFV projects and upstream projects. The Certification and Compliance committee (C&C committee) serves as the program's administrator on behalf the OPNFV Board.
Products that pass the CVP compliance verification suite may be labeled as “OPNFVReady”. The OPNFV C&C Committee on behalf of the Board of Directors can award a product “OPNFV Ready” status.
More details of CVP can be found in the CVP document.
System Under Test (SUT)
The System Under Test (SUT) are products from vendors, not OPNFV release artifacts themselves. OPNFV development tooling, such as CI/CD, is also not part of the SUT. The vendors can bring up the SUT to a pre-test state in any way they choose. Dovetail will provide documentation to help the testers to prepare and configure the SUT.
In the current CVP version (Danube release time of Dovetail), the SUT consists of NFVI software, VIM software, and necessary hardware in one System Under Test. The hardware should follow Pharos guidelines (but the guideline is generalized in the Dovetail documentation to remove specifics tied to OPNFV CI/CD environment). Vendors can use their own hardware, or third party or white box hardware to be tested as a whole. And if the combined whole passes the Test Suite, the CVP label applies to the software.
In the Danube cycle, CVP does not plan to test hardware-only systems.
Test Suite
A Test Suite is a collection of test cases grouped together for a specific purpose, for example, CVP. A Test Suite can be named and versioned for easy and accurate reference. The Dovetail test tool primarily supports the Compliance Test Suite for CVP, but can in general support multiple test suites.
Compliance Test Suite
A Compliance Test Suite is the Test Suite used in the OPNFV CVP. By default, this is the Test Suite we are referring to. The Compliance Test Suite is to be versioned with MAJOR.MINOR.PATCH together with the Dovetail tool.
Test Area
A Test Area is a collection of test cases grouped together by functional areas or upstream projects. For example, Openstack Refstack/Defcore, IPv6, HA, SDNVPN.
Test Case
A Test Case is an instance of test unit within a Test Area. In some implementation of the test cases, we may see additional sub-test-cases as smaller units under a test case.
CVP server
CVP (or Dovetail) client