...
Working with the ETSI NFV TST 001 reference: http://www.etsi.org/deliver/etsi_gs/NFV-TST/001_099/001/01.01.01_60/gs_NFV-TST001v010101p.pdf
The Dovetail project will focus on tests validating a scope for a System Under Test (SUT) associated with Chapter 4.9 - NFV Infrastructure + VIM Under Test, as adapted for OPNFV (see figure below). The test suite will also contain pre-deployment validation tests to ensure that any platform under evaluation is first in a steady state of readiness.
Aside from the very basic requirements we would have on a test case to be used in dovetail
Test case requirements
The following requirements should be fulfilled for all tests added to the Dovetail test suite:
- Test cases should implement favour implementation of a published standard interface for validation
- Where no standard is available provide API support references
- If a standard exists and is not followed, an exemption method needs to be established
- Test cases be documented
- Use case specification
- Test preconditions
- Basic test flow execution descriptor
- Post conditions and pass fail criteria
- Parameter border test cases descriptions
- Fault/Error test case descriptions (this feels optional at this time)
- Test cases must pass on OPNFV reference deployments
- Tests must pass with deployments with at least two installers
- Tests must pass with at least two deployment scenarios involving different SDN controllers
- Tests must not depend on code which has not been accepted into the relevant upstream projects
- (hongbo: this needs to be discussed further. there are several SDN controllers. some test cases from dedicated SDN controller can not be used for other controller.)
- Test documentation/implementation file and directory structure (per supported framework)
- Test result storage, structure and test result information management (these should be able to be run publically or privately)
...