Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Minor change

...

Working with the ETSI NFV TST 001 reference: http://www.etsi.org/deliver/etsi_gs/NFV-TST/001_099/001/01.01.01_60/gs_NFV-TST001v010101p.pdf
The Dovetail project will focus on tests validating a scope for a System Under Test (SUT) associated with Chapter 4.9 - NFV Infrastructure + VIM Under Test, as adapted for OPNFV (see figure below).  The test suite will also contain pre-deployment validation tests to ensure that any platform under evaluation is first in a steady state of readiness.

Aside from the very basic requirements we would have on a test case to be used in dovetail

Test case requirements


The following requirements should be fulfilled for all tests added to the Dovetail test suite:

  • Test cases should implement favour implementation of a published standard interface for validation
    • Where no standard is available provide API support references
    • If a standard exists and is not followed, an exemption method needs to be established
  • Test cases be documented
    • Use case specification
    • Test preconditions
    • Basic test flow execution descriptor
    • Post conditions and pass fail criteria
    • Parameter border test cases descriptions
    • Fault/Error test case descriptions  (this feels optional at this time)
  • Test cases must pass on OPNFV reference deployments
    • Tests must pass with deployments with at least two installers
    • Tests must pass with at least two deployment scenarios involving different SDN controllers
    • Tests must not depend on code which has not been accepted into the relevant upstream projects
    • (hongbo: this needs to be discussed further. there are several SDN controllers. some test cases from dedicated SDN controller can not be used for other controller.)
  • Test documentation/implementation file and directory structure (per supported framework)
  • Test result storage, structure and test result information management (these should be able to be run publically or privately)

...