Dovetail PlugFest Plan April 24-28

The slide deck Wenjing used on day-1 Plugfest: https://docs.google.com/presentation/d/1IAL6DzMF5EMhzLfikH_tTDQvC0gccfJRQ5ipzwQx4QE/edit?usp=sharing

Please use this etherpad for real-time feedbacks, bug reports, improvement suggestions, and the daily scrubs during the PlugFest week:

https://etherpad.opnfv.org/p/plugfest_dovetailtesting

And this etherpad for meeting discussion notes: https://etherpad.opnfv.org/p/cvp_tooling_sketch

user guide link : Dovetail Testing Guide

https://gerrit.opnfv.org/gerrit/#/c/33367/1 from trevor

https://gerrit.opnfv.org/gerrit/#/c/32499  from Chris

https://jira.opnfv.org/browse/DOVETAIL-352

worksheet: Dovetail Test Area / Test Case Worksheet and latest in https://gerrit.opnfv.org/gerrit/#/c/33319/1

HA: High availability testing (cooperate with the Yardstick team)

https://wiki.opnfv.org/display/sdnvpn/SDNVPN+Testing#SDNVPNTesting-TestcompliancetemplateforDovetail

----------

Dovetail PlugFest activities and desired outcome:

1. Test toolchain and work flow validation

Pre-requisite:

• a dovetail client software (alpha version) available prior to the start of the PlugFest
• a LF-hosted web server / DB available for testing purpose
• A draft of test strategy document: at least the tester guide sections

Desired outcome of the validation

• confirmation of the work flow's validity, or JIRA tickets to fix issues
• confirmation of dovetail client software feature completeness, or JIRA tickets to enhance or fix issues
• any feedback to web server / DB and feature enhancements

2. Validating draft test suite and test toolchain on a varieties of hardware and software stack combinations (scenarios)

Pre-requiste:

• Same as above

Desired outcome

• Testing dovetail on one or more hardware (inc. network) configurations
• Testing dovetail on more than one scenarios/installers (details in the table below)
• If vendor software available, test dovetail on vendor distributions. (this can also happen in private lab environment remotely)

3. Review of the documentation to be released with cvp

The test user guide: How to prepare a system, run the test suite, and validate the results

4. Review of test areas

Possible areas include sdn controllers, ha, ipv6, sdnvpn, ...

-------------

results:

PlugFest testing proposal for Dovetail:

<=Please edit the table below to plan for Dovetail testing during the PlugFest at Orange=>

the table below shows the dovetail  test planning. on each Pod, the CloudOS can be deployed such as Danube and Wind River Titanium 3.

it wil take 2 hours to install the dovetail tool and 1 hour to run that. once the dovetail tool is deployed, it can run several times.

for the end of each day, there will be short summary meeting for the test results revew and feedbacks.

Huawei POD(onsite)(installer: joid) on Tuesday (one scenario)

Huawei POD(onsite)(installer: Compass) on Wensday( two scenarioes)

Huawei POD(onsite) on Thursday (Comarcial CloudOS)

Intel POD(onsite) on( one scenario) ( share the pod with yardstick testing )

lenovo GP POD (remote)(installer: Apex) on Tuesday

Nokia POD(onsite)(installer: apex(Triple-O Danube)) on Monday (one scenarioes)

Advantech POD(onsite)(installer: Fuel) on Thursday

 Full based Danube primary region with a Titanium Cloud release 3 secondary region in 

Taibei is ongoing (4/18)

feedback: https://etherpad.opnfv.org/p/plugfest_dovetailtesting

HackFest dovetail meeting sessions: 

Danube Plugfest/Hackfest planning page