TestCase Run Results History Info Gathering and Display

This page provides some material about the “Test case run results history info gathering and display”.

This will help the community to do the compliance/certification test case selection when pass/fail evidence needed.

dovetail and community development progress map

CI and POD resource for dovetail

working together with infra group, ongoing

question description in details: https://wiki.opnfv.org/display/dovetail/Dovetail+Home?preview=/2926467/8690170/dovetail%20requirements%20from%20infra_v1.pptx

CI resource: https://build.opnfv.org/ci/view/dovetail/

 Status:

community regular CI test case run history(for each release)

For functest:

http://testresults.opnfv.org/test/swagger/spec.html#!/spec/List_all_Test_Results

version=colorado

case=?, such as tempest_smoke_serial

For yardstick

http://testresults.opnfv.org/grafana/dashboard/db/os-nosdn-nofeature-ha-sample

version=colorado

Time filter: 2016/09/22-2017/1/10 (Colorado.1.0- Colorado.3.0)

Remaing questions

For functest:

1. tempest_full_parallel  not runs in CI in Colorado, however, some testcase proposed for compliance includes in tempest_full_parallel

Suggestion: put tempest_full_parallel into weekly CI in Danube

2. In Colorado, the failed testcase can be seen, however, in master/D, it doesn’t exists. Besides, the skipped testcase is also needed

Suggestion: keep failed testcase shown in master/D

                    patch: https://gerrit.opnfv.org/gerrit/#/c/28025/

For yardstick

1. If a testcase don’t have test result, didn’t run or failed? can’t make a judgement