this wiki page is used to record the running histroy for the dovetil tool.this may cover the runnning in the plugfest, CI and vendors lab.
Table of Contents |
---|
1. Version change logs
For each dovetail release version, the docker images used are introduced first, then problems found and fixed are listed as well as the updates.
1.1 cvp.0.1.0 (2017/06/23)
...
this wiki page is used to record the running histroy for the dovetil tool.this may cover the runnning in the plugfest, CI and vendors lab.
Table of Contents |
---|
1. Version change logs
For each dovetail release version, the docker images used are introduced first, then problems found and fixed are listed as well as the updates.
1.1 cvp.0.1.0 (2017/06/23)
1.1.1 Docker images used:
opnfv/dovetail:cvp.0.1.0 (commit ID 041a51d6d3ba5f2d9eabcf3501abb9af30ebc394)
opnfv/yardstick:danube.2.0
opnfv/functest:danube.2.0
opnfv/testapi:cvp.0.1.0 (Commit ID 056b7ccefe38b13e4b4eb11ff7e259e254e35c32)
1.1.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0.1.0 |
| ||
opnfv/yardstick:danube.2.0 |
| ||
opnfv/functest:danube.2.0 | SDNVPN test cases are not enable in Functest | None | |
opnfv/testapi:cvp.0.1.0 | user management and some bugfix | None | None |
1.2 cvp.0.2.0 (2017/07/07)
1.2.1 Docker images used:
opnfv/dovetail:cvp.0.2.0 (commit ID 5ddf932dc28bcc47169c3091267d57ba5a99f9b2)
opnfv/yardstick:danube.3.0
opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)
opnfv/testapi:cvp.0.2.0 (commit ID a7f82c093fab2ad19c7ffb0a81ec5756e91e73ae)
1.2.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0.2.0 |
| ||
opnfv/yardstick:danube.3.0 |
| None | |
opnfv/functest:cvp.0.2.0 | None | None | None |
opnfv/testapi:cvp.0.2.0 |
|
|
1.3 cvp.0.3.0 (2017/7/21)
1.3.1 Docker images used:
opnfv/dovetail:cvp.0.
...
3.0 (commit
...
ID 7ed1cf189676693d84c9d48bb964c178b16bae76)
opnfv/yardstick:danube.
...
opnfv/functest:danube.2.0
opnfv/testapi:cvp.0.1.0 (Commit ID 056b7ccefe38b13e4b4eb11ff7e259e254e35c32)
1.1.2 Updates and problems found and fixed in this version
...
3.1
opnfv/functest:cvp.0.2.0
...
...
- https://gerrit.opnfv.org/gerrit/#/c/36541/
- https://gerrit.opnfv.org/gerrit/#/c/36785/
- https://gerrit.opnfv.org/gerrit/#/c/36615/
- https://gerrit.opnfv.org/gerrit/#/c/36775/
...
- Bugfix: Monitor command in tc019 may not show the real nova-api service status
- Bugfix: "monitor_multi" type monitor in HA test case cannot get "max_recover_time"
- Improvement: Terminate openstack service's process using "kill" command
- Improvement: "monitor_process" type monitor pass criteria
- Bugfix: test.dbf file not deleted after execution of Disk I/O Block High Availability test
...
...
(commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)
opnfv/testapi:cvp.0.3.0 (commit ID 4e0b74b0141e3ae5d250006f3d75fcc880738cc9)
1.3.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0.3.0 |
|
...
...
...
...
opnfv/ |
...
yardstick:danube. |
...
3. |
...
1 | None | None | None |
...
https://gerrit.opnfv.org/gerrit/#/c/35051/2
https://gerrit.opnfv.org/gerrit/#/c/36777/3
opnfv/functest:cvp.0.2.0 | None | None | None |
opnfv/testapi:cvp.0.3.0 |
| None | None |
1.
...
4 cvp.0.
...
4.0 (2017/
...
8/
...
4)
1.
...
4.1 Docker images used:
opnfv/dovetail:cvp.0.
...
4.
...
0 (commit
...
ID a8d7665ca783684bc10d7c3dbbc606e30f083bc7)
opnfv/yardstick:danube.3.
...
1
opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)
opnfv/testapi:cvp.0
...
.4.0
opnfv/bottlenecks:cvp.0.4.0 (commit
...
ID 3592f9016821a603930ebda7f4112abf732e6750)
1.
...
4.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0. |
...
4.0 |
...
- Update IPv6 tc018-tc025: give more details and modify some misunderstanding about these test cases
- Delete the ERROR log when it is not https
- Adapt Yardstick to copy yardstick.conf to /etc/yardstick
- Fix the docker version to be 17.03.0-ce rather than the latest one
|
...
...
...
...
...
- Support ignoring server certificate
- Add debug log for recovering service failure
- Improve method to kill keystone process
...
...
- role based access control and result upload
- testapi tox bugfix
- some bugfix
...
- None
- None
- RELENG-281
RELENG-212
FUNCTEST-694
RELENG-213
opnfv/yardstick:danube.3.1 | Bugfix: cannot run task if without yardstick.conf in danube | YARDSTICK-776 | https://gerrit.opnfv.org/gerrit/#/c/38955/ |
...
opnfv/functest:cvp.0.2.0 |
|
...
...
...
...
1.3 cvp.0.3.0 (2017/7/21)
1.3.1 Docker images used:
opnfv/dovetail:cvp.0.3.0 (commit ID 7ed1cf189676693d84c9d48bb964c178b16bae76)
opnfv/yardstick:danube.3.1
opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)opnfv/testapi:cvp.0. |
4.0 |
1.3.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0.3.0 |
| ||
opnfv/yardstick:danube.3.1 | None | None | None |
opnfv/functest:cvp.0.2.0 | None | None | None |
opnfv/testapi:cvp.0.3.0 |
| None | None |
1.4 cvp.0.4.0 (2017/8/4)
1.4.1 Docker images used:
opnfv/dovetail:cvp.0.4.0 (commit ID a8d7665ca783684bc10d7c3dbbc606e30f083bc7)
opnfv/yardstick:danube.3.1
opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)
opnfv/testapi:cvp.0.4.0
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
1.4.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit | ||
---|---|---|---|---|---|
opnfv/dovetail:cvp.0.4.0 |
|
| |||
opnfv/bottlenecks:cvp.0.4.0 |
1.5 cvp.0.5.0 (2017/8/18)
1.5.1 Docker images used:
opnfv/dovetail:cvp.0.5.0 (commit ID 474795c11c556dcd325559853fe7ed436a69418c)
opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)
opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
opnfv/testapi:cvp.0.5.0
opnfv/dovetail:nginx.cvp.0.5.0
1.5.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit | |||||||
---|---|---|---|---|---|---|---|---|---|---|
opnfv/dovetail:cvp.0.5.0 |
|
| opnfv/yardstick:danube.3.1 | Bugfix: cannot run task if without yardstick.conf in danube | YARDSTICK-776 | 38955/ | opnfv/functest:cvp.0.2.0 |
| ||
opnfv/testapi:cvp.0.4.0 |
| |||||||||
opnfv/bottlenecks:cvp.0.4.0 |
1.5 cvp.0.5.0 (2017/8/18)
1.5.1 Docker images used:
opnfv/dovetail:cvp.0.5.0 (commit ID 474795c11c556dcd325559853fe7ed436a69418c)
|
opnfv/yardstick:danube.3. |
2 | None | None | None |
opnfv/functest:cvp.0.5. |
0 | None | None | None |
opnfv/testapi:cvp.0.5. |
0 |
1.5.2 Updates and problems found and fixed in this version
1.6 cvp.0.6.0 (2017/9/8)
1.6.1 Docker images used:
opnfv/dovetail:cvp.0.6.0 (commit ID 0aacdceeeac62333651ec5440fb32af965c7689e)
opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)
opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
opnfv/testapi:cvp.0.5.0
opnfv/dovetail:web.cvp.0.6.0
opnfv/dovetail:api.cvp.0.6.0
1.6.2 Updates and problems found and fixed in this version
Image | Updates and problems found and fixed | JIRA | Gerrit |
---|---|---|---|
opnfv/dovetail:cvp.0.6.0 |
| ||
Image | Updates and problems found and fixed | JIRA | Gerrit |
opnfv/dovetail:cvp.0.6.0 | Disable get DB schema in Dockerfile |
| |
opnfv/yardstick:danube.3.2 | None | None | None |
opnfv/functest:cvp.0.5.0 | None | None | None |
opnfv/testapi:cvp.0.5.0 | |||
opnfv/dovetail:nginx.cvp.0.5.0 |
1.6 cvp.0.6.0 (2017/9/8)
1.6.1 Docker images used:
opnfv/dovetail:cvp.0.6.0 (commit ID 0aacdceeeac62333651ec5440fb32af965c7689e)
opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)
opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
opnfv/testapi:cvp.0.5.0
opnfv/dovetail:web.cvp.0.6.0
opnfv/dovetail:api.cvp.0.6.0
1.6.2 Updates and problems found and fixed in this version
| |||
opnfv/yardstick:danube.3.2 | None | None | None |
opnfv/functest:cvp.0.5.0 | None | None | None |
opnfv/testapi:cvp.0.5.0 |
|
| |
opnfv/yardstick:danube.3.2 | None | None | None |
opnfv/functest:cvp.0.5.0 | None | None | None |
opnfv/testapi: | |||
opnfv/dovetail:web.cvp.0.56.0 | |||
opnfv/dovetail:nginxapi.cvp.0.6.0 |
1.7 cvp.0.7.0 (2017/9/29)
1.7.1 Docker images used:
opnfv/dovetail:cvp.0.7.0 (commit ID 043ef2dad58c3aef0ea91cf3063dc9deb6f40bd9)
opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)
opnfv/functest:cvp.0.5.0 (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)
opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)
opnfv/testapi:cvp.0.5.0
opnfv/dovetail:web.cvp.0.7.0
opnfv/dovetail:api.cvp.0.7.0
...
scenarios | installer | owners | cvp.0.1.0 | cvp.0.2.0 | cvp.0.3.0 | cvp.0.4.0 | cvp.0.5.0 | cvp.0.6.0 | |
---|---|---|---|---|---|---|---|---|---|
Apex Scenarios Currently Test Against | |||||||||
os-nosdn-nofeature-ha | Apex | PASS/total defcore: 204/205 HA: 7/8 vping: 2/2 ipv6: 25/25 tempest: 4/6 SDNVPN: 0/4 no SDN feature | https://build.opnfv.org/ci/view/dovetail/job/dovetail-apex-huawei-pod4-proposed_tests-danube/4199/consoleconsoleFull PASS/total defcore: 204205/205 HA: 7/8 vping: 2/2 ipv6: 25/25 tempest: 45/65 SDNVPN: 0/4 no SDN feature | ||||||
Compass Scenarios Currently Test Against | |||||||||
os-nosdn-nofeature-ha | Compass | PASS/total defcore: 204/205 HA: 7/8 tc007, SLA not passed ipv6: 25/25 SDNVPN: 0/4 no SDN feature | PASS/total defcore: 204/205 HA: 8/8 ipv6: 25/25 SDNVPN: 0/4 no SDN feature | PASS/total defcore: 204/205 HA: 8/8 ipv6: 25/25 SDNVPN: 0/4 no SDN feature | PASS/total defcore: 204/205 HA: 8/8 vping: 2/2 ipv6: 25/25 SDNVPN: 0/4 no SDN feature resiliency: 1/1 | PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 3/6 SDNVPN: 0/4 no SDN feature | PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 5/5 SDNVPN: 0/4 no SDN feature | ||
os-odl_l2-nofeature-ha | Compass | PASS/total defcore: 204/205 HA: 8/8 ipv6: 25/25 SDNVPN: 0/4 no SDN feature | PASS/total defcore: 204/205 HA: 8/8 ipv6: 17/25 SDNVPN: 0/4 no SDN feature | PASS/total defcore: 204/205 HA: 7/8 vping: 2/2 ipv6: 25/25 SDNVPN: 0/4 no SDN feature resiliency: 1/1 | PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 24/25 tempest: 2/6 SDNVPN: 0/4 no SDN feature | PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 4/5 (Failed on testing port's admin state) SDNVPN: 0/4 no SDN feature | |||
os-odl_l3-nofeature-ha | Compass | PASS/total defcore: 204/205 HA: 7/8 tc007, SLA not passed ipv6: 17/25 tc018-tc025 fails SDNVPN: 0/4 no SDN feature | PASS/total defcore: 204/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 0/4 no SDN feature | PASS/total defcore: 204/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 0/4 no SDN feature | PASS/total defcore: 204/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails SDNVPN: 0/4 no SDN feature resiliency: 0/1 | PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails tempest: 2/6 SDNVPN: 0/4 no SDN feature | PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 17/25 tc018-tc025 fails tempest: 3/5 SDNVPN: 0/4 no SDN feature | ||
Fuel Scenarios Currently Test Against | |||||||||
os-nosdn-nofeature-ha | Fuel (zte-pod1) | PASS/total defcore: 205/205 HA: 8/8 vping: 2/2 ipv6: 25/25 tempest: 4/5 SDNVPN: 0/4 no SDN feature | |||||||
os-odl_l2-bgpvpn-ha | Fuel | PASS/total defcore: 205/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 3/4 sdnvpn.tc001 " | PASS/total defcore: 205/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 4/4 | PASS/total defcore: 205/205 HA: 8/8 ipv6: 17/25 tc018-tc025 fails SDNVPN: 4/4 | |||||
Other Scenarios | |||||||||
os-nosdn-kvm-ha | Apex | ||||||||
os-odl_l3-fdio-ha | Apex | ||||||||
os-onos-nofeature-ha Don't test against this scenario since Compass will not release this scenario anymore. | Compass |
|
|
|
|
| |||
os-odl_l2-nofeature-ha | Fuel(ZTE-POD1) | ||||||||
os-nosdn-ovs-ha | Fuel | ||||||||
os-odl_l3-nofeature-ha | Fuel | ||||||||
os-nosdn-kvm_ovs_dpdk-ha | Fuel |
...