Versions Compared

Version Old Version 43 New Version 44
Changes made by

Dan Xu

Dan Xu

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

 

this wiki page is used to record the running histroy for the dovetil tool.this may cover the runnning in the plugfest, CI and vendors lab.

Table of Contents

1. Version change logs

for For each dovetail release version, the docker images used are introduced first, then problems found and fixesfixed are listed as well as the updates.

1.1 cvp.0.1.0  (2017/06/23)

1.1.1

...

Docker images used:

opnfv/dovetail:cvp.0.1.0 (commit ID 041a51d6d3ba5f2d9eabcf3501abb9af30ebc394)

...

opnfv/testapi:cvp.0.1.0 (Commit ID 056b7ccefe38b13e4b4eb11ff7e259e254e35c32)

1.1.2 Updates and problems found and

...

fixed in this version

ImageUpdates and problems found and

...

fixedJIRAGerrit
opnfv/dovetail:cvp.0.1.0

...

  1. https

...

JIRA:DOVETAIL-456

2)sdnvpn path fix

JIRA:DOVETAIL-458

3)log improvement

JIRA:DOVETAIL-450

...

  1. enabled checking
  2. sdnvpn path fix
  3. log improvement
  4. docker image tag with cvp.0.2.0

...

  1. DOVETAIL-456
  2. DOVETAIL-458
  3. DOVETAIL-450
  4. DOVETAIL-447

 

problems found and fixes in opnfv/yardstick:danube.2.0 for HA test cases in yardstick consumed by dovetail

1). Bugfix: Monitor command in tc019 may not show the real nova-api service status

   JIRA:YARDSTICK-655

...

  1. https://gerrit.opnfv.org/gerrit/#/c/36541/
  2. https://gerrit.opnfv.org/gerrit/#/c/36785/
  3. https://gerrit.opnfv.org/gerrit/#/c/36615/
  4. https://gerrit.opnfv.org/gerrit/#/c/36775/
opnfv/yardstick:danube.2.0
  1. Bugfix: Monitor command in tc019 may not show the real nova-api service status
  2. Bugfix: "monitor_multi" type monitor in HA test case cannot get "max_recover_time"

   JIRA:YARDSTICK-657

...

  1. Improvement: Terminate openstack service's process using "kill" command

...

...

  1. Improvement: "monitor_process" type monitor pass criteria

...

...

  1. Bugfix: test.dbf file not deleted after execution of Disk I/O Block High Availability test

...

  1. YARDSTICK-655
  2. YARDSTICK-657
  3. YARDSTICK-659
  4. YARDSTICK-660
  5. YARDSTICK-696

 

problems found and fixes in  opnfv/functest:danube.2.0 

for SDNVPN test cases in functest consumed by dovetail 

“Unknown test case or tier 'bgpvpn', or not supported by the given scenario 'bgpvpn'”

  1. https://gerrit.opnfv.org/gerrit/#/c/34817/
  2. https://gerrit.opnfv.org/gerrit/#/c/

...

  1. 35251/

...

  2. https://gerrit.opnfv.org/gerrit/#/c/

...

  1. 36215/

...

  2. https://gerrit.opnfv.org/gerrit/#/c/

...

  1. 35329/

 

problems found and fixes in  opnfv/testapi:cvp.0.1.0

user management and some bugfix

1.2 cvp.0.2.0 (2017/07/07)

1.2.1 docker images used:

opnfv/dovetail:cvp.0.2.0 (commit ID 5ddf932dc28bcc47169c3091267d57ba5a99f9b2)

opnfv/yardstick:danube.3.0

...

  1. https://gerrit.opnfv.org/gerrit/#/c/36759/
opnfv/functest:danube.2.0 
  1. SDNVPN test cases are not enable in Functest
None

https://gerrit.opnfv.org/gerrit/#/c/35051/2

https://gerrit.opnfv.org/gerrit/#/c/36777/3

opnfv/testapi:cvp.0.

...

1.0
  1. user management and some bugfix
  


1.2 cvp.0.2.0 (2017/07/07)

1.2.

...

1 Docker images used:

opnfv/dovetail:cvp.0.2.0

...

1) IPv6 certification document: change “using DHCPv6” --->“using DHCPv6 stateless”  Update tc018-tc025: give more details and modify some misunderstanding about these test cases
JIRA: DOVETAIL-461 https://gerrit.opnfv.org/gerrit/#/c/37229/
2) Delete the ERROR log when it is not https
JIRA: DOVETAIL-462 https://gerrit.opnfv.org/gerrit/#/c/37449/
3) changes in yardstick danube.3.1 Adapt Yardstick to copy yardstick.conf to /etc/yardstick
JIRA: DOVETAIL-466 https://gerrit.opnfv.org/gerrit/#/c/37737/
4?Fix the docker version to be 17.03.0-ce rather than the latest one

...

(commit ID 5ddf932dc28bcc47169c3091267d57ba5a99f9b2)

opnfv/yardstick:danube.3.0

opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)

opnfv/testapi:cvp.0.2.0 (commit ID a7f82c093fab2ad19c7ffb0a81ec5756e91e73ae)

1.2.2 Updates and problems found and fixed in this version

ImageUpdates and problems found and fixedJIRAGerrit
opnfv/dovetail:cvp.0.2.0
  1. Update IPv6 tc018-tc025: give more details and modify some misunderstanding about these test cases
  2. Delete the ERROR log when it is not https
  3. Adapt Yardstick to copy yardstick.conf to /etc/yardstick
  4. Fix the docker version to be 17.03.0-ce rather than the latest one
  1. DOVETAIL-461
  2. DOVETAIL-462
  3. DOVETAIL-466
  4. DOVETAIL-467
  1. https://gerrit.opnfv.org/gerrit/#/c/

...

  1. 37229/
problems found and fixes in opnfv/yardstick:danube.3.1 for HA test cases in yardstick consumed by dovetail
1?“GeneralHA” type now will check if the target service process in the controller node

...

  1. https://gerrit.opnfv.org/gerrit/#/c/37449/
  2. https://gerrit.opnfv.org/gerrit/#/c/37737/
  3. https://gerrit.opnfv.org/gerrit/#/c/37813/
opnfv/yardstick:danube.3.0
  1. Support ignoring server certificate
  2. Add debug log for recovering service failure

...

  1. Improve method to kill keystone process


  1. https://gerrit.opnfv.org/gerrit/#/c/36377/

...

opnfv/functest:cvp.0.2.0None 
None 

...

 
opnfv/testapi:cvp.0.

...

2.0

...

  1. role based access control and result upload
  2. testapi tox bugfix
  3. some bugfix
 
  1. https://gerrit.opnfv.org/gerrit/#/c/37053/
    https://gerrit.opnfv.org/gerrit/#/c/37839

...

  1. /
  2. https://gerrit.opnfv.org/gerrit/#/c/37459/
  3. https://gerrit.opnfv.org/gerrit/#/c/37765/
    https://gerrit.opnfv.org/gerrit/#

...

3) some bugfix

...

  1. /c/37723/
    https://gerrit.opnfv.org/gerrit/#/c/37711/

1.3 cvp.0.3.0 (2017/7/21)

1.3.1 Docker images used:

opnfv/dovetail:cvp.0.3.0 (commit ID 7ed1cf189676693d84c9d48bb964c178b16bae76)

opnfv/yardstick:danube.3.1

opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)

opnfv/testapi:cvp.0.3.0 (commit ID 4e0b74b0141e3ae5d250006f3d75fcc880738cc9)

1.3.2 Updates and problems found and fixed in this version

ImageUpdates and problems found and fixedJIRAGerrit
opnfv/dovetail:cvp.0.3.0
  1. Add docs about vping test cases (test scope and test specification)
  2. Add 2 vping test cases (vping.tc001->vping_userdata, vping_tc002->vping_ssh) into proposed_tests
  3. Bugfix: Build docker image failed because of lacking of packages
  1. None
  2. DOVETAIL-446
  3. DOVETAIL-475
  1. https://gerrit.opnfv.org/gerrit/#/c/
37723
  1. 36253/
  2. https://gerrit.opnfv.org/gerrit/#/c/
37711/

1.3 cvp.0.3.0 (2017/7/21)

1.3.1 docker images used:

opnfv/dovetail:cvp.0.3.0 (commit ID 7ed1cf189676693d84c9d48bb964c178b16bae76)
  1. 37853/
  2. https://gerrit.opnfv.org/gerrit/#/c/38573/
opnfv/yardstick:danube.3.1None  
opnfv/functest:cvp.0.2.0
(commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)
None  
opnfv/testapi:cvp.0.3.0
(commit ID 4e0b74b0141e3ae5d250006f3d75fcc880738cc9)
  

 

 

2. Running by CI

in order to make the dovetail tool  more stable, the dovetail has been integreated in the CI for daily running.

...