2018-06-25
...
...
2018-06-25
Mandatory Tests
| Installer | Scenario | vping_userdata | vping_ssh | stress.ping | tempest.osinterop | tempest.compute | tempest.identity_v3 | tempest.image | tempest.network_api | tempest.volume | tempest.trunk_ports | tempest.ipv6_api | security.patrole | ha.nova_api | ha.neutron_server | ha.keystone | ha.glance_api | ha.cinder_api | ha.cpu_load | ha.disk_load | ha.haproxy | ha.rabbitmq | ha.database | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Apex | fraser | PASS | PASS | PASS | FAIL
| PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | FAIL HA proxy processes don't recover | PASS | PASS | ||||||||||
| Compass | fraser | PASS | FAIL cannot connect to 192.168.11.xxx | PASS | PASS total: 200 | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | FAIL
| PASS | ||||||||||
| Fuel | master | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | PASS | FAIL SLA failure: | UNSTABLE most of the time the test detects 11 keystone processes of which only 9 recover Is the keystone process query correct? | PASS | PASS | FAIL SLA failure: | PASS | PASS | FAIL SLA failure:rabbitmq-server not found | FAIL SLA failure: 13.879296 > 5.000000 |
2018-06-25
| Installer | Scenario | stress.ping | tempest.compute | tempest.identity_v2 | tempest.identity_v3 | tempest.image | tempest.network_api | tempest.volume | tempest.trunk_ports | security.patrole | ha.controller_restart | ha.rabbitmq | ha.database | ha.neutron_l3_agent | tempest.network_scenario | vnf.vEPC | vnf.vIMS | tempest.bgpvpn | snaps.smoke | |||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Apex | stable/fraser | FAIL | PASS | FAIL - only v3 used skip mechanism needed or just part of reviewer instructions (does not need to be automated)
| PASS | PASS | PASS | PASS | PASS | PASS | FAIL IPMI info missing | PASS | PASS | PASS | PASS | FAIL passes on Apex daily loop | PASS | not supported | FAIL test_volume_type_with_encryption test_volume_type_with_qos_and_encryption passes on Apex daily CI loop | |||||||||||||||||||||||||||||||||||||||||
stable/fraser | FAIL | PASSFAIL | FAIL - only v3 used skip mechanism needed or just part of reviewer instructions (does not need to be automated)
| PASS | FAIL | FAIL | FAIL | FAIL | FAIL IPMI info missing | PASS | PASS | not supported: l3 agent not installed | FAIL | FAIL | FAIL | FAIL | FAIL | |||||||||||||||||||||||||||||||||||||||||||
master | FAIL | PASS | not supported | PASS | PASS | PASS | PASS | not supportedPASS | PASS | FAIL IPMI info missing | PASS | PASS | PASS | odlPASS | stable/fraserPASS | FAIL VM in error state: "no valid host found" passes on Apex daily CI loop | not supported | FAIL | FAIL | FAIL | FAIL | FAIL - only v3 used skip mechanism needed or just part of reviewer instructions (does not need to be automated) | FAIL | FAIL | FAIL | FAIL | FAIL | FAIL IPMI info missing | PASS | not supported: l3 agent not installed | PASS | master | FAIL VM in error state: "no valid host found" passes on Apex daily CI loop | PASS | FAIL | PASS | not supported | PASS | PASS | PASS | ||||||||||||||||||||
| Compass | stable/fraser | PASS create stack rate 5/5 | PASS | SKIP | PASS | PASS | PASS | PASS | PASS skip: 9 pass: 43 | PASS skip: 3 (dvr is not enabled) pass: 132 test_create_distributed_router ... skiptest_show_distributed_router ... skiptest_update_distributed_router ... skip | PASS | PASS | PASS | FAIL SLA failure: 9.023325 > 5.000000 | FAIL fail: 5 No IPv4 addresses found | PASS | PASS | not supported | PASSPASS | PASS | PASS | Compass | nosdn-nofeatureFAIL | fail: 1 pass: 120 test_ssh_client_fip_after_reboot ... fail | ||||||||||||||||||||||||||||||||||||
stable/fraser | PASS | PASS | PASS | create stack rate | 05/ | 205 | PASS | SKIP | PASS | PASS | PASS | PASS | PASS | skip: 9 pass: 43 | PASS skip: 5 (l3_agent_scheduler extension not enabled) pass: 130 test_create_router_on_l3_agent ... skiptest_delete_router_from_l3_agent ... | failskiptest_list_routers_ | networkon_ | basicl3_ | opsagent ... | failtest_subnet_detailsskiptest_create_high_availability_router ... | failskiptest_update_ | instancehigh_ | portavailability_ | admin_staterouter ... | failskip | PASS | PASS | not supported | PASS | PASS | FAIL SLA failure: 9.023325 > 5.000000 | PASS | stable/fraser | PASS | PASSPASS | not supported: l3 agent not installed | FAIL fail: 2 (False is not true : ip address 192.168.11.114 is reachable) test_update_instance_port_admin_state test_update_router_admin_state | PASS | PASS | not supported | FAIL fail: 2 pass: 117 | FAIL failed to create stacks | PASS | SKIP119 test_create_network_router_admin_user_to_new_project ... failtest_create_network_router_new_user_to_admin_project ... fail | ||||||||||||||||
| Fuel (x86) | master | PASS | PASS | FAIL | PASS | PASS skip: 9 pass: 43 | not supported | - only v3 used skip mechanism needed or just part of reviewer instructions (does not need to be automated)
| PASS | PASS | PASS | PASS | PASS | not supportedskip: | l3 agent not installed9 pass: 43 | PASSPASS | Fuel (x86) | master | FAIL deployment clearwater-opnfv timed out | FAIL passes on FUEL daily CI loop | PASS | FAIL | FAIL | FAIL - only v3 used skip mechanism needed or just part of reviewer instructions (does not need to be automated)
| PASS | skip: 3 (dvr is not enabled) pass: 132 test_create_distributed_router ... skiptest_show_distributed_router ... skiptest_update_distributed_router ... skip | PASS | FAIL rabbitmq located in msg0x VMs | FAIL database located in dbs0x VMs | FAIL l3-agent in gtw0x VMs | test_show_distributed_routerFAIL - Success: 183
- Skipped: 0
- Expected failures: 0
- Unexpected success: 0
- Failures:
1 test_hotplug_nic ... fail | PASS | PASS skip: 9 pass: 43 | not supported | - Failures: 2test_update_instance_port_admin_state ... | skipfailtest_update | _distributed_router ... skipPASS | FAIL rabbitmq located in msg0x VMs | FAIL l3-agent in gtw0x VMs | FAIL database located in dbs0x VMs https://docs.opnfv.org/en/stable-fraser/submodules/fuel/docs/release/installation/installation.instruction.html#automatic-installation-of-a-baremetal-pod_router_admin_state ... fail | FAIL passes on FUEL daily CI loop | FAIL deployment clearwater-opnfv timed out | not supported | PASS |
| Installer | Scenario | vping_ssh | vping_userdata | tempest.osinterop | tempest.ipv6 | tempest.multi_node_scheduling | tempest.security | tempest.vm_lifecycle | ha.nova_api | ha.neutron_server | ha.keystone | ha.glance_api | ha.cinder_api | ha.cpu_load | ha.disk_load | ha.haproxy | sdnvpn.subnet_connectivity | sdnvpn.tenant_separation | sdnvpn.router_assoc | sdnvpn.router_assoc_fip |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Apex | stable/fraser | PASS | FAIL passes on Apex daily loop | FAIL passes on Apex daily CI loop | FAIL | FAIL | FAIL | FAIL | PASS | FAIL | PASS | PASS | FAIL | PASS | FAIL IPMI info missing | PASS | not supported | not supported | not supported | not supported |
| Fuel | nosdn-nofeature | PASS | PASS | FAIL | FAIL | FAIL | FAIL | FAIL | PASS | PASS | FAIL | PASS | FAIL | PASS | PASS | PASS | not supported | not supported | not supported | not supported |
Historical results below
2018-05-23 - limited results due to failed CI jobs
...