The table below captures the current functest integration status.
Participants:
| Test suite | Test case | Status |
|---|---|---|
| Healthcheck | ||
| airship-opnfv-functest-healthcheck-latest-connection_check-run | ||
| airship-opnfv-functest-healthcheck-latest-tenantnetwork1-run | ||
| airship-opnfv-functest-healthcheck-latest-tenantnetwork2-run | ||
| airship-opnfv-functest-healthcheck-latest-vmready1-run | ||
| airship-opnfv-functest-healthcheck-latest-vmready2-run | ||
| airship-opnfv-functest-healthcheck-latest-singlevm1-run | ||
| airship-opnfv-functest-healthcheck-latest-singlevm2-run | ||
| airship-opnfv-functest-healthcheck-latest-vping_ssh-run | ||
| airship-opnfv-functest-healthcheck-latest-vping_userdata-run | ||
| vping_userdata-run | Upstream bug: AIRSHIP-95. Nova instance console log api returns emptry | |
| airship-opnfv-functest-healthcheck-latest-cinder_test-run | ||
| airship-opnfv-functest-healthcheck-latest-odl-run | ||
| airship-opnfv-functest-healthcheck-latest-tempest_smoke-run | ||
| airship-opnfv-functest-healthcheck-latest-tempest_horizon-run | ||
| Smoke | ||
| airship-opnfv-functest-smoke-latest-tempest_neutron-run | ||
| neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_dhcp_port_status_active | Requires neutron extensions not supported in Airship DPDK | |
| neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_networks_hosted_by_one_dhcp | same | |
| neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_delete_policies_while_tenant_attached_to_net | same | |
| neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_update_policy_from_wildcard_to_specific_tenant | same | |
| neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_policy_allows_tenant_to_allocate_floatingip | same | |
| neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_policy_allows_tenant_to_attach_ext_gw | same | |
| neutron_tempest_plugin.api.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips_outrange | same | |
| neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_create_floatingip_with_timestamp | same | |
| neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_create_router_with_timestamp | same | |
| neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_show_floatingip_attribute_with_timestamp | same | |
| neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_show_router_attribute_with_timestamp | same | |
| neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_update_floatingip_with_timestamp | same | |
| neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_update_router_with_timestamp | same | |
| QOS test cases | Upstream: QOS support in DPDK | |
| neutron_tempest_plugin.api.test_security_groups.RbacSharedSecurityGroupTest.test_regular_client_shares_to_another_regular_client | TBD | |
| airship-opnfv-functest-smoke-latest-tempest_cinder-run | ||
| cinder_tempest_plugin.api.volume.test_volume_revert.VolumeRevertTests.test_volume_revert_to_snapshot | AIRSHIP-96: upstream bug related to kernel 4.15 | |
| airship-opnfv-functest-smoke-latest-tempest_keystone-run | ||
| airship-opnfv-functest-smoke-latest-refstack_platform-run | skipped | |
| airship-opnfv-functest-smoke-latest-tempest_full-run | ||
| airship-opnfv-functest-smoke-latest-tempest_heat-run | ||
| heat_tempest_plugin.tests.functional.test_nova_server_networks.CreateServerTest.test_create_server_with_port | Requires neutron l3 extension not supported in Airship DPDK | |
| heat_tempest_plugin.tests.functional.test_nova_server_networks.CreateServerTest.test_create_server_with_subnet_fixed_ip_sec_group | ||
| heat_tempest_plugin.tests.functional.test_nova_server_networks.CreateServerTest.test_create_update_server_with_subnet | ||
| heat_tempest_plugin.tests.functional.test_nova_server_networks.UpdateServerNetworksTest.test_create_update_server_add_network | ||
| heat_tempest_plugin.tests.functional.test_nova_server_networks.UpdateServerNetworksTest.test_create_update_server_add_same_fixed_ip | ||
| heat_tempest_plugin.tests.functional.test_nova_server_networks.UpdateServerNetworksTest.test_create_update_server_add_subnet | ||
| heat_tempest_plugin.tests.functional.test_nova_server_networks.UpdateServerNetworksTest.test_create_update_server_multi_networks_swaps | ||
| heat_tempest_plugin.tests.functional.test_nova_server_networks.UpdateServerNetworksTest.test_create_update_server_swap_network_port | ||
| heat_tempest_plugin.tests.functional.test_nova_server_networks.UpdateServerNetworksTest.test_create_update_server_swap_network_subnet | ||
| heat_tempest_plugin.tests.functional.test_nova_server_networks.UpdateServerNetworksTest.test_create_update_server_swap_subnet_network | ||
| heat_tempest_plugin.tests.scenario.test_server_signal.ServerSignalIntegrationTest.test_server_signal_userdata_format_raw | ||
| heat_tempest_plugin.tests.scenario.test_server_signal.ServerSignalIntegrationTest.test_server_signal_userdata_format_software_config | ||
| heat_tempest_plugin.tests.functional.test_os_wait_condition.OSWaitCondition.test_create_stack_with_multi_signal_waitcondition | TBD | |
| heat_tempest_plugin.tests.scenario.test_base_resources.BasicResourcesTest.test_base_resources_integration | TBD | |
| heat_tempest_plugin.tests.scenario.test_remote_deeply_nested.RemoteDeeplyNestedStackTest.test_remote_nested | TBD | |
| airship-opnfv-functest-smoke-latest-tempest_scenario-run | ||
| tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops | Upstream bug: AIRSHIP-103. Nova metaservice url not reachable from guest vm | |
| airship-opnfv-functest-smoke-latest-tempest_telemetry-run | skipped | |
| airship-opnfv-functest-smoke-latest-tempest_slow-run | ||
| tempest.scenario.test_volume_backup_restore.TestVolumeBackupRestore.test_volume_backup_restore | FUNCTEST-1019: teste volume backup depends on floating ip | |
| tempest.api.compute.servers.test_device_tagging.TaggedBootDevicesTest.test_tagged_boot_devices | FUNCTEST-1020: test device tagging still uses tenant network | |
| airship-opnfv-functest-smoke-latest-rally_sanity-run | ||
| NovaServers.boot_and_live_migrate_server | No support from OpenStack Helm. Recommend to blacklist. | |
| airship-opnfv-functest-smoke-latest-patrole-run | ||
| airship-opnfv-functest-smoke-latest-refstack_compute-run | skipped | |
| airship-opnfv-functest-smoke-latest-refstack_object-run | ||
| airship-opnfv-functest-smoke-latest-networking-sfc-run | skipped | |
| airship-opnfv-functest-smoke-latest-networking-bgpvpn-run | skipped | |
| airship-opnfv-functest-smoke-latest-tempest_barbican-run | skipped | |
| airship-opnfv-functest-smoke-latest-tempest_octavia-run | skipped | |
| Benchmark | ||
| airship-opnfv-functest-benchmarking-latest-rally_full-run | ||
| NeutronNetworks.create_and_show_ports | needs blacklist. It needs router extension. | |
| NovaServers.resize_server | SLA. Retest on pod 15. pod17 too small. | |
| GlanceImages.create_and_deactivate_image | SLA. Retest on pod 15. pod17 too small. | |
| airship-opnfv-functest-benchmarking-latest-rally_jobs-run | skipped | |
| airship-opnfv-functest-benchmarking-latest-vmtp-run | skipped | |
| airship-opnfv-functest-benchmarking-latest-shaker-run | skipped | |
| VNF | ||
| airship-opnfv-functest-vnf-latest-cloudify-run | FUNCTEST-1017: cloudify vpn deploy uses floating ip. Shoudl change to use "public" network or skip. | |
| airship-opnfv-functest-vnf-latest-cloudify_ims-run | skipped | |
| airship-opnfv-functest-vnf-latest-heat_ims-run | skipped | |
| airship-opnfv-functest-vnf-latest-vyos_vrouter-run | skipped | |
| airship-opnfv-functest-vnf-latest-juju_epc-run | skipped |
...