Airship 1.8 (DPDK) FuncTest integration

Anuket Project

Airship 1.8 (DPDK) FuncTest integration

The table below captures the current status of functest integration. Please remove the issue from the table when it is resolved,  



@Cédric Ollivier

@James Gu



Test suite

Test case

Issue

Resolution

Test suite

Test case

Issue

Resolution

Healthcheck







airship-opnfv-functest-healthcheck-latest-connection_check-run







airship-opnfv-functest-healthcheck-latest-tenantnetwork1-run







airship-opnfv-functest-healthcheck-latest-tenantnetwork2-run







airship-opnfv-functest-healthcheck-latest-vmready1-run







airship-opnfv-functest-healthcheck-latest-vmready2-run







airship-opnfv-functest-healthcheck-latest-singlevm1-run







airship-opnfv-functest-healthcheck-latest-singlevm2-run







airship-opnfv-functest-healthcheck-latest-vping_ssh-run







airship-opnfv-functest-healthcheck-latest-vping_userdata-run









vping_userdata-run

Upstream bug: AIRSHIP-95. Nova instance console log api returns emptry



airship-opnfv-functest-healthcheck-latest-cinder_test-run







airship-opnfv-functest-healthcheck-latest-odl-run







airship-opnfv-functest-healthcheck-latest-tempest_smoke-run







airship-opnfv-functest-healthcheck-latest-tempest_horizon-run







Smoke







airship-opnfv-functest-smoke-latest-tempest_neutron-run









neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_dhcp_port_status_active

Requires neutron extensions not supported in Airship DPDK





neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_networks_hosted_by_one_dhcp

same 





neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_delete_policies_while_tenant_attached_to_net

same





neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_update_policy_from_wildcard_to_specific_tenant

same





neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_policy_allows_tenant_to_allocate_floatingip

same





neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_policy_allows_tenant_to_attach_ext_gw

same





neutron_tempest_plugin.api.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips_outrange

same





neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_create_floatingip_with_timestamp

same





neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_create_router_with_timestamp

same





neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_show_floatingip_attribute_with_timestamp

same





neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_show_router_attribute_with_timestamp

same





neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_update_floatingip_with_timestamp

same





neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_update_router_with_timestamp

same





QOS test cases

Upstream: QOS support in DPDK





neutron_tempest_plugin.api.test_security_groups.RbacSharedSecurityGroupTest.test_regular_client_shares_to_another_regular_client

TBD



airship-opnfv-functest-smoke-latest-tempest_cinder-run









cinder_tempest_plugin.api.volume.test_volume_revert.VolumeRevertTests.test_volume_revert_to_snapshot

AIRSHIP-96: upstream bug related to kernel 4.15



airship-opnfv-functest-smoke-latest-tempest_keystone-run







airship-opnfv-functest-smoke-latest-refstack_platform-run



skipped



airship-opnfv-functest-smoke-latest-tempest_full-run









tempest.api.compute.admin.test_instance_usage_audit_log_negative.InstanceUsageAuditLogNegativeTestJSON.test_instance_usage_audit_logs_with_nonadmin_user

AIRSHIP-104: Airship rbac policy inconsistent with tempest default

https://review.opendev.org/c/airship/treasuremap/+/767395



empest.api.compute.admin.test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration

1289064: upstream: live migration is broken in numa. Needs Train





tempest.api.compute.admin.test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration_paused

same





tempest.api.compute.admin.test_live_migration.LiveMigrationTest.test_live_block_migration

same





tempest.api.compute.admin.test_live_migration.LiveMigrationTest.test_live_block_migration_paused

same





tempest.api.compute.admin.test_migrations.MigrationsAdminTest.test_list_migrations_in_flavor_resize_situation

TBD





tempest.api.compute.admin.test_migrations.MigrationsAdminTest.test_resize_server_revert_deleted_flavor

TBD





tempest.api.compute.admin.test_simple_tenant_usage.TenantUsagesTestJSON.test_get_usage_tenant_with_non_admin_user

AIRSHIP-105: Airship rbac policy inconsistent with tempest default

https://review.opendev.org/c/airship/treasuremap/+/767395



tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_create_list_show_delete_interfaces_by_network_port

fail 36.011





tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_reassign_port_between_servers

fail 89.588





tempest.api.compute.servers.test_create_server_multi_nic.ServersTestMultiNic.test_verify_duplicate_network_nics

fail 126.883





tempest.api.compute.servers.test_create_server_multi_nic.ServersTestMultiNic.test_verify_multiple_nics_order

fail 125.284













tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_server_while_in_verify_resize_state

TBD





tempest.api.compute.servers.test_device_tagging.TaggedAttachmentsTest.test_tagged_attachment

TBD





tempest.api.compute.servers.test_disk_config.ServerDiskConfigTestJSON.test_resize_server_from_auto_to_manual

TBD





tempest.api.compute.servers.test_disk_config.ServerDiskConfigTestJSON.test_resize_server_from_manual_to_auto

TBD





tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output

Upstream bug: AIRSHIP-95. Nova instance console log api returns emptry





tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output_server_id_in_shutoff_status

same





tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output_with_unlimited_size

same





tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm

TBD





tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm_from_stopped

TBD





tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert

TBD





tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert_with_volume_attached

TBD





tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_volume_backed_server_confirm

TBD





tempest.api.identity.admin.v3.test_application_credentials.ApplicationCredentialsV3AdminTest.test_create_application_credential_with_roles

AIRSHIP-106: Airship rbac policy inconsistent with tempest default





tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_list_groups

AIRSHIP-107: possible rbac?





tempest.api.identity.admin.v3.test_list_users.UsersV3TestJSON.test_list_usersz

AIRSHIP-108: possible rbac





tempest.api.identity.admin.v3.test_list_users.UsersV3TestJSON.test_list_users_with_name

same





tempest.api.identity.admin.v3.test_projects_negative.ProjectsNegativeStaticTestJSON.test_list_projects_by_unauthorized_user

AIRSHIP-109: airship rbac policy is different than tempest default





tempest.api.identity.v3.test_application_credentials.ApplicationCredentialsV3Test.test_create_application_credential

AIRSHIP-110: airship rbac policy is different than tempest default

https://review.opendev.org/c/airship/treasuremap/+/767395



tempest.api.identity.v3.test_application_credentials.ApplicationCredentialsV3Test.test_create_application_credential_expires

same





tempest.api.identity.v3.test_application_credentials.ApplicationCredentialsV3Test.test_list_application_credentials

same





tempest.api.identity.v3.test_application_credentials.ApplicationCredentialsV3Test.test_query_application_credentials

same





tempest.api.identity.v3.test_users.IdentityV3UsersTest.test_password_history_check_self_service_api

TBD: possible rbac





tempest.api.identity.v3.test_users.IdentityV3UsersTest.test_user_account_lockout

TBD: possible rbac





tempest.api.identity.v3.test_users.IdentityV3UsersTest.test_user_update_own_password

TBD: possible rbac