Compliance Tests on UNH Lab

zhuguanyu Please add the Basic info of the k8s cluster you have deployed on UNH Lab including the version and config file.

Also you can give the self-test results here. Thanks.

basic cluster

version: 1.21.1

kubeconfig:

self-test result

functest-kubernetes-healthcheck

k8s_quick: PASS

log

2022-11-10 06:44:37,682 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 06:44:37,693 - xtesting.ci.run_tests - INFO - Loading test case 'k8s_quick'...
2022-11-10 06:44:37,708 - xtesting.ci.run_tests - INFO - Running test case 'k8s_quick'...
2022-11-10 06:44:59,271 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 06:44:59,273 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK
(reverse-i-search)`ex': ^Cport DEPLOY_SCENARIO=k8-nosdn-nofeature-noha

k8s_smoke: PASS

log

2022-11-10 08:36:30,096 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 08:36:30,113 - xtesting.ci.run_tests - INFO - Loading test case 'k8s_smoke'...
2022-11-10 08:36:30,138 - xtesting.ci.run_tests - INFO - Running test case 'k8s_smoke'...
2022-11-10 08:36:46,562 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 08:36:46,564 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

functest-kubernetes-smoke

xrally_kubernetes: PASS

log

2022-11-10 08:36:30,096 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 08:36:30,113 - xtesting.ci.run_tests - INFO - Loading test case 'k8s_smoke'...
2022-11-10 08:36:30,138 - xtesting.ci.run_tests - INFO - Running test case 'k8s_smoke'...
2022-11-10 08:36:46,562 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 08:36:46,564 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

k8s_conformance:PASS

log

2.2
bash-5.1# run_tests -t k8s_conformance
2022-11-10 11:28:12,194 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 11:28:12,197 - xtesting.ci.run_tests - ERROR - Unknown test case or tier 'k8s_conformance', or not supported by the given scenario 'k8-nosdn-nofeature-noha'.

2.3
bash-5.1# run_tests -t k8s_conformance
2022-11-10 11:32:37,156 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 11:32:37,257 - xtesting.ci.run_tests - INFO - Loading test case 'k8s_conformance'...
2022-11-10 11:32:37,367 - xtesting.ci.run_tests - INFO - Running test case 'k8s_conformance'...
2022-11-10 11:46:36,493 - functest_kubernetes.k8stest - ERROR - Summarizing 7 Failures:

[Fail] [sig-network] Services [It] should be able to create a functioning NodePort service [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1169

[Fail] [sig-node] Probing container [It] should *not* be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/container_probe.go:148

[Fail] [sig-network] Services [It] should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:2576

[Fail] [sig-network] Services [It] should have session affinity work for NodePort service [LinuxOnly] [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:2576

[Fail] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] [It] Should recreate evicted statefulset [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113

[Fail] [sig-network] Services [It] should have session affinity timeout work for NodePort service [LinuxOnly] [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:2497

[Fail] [sig-network] Services [It] should be able to change the type from ExternalName to NodePort [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1351

2022-11-10 11:46:36,495 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 11:46:36,497 - xtesting.ci.run_tests - ERROR - The test case 'k8s_conformance' failed.
2022-11-10 11:46:36,497 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR

2.4
bash-5.1# run_tests -t sig_api_machinery
2022-11-10 12:02:57,991 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:02:58,055 - xtesting.ci.run_tests - INFO - Loading test case 'sig_api_machinery'...
2022-11-10 12:02:58,123 - xtesting.ci.run_tests - INFO - Running test case 'sig_api_machinery'...
2022-11-10 12:09:22,900 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 12:09:22,902 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

2.5
bash-5.1# run_tests -t sig_api_machinery_serial
2022-11-10 12:19:47,585 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:19:47,687 - xtesting.ci.run_tests - INFO - Loading test case 'sig_api_machinery_serial'...
2022-11-10 12:19:47,794 - xtesting.ci.run_tests - INFO - Running test case 'sig_api_machinery_serial'...
2022-11-10 12:21:21,624 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 12:21:21,627 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

2.6
bash-5.1# run_tests -t sig_apps
2022-11-10 12:34:29,184 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:34:29,283 - xtesting.ci.run_tests - INFO - Loading test case 'sig_apps'...
2022-11-10 12:34:29,389 - xtesting.ci.run_tests - INFO - Running test case 'sig_apps'...
2022-11-10 12:36:32,646 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 12:36:32,649 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

2.7
bash-5.1# run_tests -t sig_apps_serial
2022-11-10 12:43:03,217 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:43:03,315 - xtesting.ci.run_tests - INFO - Loading test case 'sig_apps_serial'...
2022-11-10 12:43:03,420 - xtesting.ci.run_tests - INFO - Running test case 'sig_apps_serial'...
2022-11-10 13:03:29,449 - functest_kubernetes.k8stest - ERROR - Summarizing 2 Failures:

[Fail] [sig-apps] DisruptionController [It] evictions: maxUnavailable deny evictions, integer => should not allow an eviction [Serial]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:286

[Fail] [sig-apps] DisruptionController [It] evictions: too few pods, replicaSet, percentage => should not allow an eviction [Serial]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:286

2022-11-10 13:03:29,450 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 13:03:29,451 - xtesting.ci.run_tests - ERROR - The test case 'sig_apps_serial' failed.
2022-11-10 13:03:29,452 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR

2.8
bash-5.1# run_tests -t sig_instrumentation
2022-11-10 12:58:48,233 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:58:48,372 - xtesting.ci.run_tests - INFO - Loading test case 'sig_instrumentation'...
2022-11-10 12:58:48,478 - xtesting.ci.run_tests - INFO - Running test case 'sig_instrumentation'...
2022-11-10 12:58:52,474 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 12:58:52,477 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

2.9
bash-5.1# run_tests -t sig_auth
2022-11-10 12:56:38,731 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:56:38,830 - xtesting.ci.run_tests - INFO - Loading test case 'sig_auth'...
2022-11-10 12:56:38,987 - xtesting.ci.run_tests - INFO - Running test case 'sig_auth'...
2022-11-10 13:06:46,024 - functest_kubernetes.k8stest - ERROR - Summarizing 5 Failures:

[Fail] [sig-auth] [Feature:NodeAuthorizer] [It] Getting an existing configmap should exit with the Forbidden error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/node_authz.go:103

[Fail] [sig-auth] [Feature:NodeAuthorizer] [It] Getting a secret for a workload the node has access to should succeed
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/node_authz.go:122

[Fail] [sig-auth] [Feature:NodeAuthorizer] [It] Getting an existing secret should exit with the Forbidden error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/node_authz.go:81

[Fail] [sig-auth] [Feature:NodeAuthorizer] [It] Getting a non-existent secret should exit with the Forbidden error, not a NotFound error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/node_authz.go:76

[Fail] [sig-auth] [Feature:NodeAuthorizer] [It] Getting a non-existent configmap should exit with the Forbidden error, not a NotFound error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/node_authz.go:86

2022-11-10 13:06:46,025 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 13:06:46,027 - xtesting.ci.run_tests - ERROR - The test case 'sig_auth' failed.
2022-11-10 13:06:46,027 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR

2.10
bash-5.1# run_tests -t sig_cluster_lifecycle
2022-11-10 12:57:12,748 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:57:12,847 - xtesting.ci.run_tests - INFO - Loading test case 'sig_cluster_lifecycle'...
2022-11-10 12:57:13,007 - xtesting.ci.run_tests - INFO - Running test case 'sig_cluster_lifecycle'...
2022-11-10 12:57:36,639 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 12:57:36,642 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

2.11

bash-5.1# run_tests -t sig_network
2022-11-10 12:59:34,362 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:59:34,463 - xtesting.ci.run_tests - INFO - Loading test case 'sig_network'...
2022-11-10 12:59:34,571 - xtesting.ci.run_tests - INFO - Running test case 'sig_network'...
2022-11-10 13:03:39,438 - functest_kubernetes.k8stest - ERROR - Summarizing 2 Failures:

[Fail] [sig-network] Conntrack [It] should be able to preserve UDP traffic when server pod cycles for a NodePort service
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113

[Fail] [sig-network] Services [It] should be able to update service type to NodePort listening on same port number but different protocols
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1245

2022-11-10 13:03:39,439 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 13:03:39,440 - xtesting.ci.run_tests - ERROR - The test case 'sig_network' failed.
2022-11-10 13:03:39,440 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR

2.12
bash-5.1# run_tests -t sig_node
2022-11-10 13:28:29,405 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 13:28:29,505 - xtesting.ci.run_tests - INFO - Loading test case 'sig_node'...
2022-11-10 13:28:29,611 - xtesting.ci.run_tests - INFO - Running test case 'sig_node'...
2022-11-10 13:57:14,874 - functest_kubernetes.k8stest - ERROR - Summarizing 1 Failure:

[Panic!] [sig-node] Probing container [It] should be ready immediately after startupProbe succeeds
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:55

2022-11-10 13:57:14,875 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 13:57:14,876 - xtesting.ci.run_tests - ERROR - The test case 'sig_node' failed.
2022-11-10 13:57:14,876 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR

2.13
bash-5.1# run_tests -t sig_scheduling_serial
2022-11-10 13:28:44,050 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 13:28:44,150 - xtesting.ci.run_tests - INFO - Loading test case 'sig_scheduling_serial'...
2022-11-10 13:28:44,256 - xtesting.ci.run_tests - INFO - Running test case 'sig_scheduling_serial'...
2022-11-10 13:42:58,573 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 13:42:58,575 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

2.14
bash-5.1# run_tests -t sig_storage
2022-11-10 13:28:58,164 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 13:28:58,263 - xtesting.ci.run_tests - INFO - Loading test case 'sig_storage'...
2022-11-10 13:28:58,370 - xtesting.ci.run_tests - INFO - Running test case 'sig_storage'...
2022-11-10 13:52:56,376 - functest_kubernetes.k8stest - ERROR - Summarizing 5 Failures:

[Fail] [sig-storage] CSI mock volume CSI NodeUnstage error cases [Slow] [It] two pods: should call NodeStage after previous NodeUnstage final error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:1017

[Fail] [sig-storage] PersistentVolumes-local [Volume type: dir-bindmounted] Set fsGroup for local volume [It] should set same fsGroup for two pods simultaneously [Slow]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:808

[Fail] [sig-storage] PersistentVolumes-local Stress with local volumes [Serial] [AfterEach] should be able to process many pods and reuse local volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/local.go:114

[Fail] [sig-storage] PersistentVolumes-local [Volume type: dir-link-bindmounted] Set fsGroup for local volume [It] should set same fsGroup for two pods simultaneously [Slow]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:808

[Fail] [sig-storage] CSI mock volume CSI NodeUnstage error cases [Slow] [It] two pods: should call NodeStage after previous NodeUnstage transient error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:1017

2022-11-10 13:52:56,377 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 13:52:56,379 - xtesting.ci.run_tests - ERROR - The test case 'sig_storage' failed.
2022-11-10 13:52:56,379 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR

2.15
bash-5.1# run_tests -t sig_storage_serial
2022-11-10 14:18:46,523 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 14:18:46,584 - xtesting.ci.run_tests - INFO - Loading test case 'sig_storage_serial'...
2022-11-10 14:18:46,650 - xtesting.ci.run_tests - INFO - Running test case 'sig_storage_serial'...
2022-11-10 14:22:24,652 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 14:22:24,655 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

3
opnfv/functest-kubernetes-security

3.1
run_tests -t kube_hunter

2022-11-10 11:20:38,300 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 11:20:38,316 - xtesting.ci.run_tests - INFO - Loading test case 'kube_hunter'...
2022-11-10 11:20:38,823 - xtesting.ci.run_tests - INFO - Running test case 'kube_hunter'...
2022-11-10 11:21:07,061 - functest_kubernetes.security.security - WARNING - Skipping CAP_NET_RAW Enabled (severity is configured as high)
2022-11-10 11:21:07,061 - functest_kubernetes.security.security - WARNING - Skipping Read access to pod's service account token (severity is configured as high)
2022-11-10 11:21:07,062 - functest_kubernetes.security.security - WARNING - Skipping Access to pod's secrets (severity is configured as high)
2022-11-10 11:21:07,062 - functest_kubernetes.security.security - WARNING - Skipping K8s Version Disclosure (severity is configured as high)
2022-11-10 11:21:07,062 - functest_kubernetes.security.security - WARNING - Skipping Access to API using service account token (severity is configured as high)
2022-11-10 11:21:07,064 - functest_kubernetes.security.security - WARNING -

2022-11-10 11:21:07,074 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 11:21:07,126 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

3.2
bash-5.1# run_tests -t kube_bench_master
2022-11-10 11:25:10,440 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 11:25:10,456 - xtesting.ci.run_tests - INFO - Loading test case 'kube_bench_master'...
2022-11-10 11:25:10,913 - xtesting.ci.run_tests - INFO - Running test case 'kube_bench_master'...
2022-11-10 11:25:18,894 - functest_kubernetes.security.security - ERROR - Ensure that the etcd pod specification file permissions are set to 644 or more restrictive (Scored)
Run the below command (based on the file location on your system) on the master node.
For example,
chmod 644 /etc/kubernetes/manifests/etcd.yaml

2022-11-10 11:25:18,895 - functest_kubernetes.security.security - ERROR - Ensure that the etcd pod specification file ownership is set to root:root (Scored)
Run the below command (based on the file location on your system) on the master node.
For example,
chown root:root /etc/kubernetes/manifests/etcd.yaml

2022-11-10 11:25:18,895 - functest_kubernetes.security.security - ERROR - Ensure that the etcd data directory permissions are set to 700 or more restrictive (Scored)
On the etcd server node, get the etcd data directory, passed as an argument --data-dir,
from the below command:
ps -ef | grep etcd
Run the below command (based on the etcd data directory found above). For example,
chmod 700 /var/lib/etcd

2022-11-10 11:25:18,895 - functest_kubernetes.security.security - ERROR - Ensure that the etcd data directory ownership is set to etcd:etcd (Scored)
On the etcd server node, get the etcd data directory, passed as an argument --data-dir,
from the below command:
ps -ef | grep etcd
Run the below command (based on the etcd data directory found above).
For example, chown etcd:etcd /var/lib/etcd

2022-11-10 11:25:18,895 - functest_kubernetes.security.security - ERROR - Ensure that the RotateKubeletServerCertificate argument is set to true (Scored)
Edit the Controller Manager pod specification file /etc/kubernetes/manifests/kube-controller-manager.yaml
on the master node and set the --feature-gates parameter to include RotateKubeletServerCertificate=true.
--feature-gates=RotateKubeletServerCertificate=true

2022-11-10 11:25:18,897 - functest_kubernetes.security.security - WARNING - Targets:

+-------------------+-----------------+-----------------------------------------+--------------+--------------+--------------+
| NODE_TYPE | VERSION | TEST_DESC | PASS | FAIL | WARN |
+-------------------+-----------------+-----------------------------------------+--------------+--------------+--------------+
| master | 1.5 | Master Node Configuration Files | 12 | 4 | 5 |
| master | 1.5 | API Server | 31 | 0 | 4 |
| master | 1.5 | Controller Manager | 6 | 1 | 0 |
| master | 1.5 | Scheduler | 2 | 0 | 0 |
+-------------------+-----------------+-----------------------------------------+--------------+--------------+--------------+

2022-11-10 11:25:18,897 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 11:25:18,955 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

3.3
bash-5.1# run_tests -t kube_bench_node
2022-11-10 11:35:47,669 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 11:35:47,685 - xtesting.ci.run_tests - INFO - Loading test case 'kube_bench_node'...
2022-11-10 11:35:47,991 - xtesting.ci.run_tests - INFO - Running test case 'kube_bench_node'...
2022-11-10 11:35:54,758 - functest_kubernetes.security.security - ERROR - Ensure that the proxy kubeconfig file permissions are set to 644 or more restrictive (Scored)
Run the below command (based on the file location on your system) on the each worker node.
For example,
chmod 644 /etc/kubernetes/proxy.conf

2022-11-10 11:35:54,759 - functest_kubernetes.security.security - ERROR - Ensure that the proxy kubeconfig file ownership is set to root:root (Scored)
Run the below command (based on the file location on your system) on the each worker node.
For example, chown root:root /etc/kubernetes/proxy.conf

2022-11-10 11:35:54,759 - functest_kubernetes.security.security - ERROR - Ensure that the --read-only-port argument is set to 0 (Scored)
If using a Kubelet config file, edit the file to set readOnlyPort to 0.
If using command line arguments, edit the kubelet service file
/etc/systemd/system/kubelet.service on each worker node and
set the below parameter in KUBELET_SYSTEM_PODS_ARGS variable.
--read-only-port=0
Based on your system, restart the kubelet service. For example:
systemctl daemon-reload
systemctl restart kubelet.service

2022-11-10 11:35:54,759 - functest_kubernetes.security.security - ERROR - Ensure that the --protect-kernel-defaults argument is set to true (Scored)
If using a Kubelet config file, edit the file to set protectKernelDefaults: true.
If using command line arguments, edit the kubelet service file
/etc/systemd/system/kubelet.service on each worker node and
set the below parameter in KUBELET_SYSTEM_PODS_ARGS variable.
--protect-kernel-defaults=true
Based on your system, restart the kubelet service. For example:
systemctl daemon-reload
systemctl restart kubelet.service

2022-11-10 11:35:54,759 - functest_kubernetes.security.security - ERROR - Ensure that the --tls-cert-file and --tls-private-key-file arguments are set as appropriate (Scored)
If using a Kubelet config file, edit the file to set tlsCertFile to the location
of the certificate file to use to identify this Kubelet, and tlsPrivateKeyFile
to the location of the corresponding private key file.
If using command line arguments, edit the kubelet service file
/etc/systemd/system/kubelet.service on each worker node and
set the below parameters in KUBELET_CERTIFICATE_ARGS variable.
--tls-cert-file=<path/to/tls-certificate-file>
--tls-private-key-file=<path/to/tls-key-file>
Based on your system, restart the kubelet service. For example:
systemctl daemon-reload
systemctl restart kubelet.service

2022-11-10 11:35:54,760 - functest_kubernetes.security.security - WARNING - Targets:

+-------------------+-----------------+-----------------------------------------+--------------+--------------+--------------+
| NODE_TYPE | VERSION | TEST_DESC | PASS | FAIL | WARN |
+-------------------+-----------------+-----------------------------------------+--------------+--------------+--------------+
| node | 1.5 | Worker Node Configuration Files | 7 | 2 | 1 |
| node | 1.5 | Kubelet | 8 | 3 | 2 |
+-------------------+-----------------+-----------------------------------------+--------------+--------------+--------------+

2022-11-10 11:35:54,760 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 11:35:54,816 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

4
opnfv/functest-kubernetes-benchmarking

4.1
bash-5.1# run_tests -t xrally_kubernetes_full
2022-11-10 11:36:23,102 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 11:36:23,118 - xtesting.ci.run_tests - INFO - Loading test case 'xrally_kubernetes_full'...
2022-11-10 11:36:23,841 - xtesting.ci.run_tests - INFO - Running test case 'xrally_kubernetes_full'...
2022-11-10 12:12:59,868 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 12:12:59,870 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

4.2
bash-5.1# run_tests -t netperf
2022-11-10 12:20:46,740 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:20:46,755 - xtesting.ci.run_tests - INFO - Loading test case 'netperf'...
2022-11-10 12:20:46,777 - xtesting.ci.run_tests - INFO - Running test case 'netperf'...
2022-11-10 13:02:09,472 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 13:02:09,475 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

5
opnfv/functest-kubernetes-cnf:v1.21

5.1
bash-5.1# run_tests -t k8s_vims
2022-11-10 13:32:56,101 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 13:32:56,118 - xtesting.ci.run_tests - INFO - Loading test case 'k8s_vims'...
2022-11-10 13:32:56,614 - xtesting.ci.run_tests - INFO - Running test case 'k8s_vims'...
2022-11-10 13:40:21,901 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 13:40:22,268 - xtesting.ci.run_tests - ERROR - The test case 'k8s_vims' failed.
2022-11-10 13:40:22,268 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR

5.2
bash-5.1# run_tests -t helm_vims
2022-11-10 13:47:15,988 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | k8-nosdn-nofeature-noha |
| INSTALLER_TYPE | unknown |
| BUILD_TAG | |
| NODE_NAME | |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+

2022-11-10 13:47:16,005 - xtesting.ci.run_tests - INFO - Loading test case 'helm_vims'...
2022-11-10 13:47:16,457 - xtesting.ci.run_tests - INFO - Running test case 'helm_vims'...
2022-11-10 13:55:19,705 - xtesting.ci.run_tests - INFO - Test result:

2022-11-10 13:55:20,812 - xtesting.ci.run_tests - ERROR - The test case 'helm_vims' failed.
2022-11-10 13:55:20,813 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR

5.3

6
home/ri2/functest-kubernetes/config:/root/.kube/config opnfv/functest-kubernetes-healthcheck:v1.21 /bin/bas
bash-5.1# zip_campaign
2022-11-10 14:21:03,676 - xtesting.core.campaign - ERROR - Cannot publish the artifacts
Traceback (most recent call last):
File "/usr/lib/python3.8/site-packages/xtesting/core/campaign.py", line 117, in dump_artifacts
's3', endpoint_url=os.environ["S3_ENDPOINT_URL"])
File "/usr/lib/python3.8/os.py", line 675, in __getitem__
raise KeyError(key) from None
KeyError: 'S3_ENDPOINT_URL'
2022-11-10 14:21:03,678 - xtesting.core.campaign - ERROR - Cannot publish the artifacts
Traceback (most recent call last):
File "/usr/lib/python3.8/site-packages/xtesting/core/campaign.py", line 172, in zip_campaign_files
assert Campaign.dump_artifacts() == Campaign.EX_OK
AssertionError

log

stage	job	result	detail
functest-kubernetes-healthcheck	k8s_quick	PASS
	k8s_smoke	PASS
functest-kubernetes-benchmarking	netperf	PASS
	xrally_kubernetes_full	PASS
	kube_bench_master	PASS
	kube_bench_node	PASS
	kube_hunter	PASS	WARNING 2022-11-10 11:20:38,300 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------+ \| ENV VAR \| VALUE \| +-------------------------+----------------------------------------------------------+ \| CI_LOOP \| daily \| \| DEBUG \| false \| \| DEPLOY_SCENARIO \| k8-nosdn-nofeature-noha \| \| INSTALLER_TYPE \| unknown \| \| BUILD_TAG \| \| \| NODE_NAME \| \| \| TEST_DB_URL \| http://testresults.opnfv.org/test/api/v1/results \| \| TEST_DB_EXT_URL \| \| \| S3_ENDPOINT_URL \| \| \| S3_DST_URL \| \| \| HTTP_DST_URL \| \| +-------------------------+----------------------------------------------------------+ 2022-11-10 11:20:38,316 - xtesting.ci.run_tests - INFO - Loading test case 'kube_hunter'... 2022-11-10 11:20:38,823 - xtesting.ci.run_tests - INFO - Running test case 'kube_hunter'... 2022-11-10 11:21:07,061 - functest_kubernetes.security.security - WARNING - Skipping CAP_NET_RAW Enabled (severity is configured as high) 2022-11-10 11:21:07,061 - functest_kubernetes.security.security - WARNING - Skipping Read access to pod's service account token (severity is configured as high) 2022-11-10 11:21:07,062 - functest_kubernetes.security.security - WARNING - Skipping Access to pod's secrets (severity is configured as high) 2022-11-10 11:21:07,062 - functest_kubernetes.security.security - WARNING - Skipping K8s Version Disclosure (severity is configured as high) 2022-11-10 11:21:07,062 - functest_kubernetes.security.security - WARNING - Skipping Access to API using service account token (severity is configured as high) 2022-11-10 11:21:07,064 - functest_kubernetes.security.security - WARNING - +--------------------------------+----------------------------------------------------+------------------+ \| CATEGORY \| VULNERABILITY \| SEVERITY \| +--------------------------------+----------------------------------------------------+------------------+ \| Access Risk \| CAP_NET_RAW Enabled \| low \| \| Access Risk \| Read access to pod's service account token \| low \| \| Access Risk \| Access to pod's secrets \| low \| \| Information Disclosure \| K8s Version Disclosure \| medium \| \| Information Disclosure \| Access to API using service account token \| medium \| +--------------------------------+----------------------------------------------------+------------------+ 2022-11-10 11:21:07,074 - xtesting.ci.run_tests - INFO - Test result: +---------------------+------------------+------------------+----------------+ \| TEST CASE \| PROJECT \| DURATION \| RESULT \| +---------------------+------------------+------------------+----------------+ \| kube_hunter \| functest \| 00:28 \| PASS \| +---------------------+------------------+------------------+----------------+ 2022-11-10 11:21:07,126 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK