Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

zhuguanyu Please add the Basic info of the k8s cluster you have deployed on UNH Lab including the version and config file.

Also you can give the self-test results here. Thanks.

basic

...

info

version: 1.21.1

kubeconfig:  

View file
namekubeconfig
height250


self-test result

functest-kubernetes-healthcheck

k8s_quick: PASS

Expand
titlelog

2022-11-10 06:44:37,682 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+----------------------------------------------------------+


2022-11-10 06:44:37,693 - xtesting.ci.run_tests - INFO - Loading test case 'k8s_quick'...
2022-11-10 06:44:37,708 - xtesting.ci.run_tests - INFO - Running test case 'k8s_quick'...
2022-11-10 06:44:59,271 - xtesting.ci.run_tests - INFO - Test result:


+-------------------+------------------+------------------+----------------+
|     TEST CASE     |     PROJECT      |     DURATION     |     RESULT     |
+-------------------+------------------+------------------+----------------+
|     k8s_quick     |     functest     |      00:21       |      PASS      |
+-------------------+------------------+------------------+----------------+


2022-11-10 06:44:59,273 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK
(reverse-i-search)`ex': ^Cport  DEPLOY_SCENARIO=k8-nosdn-nofeature-noha

k8s_smoke: PASS

Expand
titlelog

2022-11-10 08:36:30,096 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 08:36:30,113 - xtesting.ci.run_tests - INFO - Loading test case 'k8s_smoke'...
2022-11-10 08:36:30,138 - xtesting.ci.run_tests - INFO - Running test case 'k8s_smoke'...
2022-11-10 08:36:46,562 - xtesting.ci.run_tests - INFO - Test result:

+-------------------+------------------+------------------+----------------+
|     TEST CASE     |     PROJECT      |     DURATION     |     RESULT     |
+-------------------+------------------+------------------+----------------+
|     k8s_smoke     |     functest     |      00:16       |      PASS      |
+-------------------+------------------+------------------+----------------+

2022-11-10 08:36:46,564 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

functest-kubernetes-smoke

xrally_kubernetes: PASS

Expand
titlelog

2022-11-10 0811:3612:3043,096 143 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 0811:3612:3043,113 242 - xtesting.ci.run_tests - INFO - Loading test case 'k8sxrally_smokekubernetes'...
2022-11-10 0811:3612:3043,138 936 - xtesting.ci.run_tests - INFO - Running test case 'k8sxrally_smokekubernetes'...
2022-11-10 0811:3624:4643,562 804 - xtesting.ci.run_tests - INFO - Test result:

+---------------------------+------------------+------------------+----------------+
|         TEST CASE         |     PROJECT      |     DURATION     |     RESULT     |
+---------------------------+------------------+------------------+----------------+
|     k8sxrally_smoke kubernetes     |     functest     |      00 11:16 59       |      PASS      |
+---------------------------+------------------+------------------+----------------+

2022-11-10 0811:3624:4643,564 807 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

k8s_conformance: PASS FAIL

Expand
titlelog
Expand
titlelog

2.2
bash-5.1# run_tests -t k8s_conformance
2022-11-10 11:28:12,194 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 11:2832:1237,197 257 - xtesting.ci.run_tests - ERROR INFO - Unknown Loading test case or tier 'k8s_conformance', or not supported by the given scenario 'k8-nosdn-nofeature-noha'.2.3
bash-5.1# run_tests -t k8s_conformance
...
2022-11-10 11:32:37,156 367 - xtesting.ci.run_tests - INFO - Deployment description:+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+--------Running test case 'k8s_conformance'...
2022-11-10 11:46:36,493 - functest_kubernetes.k8stest - ERROR - Summarizing 7 Failures:

[Fail] [sig-network] Services [It] should be able to create a functioning NodePort service [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1169

[Fail] [sig-node] Probing container [It] should *not* be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/container_probe.go:148

[Fail] [sig-network] Services [It] should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:2576

[Fail] [sig-network] Services [It] should have session affinity work for NodePort service [LinuxOnly] [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:2576

[Fail] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] [It] Should recreate evicted statefulset [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113

[Fail] [sig-network] Services [It] should have session affinity timeout work for NodePort service [LinuxOnly] [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:2497

[Fail] [sig-network] Services [It] should be able to change the type from ExternalName to NodePort [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1351


2022-11-10 11:46:36,495 - xtesting.ci.run_tests - INFO - Test result:

+-------------------------+------------------+------------------+----------------+
|        TEST CASE        |     PROJECT      |     DURATION     |     RESULT     |
+-------------------------+------------------+------------------+----------------+
|     k8s_conformance     |     functest     |      13:59       |      FAIL      |
+-------------------------+------------------+-----------------------+-----------------+

2022-11-10 11:3246:3736,257 497 - xtesting.ci.run_tests - INFO ERROR - Loading The test case 'k8s_conformance' failed...
2022-11-10 11:3246:3736,367 497 - xtesting.ci.run_tests - INFO - Running test case 'k8s_conformance'...Execution exit value: Result.EX_ERROR

sig_api_machinery: PASS

Expand
titlelog

2022-11-10 1112:4602:3657,493 - functest_kubernetes.k8stest - ERROR - Summarizing 7 Failures:

[Fail] [sig-network] Services [It] should be able to create a functioning NodePort service [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1169

[Fail] [sig-node] Probing container [It] should *not* be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/container_probe.go:148

[Fail] [sig-network] Services [It] should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:2576

[Fail] [sig-network] Services [It] should have session affinity work for NodePort service [LinuxOnly] [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:2576

[Fail] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] [It] Should recreate evicted statefulset [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113

[Fail] [sig-network] Services [It] should have session affinity timeout work for NodePort service [LinuxOnly] [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:2497

[Fail] [sig-network] Services [It] should be able to change the type from ExternalName to NodePort [Conformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1351

2022-11-10 11:46:36,495 - xtesting.ci.run_tests - INFO - Test result:+-------------------------+------------------+------------------+----------------+
|        TEST CASE        |     PROJECT      |     DURATION     |     RESULT     |
+-------------------------+------------------+------------------+----------------+
|     k8s_conformance     |     functest     |      13:59       |      FAIL 991 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+------------------+------------------------+----------------+

2022-11-10 1112:4602:3658,497 055 - xtesting.ci.run_tests - ERROR INFO - The Loading test case 'k8ssig_api_conformancemachinery' failed...
2022-11-10 1112:4602:3658,497 123 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR2.4
bash-5.1#  run_tests -t sig_api_machineryRunning test case 'sig_api_machinery'...
2022-11-10 12:0209:5722,991 900 - xtesting.ci.run_tests - INFO - Deployment descriptionTest result:

+-------------------------+--+------------------+----------------------+----------------+
|         ENV VAR TEST CASE         |     PROJECT      |     DURATION     |        VALUE                     RESULT       |
+-------------------------+--+------------------+----------------------+----------------+
|         CI_LOOP   sig_api_machinery       |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |         functest     |      06:24       |      PASS      |
+---------------------------+------------------+------------------+----------------+

2022-11-10 12:09:22,902 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

sig_api_machinery_serial: PASS

Expand
titlelog

bash-5.1# run_tests -t sig_api_machinery_serial
2022-11-10 12:19:47,585 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
|     S3_ENDPOINT_URL     | +-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |            S3_DST_URL       k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|       HTTP_DST_URL  BUILD_TAG        |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:02:58,055 - xtesting.ci.run_tests - INFO - Loading test case 'sig_api_machinery'...
2022-11-10 12:02:58,123 - xtesting.ci.run_tests - INFO - Running test case 'sig_api_machinery'...
2022-11-10 12:09:22,900 - xtesting.ci.run_tests - INFO - Test result:

+---------------------------+------------------+------------------+----------------+
|         TEST CASE         |     PROJECT      |     DURATION     |     RESULT     |
+---------------------------+------------------+------------------+----------------+
|     sig_api_machinery     |     functest     |      06:24       |      PASS      |
+|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+------+------------------+------------------+----------------+

2022-11-10 12:0919:2247,902 687 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK2.5
bash-5.1# run_tests -t Loading test case 'sig_api_machinery_serial'...
2022-11-10 12:19:47,585 794 - xtesting.ci.run_tests - INFO - Running test case 'sig_api_machinery_serial'...
2022-11-10 12:21:21,624 - xtesting.ci.run_tests - INFO - Deployment descriptionTest result:

+-------------------------+---------+------------------+------------------+----------------+
|         ENV VAR      TEST CASE     |         |     PROJECT      |        VALUE DURATION     |                   RESULT     |
+----------------------------+------+------------------+------------------+----------------+
|         CI_LOOP   sig_api_machinery_serial       |                          daily                           |
|          DEBUG     functest     |      01:33       |                          false        PASS                     |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |         |
+----------------------------------+------------------+------------------+----------------+

2022-11-10 12:21:21,627 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

sig_apps: PASS

Expand
titlelog

2022-11-10 12:34:29,184 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         S3_ENDPOINT_URL     | CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |            S3_DST_URL       k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|       HTTP_DST_URL  BUILD_TAG        |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:19:47,687 - xtesting.ci.run_tests - INFO - Loading test case 'sig_api_machinery_serial'...
2022-11-10 12:19:47,794 - xtesting.ci.run_tests - INFO - Running test case 'sig_api_machinery_serial'...
2022-11-10 12:21:21,624 - xtesting.ci.run_tests - INFO - Test result:

+----------------------------------+------------------+------------------+----------------+
|            TEST CASE             |     PROJECT      |     DURATION     |     RESULT     |
+----------------------------------+------------------+------------------+----------------+
|     sig_api_machinery_serial     |     functest     |      01:33       |      PASS |        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+----------------------------+------+------------------+------------------+----------------+

2022-11-10 12:2134:2129,627 283 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK2.6
bash-5.1# run_tests -t sig_appsLoading test case 'sig_apps'...
2022-11-10 12:34:29,389 - xtesting.ci.run_tests - INFO - Running test case 'sig_apps'...
2022-11-10 12:3436:2932,184 646 - xtesting.ci.run_tests - INFO - Deployment descriptionTest result:

+-------------------------+------------------+------------------------+----------------+
|         ENV VAR   TEST CASE       |     PROJECT      |     DURATION     |        VALUE                     RESULT       |
+-------------------------+------------------+------------------+----------------------+
|         CI_LOOP    sig_apps       |                          daily                           |
functest     |        02:03    DEBUG           |                          false                      PASS      |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                 +-------------------+------------------+------------------+----------------+

2022-11-10 12:36:32,649 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

sig_apps_serial: FAIL

Expand
titlelog

2022-11-10 12:43:03,217 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                              VALUE               |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |    
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     S3_ENDPOINT_URL     |         DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        S3_DST_URL  BUILD_TAG        |                                                          |
|       HTTP_DST_URL  NODE_NAME        |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:34:29,283 - xtesting.ci.run_tests - INFO - Loading test case 'sig_apps'...
2022-11-10 12:34:29,389 - xtesting.ci.run_tests - INFO - Running test case 'sig_apps'...
2022-11-10 12:36:32,646 - xtesting.ci.run_tests - INFO - Test result:

+|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+------------------------+------------------+----------------+|     TEST CASE     |     PROJECT      |     DURATION     |     RESULT     |
+-------------------+------------------+------------------+----------------+
|      sig_apps     |     functest     |      02:03       |      PASS      |

+2022-11-10 12:43:03,315 - xtesting.ci.run_tests - INFO - Loading test case 'sig_apps_serial'...
2022-11-10 12:43:03,420 - xtesting.ci.run_tests - INFO - Running test case 'sig_apps_serial'...
2022-11-10 13:03:29,449 - functest_kubernetes.k8stest - ERROR - Summarizing 2 Failures:

[Fail] [sig-apps] DisruptionController [It] evictions: maxUnavailable deny evictions, integer => should not allow an eviction [Serial]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:286

[Fail] [sig-apps] DisruptionController [It] evictions: too few pods, replicaSet, percentage => should not allow an eviction [Serial]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:286

2022-11-10 13:03:29,450 - xtesting.ci.run_tests - INFO - Test result:

+-------------------------+------------------+------------------+----------------+

2022-11-10 12:36:32,649 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

2.7
bash-5.1# run_tests -t sig_apps_serial
2022-11-10 12:43:03,217 - xtesting.ci.run_tests - INFO - Deployment description:

|        TEST CASE        |     PROJECT      |     DURATION     |     RESULT     |
+-------------------------+------------------+-----------------------+-----------------+
|     sig_apps_serial     ENV VAR |     functest     |      20:26       |      FAIL            VALUE                           |
+-------------------------+------------------+------------------+----------------+

2022-11-10 13:03:29,451 - xtesting.ci.run_tests - ERROR - -+
|         CI_LOOP         |                          daily                           |The test case 'sig_apps_serial' failed.
2022-11-10 13:03:29,452 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR

sig_apps: PASS

Expand
titlelog

2022-11-10 12:34:29,184 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|          DEBUG ENV VAR           |                          false  VALUE                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|     +-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:4334:0329,315 283 - xtesting.ci.run_tests - INFO - Loading test case 'sig_apps_serial''...
2022-11-10 12:4334:0329,420 389 - xtesting.ci.run_tests - INFO - Running test case 'sig_apps_serial'...
2022-11-10 1312:0336:29,449 - functest_kubernetes.k8stest - ERROR - Summarizing 2 Failures:

[Fail] [sig-apps] DisruptionController [It] evictions: maxUnavailable deny evictions, integer => should not allow an eviction [Serial]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:286

[Fail] [sig-apps] DisruptionController [It] evictions: too few pods, replicaSet, percentage => should not allow an eviction [Serial]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:286

2022-11-10 13:03:29,450 - 32,646 - xtesting.ci.run_tests - INFO - Test result:

+-------------------------+------------------+------------------+----------------+
|        TEST TEST CASE         |     PROJECT      |     DURATION     |     RESULT     |
+-------------------------+------------------+------------------+----------------+
|     sig sig_apps _serial     |     functest     |      20 02:26 03       |      FAIL  PASS      |
+-------------------------+------------------+------------------+----------------+

2022-11-10 1312:0336:2932,451 649 - xtesting.ci.run_tests - ERROR - The test case 'sig_apps_serial' failed.
2022 - 11-10 13:03:29,452 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR2.8
bash-5.1# run_tests -t sig_instrumentationOK

sig_apps_serial: FAIL

Expand
titlelog

2022-11-10 1213:5803:4829,233 450 - xtesting.ci.run_tests - INFO - Deployment descriptionTest result:

+-------------------------+------------------+------------------+----------------------+
|         ENV VAR  TEST CASE        |     PROJECT      |     DURATION     |        VALUE                       RESULT     |
+-------------------------+------------------+-----------------------+-----------------+
|         CI_LOOP     sig_apps_serial     |     functest     |      20:26       |        daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG  FAIL      |
+-------------------------+------------------+------------------+----------------+

2022-11-10 13:03:29,451 - xtesting.ci.run_tests - ERROR - The test case 'sig_apps_serial' failed.
2022-11-10 13:03:29,452 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR

sig_instrumentation: PASS

Expand
titlelog

2022-11-10 12:58:48,233 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                                  VALUE                           |
|        NODE_NAME        | +-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG     TEST_DB_URL      |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|     S3 INSTALLER_ENDPOINT_URL TYPE     |                                 unknown                          |
|        S3_DST_URL  BUILD_TAG        |                                                          |
|       HTTP_DST_URL  NODE_NAME        |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:58:48,372 - xtesting.ci.run_tests - INFO - Loading test case 'sig_instrumentation'...
2022-11-10 12:58:48,478 - xtesting.ci.run_tests - INFO - Running test case 'sig_instrumentation'...
2022-11-10 12:58:52,474 - xtesting.ci.run_tests - INFO - Test result:

+|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+------+------------------+------------------+----------------+

|          TEST CASE          |     2022-11-10 12:58:48,372 - xtesting.ci.run_tests - INFO - Loading test case 'sig_instrumentation'...
2022-11-10 12:58:48,478 - xtesting.ci.run_tests - INFO - Running test case 'sig_instrumentation'...
2022-11-10 12:58:52,474 - xtesting.ci.run_tests - INFO - Test result:

+-----------------------------+------------------+------------------+----------------+
|          TEST CASE          |     PROJECT      |     DURATION     |     RESULT     |
+-----------------------------+------------------+------------------+----------------+
|     sig_instrumentation     |     functest     |      00:03       |      PASS      |
+-----------------------------+------------------+------------------+----------------+

2022-11-10 12:58:52,477 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK2.9
bash-5.1# run_tests -t sig_auth

sig_instrumentation: PASS

Expand
titlelog

2022-11-10 12:5658:3848,731 233 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:5658:3848,830 372 - xtesting.ci.run_tests - INFO - Loading test case 'sig_authinstrumentation'...
2022-11-10 12:5658:3848,987 478 - xtesting.ci.run_tests - INFO - Running test case 'sig_authinstrumentation'...
2022-11-10 1312:0658:4652,024 - functest_kubernetes.k8stest - ERROR - Summarizing 5 Failures:

[Fail] [sig-auth] [Feature:NodeAuthorizer] [It] Getting an existing configmap should exit with the Forbidden error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/node_authz.go:103

[Fail] [sig-auth] [Feature:NodeAuthorizer] [It] Getting a secret for a workload the node has access to should succeed
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/node_authz.go:122

[Fail] [sig-auth] [Feature:NodeAuthorizer] [It] Getting an existing secret should exit with the Forbidden error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/node_authz.go:81

[Fail] [sig-auth] [Feature:NodeAuthorizer] [It] Getting a non-existent secret should exit with the Forbidden error, not a NotFound error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/node_authz.go:76

[Fail] [sig-auth] [Feature:NodeAuthorizer] [It] Getting a non-existent configmap should exit with the Forbidden error, not a NotFound error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/node_authz.go:86

2022-11-10 13:06:46,025 474 - xtesting.ci.run_tests - INFO - Test result:

+-----------------------------+------------------+------------------+----------------+
|          TEST CASE          |     PROJECT      |     DURATION     |     RESULT     |
+-----------------------------+------------------+------------------+----------------+
|     sig_instrumentation     |     functest     |      00:03       |      PASS      |
+-----------------------------+------------------+------------------+----------------+

2022-11-10 12:58:52,477 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

sig_instrumentation: PASS

Expand
titlelog

2022-11-10 12:58:48,233 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:58:48,372 - xtesting.ci.run_tests - INFO - Loading test case 'sig_instrumentation'...
2022-11-10 12:58:48,478 - xtesting.ci.run_tests - INFO - Running test case 'sig_instrumentation'...
2022-11-10 12:58:52,474 - xtesting.ci.run_tests - INFO - Test result:

+-----------------------------+------------------+------------------+----------------+
|       TEST    TEST CASE          |     PROJECT      |     DURATION     |     RESULT     |
+-----------------------------+------------------+------------------+----------------+
|      sigsig_auth instrumentation     |     functest     |      10 00:07 03       |      FAIL  PASS      |
+-------------------+----------+-------------+-----+-------------+-----+-----------+2022-11-10 13:06:46,027 - xtesting.ci.run_tests - ERROR - The test case 'sig_auth' failed.-+

2022-11-10 1312:0658:4652,027 477 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR2.10
bash-5.1# run_tests -t sig_cluster_lifecycleOK

sig_instrumentation: PASS

Expand
titlelog

2022-11-10 12:5758:1248,748 233 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:5758:1248,847 372 - xtesting.ci.run_tests - INFO - Loading test case 'sig_cluster_lifecycleinstrumentation'...
2022-11-10 12:5758:1348,007 478 - xtesting.ci.run_tests - INFO - Running test case 'sig_cluster_lifecycleinstrumentation'...
2022-11-10 12:5758:3652,639 474 - xtesting.ci.run_tests - INFO - Test result:

+-------------------------------+------------------+------------------+----------------+
|           TEST  TEST CASE          |     PROJECT      |     DURATION     |     RESULT     |
+-------------------------------+------------------+------------------+----------------+
|     sig_cluster_lifecycle instrumentation     |     functest     |      00:23 03       |      PASS      |
+-------------------------------+------------------+------------------+----------------+

2022-11-10 12:5758:3652,642 477 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

2.11

bash-5.1# run_tests -t sig_network

sig_auth: FAIL

Expand
titlelog

2022-11-10 12:5956:3438,362 731 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 12:5956:3438,463 830 - xtesting.ci.run_tests - INFO - Loading test case 'sig_networkauth'...
2022-11-10 12:59:34,571 - xtesting.ci.run_tests - INFO - Running test case 'sig_network'...
2022-11-10 13:03:39,438 - functest_kubernetes.k8stest - ERROR - Summarizing 2 Failures::56:38,987 - xtesting.ci.run_tests - INFO - Running test case 'sig_auth'...
2022-11-10 13:06:46,024 - functest_kubernetes.k8stest - ERROR - Summarizing 5 Failures:

[Fail] [sig-auth] [Feature:NodeAuthorizer] [It] Getting an existing configmap should exit with the Forbidden error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/node_authz.go:103

[Fail] [sig-auth] [Feature:NodeAuthorizer] [It] Getting a secret for a workload the node has access to should succeed
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/node_authz.go:122

[Fail] [sig-auth] [Feature:NodeAuthorizer] [It] Getting an existing secret should exit with the Forbidden error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/node_authz.go:81

[Fail] [sig-network] Conntrack auth] [Feature:NodeAuthorizer] [It] should be able to preserve UDP traffic when server pod cycles for a NodePort serviceGetting a non-existent secret should exit with the Forbidden error, not a NotFound error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendortest/github.come2e/onsi/ginkgo/internal/leafnodes/runnerauth/node_authz.go:11376

[Fail] [sig-network] Services auth] [Feature:NodeAuthorizer] [It] should be able to update service type to NodePort listening on same port number but different protocolsGetting a non-existent configmap should exit with the Forbidden error, not a NotFound error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/networkauth/servicenode_authz.go:124586


2022-11-10 13:0306:3946,439 025 - xtesting.ci.run_tests - INFO - Test result:

+---------------------+------------------+------------------+----------------+
|      TEST TEST CASE       |     PROJECT      |     DURATION     |     RESULT     |
+---------------------+------------------+------------------+----------------+
|     sig sig_network auth     |     functest     |      04 10:04 07       |      FAIL      |
+---------------------+------------------+------------------+----------------+

2022-11-10 13:0306:3946,440 027 - xtesting.ci.run_tests - ERROR - The test case 'sig_networkauth' failed.
2022-11-10 13:03:39,440 :06:46,027 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR

sig_cluster_lifecycle: PASS

Expand
titlelog

2022-11-10 12:57:12,748 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR2.12
bash-5.1# run_tests -t sig_node
2022-11-10 13:28:29,405 - xtesting.ci.run_tests - INFO - Deployment description:tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn--+
|         ENV VAR nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                  VALUE                          |
+-------------------------+----------------------------------------------------------+
|         CI NODE_LOOP NAME        |                                                          daily  |
|       TEST_DB_URL       |         http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL      DEBUG |           |                          false                           |
|     DEPLOYS3_ENDPOINT_SCENARIO URL     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD S3_DST_TAG URL         |                                                          |
|        NODE_NAME   HTTP_DST_URL      |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          
+-------------------------+----------------------------------------------------------+

2022-11-10 12:57:12,847 - xtesting.ci.run_tests - INFO - Loading test case 'sig_cluster_lifecycle'...
2022-11-10 12:57:13,007 - xtesting.ci.run_tests - INFO - Running test case 'sig_cluster_lifecycle'...
2022-11-10 12:57:36,639 - xtesting.ci.run_tests - INFO - Test result:

+-------------------------------+------------------+------------------+----------------+
|           TEST CASE           |     PROJECT      |     DURATION     |     RESULT     |
+-------------------------------+------------------+------------------+----------------+
|     sig_cluster_lifecycle     |     functest     |      00:23       |      PASS      |
+-------------------------+------+------------------+------------------+----------------+

2022-11-10 1312:2857:2936,505 642 - xtesting.ci.run_tests - INFO - Loading test case 'sig_node'...Execution exit value: Result.EX_OK

sig_network: FAIL

Expand
titlelog

2022-11-10 1312:2859:2934,611 362 - xtesting.ci.run_tests - INFO - Running test case 'sig_node'...
2022-11-10 13:57:14,874 - functest_kubernetes.k8stest - ERROR - Summarizing 1 Failure:

[Panic!] [sig-node] Probing container [It] should be ready immediately after startupProbe succeeds
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:55

2022-11-10 13:57:14,875 - xtesting.ci.run_tests - INFO - Test result:+Deployment description:

+-------------------------+------+------------------+------------------+----------------+
|         TEST CASE ENV VAR         |           PROJECT                VALUE           |     DURATION     |     RESULT     |
+-------------------------+------------------------------+-------------------+---------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn------+
|      sig_node     |     functest     |      28:45       |      FAIL      |
+-------------------+------------------+------------------+----------------+

2022-11-10 13:57:14,876 - xtesting.ci.run_tests - ERROR - The test case 'sig_node' failed.
2022-11-10 13:57:14,876 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR

2.13
bash-5.1# run_tests -t sig_scheduling_serial
2022-11-10 13:28:44,050 - xtesting.ci.run_tests - INFO - Deployment description:+-------------------------+----------------------------------------------------------+
|         ENV VAR         | nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                              VALUE                              |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+----------+

2022-11-10 12:59:34,463 - xtesting.ci.run_tests - INFO - Loading test case 'sig_network'...
2022-11-10 12:59:34,571 - xtesting.ci.run_tests - INFO - Running test case 'sig_network'...
2022-11-10 13:03:39,438 - functest_kubernetes.k8stest - ERROR - Summarizing 2 Failures:

[Fail] [sig-network] Conntrack [It] should be able to preserve UDP traffic when server pod cycles for a NodePort service
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113

[Fail] [sig-network] Services [It] should be able to update service type to NodePort listening on same port number but different protocols
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1245


2022-11-10 13:03:39,439 - xtesting.ci.run_tests - INFO - Test result:

+---------------------+------------------+-----------------------+-----------------+

2022-11-10 13:28:44,150 - xtesting.ci.run_tests - INFO - Loading test case 'sig_scheduling_serial'...
2022-11-10 13:28:44,256 - xtesting.ci.run_tests - INFO - Running test case 'sig_scheduling_serial'...
2022-11-10 13:42:58,573 - xtesting.ci.run_tests - INFO - Test result:

+----------+
|      TEST CASE      |     PROJECT      |     DURATION     |     RESULT     |
+---------------------+------------------+------------------+----------------+
|     sig_network       TEST CASE |       functest     |     PROJECT      |  04:04     DURATION   |   |    FAIL   RESULT    |
+---------------------+----------+--------+----------+--------+----------+------+

2022-11-10 13:03:39,440 - xtesting.ci.run_tests - ERROR - The test case 'sig_network' failed.
2022-11-10 13:03:39,440 - xtesting.ci.run_tests - -+
|     sig_scheduling_serial     |     functest     |      14:14       |      PASS      |INFO - Execution exit value: Result.EX_ERROR

sig_node: FAIL

Expand
titlelog

2022-11-10 13:28:29,405 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+------+------------------+------------------+----------------+

2022-11-10 13:42:58,575 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

2.14
bash-5.1# run_tests -t sig_storage
2022-11-10 13:28:58,164 - xtesting.ci.run_tests - INFO - Deployment description:

+|         ENV VAR         |                          VALUE                           |
+-------------------------+-----------------+-----------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn----------------+
|         ENV VAR nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                VALUE                            |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         | |       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                  daily                          |
|     S3_ENDPOINT_URL      DEBUG |          |                          false                          |
|     DEPLOY_SCENARIO    S3_DST_URL       |                               k8-nosdn-nofeature-noha                            |
|      INSTALLER_TYPE   HTTP_DST_URL      |                           unknown                           |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+------     |
+-------------------------+----------------------------------------------------------+

2022-11-10 13:28:29,505 - xtesting.ci.run_tests - INFO - Loading test case 'sig_node'...
2022-11-10 13:28:29,611 - xtesting.ci.run_tests - INFO - Running test case 'sig_node'...
2022-11-10 13:57:14,874 - functest_kubernetes.k8stest - ERROR - Summarizing 1 Failure:

[Panic!] [sig-node] Probing container [It] should be ready immediately after startupProbe succeeds
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:55


2022-11-10 13:57:14,875 - xtesting.ci.run_tests - INFO - Test result:

+-------------------+------------------+------------------+----------------+
|     TEST CASE     |     PROJECT      |     DURATION     |     RESULT     |
+-------------------+------------------+------------------+----------------+
|      sig_node     |     functest     |      28:45       |      FAIL      |
+-------------------+------------------+------------------------------+----------+2022-11-10 13:28:58,263 - xtesting.ci.run_tests - INFO - Loading test case 'sig_storage'...----+

2022-11-10 13:2857:5814,370 876 - xtesting.ci.run_tests - INFO ERROR - Running The test case 'sig_storagenode' .failed..
2022-11-10 13:5257:5614,376 - functest_kubernetes.k8stest - ERROR - Summarizing 5 Failures:

[Fail] [sig-storage] CSI mock volume CSI NodeUnstage error cases [Slow] [It] two pods: should call NodeStage after previous NodeUnstage final error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:1017

[Fail] [sig-storage] PersistentVolumes-local  [Volume type: dir-bindmounted] Set fsGroup for local volume [It] should set same fsGroup for two pods simultaneously [Slow]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:808

[Fail] [sig-storage] PersistentVolumes-local  Stress with local volumes [Serial] [AfterEach] should be able to process many pods and reuse local volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/local.go:114

[Fail] [sig-storage] PersistentVolumes-local  [Volume type: dir-link-bindmounted] Set fsGroup for local volume [It] should set same fsGroup for two pods simultaneously [Slow]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:808

[Fail] [sig-storage] CSI mock volume CSI NodeUnstage error cases [Slow] [It] two pods: should call NodeStage after previous NodeUnstage transient error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:1017

2022-11-10 13:52:56,377 - xtesting.ci.run_tests - INFO - Test result:+--876 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR

sig_scheduling_serial: PASS

Expand
titlelog

2022-11-10 13:28:44,050 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+-------------------+------------------+------------------+---+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn------------+
|      TEST CASE      |     PROJECT      |     DURATION     |     RESULT     |
+---------------------+------------------+------------------+----------------+
|     sig_storage     |     functest     |      23:58       |      FAIL      |
+---------------------+------------------+------------------+----------------+

2022-11-10 13:52:56,379 - xtesting.ci.run_tests - ERROR - The test case 'sig_storage' failed.
2022-11-10 13:52:56,379 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR

2.15
bash-5.1# run_tests -t sig_storage_serial
2022-11-10 14:18:46,523 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         | nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                  VALUE                          |
+-------------------------+----------------------------------------------------------+|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |

+----------2022-11-10 13:28:44,150 - xtesting.ci.run_tests - INFO - Loading test case 'sig_scheduling_serial'...
2022-11-10 13:28:44,256 - xtesting.ci.run_tests - INFO - Running test case 'sig_scheduling_serial'...
2022-11-10 13:42:58,573 - xtesting.ci.run_tests - INFO - Test result:

+-------------------------------+------------------+------------------+----------------+
|           TEST CASE           |     PROJECT      |     DURATION     |     RESULT     |
+-------------------------------+------------------+------------------+----------------+
|     sig_scheduling_serial     |     functest     |      14:14       |      PASS      |
+-------------------------------+------------------+------------------+----------------+

2022-11-10 13:42:58,575 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

sig_storage: FAIL

Expand
titlelog

2022-11-10 13:28:58,164 - xtesting.ci.run_tests - INFO - Deployment description:

+---------------+----------+------------------------------------------------+2022-11-10 14:18:46,584 - xtesting.ci.run_tests - INFO - Loading test case 'sig_storage_serial'...
2022-11-10 14:18:46,650 - xtesting.ci.run_tests - INFO - Running test case 'sig_storage_serial'...
2022-11-10 14:22:24,652 - xtesting.ci.run_tests - INFO - Test result:+-+
|         ENV VAR         |                          VALUE                           |
+-------------------------+---------+------------------+------------------+-------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn--+
| nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                     TEST CASE      |
|     |    NODE_NAME   PROJECT      |     DURATION       |     RESULT     |
+----------------------------+------------------+------------------+----------------+
|     sig_storage_serial     |     functest     |      03:38       |      PASS      |
+----------------------------+------------------+------------------+----------------+

2022-11-10 14:22:24,655 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

3
opnfv/functest-kubernetes-security

3.1
run_tests -t kube_hunter
 
2022-11-10 11:20:38,300 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                VALUE                            |
+-------------------------+----------------------------------------------------------+

2022-11-10 13:28:58,263 - xtesting.ci.run_tests - INFO - Loading test case 'sig_storage'...
2022-11-10 13:28:58,370 - xtesting.ci.run_tests - INFO - Running test case 'sig_storage'...
2022-11-10 13:52:56,376 - functest_kubernetes.k8stest - ERROR - Summarizing 5 Failures:

[Fail] [sig-storage] CSI mock volume CSI NodeUnstage error cases [Slow] [It] two pods: should call NodeStage after previous NodeUnstage final error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:1017

[Fail] [sig-storage] PersistentVolumes-local  [Volume type: dir-bindmounted] Set fsGroup for local volume [It] should set same fsGroup for two pods simultaneously [Slow]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:808

[Fail] [sig----+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          storage] PersistentVolumes-local  Stress with local volumes [Serial] [AfterEach] should be able to process many pods and reuse local volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/local.go:114

[Fail] [sig-storage] PersistentVolumes-local  [Volume type: dir-link-bindmounted] Set fsGroup for local volume [It] should set same fsGroup for two pods simultaneously [Slow]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:808

[Fail] [sig-storage] CSI mock volume CSI NodeUnstage error cases [Slow] [It] two pods: should call NodeStage after previous NodeUnstage transient error
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:1017


2022-11-10 13:52:56,377 - xtesting.ci.run_tests - INFO - Test result:

+---------------------+------------------+------------------+----------------+
|      TEST CASE      |     PROJECT      |     DURATION     |     RESULT     |
+---------------------+------------------+------------------+----------------+
|     sig_storage     |     functest     |      23:58       |      FAIL      |
+-------------------------+------------------+------------------------+----------------+

2022-11-10 1113:2052:3856,316 379 - xtesting.ci.run_tests - INFO ERROR - Loading test case 'kube_hunter'...
2022-11-10 11:20:38,823 - xtesting.ci.run_tests - INFO - Running test case 'kube_hunter'...
2022-11-10 11:21:07,061 - functest_kubernetes.security.security - WARNING - Skipping CAP_NET_RAW Enabled (severity is configured as high)
2022-11-10 11:21:07,061 - functest_kubernetes.security.security - WARNING - Skipping Read access to pod's service account token (severity is configured as high)
2022-11-10 11:21:07,062 - functest_kubernetes.security.security - WARNING - Skipping Access to pod's secrets (severity is configured as high)The test case 'sig_storage' failed.
2022-11-10 1113:2152:0756,062 379 - functest_kubernetesxtesting.securityci.security run_tests - WARNING - Skipping K8s Version Disclosure (severity is configured as high)INFO - Execution exit value: Result.EX_ERROR

sig_storage_serial: PASS

Expand
titlelog

2022-11-10 1114:2118:0746,062 523 - functest_kubernetesxtesting.securityci.security run_tests - WARNING - Skipping Access to API using service account token (severity is configured as high)
2022-11-10 11:21:07,064 - functest_kubernetes.security.security - WARNING -INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+-------+----------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-----------------+
|            CATEGORY            | nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                       VULNERABILITY                    |
|       TEST_DB_URL   SEVERITY     |
+--------------------------------+----------------------------------------------------+------------------+
|          Access Risk     |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |               |                CAP_NET_RAW Enabled                 |       low        |
|     S3_ENDPOINT_URL     |                          Access Risk             |     Read access to pod's service account token     |       low        |
|        S3_DST_URL       |          Access Risk           |              Access to pod's secrets               |       low        |
|     Information Disclosure   HTTP_DST_URL   |    |           K8s Version Disclosure               |      medium       |
|     Information Disclosure     |     Access to API using service account token       |      medium      |
+-------------------------+-------+----------------------------------------------------+

2022-11-10 14:18:46,584 - xtesting.ci.run_tests - INFO - Loading test case 'sig_storage_serial'...
2022-11------------+10 14:18:46,650 - xtesting.ci.run_tests - INFO - Running test case 'sig_storage_serial'...
2022-11-10 1114:2122:0724,074 652 - xtesting.ci.run_tests - INFO - Test result:

+----------------------------+------------------+------------------+----------------+
|        TEST   TEST CASE          |     PROJECT      |     DURATION     |     RESULT     |
+----------------------------+------------------+------------------+----------------+
|     kubesig_storage_hunter serial     |     functest     |      00 03:28 38       |      PASS      |
+----------------------------+------------------+------------------+----------------+

2022-11-10 1114:2122:0724,126 655 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK3.2
bash-5.1# run_tests -t kube_bench_master
2022

functest-kubernetes-security

kube_hunter: WARN

Expand
titlelog

022-11-10 11:2520:1038,440 300 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+----------------------------------------------------------+2022-11-10 11:25:10,456 - xtesting.ci.run_tests - INFO - Loading test case 'kube_bench_master'...
2022-11-10 11:25:10,913 - xtesting.ci.run_tests - INFO - Running test case 'kube_bench_master'...
2022-11-10 11:25:18,894 - functest_kubernetes.security.security - ERROR - Ensure that the etcd pod specification file permissions are set to 644 or more restrictive (Scored)
Run the below command (based on the file location on your system) on the master node.
For example,
chmod 644 /etc/kubernetes/manifests/etcd.yaml2022-11-10 11:25:18,895 - functest_kubernetes.security.security - ERROR - Ensure that the etcd pod specification file ownership is set to root:root (Scored)
Run the below command (based on the file location on your system) on the master node.
For example,
chown root:root /etc/kubernetes/manifests/etcd.yaml-+

2022-11-10 11:25:18,895 - functest_kubernetes.security.security - ERROR - Ensure that the etcd data directory permissions are set to 700 or more restrictive (Scored)
On the etcd server node, get the etcd data directory, passed as an argument --data-dir,
from the below command:
ps -ef | grep etcd
Run the below command (based on the etcd data directory found above). For example,
chmod 700 /var/lib/etcd20:38,316 - xtesting.ci.run_tests - INFO - Loading test case 'kube_hunter'...
2022-11-10 11:20:38,823 - xtesting.ci.run_tests - INFO - Running test case 'kube_hunter'...
2022-11-10 11:2521:1807,895 061 - functest_kubernetes.security.security - ERROR - Ensure that the etcd data directory ownership is set to etcd:etcd (Scored)
On the etcd server node, get the etcd data directory, passed as an argument --data-dir,
from the below command:
ps -ef | grep etcd
Run the below command (based on the etcd data directory found above).
For example, chown etcd:etcd /var/lib/etcdWARNING - Skipping CAP_NET_RAW Enabled (severity is configured as high)
2022-11-10 11:2521:1807,895 061 - functest_kubernetes.security.security - ERROR - Ensure that the RotateKubeletServerCertificate argument is set to true (Scored)
Edit the Controller Manager pod specification file /etc/kubernetes/manifests/kube-controller-manager.yaml
on the master node and set the --feature-gates parameter to include RotateKubeletServerCertificate=true.
--feature-gates=RotateKubeletServerCertificate=trueWARNING - Skipping Read access to pod's service account token (severity is configured as high)
2022-11-10 11:21:07,062 - functest_kubernetes.security.security - WARNING - Skipping Access to pod's secrets (severity is configured as high)
2022-11-10 11:2521:1807,897 062 - functest_kubernetes.security.security - WARNING - Targets:+------------Skipping K8s Version Disclosure (severity is configured as high)
2022-11-10 11:21:07,062 - functest_kubernetes.security.security - WARNING - Skipping Access to API using service account token (severity is configured as high)
2022-11-10 11:21:07,064 - functest_kubernetes.security.security - WARNING -

+-------+-----------------+------------+-----------------------------+--------------+----------+----+--------------+
|     NODE_TYPE     |    CATEGORY   VERSION     |      |          TEST_DESC             VULNERABILITY     |     PASS     |     FAIL    |     WARN SEVERITY     |
+-------------------+-----------------+-----------------------------------------+--------------+--------------+--------------+
|       master    Access Risk     |       1.5 |       |     Master Node Configuration Files     |  CAP_NET_RAW Enabled      12       |      4   |     |   low    5      |
|       master      |    Access Risk     1.5       |                API Server           Read access to pod's service account token     |      31   low     |      0       |      4       |
|       master    Access Risk    |       1.5       |            Controller Manager          Access to pod's secrets     |      6       |      1       | low      0      |
|     Information Disclosure   master       |       1.5       |   K8s Version Disclosure              Scheduler   |      medium          |
|      2 Information Disclosure       |      0 Access to API using service account token      |      0  medium      |
+-------------------+-----------------+-----------------------------------------+--------------+----------+----+--------------+

2022-11-10 11:2521:1807,897 074 - xtesting.ci.run_tests - INFO - Test result:

+---------------------------+------------------+------------------+----------------+
|         TEST  TEST CASE         |     PROJECT      |     DURATION     |     RESULT     |
+---------------------------+------------------+------------------+----------------+
|     kube_bench_master hunter     |     functest     |      00:07 28       |      PASS      |
+---------------------------+------------------+------------------+----------------+

2022-11-10 11:2521:1807,955 126 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK3.3bash-5.1# run_tests -t

kube_bench_

...

master: PASS

Expand
titlelog

2022-11-10 11:3525:4710,669 440 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 11:3525:4710,685 456 - xtesting.ci.run_tests - INFO - Loading test case 'kube_bench_nodemaster'...
2022-11-10 11:3525:4710,991 913 - xtesting.ci.run_tests - INFO - Running test case 'kube_bench_nodemaster'...
2022-11-10 11:3525:5418,758 894 - functest_kubernetes.security.security - ERROR - Ensure that the proxy kubeconfig etcd pod specification file permissions are set to 644 or more restrictive (Scored)
Run the below command (based on the file location on your system) on the each worker master node.
For example,
chmod 644 /etc/kubernetes/manifests/proxyetcd.confyaml

2022-11-10 11:3525:5418,759 895 - functest_kubernetes.security.security - ERROR - Ensure that the proxy kubeconfig etcd pod specification file ownership is set to root:root (Scored)
Run the below command (based on the file location on your system) on the each worker master node.
For example,
chown root:root /etc/kubernetes/manifests/proxyetcd.confyaml

2022-11-10 11:3525:5418,759 895 - functest_kubernetes.security.security - ERROR - Ensure that the --read-only-port argument is set to 0 etcd data directory permissions are set to 700 or more restrictive (Scored)
If using a Kubelet config file, edit the file to set readOnlyPort to 0.
If using command line arguments, edit the kubelet service file
/etc/systemd/system/kubelet.service on each worker node and
set the below parameter in KUBELET_SYSTEM_PODS_ARGS variable.
--read-only-port=0
Based on your system, restart the kubelet service. For example:
systemctl daemon-reload
systemctl restart kubelet.serviceOn the etcd server node, get the etcd data directory, passed as an argument --data-dir,
from the below command:
ps -ef | grep etcd
Run the below command (based on the etcd data directory found above). For example,
chmod 700 /var/lib/etcd

2022-11-10 11:3525:5418,759 895 - functest_kubernetes.security.security - ERROR - Ensure that the --protect-kernel-defaults argument etcd data directory ownership is set to true etcd:etcd (Scored)
If using a Kubelet config file, edit the file to set protectKernelDefaults: true.
If using command line arguments, edit the kubelet service file
/etc/systemd/system/kubelet.service on each worker node and
set the below parameter in KUBELET_SYSTEM_PODS_ARGS variable.
--protect-kernel-defaults=true
Based on your system, restart the kubelet service. For example:
systemctl daemon-reload
systemctl restart kubelet.serviceOn the etcd server node, get the etcd data directory, passed as an argument --data-dir,
from the below command:
ps -ef | grep etcd
Run the below command (based on the etcd data directory found above).
For example, chown etcd:etcd /var/lib/etcd

2022-11-10 11:3525:5418,759 895 - functest_kubernetes.security.security - ERROR - Ensure that the --tls-cert-file and --tls-private-key-file arguments are set as appropriate RotateKubeletServerCertificate argument is set to true (Scored)
If using a Kubelet config file, edit the file to set tlsCertFile to the location
of the certificate file to use to identify this Kubelet, and tlsPrivateKeyFile
to the location of the corresponding private key file.
If using command line arguments, edit the kubelet service file
/etc/systemd/system/kubelet.service on each worker node and
set the below parameters in KUBELET_CERTIFICATE_ARGS variable.
--tls-cert-file=<path/to/tls-certificate-file>
--tls-private-key-file=<path/to/tls-key-file>
Based on your system, restart the kubelet service. For example:
systemctl daemon-reload
systemctl restart kubelet.serviceEdit the Controller Manager pod specification file /etc/kubernetes/manifests/kube-controller-manager.yaml
on the master node and set the --feature-gates parameter to include RotateKubeletServerCertificate=true.
--feature-gates=RotateKubeletServerCertificate=true

2022-11-10 11:3525:5418,760 897 - functest_kubernetes.security.security - WARNING - Targets:

+-------------------+-----------------+-----------------------------------------+--------------+--------------+--------------+
|     NODE_TYPE     |     VERSION     |                TEST_DESC                |     PASS     |     FAIL     |     WARN     |
+-------------------+-----------------+-----------------------------------------+--------------+--------------+--------------+
|        node master      |       1.5       |     Worker Master Node Configuration Files     |      12      |      4       |      5       |
|       master      |      7   1.5       |                API Server               |      31      |      2  0       |      1  4       |
|        node master      |       1.5       |            Controller Manager           |      6     Kubelet   |      1       |      0       |
|       master      |        8 1.5       |                Scheduler            3      |      2       |      0       |      0       |
+-------------------+-----------------+-----------------------------------------+--------------+--------------+--------------+

2022-11-10 11:3525:5418,760 897 - xtesting.ci.run_tests - INFO - Test result:+-------------------------+------------------+------------------+----------------+
|        TEST CASE        |     PROJECT      |     DURATION     |     RESULT     |

+-------------------------+------------------+------------------+----------------+
|     kube_bench_node     |     functest     |      00:06       |      PASS      |
+---+------------------+----+------------+
|         TEST CASE         |     PROJECT      |     DURATION     |     RESULT     |
+------+------------------+---+-------------+2022-11-10 11:35:54,816 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK4
opnfv/functest-kubernetes-benchmarking

4.1
bash-5.1# run_tests -t xrally_kubernetes_full
2022-11-10 11:36:23,102 - xtesting.ci.run_tests - INFO - Deployment description:

+-+------------------+----------------+
|     kube_bench_master     |     functest     |      00:07       |      PASS      |
+---------------------------+------------------+--------------+
|         ENV VAR         |                          VALUE                           |
----+----------------+

2022-11-10 11:25:18,955 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

kube_bench_node: PASS

Expand
titlelog

2022-11-10 11:35:47,669 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+--------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     | --------+
|         ENV VAR         |                                 unknown  VALUE                           |
+-------------------------+----------------------------------------------------------+
|          BUILDCI_TAG LOOP         |                                  daily                           |
|        NODE_NAME    DEBUG       |    |                                                      |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |  false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|     S3 INSTALLER_ENDPOINT_URL TYPE     |                                 unknown                          |
|        S3_DST_URL  BUILD_TAG        |                                                          |
|       HTTP_DST_URL  NODE_NAME        |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 11:36:23,118 - xtesting.ci.run_tests - INFO - Loading test case 'xrally_kubernetes_full'...
2022-11-10 11:36:23,841 - xtesting.ci.run_tests - INFO - Running test case 'xrally_kubernetes_full'...
2022-11-10 12:12:59,868 - xtesting.ci.run_tests - INFO - Test result:

+--------------------------------+------------------+------------------+----------------+
|           TEST CASE            |     PROJECT      |     DURATION     |     RESULT |       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+-------+------------------+------------------+----------------+
|     xrally_kubernetes_full     |     functest     |      36:36       |      PASS      |
+--------------------------------+------------------+------------------+----------------+

2022-11-10 12:12:59,870 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK

4.2
bash-5.1# run_tests -t netperf
2022-11-10 12:20:46,740 - xtesting.ci.run_tests - INFO - Deployment description:+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
++

2022-11-10 11:35:47,685 - xtesting.ci.run_tests - INFO - Loading test case 'kube_bench_node'...
2022-11-10 11:35:47,991 - xtesting.ci.run_tests - INFO - Running test case 'kube_bench_node'...
2022-11-10 11:35:54,758 - functest_kubernetes.security.security - ERROR - Ensure that the proxy kubeconfig file permissions are set to 644 or more restrictive (Scored)
Run the below command (based on the file location on your system) on the each worker node.
For example,
chmod 644 /etc/kubernetes/proxy.conf

2022-11-10 11:35:54,759 - functest_kubernetes.security.security - ERROR - Ensure that the proxy kubeconfig file ownership is set to root:root (Scored)
Run the below command (based on the file location on your system) on the each worker node.
For example, chown root:root /etc/kubernetes/proxy.conf

2022-11-10 11:35:54,759 - functest_kubernetes.security.security - ERROR - Ensure that the --read-only-port argument is set to 0 (Scored)
If using a Kubelet config file, edit the file to set readOnlyPort to 0.
If using command line arguments, edit the kubelet service file
/etc/systemd/system/kubelet.service on each worker node and
set the below parameter in KUBELET_SYSTEM_PODS_ARGS variable.
--read-only-port=0
Based on your system, restart the kubelet service. For example:
systemctl daemon-reload
systemctl restart kubelet.service

2022-11-10 11:35:54,759 - functest_kubernetes.security.security - ERROR - Ensure that the --protect-kernel-defaults argument is set to true (Scored)
If using a Kubelet config file, edit the file to set protectKernelDefaults: true.
If using command line arguments, edit the kubelet service file
/etc/systemd/system/kubelet.service on each worker node and
set the below parameter in KUBELET_SYSTEM_PODS_ARGS variable.
--protect-kernel-defaults=true
Based on your system, restart the kubelet service. For example:
systemctl daemon-reload
systemctl restart kubelet.service

2022-11-10 11:35:54,759 - functest_kubernetes.security.security - ERROR - Ensure that the --tls-cert-file and --tls-private-key-file arguments are set as appropriate (Scored)
If using a Kubelet config file, edit the file to set tlsCertFile to the location
of the certificate file to use to identify this Kubelet, and tlsPrivateKeyFile
to the location of the corresponding private key file.
If using command line arguments, edit the kubelet service file
/etc/systemd/system/kubelet.service on each worker node and
set the below parameters in KUBELET_CERTIFICATE_ARGS variable.
--tls-cert-file=<path/to/tls-certificate-file>
--tls-private-key-file=<path/to/tls-key-file>
Based on your system, restart the kubelet service. For example:
systemctl daemon-reload
systemctl restart kubelet.service

2022-11-10 11:35:54,760 - functest_kubernetes.security.security - WARNING - Targets:

+-------------------+-----------------+-----------------------------------------+--------------+-----+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |         ---------+--------------+
|     NODE_TYPE     |     VERSION     |                TEST_DESC                |               PASS      |
|     FAIL    NODE_NAME         |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL WARN     |
+-------------------+-----------------+-----------------------------------------+--------------+--------------+--------------+
|        node       |       1.5       |     Worker Node Configuration Files     |      7       |      2       |      1       |
|        node       |       1.5       |                 Kubelet                 |      8           |
|      3   HTTP_DST_URL       |                      2                                       |
+-------------------+-----------------+-----------------------------------------+--------------+--------------+2022-11-10 12:20:46,755 - xtesting.ci.run_tests - INFO - Loading test case 'netperf'...
2022-11-10 12:20:46,777 - xtesting.ci.run_tests - INFO - Running test case 'netperf'...--------------+

2022-11-10 1311:0235:0954,472 760 - xtesting.ci.run_tests - INFO - Test result:

+-------------------------+------------------+------------------+----------------+
|       TEST  TEST CASE        |     PROJECT      |     DURATION     |     RESULT     |
+-------------------------+------------------+------------------+----------------+
|      netperf kube_bench_node       |     functest     |      41 00:22 06       |      PASS      |
+-------------------------+------------------+------------------+----------------+

2022-11-10 1311:0235:0954,475 816 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK5

opnfv/functest-kubernetes-

...

benchmarking

xrally_kubernetes_full: PASS

Expand
titlelog

2022-11-10 1311:3236:5623,101 102 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 1311:3236:5623,118 - xtesting.ci.run_tests - INFO - Loading test case 'k8sxrally_kubernetes_vimsfull'...
2022-11-10 1311:3236:5623,614 841 - xtesting.ci.run_tests - INFO - Running test case 'k8sxrally_kubernetes_vimsfull'...
2022-11-10 1312:4012:2159,901 868 - xtesting.ci.run_tests - INFO - Test result:

+--------------------------------+------------------+------------------+----------------+
|           TEST CASE            |     PROJECT      |     DURATION     |     RESULT     |
+--------------------------------+------------------+------------------+----------------+
|      k8sxrally_kubernetes_vims full     |     functest     |      07 36:25 36       |      FAIL  PASS      |
+-------------------+-------------+-------------+-----+-------------+-----+-----------+2022-11-10 13:40:22,268 - xtesting.ci.run_tests - ERROR - The test case 'k8s_vims' failed.-+

2022-11-10 1312:4012:2259,268 870 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR5.2
bash-5.1# run_tests -t helm_vimsOK

netperf: PASS

...

functest-kubernetes-healthcheck

...

k8s_quick

...

PASS

...

k8s_smoke 

...

PASS

...

functest-kubernetes-benchmarking

...

netperf

...

PASS

...

xrally_kubernetes_full

...

PASS

...

kube_bench_master

...

PASS

...

kube_bench_node

...

PASS

...

kube_hunter

...

PASS

...

Expand
titlelog

2022-11-10 1312:4720:1546,988 740 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                                                          |
|     S3_ENDPOINT_URL     |                                                          |
|        S3_DST_URL       |                                                          |
|       HTTP_DST_URL      |                                                          |
+-------------------------+----------------------------------------------------------+

2022-11-10 1312:4720:1646,005 755 - xtesting.ci.run_tests - INFO - Loading test case 'helm_vimsnetperf'...
2022-11-10 1312:4720:1646,457 777 - xtesting.ci.run_tests - INFO - Running test case 'helm_vimsnetperf'...
2022-11-10 13:5502:1909,705 472 - xtesting.ci.run_tests - INFO - Test result:

+-------------------+------------------+------------------+----------------+
|     TEST CASE     |     PROJECT      |     DURATION     |     RESULT     |
+-------------------+------------------+------------------+----------------+
|     helm_vims  netperf      |     functest     |      08 41:03 22       |      FAIL  PASS      |
+-------------------+------------------+------------------+----------------+2022-11-10 13:55:20,812 - xtesting.ci.run_tests - ERROR - The test case 'helm_vims' failed.
2022-11-10 13:55:20,813 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR5.36
home/ri2/functest-kubernetes/config:/root/.kube/config  opnfv/functest-kubernetes-healthcheck:v1.21 /bin/bas
bash-5.1# zip_campaign
2022-11-10 14:21:03,676 - xtesting.core.campaign - ERROR - Cannot publish the artifacts
Traceback (most recent call last):
  File "/usr/lib/python3.8/site-packages/xtesting/core/campaign.py", line 117, in dump_artifacts
    's3', endpoint_url=os.environ["S3_ENDPOINT_URL"])
  File "/usr/lib/python3.8/os.py", line 675, in __getitem__
    raise KeyError(key) from None
KeyError: 'S3_ENDPOINT_URL'-+------------------+----------------+

2022-11-10 1413:2102:0309,678 475 - xtesting.coreci.campaign run_tests - ERROR - Cannot publish the artifacts
Traceback (most recent call last):
  File "/usr/lib/python3.8/site-packages/xtesting/core/campaign.py", line 172, in zip_campaign_files
    assert Campaign.dump_artifacts() == Campaign.EX_OK
AssertionError

Expand
titlelog

...

stage

...

job

...

result

detail

INFO - Execution exit value: Result.EX_OK

functest-kubernetes-cnf

k8s_vims: FAIL

Expand
titlelog

2022-11-10

...

13:

...

32:

...

56,

...

101 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+
|         ENV VAR         |                          VALUE                           |
+-------------------------+----------------------------------------------------------+
|         CI

...

_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                              

...

                       

...

   |
|        NODE_NAME        |        

...

       

...

         

...

                       

...

       |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|    

...

TEST_DB_EXT_URL     |                                      

...

                   |
|    

...

S3_ENDPOINT_

...

URL     |                                

...

                         |
|      

...

 S3_DST_URL       |                                                          |
|      

...

HTTP_DST_URL      |                                                          |

...


+-------------------------+----------------------------------------------------------+

2022-11-10 13:32:56,118 - xtesting.ci.run_tests - INFO - Loading test case 'k8s_vims'...
2022-11-10 13:32:56,614 - xtesting.ci.run_tests - INFO - Running test case 'k8s_vims'...
2022-11-10 13:40:21,901 - xtesting.ci.run_tests - INFO - Test result:

+-------------------+------------------+------------------+----------------+
|     TEST CASE     |     PROJECT      |     DURATION     |     RESULT     |
+-------------------+------------------+------------------+----------------+
|      k8s_vims     |     functest     |      07:25       |      FAIL      |
+-------------------+------------------+------------------+----------------+

2022-11-10 13:40:22,268 - xtesting.ci.run_tests - ERROR - The test case 'k8s_vims' failed.
2022-11-10 13:40:22,268 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR

helm_vims: FAIL

Expand
titlelog

2022-11-10 13:47:15,988 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------+

2022-11-10 11:20:38,316 - xtesting.ci.run_tests - INFO - Loading test case 'kube_hunter'...
2022-11-10 11:20:38,823 - xtesting.ci.run_tests - INFO - Running test case 'kube_hunter'...
2022-11-10 11:21:07,061 - functest_kubernetes.security.security - WARNING - Skipping CAP_NET_RAW Enabled (severity is configured as high)
2022-11-10 11:21:07,061 - functest_kubernetes.security.security - WARNING - Skipping Read access to pod's service account token (severity is configured as high)
2022-11-10 11:21:07,062 - functest_kubernetes.security.security - WARNING - Skipping Access to pod's secrets (severity is configured as high)
2022-11-10 11:21:07,062 - functest_kubernetes.security.security - WARNING - Skipping K8s Version Disclosure (severity is configured as high)
2022-11-10 11:21:07,062 - functest_kubernetes.security.security - WARNING - Skipping Access to API using service account token (severity is configured as high)
2022-11-10 11:21:07,064 - functest_kubernetes.security.security - WARNING -

...

|         ENV VAR         |                          VALUE                           |
+-------------------------+-----------------------

...

-----------------------------------+
|         CI_LOOP         |                          daily                           |
|          DEBUG          |                          false                           |
|     DEPLOY_SCENARIO     |                 k8-nosdn-

...

nofeature-noha                  |
|      INSTALLER_TYPE     |                         unknown                          |
|        BUILD_TAG        |                                                          |
|        NODE_NAME        |                                                          |
|       TEST_DB_URL       |     http://testresults.opnfv.org/test/api/v1/results     |
|     TEST_DB_EXT_URL     |                      

...

   

...

   

...

       

...

         

...

         |
|    

...

S3_

...

ENDPOINT_URL     |                  

...

     

...

       

...

       

...

         

...

   

...

   |
|      

...

 S3_DST_URL      

...

|        

...

         

...

           

...

             

...

     

...

       |
|    

...

  HTTP_DST_URL  

...

   |          

...

             

...

   

...

 

...

   

...

   

...

   

...

     

...

   

...

     |
+-------------------------+------

...

----------------------------------------------------+

2022-11-10 13:47:16,005 - xtesting.ci.run_tests - INFO - Loading test case 'helm_vims'...
2022-11-10 13:47:16,457 - xtesting.ci.run_tests -

...

INFO - Running test case 'helm_vims'...
2022-11-10

...

13:

...

55:

...

19,

...

705 - xtesting.ci.run_tests - INFO - Test result:

+

...

-------------------+------------------+------------------+----------------+
|    

...

TEST CASE

...

    |     PROJECT      |     DURATION     |     RESULT     |
+

...

-------------------

...

+------------------+------------------+----------------+
|    

...

helm_

...

vims     |     functest     |    

...

 08:

...

03       |    

...

 FAIL      |
+

...

-------------------

...

+------------------+------------------+----------------+

2022-11-10 13:55:20,812 - xtesting.ci.run_tests - ERROR - The test case 'helm_vims' failed.
2022-11-10 13:

...

55:

...

20,

...

813 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX

...

_ERROR

functest-kubernetes-healthcheck

zip_campaign