Skip to content

OPRUN-4054: [OTE] add catalog tests from openshift/origin #419

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

camilamacedo86
Copy link
Contributor

@camilamacedo86 camilamacedo86 commented Aug 1, 2025

This commit migrates the olmv1_catalog set of tests from openshift/origin
to OTE as part the broad effort to migrate all tests.
We are also doing some improvements to avoid flakes by ensuring cleanup and unique names

Local Test

$ ./bin/olmv1-tests-ext run-suite olmv1/all
  [INFO] [env] Using kubeconfig: /Users/camilam/.kube/cluster-bot.kubeconfig[INFO] [env] Cluster environment initialized (OpenShift: true)  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
  ===============================================================================================================
  Random Seed: 1754926467 - will randomize all specs

  Will run 1 of 1 specs
  ------------------------------
  [sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-certified-operators Catalog should serve FBC via the /v1/api/metas endpoint
  /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:171
    STEP: Retrieving base URL from ClusterCatalog "openshift-certified-operators" @ 08/11/25 16:34:28.614
    STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-certified-operators/api/v1/metas?schema=olm.package @ 08/11/25 16:34:29.016
    STEP: Waiting for Job to succeed @ 08/11/25 16:34:29.148
  • [0.924 seconds]
  ------------------------------

  Ran 1 of 1 Specs in 0.925 seconds
  SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
  ===============================================================================================================
  Random Seed: 1754926467 - will randomize all specs

  Will run 1 of 1 specs
  ------------------------------
  [sig-olmv1] OLMv1 should pass a trivial sanity check
  /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1.go:28
  • [0.000 seconds]
  ------------------------------

  Ran 1 of 1 Specs in 0.000 seconds
  SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
  ===============================================================================================================
  Random Seed: 1754926467 - will randomize all specs

  Will run 1 of 1 specs
  ------------------------------
  [sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-redhat-marketplace Catalog should serve FBC via the /v1/api/metas endpoint
  /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:183
    STEP: Retrieving base URL from ClusterCatalog "openshift-redhat-marketplace" @ 08/11/25 16:34:29.539
    STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-marketplace/api/v1/metas?schema=olm.package @ 08/11/25 16:34:29.663
    STEP: Waiting for Job to succeed @ 08/11/25 16:34:29.794
  • [0.650 seconds]
  ------------------------------

  Ran 1 of 1 Specs in 0.650 seconds
  SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
  ===============================================================================================================
  Random Seed: 1754926467 - will randomize all specs

  Will run 1 of 1 specs
  ------------------------------
  [sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-redhat-operators Catalog should serve FBC via the /v1/api/metas endpoint
  /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:195
    STEP: Retrieving base URL from ClusterCatalog "openshift-redhat-operators" @ 08/11/25 16:34:30.192
    STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-operators/api/v1/metas?schema=olm.package @ 08/11/25 16:34:30.319
    STEP: Waiting for Job to succeed @ 08/11/25 16:34:30.447
  • [0.648 seconds]
  ------------------------------

  Ran 1 of 1 Specs in 0.649 seconds
  SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
  ===============================================================================================================
  Random Seed: 1754926467 - will randomize all specs

  Will run 1 of 1 specs
  ------------------------------
  [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-certified-operators Catalog should serve FBC via the /v1/api/all endpoint
  /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:123
    STEP: Retrieving base URL from ClusterCatalog "openshift-certified-operators" @ 08/11/25 16:34:30.84
    STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-certified-operators/api/v1/all @ 08/11/25 16:34:30.967
    STEP: Waiting for Job to succeed @ 08/11/25 16:34:31.102
  • [0.648 seconds]
  ------------------------------

  Ran 1 of 1 Specs in 0.649 seconds
  SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
  ===============================================================================================================
  Random Seed: 1754926467 - will randomize all specs

  Will run 1 of 1 specs
  ------------------------------
  [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 Catalogs should be installed
  /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:31
    STEP: checking that "openshift-certified-operators" exists @ 08/11/25 16:34:31.49
    STEP: checking that "openshift-certified-operators" is serving @ 08/11/25 16:34:31.617
    STEP: checking that "openshift-community-operators" exists @ 08/11/25 16:34:31.617
    STEP: checking that "openshift-community-operators" is serving @ 08/11/25 16:34:31.743
    STEP: checking that "openshift-redhat-marketplace" exists @ 08/11/25 16:34:31.743
    STEP: checking that "openshift-redhat-marketplace" is serving @ 08/11/25 16:34:31.874
    STEP: checking that "openshift-redhat-operators" exists @ 08/11/25 16:34:31.874
    STEP: checking that "openshift-redhat-operators" is serving @ 08/11/25 16:34:32.007
  • [0.646 seconds]
  ------------------------------

  Ran 1 of 1 Specs in 0.646 seconds
  SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
  ===============================================================================================================
  Random Seed: 1754926467 - will randomize all specs

  Will run 1 of 1 specs
  ------------------------------
  [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-community-operators Catalog should serve FBC via the /v1/api/all endpoint
  /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:111
    STEP: Retrieving base URL from ClusterCatalog "openshift-community-operators" @ 08/11/25 16:34:32.137
    STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-community-operators/api/v1/all @ 08/11/25 16:34:32.267
    STEP: Waiting for Job to succeed @ 08/11/25 16:34:32.395
  • [0.652 seconds]
  ------------------------------

  Ran 1 of 1 Specs in 0.652 seconds
  SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
  ===============================================================================================================
  Random Seed: 1754926467 - will randomize all specs

  Will run 1 of 1 specs
  ------------------------------
  [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-redhat-operators Catalog should serve FBC via the /v1/api/all endpoint
  /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:147
    STEP: Retrieving base URL from ClusterCatalog "openshift-redhat-operators" @ 08/11/25 16:34:32.788
    STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-operators/api/v1/all @ 08/11/25 16:34:32.915
    STEP: Waiting for Job to succeed @ 08/11/25 16:34:33.045
  • [0.656 seconds]
  ------------------------------

  Ran 1 of 1 Specs in 0.657 seconds
  SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
  ===============================================================================================================
  Random Seed: 1754926467 - will randomize all specs

  Will run 1 of 1 specs
  ------------------------------
  [sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-community-operators Catalog should serve FBC via the /v1/api/metas endpoint
  /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:159
    STEP: Retrieving base URL from ClusterCatalog "openshift-community-operators" @ 08/11/25 16:34:33.452
    STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-community-operators/api/v1/metas?schema=olm.package @ 08/11/25 16:34:33.579
    STEP: Waiting for Job to succeed @ 08/11/25 16:34:33.707
  • [0.652 seconds]
  ------------------------------

  Ran 1 of 1 Specs in 0.653 seconds
  SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
  ===============================================================================================================
  Random Seed: 1754926467 - will randomize all specs

  Will run 1 of 1 specs
  ------------------------------
  [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-redhat-marketplace Catalog should serve FBC via the /v1/api/all endpoint
  /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:135
    STEP: Retrieving base URL from ClusterCatalog "openshift-redhat-marketplace" @ 08/11/25 16:34:34.096
    STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-marketplace/api/v1/all @ 08/11/25 16:34:34.218
    STEP: Waiting for Job to succeed @ 08/11/25 16:34:34.351
  • [0.644 seconds]
  ------------------------------

  Ran 1 of 1 Specs in 0.644 seconds
  SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
  ===============================================================================================================
  Random Seed: 1754926467 - will randomize all specs

  Will run 1 of 1 specs
  ------------------------------
  [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 New Catalog Install should fail to install if it has an invalid reference
  /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:204
    STEP: creating the malformed catalog with an invalid image ref @ 08/11/25 16:34:34.742
    STEP: waiting for the catalog to report failure via Progressing=True and reason=Retrying @ 08/11/25 16:34:34.893
    STEP: deleting lingering ClusterCatalog "bad-catalog" @ 08/11/25 16:34:36.407
  • [2.046 seconds]
  ------------------------------

  Ran 1 of 1 Specs in 2.047 seconds
  SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
  ===============================================================================================================
  Random Seed: 1754926467 - will randomize all specs

  Will run 1 of 1 specs
  ------------------------------
  [sig-olmv1][OCPFeatureGate:NewOLM] OLMv1 CRDs should be installed
  /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1.go:39
    STEP: verifying CRD clusterextensions.olm.operatorframework.io @ 08/11/25 16:34:36.793
    STEP: verifying CRD clustercatalogs.olm.operatorframework.io @ 08/11/25 16:34:36.923
  • [0.394 seconds]
  ------------------------------

  Ran 1 of 1 Specs in 0.394 seconds
  SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
  ===============================================================================================================
  Random Seed: 1754926467 - will randomize all specs

  Will run 1 of 1 specs
  ------------------------------
  [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should install a cluster extension
  /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1.go:97
    STEP: creating namespace install-test-ns-zfvq @ 08/11/25 16:34:37.186
    STEP: ensuring no ClusterExtension and CRD for quay-operator @ 08/11/25 16:34:37.315
    STEP: applying the ClusterExtension resource @ 08/11/25 16:34:37.575
    STEP: ensuring ServiceAccount is available before proceeding @ 08/11/25 16:34:37.704
    STEP: ensuring ClusterRoleBinding is available before proceeding @ 08/11/25 16:34:37.964
    STEP: waiting for the quay-operator ClusterExtension to be installed @ 08/11/25 16:34:38.231
  • [6.394 seconds]
  ------------------------------

  Ran 1 of 1 Specs in 6.394 seconds
  SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
  ===============================================================================================================
  Random Seed: 1754926467 - will randomize all specs

  Will run 1 of 1 specs
  ------------------------------
  [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should fail to install a non-existing cluster extension
  /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1.go:113
    STEP: creating namespace install-test-ns-h5xg @ 08/11/25 16:34:43.587
    STEP: ensuring no ClusterExtension and CRD for non-existing operator @ 08/11/25 16:34:43.715
    STEP: applying the ClusterExtension resource @ 08/11/25 16:34:43.841
    STEP: ensuring ServiceAccount is available before proceeding @ 08/11/25 16:34:43.972
    STEP: ensuring ClusterRoleBinding is available before proceeding @ 08/11/25 16:34:44.232
    STEP: waiting for the ClusterExtension to exist @ 08/11/25 16:34:44.568
    STEP: waiting up to 2 minutes for ClusterExtension to report failure @ 08/11/25 16:34:44.693
  • [1.933 seconds]
  ------------------------------

  Ran 1 of 1 Specs in 1.933 seconds
  SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
  ===============================================================================================================
  Random Seed: 1754926467 - will randomize all specs

  Will run 1 of 1 specs
  ------------------------------
  [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should block cluster upgrades if an incompatible operator is installed
  /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1.go:147
    STEP: creating namespace install-test-ns-mm9x @ 08/11/25 16:34:45.515
    STEP: ensuring no ClusterExtension no ClusterExtension and CRD for cluster-logging @ 08/11/25 16:34:45.652
    STEP: applying the ClusterExtension resource @ 08/11/25 16:34:45.908
    STEP: ensuring ServiceAccount is available before proceeding @ 08/11/25 16:34:46.037
    STEP: ensuring ClusterRoleBinding is available before proceeding @ 08/11/25 16:34:46.292
    STEP: waiting for the cluster-logging ClusterExtension to be installed @ 08/11/25 16:34:46.552
    STEP: ensuring the cluster is not upgradeable when olm.maxopenshiftversion is specified @ 08/11/25 16:34:51.2
  • [6.511 seconds]
  ------------------------------

  Ran 1 of 1 Specs in 6.511 seconds
  SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
[
  {
    "name": "[sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-certified-operators Catalog should serve FBC via the /v1/api/metas endpoint",
    "lifecycle": "blocking",
    "duration": 925,
    "startTime": "2025-08-11 15:34:28.485898 UTC",
    "endTime": "2025-08-11 15:34:29.411467 UTC",
    "result": "passed",
    "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-certified-operators\" @ 08/11/25 16:34:28.614\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-certified-operators/api/v1/metas?schema=olm.package @ 08/11/25 16:34:29.016\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:29.148\n"
  },
  {
    "name": "[sig-olmv1] OLMv1 should pass a trivial sanity check",
    "lifecycle": "blocking",
    "duration": 0,
    "startTime": "2025-08-11 15:34:29.411474 UTC",
    "endTime": "2025-08-11 15:34:29.412376 UTC",
    "result": "passed",
    "output": ""
  },
  {
    "name": "[sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-redhat-marketplace Catalog should serve FBC via the /v1/api/metas endpoint",
    "lifecycle": "blocking",
    "duration": 1577,
    "startTime": "2025-08-11 15:34:28.485918 UTC",
    "endTime": "2025-08-11 15:34:30.062923 UTC",
    "result": "passed",
    "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-redhat-marketplace\" @ 08/11/25 16:34:29.539\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-marketplace/api/v1/metas?schema=olm.package @ 08/11/25 16:34:29.663\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:29.794\n"
  },
  {
    "name": "[sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-redhat-operators Catalog should serve FBC via the /v1/api/metas endpoint",
    "lifecycle": "blocking",
    "duration": 2225,
    "startTime": "2025-08-11 15:34:28.485931 UTC",
    "endTime": "2025-08-11 15:34:30.711823 UTC",
    "result": "passed",
    "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-redhat-operators\" @ 08/11/25 16:34:30.192\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-operators/api/v1/metas?schema=olm.package @ 08/11/25 16:34:30.319\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:30.447\n"
  },
  {
    "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-certified-operators Catalog should serve FBC via the /v1/api/all endpoint",
    "lifecycle": "blocking",
    "duration": 2875,
    "startTime": "2025-08-11 15:34:28.485935 UTC",
    "endTime": "2025-08-11 15:34:31.361019 UTC",
    "result": "passed",
    "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-certified-operators\" @ 08/11/25 16:34:30.84\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-certified-operators/api/v1/all @ 08/11/25 16:34:30.967\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:31.102\n"
  },
  {
    "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 Catalogs should be installed",
    "lifecycle": "blocking",
    "duration": 3521,
    "startTime": "2025-08-11 15:34:28.485949 UTC",
    "endTime": "2025-08-11 15:34:32.007947 UTC",
    "result": "passed",
    "output": "  STEP: checking that \"openshift-certified-operators\" exists @ 08/11/25 16:34:31.49\n  STEP: checking that \"openshift-certified-operators\" is serving @ 08/11/25 16:34:31.617\n  STEP: checking that \"openshift-community-operators\" exists @ 08/11/25 16:34:31.617\n  STEP: checking that \"openshift-community-operators\" is serving @ 08/11/25 16:34:31.743\n  STEP: checking that \"openshift-redhat-marketplace\" exists @ 08/11/25 16:34:31.743\n  STEP: checking that \"openshift-redhat-marketplace\" is serving @ 08/11/25 16:34:31.874\n  STEP: checking that \"openshift-redhat-operators\" exists @ 08/11/25 16:34:31.874\n  STEP: checking that \"openshift-redhat-operators\" is serving @ 08/11/25 16:34:32.007\n"
  },
  {
    "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-community-operators Catalog should serve FBC via the /v1/api/all endpoint",
    "lifecycle": "blocking",
    "duration": 4174,
    "startTime": "2025-08-11 15:34:28.485952 UTC",
    "endTime": "2025-08-11 15:34:32.660689 UTC",
    "result": "passed",
    "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-community-operators\" @ 08/11/25 16:34:32.137\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-community-operators/api/v1/all @ 08/11/25 16:34:32.267\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:32.395\n"
  },
  {
    "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-redhat-operators Catalog should serve FBC via the /v1/api/all endpoint",
    "lifecycle": "blocking",
    "duration": 4831,
    "startTime": "2025-08-11 15:34:28.485954 UTC",
    "endTime": "2025-08-11 15:34:33.317529 UTC",
    "result": "passed",
    "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-redhat-operators\" @ 08/11/25 16:34:32.788\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-operators/api/v1/all @ 08/11/25 16:34:32.915\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:33.045\n"
  },
  {
    "name": "[sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-community-operators Catalog should serve FBC via the /v1/api/metas endpoint",
    "lifecycle": "blocking",
    "duration": 5485,
    "startTime": "2025-08-11 15:34:28.485974 UTC",
    "endTime": "2025-08-11 15:34:33.971454 UTC",
    "result": "passed",
    "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-community-operators\" @ 08/11/25 16:34:33.452\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-community-operators/api/v1/metas?schema=olm.package @ 08/11/25 16:34:33.579\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:33.707\n"
  },
  {
    "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-redhat-marketplace Catalog should serve FBC via the /v1/api/all endpoint",
    "lifecycle": "blocking",
    "duration": 6130,
    "startTime": "2025-08-11 15:34:28.485956 UTC",
    "endTime": "2025-08-11 15:34:34.616182 UTC",
    "result": "passed",
    "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-redhat-marketplace\" @ 08/11/25 16:34:34.096\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-marketplace/api/v1/all @ 08/11/25 16:34:34.218\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:34.351\n"
  },
  {
    "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 New Catalog Install should fail to install if it has an invalid reference",
    "lifecycle": "blocking",
    "duration": 8177,
    "startTime": "2025-08-11 15:34:28.485944 UTC",
    "endTime": "2025-08-11 15:34:36.663541 UTC",
    "result": "passed",
    "output": "  STEP: creating the malformed catalog with an invalid image ref @ 08/11/25 16:34:34.742\n  STEP: waiting for the catalog to report failure via Progressing=True and reason=Retrying @ 08/11/25 16:34:34.893\n  STEP: deleting lingering ClusterCatalog \"bad-catalog\" @ 08/11/25 16:34:36.407\n"
  },
  {
    "name": "[sig-olmv1][OCPFeatureGate:NewOLM] OLMv1 CRDs should be installed",
    "lifecycle": "blocking",
    "duration": 7645,
    "startTime": "2025-08-11 15:34:29.412381 UTC",
    "endTime": "2025-08-11 15:34:37.058191 UTC",
    "result": "passed",
    "output": "  STEP: verifying CRD clusterextensions.olm.operatorframework.io @ 08/11/25 16:34:36.793\n  STEP: verifying CRD clustercatalogs.olm.operatorframework.io @ 08/11/25 16:34:36.923\n"
  },
  {
    "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should install a cluster extension",
    "lifecycle": "blocking",
    "duration": 13390,
    "startTime": "2025-08-11 15:34:30.062930 UTC",
    "endTime": "2025-08-11 15:34:43.453235 UTC",
    "result": "passed",
    "output": "  STEP: creating namespace install-test-ns-zfvq @ 08/11/25 16:34:37.186\n  STEP: ensuring no ClusterExtension and CRD for quay-operator @ 08/11/25 16:34:37.315\n  STEP: applying the ClusterExtension resource @ 08/11/25 16:34:37.575\n  STEP: ensuring ServiceAccount is available before proceeding @ 08/11/25 16:34:37.704\n  STEP: ensuring ClusterRoleBinding is available before proceeding @ 08/11/25 16:34:37.964\n  STEP: waiting for the quay-operator ClusterExtension to be installed @ 08/11/25 16:34:38.231\n"
  },
  {
    "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should fail to install a non-existing cluster extension",
    "lifecycle": "blocking",
    "duration": 14675,
    "startTime": "2025-08-11 15:34:30.711829 UTC",
    "endTime": "2025-08-11 15:34:45.386985 UTC",
    "result": "passed",
    "output": "  STEP: creating namespace install-test-ns-h5xg @ 08/11/25 16:34:43.587\n  STEP: ensuring no ClusterExtension and CRD for non-existing operator @ 08/11/25 16:34:43.715\n  STEP: applying the ClusterExtension resource @ 08/11/25 16:34:43.841\n  STEP: ensuring ServiceAccount is available before proceeding @ 08/11/25 16:34:43.972\n  STEP: ensuring ClusterRoleBinding is available before proceeding @ 08/11/25 16:34:44.232\n  STEP: waiting for the ClusterExtension to exist @ 08/11/25 16:34:44.568\n  STEP: waiting up to 2 minutes for ClusterExtension to report failure @ 08/11/25 16:34:44.693\n"
  },
  {
    "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should block cluster upgrades if an incompatible operator is installed",
    "lifecycle": "blocking",
    "duration": 20538,
    "startTime": "2025-08-11 15:34:31.361028 UTC",
    "endTime": "2025-08-11 15:34:51.899231 UTC",
    "result": "passed",
    "output": "  STEP: creating namespace install-test-ns-mm9x @ 08/11/25 16:34:45.515\n  STEP: ensuring no ClusterExtension no ClusterExtension and CRD for cluster-logging @ 08/11/25 16:34:45.652\n  STEP: applying the ClusterExtension resource @ 08/11/25 16:34:45.908\n  STEP: ensuring ServiceAccount is available before proceeding @ 08/11/25 16:34:46.037\n  STEP: ensuring ClusterRoleBinding is available before proceeding @ 08/11/25 16:34:46.292\n  STEP: waiting for the cluster-logging ClusterExtension to be installed @ 08/11/25 16:34:46.552\n  STEP: ensuring the cluster is not upgradeable when olm.maxopenshiftversion is specified @ 08/11/25 16:34:51.2\n"
  }
]

@openshift-ci openshift-ci bot requested review from grokspawn and tmshort August 1, 2025 10:13
Copy link
Contributor

openshift-ci bot commented Aug 1, 2025

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: camilamacedo86
Once this PR has been reviewed and has the lgtm label, please assign tmshort for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@camilamacedo86 camilamacedo86 force-pushed the add-catalog-tests-only-ote branch 3 times, most recently from 544842d to 5ac974e Compare August 1, 2025 11:00
@camilamacedo86
Copy link
Contributor Author

/retest-required

@camilamacedo86 camilamacedo86 changed the title [OTE] add catalog tests from openshift/origin OPRUN-4054: [OTE] add catalog tests from openshift/origin Aug 4, 2025
@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Aug 4, 2025
@openshift-ci-robot
Copy link

openshift-ci-robot commented Aug 4, 2025

@camilamacedo86: This pull request references OPRUN-4054 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.20.0" version, but no target version was set.

In response to this:

Summary of Changes

This PR migrates the OLMv1 catalog tests from openshift/origin/test/extended/olm/olmv1-catalogd.go to the OpenShift Test Extension (OTE) framework. The new implementation replaces the use of the oc command-line interface with a Go-native, strongly-typed client, and leverages the OLM API directly for resource management.

The migration offers several key improvements:

  • Go-native API Interaction: Replaces oc command executions and manual JSON parsing with direct calls to the Kubernetes API using the controller-runtime client. This provides a more robust, type-safe, and efficient way to interact with cluster resources.
  • Programmatic Resource Management: Instead of relying on testdata YAML files, test resources like ClusterCatalog and Job objects are now created and managed programmatically using Go structs. This eliminates the need for temporary files and enhances test reliability.
  • Improved Polling and Assertions: Switches from manual polling loops (wait.PollUntilContextTimeout) and output parsing to declarative gomega.Eventually blocks. This makes the tests more readable and less fragile when verifying asynchronous state changes.

This change aligns the OLMv1 tests with modern Go testing practices, improves maintainability, and removes the dependency on the oc CLI for test execution.

Comparison of Methodologies

Feature Original Test (openshift/origin) New OTE Test (operator-controller/openshift)
Kubernetes Interaction oc CLI commands (oc get, oc apply) with manual JSON output parsing. Go client (controller-runtime) for direct, type-safe API calls.
Resource Creation Manually writing and applying YAML files from a testdata directory. Programmatic creation of Go structs (e.g., olmv1.ClusterCatalog).
Resource Cleanup Relies on AfterEach blocks with oc delete commands on temporary files. Uses ginkgo.DeferCleanup for a more robust and idiomatic cleanup mechanism.
Asynchronous State Checks wait.PollUntilContextTimeout function with manual logic to parse and check status conditions from oc output. gomega.Eventually with typed assertions against native Go objects.
Dependency Requires the oc CLI to be installed and available in the test environment. No dependency on external CLI tools. Relies solely on the Go test binary and a valid kubeconfig.

--- **Disclaimer:** This summary and comparison was generated by an AI assistant.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@camilamacedo86 camilamacedo86 changed the title OPRUN-4054: [OTE] add catalog tests from openshift/origin WIP OPRUN-4054: [OTE] add catalog tests from openshift/origin Aug 6, 2025
@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Aug 6, 2025
@camilamacedo86 camilamacedo86 force-pushed the add-catalog-tests-only-ote branch 6 times, most recently from be4f081 to 0e7e9e0 Compare August 8, 2025 22:02
@openshift-ci-robot
Copy link

openshift-ci-robot commented Aug 8, 2025

@camilamacedo86: This pull request references OPRUN-4054 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.20.0" version, but no target version was set.

In response to this:

This commit migrates the olmv1_catalog set of tests from openshift/origin
to OTE as part the broad effort to migrate all tests.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@@ -1,4 +1,104 @@
[
{
"name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 Catalogs should be installed",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"environmentSelector": {}
},
{
"name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-community-operators Catalog should serve FBC via the /v1/api/all endpoint",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"environmentSelector": {}
},
{
"name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-certified-operators Catalog should serve FBC via the /v1/api/all endpoint",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"environmentSelector": {}
},
{
"name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-redhat-marketplace Catalog should serve FBC via the /v1/api/all endpoint",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"environmentSelector": {}
},
{
"name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-redhat-operators Catalog should serve FBC via the /v1/api/all endpoint",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"environmentSelector": {}
},
{
"name": "[sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-community-operators Catalog should serve FBC via the /v1/api/metas endpoint",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"environmentSelector": {}
},
{
"name": "[sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-certified-operators Catalog should serve FBC via the /v1/api/metas endpoint",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"environmentSelector": {}
},
{
"name": "[sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-redhat-marketplace Catalog should serve FBC via the /v1/api/metas endpoint",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"environmentSelector": {}
},
{
"name": "[sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-redhat-operators Catalog should serve FBC via the /v1/api/metas endpoint",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"environmentSelector": {}
},
{
"name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 New Catalog Install should fail to install if it has an invalid reference",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@camilamacedo86
Copy link
Contributor Author

/test e2e-aws-techpreview-olmv1-ext

@camilamacedo86
Copy link
Contributor Author

/hold

until we have a green light to merge

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Aug 11, 2025
@camilamacedo86 camilamacedo86 changed the title OPRUN-4054: [OTE] add catalog tests from openshift/origin WIP OPRUN-4054: [OTE] add catalog tests from openshift/origin Aug 11, 2025
@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Aug 11, 2025
@openshift-ci-robot
Copy link

openshift-ci-robot commented Aug 11, 2025

@camilamacedo86: This pull request references OPRUN-4054 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.20.0" version, but no target version was set.

In response to this:

This commit migrates the olmv1_catalog set of tests from openshift/origin
to OTE as part the broad effort to migrate all tests.
We are also doing some improvements to avoid flakes by ensuring cleanup and unique names

Local Test

$ ./bin/olmv1-tests-ext run-suite olmv1/all
 [INFO] [env] Using kubeconfig: /Users/camilam/.kube/cluster-bot.kubeconfig[INFO] [env] Cluster environment initialized (OpenShift: true)  Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
 ===============================================================================================================
 Random Seed: 1754926467 - will randomize all specs

 Will run 1 of 1 specs
 ------------------------------
 [sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-certified-operators Catalog should serve FBC via the /v1/api/metas endpoint
 /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:171
   STEP: Retrieving base URL from ClusterCatalog "openshift-certified-operators" @ 08/11/25 16:34:28.614
   STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-certified-operators/api/v1/metas?schema=olm.package @ 08/11/25 16:34:29.016
   STEP: Waiting for Job to succeed @ 08/11/25 16:34:29.148
 • [0.924 seconds]
 ------------------------------

 Ran 1 of 1 Specs in 0.925 seconds
 SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
 Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
 ===============================================================================================================
 Random Seed: 1754926467 - will randomize all specs

 Will run 1 of 1 specs
 ------------------------------
 [sig-olmv1] OLMv1 should pass a trivial sanity check
 /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1.go:28
 • [0.000 seconds]
 ------------------------------

 Ran 1 of 1 Specs in 0.000 seconds
 SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
 Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
 ===============================================================================================================
 Random Seed: 1754926467 - will randomize all specs

 Will run 1 of 1 specs
 ------------------------------
 [sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-redhat-marketplace Catalog should serve FBC via the /v1/api/metas endpoint
 /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:183
   STEP: Retrieving base URL from ClusterCatalog "openshift-redhat-marketplace" @ 08/11/25 16:34:29.539
   STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-marketplace/api/v1/metas?schema=olm.package @ 08/11/25 16:34:29.663
   STEP: Waiting for Job to succeed @ 08/11/25 16:34:29.794
 • [0.650 seconds]
 ------------------------------

 Ran 1 of 1 Specs in 0.650 seconds
 SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
 Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
 ===============================================================================================================
 Random Seed: 1754926467 - will randomize all specs

 Will run 1 of 1 specs
 ------------------------------
 [sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-redhat-operators Catalog should serve FBC via the /v1/api/metas endpoint
 /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:195
   STEP: Retrieving base URL from ClusterCatalog "openshift-redhat-operators" @ 08/11/25 16:34:30.192
   STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-operators/api/v1/metas?schema=olm.package @ 08/11/25 16:34:30.319
   STEP: Waiting for Job to succeed @ 08/11/25 16:34:30.447
 • [0.648 seconds]
 ------------------------------

 Ran 1 of 1 Specs in 0.649 seconds
 SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
 Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
 ===============================================================================================================
 Random Seed: 1754926467 - will randomize all specs

 Will run 1 of 1 specs
 ------------------------------
 [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-certified-operators Catalog should serve FBC via the /v1/api/all endpoint
 /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:123
   STEP: Retrieving base URL from ClusterCatalog "openshift-certified-operators" @ 08/11/25 16:34:30.84
   STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-certified-operators/api/v1/all @ 08/11/25 16:34:30.967
   STEP: Waiting for Job to succeed @ 08/11/25 16:34:31.102
 • [0.648 seconds]
 ------------------------------

 Ran 1 of 1 Specs in 0.649 seconds
 SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
 Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
 ===============================================================================================================
 Random Seed: 1754926467 - will randomize all specs

 Will run 1 of 1 specs
 ------------------------------
 [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 Catalogs should be installed
 /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:31
   STEP: checking that "openshift-certified-operators" exists @ 08/11/25 16:34:31.49
   STEP: checking that "openshift-certified-operators" is serving @ 08/11/25 16:34:31.617
   STEP: checking that "openshift-community-operators" exists @ 08/11/25 16:34:31.617
   STEP: checking that "openshift-community-operators" is serving @ 08/11/25 16:34:31.743
   STEP: checking that "openshift-redhat-marketplace" exists @ 08/11/25 16:34:31.743
   STEP: checking that "openshift-redhat-marketplace" is serving @ 08/11/25 16:34:31.874
   STEP: checking that "openshift-redhat-operators" exists @ 08/11/25 16:34:31.874
   STEP: checking that "openshift-redhat-operators" is serving @ 08/11/25 16:34:32.007
 • [0.646 seconds]
 ------------------------------

 Ran 1 of 1 Specs in 0.646 seconds
 SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
 Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
 ===============================================================================================================
 Random Seed: 1754926467 - will randomize all specs

 Will run 1 of 1 specs
 ------------------------------
 [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-community-operators Catalog should serve FBC via the /v1/api/all endpoint
 /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:111
   STEP: Retrieving base URL from ClusterCatalog "openshift-community-operators" @ 08/11/25 16:34:32.137
   STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-community-operators/api/v1/all @ 08/11/25 16:34:32.267
   STEP: Waiting for Job to succeed @ 08/11/25 16:34:32.395
 • [0.652 seconds]
 ------------------------------

 Ran 1 of 1 Specs in 0.652 seconds
 SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
 Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
 ===============================================================================================================
 Random Seed: 1754926467 - will randomize all specs

 Will run 1 of 1 specs
 ------------------------------
 [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-redhat-operators Catalog should serve FBC via the /v1/api/all endpoint
 /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:147
   STEP: Retrieving base URL from ClusterCatalog "openshift-redhat-operators" @ 08/11/25 16:34:32.788
   STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-operators/api/v1/all @ 08/11/25 16:34:32.915
   STEP: Waiting for Job to succeed @ 08/11/25 16:34:33.045
 • [0.656 seconds]
 ------------------------------

 Ran 1 of 1 Specs in 0.657 seconds
 SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
 Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
 ===============================================================================================================
 Random Seed: 1754926467 - will randomize all specs

 Will run 1 of 1 specs
 ------------------------------
 [sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-community-operators Catalog should serve FBC via the /v1/api/metas endpoint
 /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:159
   STEP: Retrieving base URL from ClusterCatalog "openshift-community-operators" @ 08/11/25 16:34:33.452
   STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-community-operators/api/v1/metas?schema=olm.package @ 08/11/25 16:34:33.579
   STEP: Waiting for Job to succeed @ 08/11/25 16:34:33.707
 • [0.652 seconds]
 ------------------------------

 Ran 1 of 1 Specs in 0.653 seconds
 SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
 Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
 ===============================================================================================================
 Random Seed: 1754926467 - will randomize all specs

 Will run 1 of 1 specs
 ------------------------------
 [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-redhat-marketplace Catalog should serve FBC via the /v1/api/all endpoint
 /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:135
   STEP: Retrieving base URL from ClusterCatalog "openshift-redhat-marketplace" @ 08/11/25 16:34:34.096
   STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-marketplace/api/v1/all @ 08/11/25 16:34:34.218
   STEP: Waiting for Job to succeed @ 08/11/25 16:34:34.351
 • [0.644 seconds]
 ------------------------------

 Ran 1 of 1 Specs in 0.644 seconds
 SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
 Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
 ===============================================================================================================
 Random Seed: 1754926467 - will randomize all specs

 Will run 1 of 1 specs
 ------------------------------
 [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 New Catalog Install should fail to install if it has an invalid reference
 /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1-catalog.go:204
   STEP: creating the malformed catalog with an invalid image ref @ 08/11/25 16:34:34.742
   STEP: waiting for the catalog to report failure via Progressing=True and reason=Retrying @ 08/11/25 16:34:34.893
   STEP: deleting lingering ClusterCatalog "bad-catalog" @ 08/11/25 16:34:36.407
 • [2.046 seconds]
 ------------------------------

 Ran 1 of 1 Specs in 2.047 seconds
 SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
 Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
 ===============================================================================================================
 Random Seed: 1754926467 - will randomize all specs

 Will run 1 of 1 specs
 ------------------------------
 [sig-olmv1][OCPFeatureGate:NewOLM] OLMv1 CRDs should be installed
 /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1.go:39
   STEP: verifying CRD clusterextensions.olm.operatorframework.io @ 08/11/25 16:34:36.793
   STEP: verifying CRD clustercatalogs.olm.operatorframework.io @ 08/11/25 16:34:36.923
 • [0.394 seconds]
 ------------------------------

 Ran 1 of 1 Specs in 0.394 seconds
 SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
 Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
 ===============================================================================================================
 Random Seed: 1754926467 - will randomize all specs

 Will run 1 of 1 specs
 ------------------------------
 [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should install a cluster extension
 /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1.go:97
   STEP: creating namespace install-test-ns-zfvq @ 08/11/25 16:34:37.186
   STEP: ensuring no ClusterExtension and CRD for quay-operator @ 08/11/25 16:34:37.315
   STEP: applying the ClusterExtension resource @ 08/11/25 16:34:37.575
   STEP: ensuring ServiceAccount is available before proceeding @ 08/11/25 16:34:37.704
   STEP: ensuring ClusterRoleBinding is available before proceeding @ 08/11/25 16:34:37.964
   STEP: waiting for the quay-operator ClusterExtension to be installed @ 08/11/25 16:34:38.231
 • [6.394 seconds]
 ------------------------------

 Ran 1 of 1 Specs in 6.394 seconds
 SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
 Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
 ===============================================================================================================
 Random Seed: 1754926467 - will randomize all specs

 Will run 1 of 1 specs
 ------------------------------
 [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should fail to install a non-existing cluster extension
 /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1.go:113
   STEP: creating namespace install-test-ns-h5xg @ 08/11/25 16:34:43.587
   STEP: ensuring no ClusterExtension and CRD for non-existing operator @ 08/11/25 16:34:43.715
   STEP: applying the ClusterExtension resource @ 08/11/25 16:34:43.841
   STEP: ensuring ServiceAccount is available before proceeding @ 08/11/25 16:34:43.972
   STEP: ensuring ClusterRoleBinding is available before proceeding @ 08/11/25 16:34:44.232
   STEP: waiting for the ClusterExtension to exist @ 08/11/25 16:34:44.568
   STEP: waiting up to 2 minutes for ClusterExtension to report failure @ 08/11/25 16:34:44.693
 • [1.933 seconds]
 ------------------------------

 Ran 1 of 1 Specs in 1.933 seconds
 SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
 Running Suite:  - /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension
 ===============================================================================================================
 Random Seed: 1754926467 - will randomize all specs

 Will run 1 of 1 specs
 ------------------------------
 [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should block cluster upgrades if an incompatible operator is installed
 /Users/camilam/go/src/github/operator-framework-operator-controller/openshift/tests-extension/test/olmv1.go:147
   STEP: creating namespace install-test-ns-mm9x @ 08/11/25 16:34:45.515
   STEP: ensuring no ClusterExtension no ClusterExtension and CRD for cluster-logging @ 08/11/25 16:34:45.652
   STEP: applying the ClusterExtension resource @ 08/11/25 16:34:45.908
   STEP: ensuring ServiceAccount is available before proceeding @ 08/11/25 16:34:46.037
   STEP: ensuring ClusterRoleBinding is available before proceeding @ 08/11/25 16:34:46.292
   STEP: waiting for the cluster-logging ClusterExtension to be installed @ 08/11/25 16:34:46.552
   STEP: ensuring the cluster is not upgradeable when olm.maxopenshiftversion is specified @ 08/11/25 16:34:51.2
 • [6.511 seconds]
 ------------------------------

 Ran 1 of 1 Specs in 6.511 seconds
 SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
[
 {
   "name": "[sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-certified-operators Catalog should serve FBC via the /v1/api/metas endpoint",
   "lifecycle": "blocking",
   "duration": 925,
   "startTime": "2025-08-11 15:34:28.485898 UTC",
   "endTime": "2025-08-11 15:34:29.411467 UTC",
   "result": "passed",
   "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-certified-operators\" @ 08/11/25 16:34:28.614\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-certified-operators/api/v1/metas?schema=olm.package @ 08/11/25 16:34:29.016\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:29.148\n"
 },
 {
   "name": "[sig-olmv1] OLMv1 should pass a trivial sanity check",
   "lifecycle": "blocking",
   "duration": 0,
   "startTime": "2025-08-11 15:34:29.411474 UTC",
   "endTime": "2025-08-11 15:34:29.412376 UTC",
   "result": "passed",
   "output": ""
 },
 {
   "name": "[sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-redhat-marketplace Catalog should serve FBC via the /v1/api/metas endpoint",
   "lifecycle": "blocking",
   "duration": 1577,
   "startTime": "2025-08-11 15:34:28.485918 UTC",
   "endTime": "2025-08-11 15:34:30.062923 UTC",
   "result": "passed",
   "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-redhat-marketplace\" @ 08/11/25 16:34:29.539\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-marketplace/api/v1/metas?schema=olm.package @ 08/11/25 16:34:29.663\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:29.794\n"
 },
 {
   "name": "[sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-redhat-operators Catalog should serve FBC via the /v1/api/metas endpoint",
   "lifecycle": "blocking",
   "duration": 2225,
   "startTime": "2025-08-11 15:34:28.485931 UTC",
   "endTime": "2025-08-11 15:34:30.711823 UTC",
   "result": "passed",
   "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-redhat-operators\" @ 08/11/25 16:34:30.192\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-operators/api/v1/metas?schema=olm.package @ 08/11/25 16:34:30.319\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:30.447\n"
 },
 {
   "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-certified-operators Catalog should serve FBC via the /v1/api/all endpoint",
   "lifecycle": "blocking",
   "duration": 2875,
   "startTime": "2025-08-11 15:34:28.485935 UTC",
   "endTime": "2025-08-11 15:34:31.361019 UTC",
   "result": "passed",
   "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-certified-operators\" @ 08/11/25 16:34:30.84\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-certified-operators/api/v1/all @ 08/11/25 16:34:30.967\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:31.102\n"
 },
 {
   "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 Catalogs should be installed",
   "lifecycle": "blocking",
   "duration": 3521,
   "startTime": "2025-08-11 15:34:28.485949 UTC",
   "endTime": "2025-08-11 15:34:32.007947 UTC",
   "result": "passed",
   "output": "  STEP: checking that \"openshift-certified-operators\" exists @ 08/11/25 16:34:31.49\n  STEP: checking that \"openshift-certified-operators\" is serving @ 08/11/25 16:34:31.617\n  STEP: checking that \"openshift-community-operators\" exists @ 08/11/25 16:34:31.617\n  STEP: checking that \"openshift-community-operators\" is serving @ 08/11/25 16:34:31.743\n  STEP: checking that \"openshift-redhat-marketplace\" exists @ 08/11/25 16:34:31.743\n  STEP: checking that \"openshift-redhat-marketplace\" is serving @ 08/11/25 16:34:31.874\n  STEP: checking that \"openshift-redhat-operators\" exists @ 08/11/25 16:34:31.874\n  STEP: checking that \"openshift-redhat-operators\" is serving @ 08/11/25 16:34:32.007\n"
 },
 {
   "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-community-operators Catalog should serve FBC via the /v1/api/all endpoint",
   "lifecycle": "blocking",
   "duration": 4174,
   "startTime": "2025-08-11 15:34:28.485952 UTC",
   "endTime": "2025-08-11 15:34:32.660689 UTC",
   "result": "passed",
   "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-community-operators\" @ 08/11/25 16:34:32.137\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-community-operators/api/v1/all @ 08/11/25 16:34:32.267\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:32.395\n"
 },
 {
   "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-redhat-operators Catalog should serve FBC via the /v1/api/all endpoint",
   "lifecycle": "blocking",
   "duration": 4831,
   "startTime": "2025-08-11 15:34:28.485954 UTC",
   "endTime": "2025-08-11 15:34:33.317529 UTC",
   "result": "passed",
   "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-redhat-operators\" @ 08/11/25 16:34:32.788\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-operators/api/v1/all @ 08/11/25 16:34:32.915\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:33.045\n"
 },
 {
   "name": "[sig-olmv1][OCPFeatureGate:NewOLMCatalogdAPIV1Metas][Skipped:Disconnected] OLMv1 openshift-community-operators Catalog should serve FBC via the /v1/api/metas endpoint",
   "lifecycle": "blocking",
   "duration": 5485,
   "startTime": "2025-08-11 15:34:28.485974 UTC",
   "endTime": "2025-08-11 15:34:33.971454 UTC",
   "result": "passed",
   "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-community-operators\" @ 08/11/25 16:34:33.452\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-community-operators/api/v1/metas?schema=olm.package @ 08/11/25 16:34:33.579\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:33.707\n"
 },
 {
   "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 openshift-redhat-marketplace Catalog should serve FBC via the /v1/api/all endpoint",
   "lifecycle": "blocking",
   "duration": 6130,
   "startTime": "2025-08-11 15:34:28.485956 UTC",
   "endTime": "2025-08-11 15:34:34.616182 UTC",
   "result": "passed",
   "output": "  STEP: Retrieving base URL from ClusterCatalog \"openshift-redhat-marketplace\" @ 08/11/25 16:34:34.096\n  STEP: Creating curl Job to hit: https://catalogd-service.openshift-catalogd.svc/catalogs/openshift-redhat-marketplace/api/v1/all @ 08/11/25 16:34:34.218\n  STEP: Waiting for Job to succeed @ 08/11/25 16:34:34.351\n"
 },
 {
   "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 New Catalog Install should fail to install if it has an invalid reference",
   "lifecycle": "blocking",
   "duration": 8177,
   "startTime": "2025-08-11 15:34:28.485944 UTC",
   "endTime": "2025-08-11 15:34:36.663541 UTC",
   "result": "passed",
   "output": "  STEP: creating the malformed catalog with an invalid image ref @ 08/11/25 16:34:34.742\n  STEP: waiting for the catalog to report failure via Progressing=True and reason=Retrying @ 08/11/25 16:34:34.893\n  STEP: deleting lingering ClusterCatalog \"bad-catalog\" @ 08/11/25 16:34:36.407\n"
 },
 {
   "name": "[sig-olmv1][OCPFeatureGate:NewOLM] OLMv1 CRDs should be installed",
   "lifecycle": "blocking",
   "duration": 7645,
   "startTime": "2025-08-11 15:34:29.412381 UTC",
   "endTime": "2025-08-11 15:34:37.058191 UTC",
   "result": "passed",
   "output": "  STEP: verifying CRD clusterextensions.olm.operatorframework.io @ 08/11/25 16:34:36.793\n  STEP: verifying CRD clustercatalogs.olm.operatorframework.io @ 08/11/25 16:34:36.923\n"
 },
 {
   "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should install a cluster extension",
   "lifecycle": "blocking",
   "duration": 13390,
   "startTime": "2025-08-11 15:34:30.062930 UTC",
   "endTime": "2025-08-11 15:34:43.453235 UTC",
   "result": "passed",
   "output": "  STEP: creating namespace install-test-ns-zfvq @ 08/11/25 16:34:37.186\n  STEP: ensuring no ClusterExtension and CRD for quay-operator @ 08/11/25 16:34:37.315\n  STEP: applying the ClusterExtension resource @ 08/11/25 16:34:37.575\n  STEP: ensuring ServiceAccount is available before proceeding @ 08/11/25 16:34:37.704\n  STEP: ensuring ClusterRoleBinding is available before proceeding @ 08/11/25 16:34:37.964\n  STEP: waiting for the quay-operator ClusterExtension to be installed @ 08/11/25 16:34:38.231\n"
 },
 {
   "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should fail to install a non-existing cluster extension",
   "lifecycle": "blocking",
   "duration": 14675,
   "startTime": "2025-08-11 15:34:30.711829 UTC",
   "endTime": "2025-08-11 15:34:45.386985 UTC",
   "result": "passed",
   "output": "  STEP: creating namespace install-test-ns-h5xg @ 08/11/25 16:34:43.587\n  STEP: ensuring no ClusterExtension and CRD for non-existing operator @ 08/11/25 16:34:43.715\n  STEP: applying the ClusterExtension resource @ 08/11/25 16:34:43.841\n  STEP: ensuring ServiceAccount is available before proceeding @ 08/11/25 16:34:43.972\n  STEP: ensuring ClusterRoleBinding is available before proceeding @ 08/11/25 16:34:44.232\n  STEP: waiting for the ClusterExtension to exist @ 08/11/25 16:34:44.568\n  STEP: waiting up to 2 minutes for ClusterExtension to report failure @ 08/11/25 16:34:44.693\n"
 },
 {
   "name": "[sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 operator installation should block cluster upgrades if an incompatible operator is installed",
   "lifecycle": "blocking",
   "duration": 20538,
   "startTime": "2025-08-11 15:34:31.361028 UTC",
   "endTime": "2025-08-11 15:34:51.899231 UTC",
   "result": "passed",
   "output": "  STEP: creating namespace install-test-ns-mm9x @ 08/11/25 16:34:45.515\n  STEP: ensuring no ClusterExtension no ClusterExtension and CRD for cluster-logging @ 08/11/25 16:34:45.652\n  STEP: applying the ClusterExtension resource @ 08/11/25 16:34:45.908\n  STEP: ensuring ServiceAccount is available before proceeding @ 08/11/25 16:34:46.037\n  STEP: ensuring ClusterRoleBinding is available before proceeding @ 08/11/25 16:34:46.292\n  STEP: waiting for the cluster-logging ClusterExtension to be installed @ 08/11/25 16:34:46.552\n  STEP: ensuring the cluster is not upgradeable when olm.maxopenshiftversion is specified @ 08/11/25 16:34:51.2\n"
 }
]

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@camilamacedo86 camilamacedo86 force-pushed the add-catalog-tests-only-ote branch from 83b6bd5 to 468ad0f Compare August 11, 2025 15:37
@camilamacedo86 camilamacedo86 changed the title WIP OPRUN-4054: [OTE] add catalog tests from openshift/origin OPRUN-4054: [OTE] add catalog tests from openshift/origin Aug 11, 2025
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Aug 11, 2025
@camilamacedo86 camilamacedo86 force-pushed the add-catalog-tests-only-ote branch from 468ad0f to f8ef892 Compare August 11, 2025 18:50
@camilamacedo86
Copy link
Contributor Author

/test openshift-e2e-aws

1 similar comment
@camilamacedo86
Copy link
Contributor Author

/test openshift-e2e-aws

@camilamacedo86 camilamacedo86 force-pushed the add-catalog-tests-only-ote branch from f8ef892 to 08c1632 Compare August 13, 2025 17:21
@camilamacedo86
Copy link
Contributor Author

/retest-required

@camilamacedo86
Copy link
Contributor Author

/test openshift-e2e-aws

2 similar comments
@camilamacedo86
Copy link
Contributor Author

/test openshift-e2e-aws

@camilamacedo86
Copy link
Contributor Author

/test openshift-e2e-aws

@tmshort
Copy link
Contributor

tmshort commented Aug 14, 2025

/test openshift-e2e-aws-techpreview

@camilamacedo86
Copy link
Contributor Author

/test openshift-e2e-aws

/hold cancel

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Aug 15, 2025
@camilamacedo86
Copy link
Contributor Author

/test openshift-e2e-aws

@camilamacedo86
Copy link
Contributor Author

/test openshift-e2e-aws-techpreview

@camilamacedo86
Copy link
Contributor Author

/retest-required

@camilamacedo86
Copy link
Contributor Author

/payload-aggregate-with-prs periodic-ci-openshift-release-master-ci-4.20-e2e-gcp-ovn-techpreview-serial 5

@camilamacedo86
Copy link
Contributor Author

/test openshift-e2e-aws

Copy link
Contributor

openshift-ci bot commented Aug 15, 2025

@camilamacedo86: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/okd-scos-e2e-aws-ovn 08c1632 link false /test okd-scos-e2e-aws-ovn
ci/prow/openshift-e2e-aws 08c1632 link true /test openshift-e2e-aws
ci/prow/openshift-e2e-aws-techpreview 08c1632 link false /test openshift-e2e-aws-techpreview

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

This commit migrates the olmv1_catalog set of tests from openshift/origin
to OTE as part the broad effort to migrate all tests.

Assisted-by: Gemini
@camilamacedo86 camilamacedo86 force-pushed the add-catalog-tests-only-ote branch from 08c1632 to 5805448 Compare August 15, 2025 21:02
@camilamacedo86
Copy link
Contributor Author

/payload-aggregate periodic-ci-openshift-release-master-ci-4.20-e2e-gcp-ovn-techpreview-serial 10

Copy link
Contributor

openshift-ci bot commented Aug 15, 2025

@camilamacedo86: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.20-e2e-gcp-ovn-techpreview-serial

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/e13b7370-7a1f-11f0-8148-aed3af58e7cc-0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
jira/valid-reference Indicates that this PR references a valid Jira ticket of any type.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants