2026-06-12 00:01:09.664321 | Job console starting 2026-06-12 00:01:09.791506 | Updating git repos 2026-06-12 00:01:10.238033 | Cloning repos into workspace 2026-06-12 00:01:10.732736 | Restoring repo states 2026-06-12 00:01:10.746280 | Merging changes 2026-06-12 00:01:10.746298 | Checking out repos 2026-06-12 00:01:10.902765 | Preparing playbooks 2026-06-12 00:01:13.344892 | Running Ansible setup 2026-06-12 00:01:17.634403 | PRE-RUN START: [trusted : gitlab.com/softwarefactory-project/centosinfra-prod/sf-config/playbooks/base/pre.yaml@main] 2026-06-12 00:01:18.353588 | 2026-06-12 00:01:18.353787 | PLAY [localhost] 2026-06-12 00:01:18.363253 | 2026-06-12 00:01:18.363400 | TASK [Gathering Facts] 2026-06-12 00:01:19.342137 | localhost | ok 2026-06-12 00:01:19.361368 | 2026-06-12 00:01:19.361565 | TASK [Setup log path fact] 2026-06-12 00:01:19.392779 | localhost | ok 2026-06-12 00:01:19.416979 | 2026-06-12 00:01:19.417176 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-06-12 00:01:19.446214 | localhost | ok 2026-06-12 00:01:19.454516 | 2026-06-12 00:01:19.454668 | TASK [emit-job-header : Print job information] 2026-06-12 00:01:19.494921 | # Job Information 2026-06-12 00:01:19.495130 | Ansible Version: 2.16.18 2026-06-12 00:01:19.495175 | Job: sf-operator-minikube-integration 2026-06-12 00:01:19.495204 | Pipeline: periodic 2026-06-12 00:01:19.495230 | Executor: 38.102.83.47 2026-06-12 00:01:19.495254 | Triggered by: https://softwarefactory-project.io/r/plugins/gitiles/software-factory/sf-operator/+/None^!/ 2026-06-12 00:01:19.495283 | Log URL (when completed): https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/logs/d04/sf/d0412b82f8ae4a96a604fa1c8ccd9fad/ 2026-06-12 00:01:19.495311 | Event ID: 237638922f154f4f9cd60bf2d54a6de8 2026-06-12 00:01:19.499282 | 2026-06-12 00:01:19.499391 | LOOP [emit-job-header : Print node information] 2026-06-12 00:01:19.606497 | localhost | ok: 2026-06-12 00:01:19.606652 | localhost | # Node Information 2026-06-12 00:01:19.606680 | localhost | Inventory Hostname: controller 2026-06-12 00:01:19.606700 | localhost | Hostname: np0000071326 2026-06-12 00:01:19.606718 | localhost | Username: zuul-worker 2026-06-12 00:01:19.606737 | localhost | Distro: CentOS 9 2026-06-12 00:01:19.606755 | localhost | Provider: vexxhost-nodepool-sf 2026-06-12 00:01:19.606772 | localhost | Region: RegionOne 2026-06-12 00:01:19.606788 | localhost | Label: cloud-centos-9-big 2026-06-12 00:01:19.606804 | localhost | Product Name: OpenStack Nova 2026-06-12 00:01:19.606821 | localhost | Interface IP: 38.102.83.97 2026-06-12 00:01:19.623532 | 2026-06-12 00:01:19.623689 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-06-12 00:01:20.066820 | localhost -> localhost | changed 2026-06-12 00:01:20.072216 | 2026-06-12 00:01:20.072314 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-06-12 00:01:21.131724 | localhost -> localhost | changed 2026-06-12 00:01:21.138268 | 2026-06-12 00:01:21.138323 | PLAY [all] 2026-06-12 00:01:21.144531 | 2026-06-12 00:01:21.144598 | TASK [include_role : start-zuul-console] 2026-06-12 00:01:21.178217 | controller | ok 2026-06-12 00:01:21.202905 | 2026-06-12 00:01:21.203070 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-06-12 00:01:21.629682 | controller | ok 2026-06-12 00:01:21.644557 | 2026-06-12 00:01:21.644687 | TASK [include_role : validate-host] 2026-06-12 00:01:21.677896 | controller | ok 2026-06-12 00:01:21.710260 | 2026-06-12 00:01:21.710392 | TASK [validate-host : Define zuul_info_dir fact] 2026-06-12 00:01:21.754833 | controller | ok 2026-06-12 00:01:21.762633 | 2026-06-12 00:01:21.762787 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-06-12 00:01:22.053373 | controller -> localhost | ok 2026-06-12 00:01:22.059541 | 2026-06-12 00:01:22.059627 | TASK [validate-host : Collect information about the host] 2026-06-12 00:01:22.829025 | controller | ok 2026-06-12 00:01:22.866485 | 2026-06-12 00:01:22.866603 | TASK [validate-host : Sanitize hostname] 2026-06-12 00:01:22.904103 | controller | ok 2026-06-12 00:01:22.907637 | 2026-06-12 00:01:22.907743 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-06-12 00:01:23.407094 | controller -> localhost | changed 2026-06-12 00:01:23.411543 | 2026-06-12 00:01:23.411606 | TASK [validate-host : Collect information about zuul worker] 2026-06-12 00:01:23.877674 | controller | ok 2026-06-12 00:01:23.880980 | 2026-06-12 00:01:23.881051 | TASK [validate-host : Write out all zuul information for each host] 2026-06-12 00:01:24.442386 | controller -> localhost | changed 2026-06-12 00:01:24.449632 | 2026-06-12 00:01:24.449709 | TASK [include_role : prepare-workspace] 2026-06-12 00:01:24.477071 | controller | ok 2026-06-12 00:01:24.499094 | 2026-06-12 00:01:24.499285 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-06-12 00:01:24.795275 | controller | ok 2026-06-12 00:01:24.804235 | 2026-06-12 00:01:24.804370 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-06-12 00:01:26.452366 | controller | Output suppressed because no_log was given 2026-06-12 00:01:26.467928 | 2026-06-12 00:01:26.468119 | TASK [include_role : add-build-sshkey] 2026-06-12 00:01:26.499906 | controller | ok 2026-06-12 00:01:26.523706 | 2026-06-12 00:01:26.523844 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-06-12 00:01:26.771467 | controller -> localhost | ok 2026-06-12 00:01:26.775495 | 2026-06-12 00:01:26.775563 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-06-12 00:01:26.802929 | controller | ok 2026-06-12 00:01:26.814953 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-06-12 00:01:26.819127 | 2026-06-12 00:01:26.819187 | TASK [add-build-sshkey : Create Temp SSH key] 2026-06-12 00:01:27.790156 | controller -> localhost | Generating public/private rsa key pair. 2026-06-12 00:01:27.790351 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/work/d0412b82f8ae4a96a604fa1c8ccd9fad_id_rsa 2026-06-12 00:01:27.790393 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/work/d0412b82f8ae4a96a604fa1c8ccd9fad_id_rsa.pub 2026-06-12 00:01:27.790443 | controller -> localhost | The key fingerprint is: 2026-06-12 00:01:27.790484 | controller -> localhost | SHA256:HUBUH8rhIP09nPhwALf/nksfaMgM6Q4KOCxBFwa9DEs zuul-build-sshkey 2026-06-12 00:01:27.790515 | controller -> localhost | The key's randomart image is: 2026-06-12 00:01:27.790545 | controller -> localhost | +---[RSA 3072]----+ 2026-06-12 00:01:27.790574 | controller -> localhost | | .oo .+*o+ . | 2026-06-12 00:01:27.790604 | controller -> localhost | | E... ..*.= . | 2026-06-12 00:01:27.790630 | controller -> localhost | |..+.. .*=.. | 2026-06-12 00:01:27.790655 | controller -> localhost | |...o .=o* | 2026-06-12 00:01:27.790680 | controller -> localhost | |. So.+.. | 2026-06-12 00:01:27.790706 | controller -> localhost | |... . + o.. | 2026-06-12 00:01:27.790732 | controller -> localhost | |.+ . . . + oo. | 2026-06-12 00:01:27.790761 | controller -> localhost | |. . . . o .o o.| 2026-06-12 00:01:27.790789 | controller -> localhost | | . . +..| 2026-06-12 00:01:27.790815 | controller -> localhost | +----[SHA256]-----+ 2026-06-12 00:01:27.790869 | controller -> localhost | ok: Runtime: 0:00:00.512278 2026-06-12 00:01:27.795647 | 2026-06-12 00:01:27.795723 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-06-12 00:01:27.827363 | controller | ok 2026-06-12 00:01:27.835825 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-06-12 00:01:27.842316 | 2026-06-12 00:01:27.842413 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-06-12 00:01:27.866131 | controller | skipping: Conditional result was False 2026-06-12 00:01:27.870159 | 2026-06-12 00:01:27.870220 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-06-12 00:01:28.384518 | controller | changed 2026-06-12 00:01:28.390930 | 2026-06-12 00:01:28.391078 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-06-12 00:01:28.639325 | controller | ok 2026-06-12 00:01:28.646776 | 2026-06-12 00:01:28.646930 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-06-12 00:01:29.481194 | controller | changed 2026-06-12 00:01:29.485652 | 2026-06-12 00:01:29.485732 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-06-12 00:01:30.353388 | controller | changed 2026-06-12 00:01:30.356835 | 2026-06-12 00:01:30.356896 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-06-12 00:01:30.382135 | controller | skipping: Conditional result was False 2026-06-12 00:01:30.391329 | 2026-06-12 00:01:30.391568 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-06-12 00:01:30.752359 | controller -> localhost | changed 2026-06-12 00:01:30.760772 | 2026-06-12 00:01:30.760895 | TASK [add-build-sshkey : Add back temp key] 2026-06-12 00:01:31.072195 | controller -> localhost | Identity added: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/work/d0412b82f8ae4a96a604fa1c8ccd9fad_id_rsa (zuul-build-sshkey) 2026-06-12 00:01:31.072397 | controller -> localhost | ok: Runtime: 0:00:00.017345 2026-06-12 00:01:31.076086 | 2026-06-12 00:01:31.076145 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-06-12 00:01:31.411683 | controller | ok 2026-06-12 00:01:31.417533 | 2026-06-12 00:01:31.417645 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-06-12 00:01:31.461952 | controller | skipping: Conditional result was False 2026-06-12 00:01:31.468399 | 2026-06-12 00:01:31.468491 | TASK [include_role : prepare-workspace-openshift] 2026-06-12 00:01:31.483191 | controller | skipping: Conditional result was False 2026-06-12 00:01:31.487456 | 2026-06-12 00:01:31.487520 | TASK [include_role : remove-zuul-sshkey] 2026-06-12 00:01:31.501778 | controller | skipping: Conditional result was False 2026-06-12 00:01:31.506353 | 2026-06-12 00:01:31.506414 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-06-12 00:01:31.772638 | controller | ok: "logs" 2026-06-12 00:01:31.773028 | controller | ok: All items complete 2026-06-12 00:01:31.773087 | 2026-06-12 00:01:31.991607 | controller | ok: "artifacts" 2026-06-12 00:01:32.206717 | controller | ok: "docs" 2026-06-12 00:01:32.218340 | 2026-06-12 00:01:32.218520 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-06-12 00:01:32.527445 | controller | changed: "logs" 2026-06-12 00:01:32.756303 | controller | changed: "artifacts" 2026-06-12 00:01:32.981555 | controller | changed: "docs" 2026-06-12 00:01:32.997448 | 2026-06-12 00:01:32.997584 | LOOP [Tune dnf options] 2026-06-12 00:01:33.445678 | controller | changed: option added 2026-06-12 00:01:33.445990 | controller | changed: All items complete 2026-06-12 00:01:33.446029 | 2026-06-12 00:01:33.705869 | controller | changed: option added 2026-06-12 00:01:33.955004 | controller | changed: option added 2026-06-12 00:01:33.966269 | 2026-06-12 00:01:33.966372 | PLAY RECAP 2026-06-12 00:01:33.966416 | controller | ok: 24 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-06-12 00:01:33.966464 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-06-12 00:01:33.966484 | 2026-06-12 00:01:34.122062 | PRE-RUN END RESULT_NORMAL: [trusted : gitlab.com/softwarefactory-project/centosinfra-prod/sf-config/playbooks/base/pre.yaml@main] 2026-06-12 00:01:34.123231 | PRE-RUN START: [trusted : gitlab.com/softwarefactory-project/centosinfra-prod/sf-config/playbooks/rhel_subscription/register.yaml@main] 2026-06-12 00:01:34.736547 | 2026-06-12 00:01:34.736816 | PLAY [all] 2026-06-12 00:01:34.746661 | 2026-06-12 00:01:34.746838 | TASK [Register system] 2026-06-12 00:01:34.818490 | 2026-06-12 00:01:34.818695 | TASK [Get minor release for EUS activation] 2026-06-12 00:01:34.863951 | controller | skipping: Conditional result was False 2026-06-12 00:01:34.873184 | 2026-06-12 00:01:34.873375 | LOOP [Manage Extended Update Support repos] 2026-06-12 00:01:34.916531 | controller | skipping: Conditional result was False 2026-06-12 00:01:34.919837 | controller | skipping: Conditional result was False 2026-06-12 00:01:34.940090 | 2026-06-12 00:01:34.940288 | TASK [Upgrade all packages] 2026-06-12 00:01:34.988822 | controller | skipping: Conditional result was False 2026-06-12 00:01:34.995852 | 2026-06-12 00:01:34.995952 | TASK [Reboot to use new kernel] 2026-06-12 00:01:35.040833 | controller | skipping: Conditional result was False 2026-06-12 00:01:35.042582 | 2026-06-12 00:01:35.042642 | PLAY RECAP 2026-06-12 00:01:35.042708 | controller | ok: 0 changed: 0 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-06-12 00:01:35.042735 | 2026-06-12 00:01:35.375720 | PRE-RUN END RESULT_NORMAL: [trusted : gitlab.com/softwarefactory-project/centosinfra-prod/sf-config/playbooks/rhel_subscription/register.yaml@main] 2026-06-12 00:01:35.378411 | PRE-RUN START: [untrusted : softwarefactory-project.io/software-factory/sf-operator/playbooks/install-minikube.yaml@master] 2026-06-12 00:01:36.064342 | 2026-06-12 00:01:36.064652 | PLAY [controller] 2026-06-12 00:01:36.075659 | 2026-06-12 00:01:36.075808 | TASK [Create ramdisk folder] 2026-06-12 00:01:36.564713 | controller | changed 2026-06-12 00:01:36.570468 | 2026-06-12 00:01:36.570569 | TASK [Installing packages] 2026-06-12 00:02:52.828301 | controller | changed 2026-06-12 00:02:52.835565 | 2026-06-12 00:02:52.835778 | TASK [Set pids_limit in containers.conf] 2026-06-12 00:02:53.929916 | controller | changed 2026-06-12 00:02:53.943609 | 2026-06-12 00:02:53.943748 | TASK [Installing Minikube] 2026-06-12 00:02:56.541608 | controller | changed: OK (132766301 bytes) 2026-06-12 00:02:56.555653 | 2026-06-12 00:02:56.555864 | TASK [Start minikube] 2026-06-11 20:02:57.323557 | controller | * minikube v1.36.0 on Centos 9 (kvm/amd64) 2026-06-11 20:02:57.622444 | controller | Using Kubernetes 1.32.5 since patch version was unspecified 2026-06-11 20:02:57.982203 | controller | * minikube 1.38.1 is available! Download it: https://github.com/kubernetes/minikube/releases/tag/v1.38.1 2026-06-11 20:02:58.008926 | controller | * To disable this notice, run: 'minikube config set WantUpdateNotification false' 2026-06-11 20:02:58.009009 | controller | 2026-06-11 20:02:58.155001 | controller | * Using the podman driver based on user configuration 2026-06-11 20:02:58.802502 | controller | * Using Podman driver with root privileges 2026-06-11 20:02:58.806232 | controller | * Starting "minikube" primary control-plane node in "minikube" cluster 2026-06-11 20:02:58.811565 | controller | * Pulling base image v0.0.47 ... 2026-06-11 20:02:58.870886 | controller | * Downloading Kubernetes v1.32.5 preload ... 2026-06-11 20:03:08.374933 | controller | > gcr.io/k8s-minikube/kicbase...: 0 B [_______________________] ?% ? p/s ? > gcr.io/k8s-minikube/kicbase...: 1.61 KiB / 502.26 MiB [>_] 0.00% ? p/s ? > gcr.io/k8s-minikube/kicbase...: 1.61 KiB / 502.26 MiB [>_] 0.00% ? p/s ? > gcr.io/k8s-minikube/kicbase...: 257.74 KiB / 502.26 MiB 0.05% 429.74 Ki > gcr.io/k8s-minikube/kicbase...: 10.99 MiB / 502.26 MiB 2.19% 429.74 KiB > gcr.io/k8s-minikube/kicbase...: 24.00 MiB / 502.26 MiB 4.78% 429.74 KiB > gcr.io/k8s-minikube/kicbase...: 42.99 MiB / 502.26 MiB 8.56% 4.97 MiB p > gcr.io/k8s-minikube/kicbase...: 59.67 MiB / 502.26 MiB 11.88% 4.97 MiB > gcr.io/k8s-minikube/kicbase...: 75.99 MiB / 502.26 MiB 15.13% 4.97 MiB > gcr.io/k8s-minikube/kicbase...: 89.40 MiB / 502.26 MiB 17.80% 9.66 MiB > gcr.io/k8s-minikube/kicbase...: 102.38 MiB / 502.26 MiB 20.38% 9.66 MiB > gcr.io/k8s-minikube/kicbase...: 120.13 MiB / 502.26 MiB 23.92% 9.66 MiB > gcr.io/k8s-minikube/kicbase...: 139.31 MiB / 502.26 MiB 27.74% 14.40 Mi > gcr.io/k8s-minikube/kicbase...: 155.55 MiB / 502.26 MiB 30.97% 14.40 Mi > gcr.io/k8s-minikube/kicbase...: 173.74 MiB / 502.26 MiB 34.59% 14.40 Mi > gcr.io/k8s-minikube/kicbase...: 176.00 MiB / 502.26 MiB 35.04% 17.42 Mi > gcr.io/k8s-minikube/kicbase...: 183.62 MiB / 502.26 MiB 36.56% 17.42 Mi > gcr.io/k8s-minikube/kicbase...: 192.00 MiB / 502.26 MiB 38.23% 17.42 Mi > gcr.io/k8s-minikube/kicbase...: 204.64 MiB / 502.26 MiB 40.74% 19.37 Mi > gcr.io/k8s-minikube/kicbase...: 220.71 MiB / 502.26 MiB 43.94% 19.37 Mi > gcr.io/k8s-minikube/kicbase...: 234.36 MiB / 502.26 MiB 46.66% 19.37 Mi > gcr.io/k8s-minikube/kicbase...: 251.29 MiB / 502.26 MiB 50.03% 23.14 Mi > gcr.io/k8s-minikube/kicbase...: 269.29 MiB / 502.26 MiB 53.62% 23.14 Mi > gcr.io/k8s-minikube/kicbase...: 280.00 MiB / 502.26 MiB 55.75% 23.14 Mi > gcr.io/k8s-minikube/kicbase...: 284.67 MiB / 502.26 MiB 56.68% 25.24 Mi > gcr.io/k8s-minikube/kicbase...: 300.21 MiB / 502.26 MiB 59.77% 25.24 Mi > gcr.io/k8s-minikube/kicbase...: 310.63 MiB / 502.26 MiB 61.85% 25.24 Mi > gcr.io/k8s-minikube/kicbase...: 318.19 MiB / 502.26 MiB 63.35% 27.21 Mi > gcr.io/k8s-minikube/kicbase...: 331.08 MiB / 502.26 MiB 65.92% 27.21 Mi > gcr.io/k8s-minikube/kicbase...: 347.10 MiB / 502.26 MiB 69.11% 27.21 Mi > gcr.io/k8s-minikube/kicbase...: 363.85 MiB / 502.26 MiB 72.44% 30.37 Mi > gcr.io/k8s-minikube/kicbase...: 377.42 MiB / 502.26 MiB 75.14% 30.37 Mi > gcr.io/k8s-minikube/kicbase...: 391.75 MiB / 502.26 MiB 78.00% 30.37 Mi > gcr.io/k8s-minikube/kicbase...: 398.50 MiB / 502.26 MiB 79.34% 32.13 Mi > gcr.io/k8s-minikube/kicbase...: 404.00 MiB / 502.26 MiB 80.44% 32.13 Mi > gcr.io/k8s-minikube/kicbase...: 411.54 MiB / 502.26 MiB 81.94% 32.13 Mi > gcr.io/k8s-minikube/kicbase...: 416.00 MiB / 502.26 MiB 82.83% 31.94 Mi > gcr.io/k8s-minikube/kicbase...: 424.51 MiB / 502.26 MiB 84.52% 31.94 Mi > gcr.io/k8s-minikube/kicbase...: 433.60 MiB / 502.26 MiB 86.33% 31.94 Mi > gcr.io/k8s-minikube/kicbase...: 449.69 MiB / 502.26 MiB 89.53% 33.50 Mi > gcr.io/k8s-minikube/kicbase...: 461.24 MiB / 502.26 MiB 91.83% 33.50 Mi > gcr.io/k8s-minikube/kicbase...: 473.15 MiB / 502.26 MiB 94.20% 33.50 Mi > gcr.io/k8s-minikube/kicbase...: 489.59 MiB / 502.26 MiB 97.48% 35.63 Mi > gcr.io/k8s-minikube/kicbase...: 499.77 MiB / 502.26 MiB 99.50% 35.63 Mi > gcr.io/k8s-minikube/kicbase...: 502.25 MiB / 502.26 MiB 100.00% 58.05 ME0611 20:03:08.374832 11492 cache.go:225] Error downloading kic artifacts: not yet implemented, see issue #8426 2026-06-11 20:03:08.381678 | controller | * Creating podman container (CPUs=no-limit, Memory=no-limit) ... 2026-06-11 20:03:45.296909 | controller | * Preparing Kubernetes v1.32.5 on CRI-O 1.24.6 ... 2026-06-11 20:03:45.492645 | controller | - kubelet.housekeeping-interval=5m 2026-06-11 20:03:56.812785 | controller | - Generating certificates and keys ... 2026-06-11 20:03:56.820861 | controller | - Booting up control plane ... 2026-06-11 20:03:56.826116 | controller | - Configuring RBAC rules ... 2026-06-11 20:03:56.833099 | controller | * Configuring CNI (Container Networking Interface) ... 2026-06-11 20:03:57.369090 | controller | * Verifying Kubernetes components... 2026-06-11 20:03:57.449528 | controller | - Using image gcr.io/k8s-minikube/storage-provisioner:v5 2026-06-11 20:03:57.462047 | controller | - Using image registry.k8s.io/ingress-nginx/controller:v1.12.2 2026-06-11 20:03:57.464411 | controller | - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.5.3 2026-06-11 20:03:57.466642 | controller | - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.5.3 2026-06-11 20:03:57.480755 | controller | - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3 2026-06-11 20:03:58.737419 | controller | * Verifying ingress addon... 2026-06-11 20:04:26.751453 | controller | * Enabled addons: storage-provisioner, ingress-dns, default-storageclass, ingress 2026-06-11 20:04:26.761527 | controller | * kubectl not found. If you need it, try: 'minikube kubectl -- get pods -A' 2026-06-11 20:04:26.763201 | controller | * Done! kubectl is now configured to use "minikube" cluster and "default" namespace by default 2026-06-12 00:04:27.211569 | controller | ok: Runtime: 0:01:29.797500 2026-06-12 00:04:27.215706 | 2026-06-12 00:04:27.215797 | TASK [Get minikube deployment ip] 2026-06-11 20:04:27.834778 | controller | 192.168.49.2 2026-06-12 00:04:28.241218 | controller | ok: Runtime: 0:00:00.365099 2026-06-12 00:04:28.245952 | 2026-06-12 00:04:28.246052 | TASK [Get default interface] 2026-06-11 20:04:28.475110 | controller | eth0 2026-06-12 00:04:28.770335 | controller | ok: Runtime: 0:00:00.006600 2026-06-12 00:04:28.774017 | 2026-06-12 00:04:28.774080 | TASK [Test minikube] 2026-06-11 20:04:29.876730 | controller | NAMESPACE NAME READY STATUS RESTARTS AGE 2026-06-11 20:04:29.876855 | controller | ingress-nginx ingress-nginx-admission-create-rdqwd 0/1 Completed 0 29s 2026-06-11 20:04:29.876898 | controller | ingress-nginx ingress-nginx-admission-patch-9b2v2 0/1 CrashLoopBackOff 1 (10s ago) 29s 2026-06-11 20:04:29.876923 | controller | ingress-nginx ingress-nginx-controller-86649c845b-s9hqf 0/1 Running 0 28s 2026-06-11 20:04:29.876939 | controller | kube-system coredns-668d6bf9bc-5j4w8 1/1 Running 0 28s 2026-06-11 20:04:29.876950 | controller | kube-system etcd-minikube 1/1 Running 0 34s 2026-06-11 20:04:29.876961 | controller | kube-system kindnet-8ghkz 1/1 Running 0 29s 2026-06-11 20:04:29.876970 | controller | kube-system kube-apiserver-minikube 1/1 Running 0 33s 2026-06-11 20:04:29.876980 | controller | kube-system kube-controller-manager-minikube 1/1 Running 0 33s 2026-06-11 20:04:29.876991 | controller | kube-system kube-ingress-dns-minikube 0/1 ErrImagePull 0 32s 2026-06-11 20:04:29.877011 | controller | kube-system kube-proxy-z4h4c 1/1 Running 0 29s 2026-06-11 20:04:29.877021 | controller | kube-system kube-scheduler-minikube 1/1 Running 0 33s 2026-06-11 20:04:29.877030 | controller | kube-system storage-provisioner 1/1 Running 0 32s 2026-06-12 00:04:30.302049 | controller | ok: Runtime: 0:00:00.843324 2026-06-12 00:04:30.303688 | 2026-06-12 00:04:30.303737 | PLAY RECAP 2026-06-12 00:04:30.303778 | controller | ok: 8 changed: 8 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-06-12 00:04:30.303797 | 2026-06-12 00:04:30.529319 | PRE-RUN END RESULT_NORMAL: [untrusted : softwarefactory-project.io/software-factory/sf-operator/playbooks/install-minikube.yaml@master] 2026-06-12 00:04:30.530490 | PRE-RUN START: [untrusted : softwarefactory-project.io/software-factory/sf-operator/playbooks/prepare-minikube.yaml@master] 2026-06-12 00:04:31.187407 | 2026-06-12 00:04:31.187587 | PLAY [controller] 2026-06-12 00:04:31.199844 | 2026-06-12 00:04:31.200015 | TASK [Crete sf namespace] 2026-06-11 20:04:31.775675 | controller | namespace/sf created 2026-06-12 00:04:32.228019 | controller | ok: Runtime: 0:00:00.156024 2026-06-12 00:04:32.233392 | 2026-06-12 00:04:32.233534 | TASK [Set sf as the default namespace] 2026-06-11 20:04:32.803514 | controller | Context "minikube" modified. 2026-06-12 00:04:33.267415 | controller | ok: Runtime: 0:00:00.344035 2026-06-12 00:04:33.268865 | 2026-06-12 00:04:33.268915 | PLAY RECAP 2026-06-12 00:04:33.268962 | controller | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-06-12 00:04:33.268995 | 2026-06-12 00:04:33.433840 | PRE-RUN END RESULT_NORMAL: [untrusted : softwarefactory-project.io/software-factory/sf-operator/playbooks/prepare-minikube.yaml@master] 2026-06-12 00:04:33.435200 | PRE-RUN START: [untrusted : softwarefactory-project.io/software-factory/sf-operator/playbooks/install-test-dependencies.yaml@master] 2026-06-12 00:04:34.183133 | 2026-06-12 00:04:34.183276 | PLAY [controller] 2026-06-12 00:04:34.194376 | 2026-06-12 00:04:34.194493 | TASK [install-golang : Check Go version] 2026-06-12 00:04:34.722937 | controller | ok: ERROR (ignored) 2026-06-12 00:04:34.723205 | controller | { 2026-06-12 00:04:34.723253 | controller | "failed_when_result": false, 2026-06-12 00:04:34.723287 | controller | "msg": "[Errno 2] No such file or directory: b'go'", 2026-06-12 00:04:34.723342 | controller | "rc": 2 2026-06-12 00:04:34.723366 | controller | } 2026-06-12 00:04:34.729844 | 2026-06-12 00:04:34.729936 | TASK [install-golang : Ensure a clean install] 2026-06-12 00:04:35.207491 | controller | ok 2026-06-12 00:04:35.212139 | 2026-06-12 00:04:35.212235 | TASK [install-golang : Extract Go archive] 2026-06-12 00:04:46.841500 | controller | changed 2026-06-12 00:04:46.846781 | 2026-06-12 00:04:46.846945 | LOOP [install-golang : Create symlinks for Go binary] 2026-06-12 00:04:47.131730 | controller | changed: "go" 2026-06-12 00:04:47.351324 | controller | changed: "gofmt" 2026-06-12 00:04:47.368003 | 2026-06-12 00:04:47.368162 | TASK [Installing packages] 2026-06-12 00:04:48.865714 | controller | ok: Nothing to do 2026-06-12 00:04:48.871166 | 2026-06-12 00:04:48.871269 | TASK [Install pip packages] 2026-06-12 00:04:52.836973 | controller | changed 2026-06-12 00:04:52.839195 | 2026-06-12 00:04:52.839260 | PLAY RECAP 2026-06-12 00:04:52.839321 | controller | ok: 6 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-06-12 00:04:52.839351 | 2026-06-12 00:04:53.006895 | PRE-RUN END RESULT_NORMAL: [untrusted : softwarefactory-project.io/software-factory/sf-operator/playbooks/install-test-dependencies.yaml@master] 2026-06-12 00:04:53.008592 | RUN START: [untrusted : softwarefactory-project.io/software-factory/sf-operator/playbooks/run-deploy.yaml@master] 2026-06-12 00:04:53.802991 | 2026-06-12 00:04:53.803213 | PLAY [controller] 2026-06-12 00:04:53.819419 | 2026-06-12 00:04:53.819677 | TASK [Run ./hack/deploy.sh] 2026-06-11 20:04:54.325436 | controller | [+] Installing kubectl 2026-06-11 20:04:54.403351 | controller | % Total % Received % Xferd Average Speed Time Time Time Current 2026-06-11 20:04:54.403464 | controller | Dload Upload Total Spent Left Speed 2026-06-11 20:04:55.116213 | controller | 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 56.7M 100 56.7M 0 0 79.6M 0 --:--:-- --:--:-- --:--:-- 79.6M 2026-06-11 20:04:55.233251 | controller | go: downloading go1.25.11 (linux/amd64) 2026-06-11 20:05:00.826049 | controller | Error from server (NotFound): pods "gerrit-0" not found 2026-06-11 20:05:00.828415 | controller | [+] Setting up gerrit 2026-06-11 20:05:00.865120 | controller | go: downloading k8s.io/client-go v0.30.2 2026-06-11 20:05:00.866486 | controller | go: downloading github.com/spf13/cobra v1.8.1 2026-06-11 20:05:00.892006 | controller | go: downloading sigs.k8s.io/controller-runtime v0.18.4 2026-06-11 20:05:00.901203 | controller | go: downloading k8s.io/api v0.30.2 2026-06-11 20:05:00.908434 | controller | go: downloading sigs.k8s.io/yaml v1.4.0 2026-06-11 20:05:01.079242 | controller | go: downloading github.com/openshift/api v0.0.0-20240715171821-e9f09d21bcb5 2026-06-11 20:05:01.082995 | controller | go: downloading gopkg.in/yaml.v3 v3.0.1 2026-06-11 20:05:01.356355 | controller | go: downloading go.uber.org/zap v1.27.0 2026-06-11 20:05:02.062978 | controller | go: downloading k8s.io/apimachinery v0.30.2 2026-06-11 20:05:02.063380 | controller | go: downloading k8s.io/utils v0.0.0-20240711033017-18e509b52bc8 2026-06-11 20:05:02.161749 | controller | go: downloading github.com/fatih/color v1.17.0 2026-06-11 20:05:02.200228 | controller | go: downloading github.com/go-sql-driver/mysql v1.8.1 2026-06-11 20:05:02.266423 | controller | go: downloading gopkg.in/ini.v1 v1.67.0 2026-06-11 20:05:02.347365 | controller | go: downloading k8s.io/kubectl v0.30.2 2026-06-11 20:05:02.635557 | controller | go: downloading github.com/google/uuid v1.6.0 2026-06-11 20:05:02.635644 | controller | go: downloading golang.org/x/crypto v0.52.0 2026-06-11 20:05:02.639271 | controller | go: downloading github.com/spf13/pflag v1.0.5 2026-06-11 20:05:02.639792 | controller | go: downloading golang.org/x/exp v0.0.0-20240716175740-e3f259677ff7 2026-06-11 20:05:02.640017 | controller | go: downloading gopkg.in/yaml.v2 v2.4.0 2026-06-11 20:05:02.652309 | controller | go: downloading k8s.io/apiextensions-apiserver v0.30.2 2026-06-11 20:05:02.683656 | controller | go: downloading go.uber.org/multierr v1.11.0 2026-06-11 20:05:02.693737 | controller | go: downloading github.com/gogo/protobuf v1.3.2 2026-06-11 20:05:02.734154 | controller | go: downloading github.com/go-logr/logr v1.4.2 2026-06-11 20:05:02.801536 | controller | go: downloading github.com/go-logr/zapr v1.3.0 2026-06-11 20:05:02.844462 | controller | go: downloading github.com/mattn/go-colorable v0.1.13 2026-06-11 20:05:02.886568 | controller | go: downloading github.com/mattn/go-isatty v0.0.20 2026-06-11 20:05:02.899349 | controller | go: downloading filippo.io/edwards25519 v1.1.1 2026-06-11 20:05:02.928652 | controller | go: downloading github.com/imdario/mergo v0.3.16 2026-06-11 20:05:02.946422 | controller | go: downloading golang.org/x/term v0.43.0 2026-06-11 20:05:02.975674 | controller | go: downloading k8s.io/klog/v2 v2.130.1 2026-06-11 20:05:02.988542 | controller | go: downloading golang.org/x/net v0.55.0 2026-06-11 20:05:03.050054 | controller | go: downloading github.com/gorilla/websocket v1.5.1 2026-06-11 20:05:03.142780 | controller | go: downloading github.com/google/gofuzz v1.2.0 2026-06-11 20:05:03.145071 | controller | go: downloading github.com/evanphx/json-patch/v5 v5.9.0 2026-06-11 20:05:03.185492 | controller | go: downloading gopkg.in/inf.v0 v0.9.1 2026-06-11 20:05:03.233101 | controller | go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.4.1 2026-06-11 20:05:03.313287 | controller | go: downloading golang.org/x/sys v0.45.0 2026-06-11 20:05:03.316418 | controller | go: downloading github.com/golang/protobuf v1.5.4 2026-06-11 20:05:03.316983 | controller | go: downloading github.com/google/gnostic-models v0.6.8 2026-06-11 20:05:03.339673 | controller | go: downloading golang.org/x/oauth2 v0.27.0 2026-06-11 20:05:03.388897 | controller | go: downloading golang.org/x/time v0.5.0 2026-06-11 20:05:03.393292 | controller | go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd 2026-06-11 20:05:03.399990 | controller | go: downloading k8s.io/kube-openapi v0.0.0-20240430033511-f0e62f92d13f 2026-06-11 20:05:03.426771 | controller | go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 2026-06-11 20:05:03.428235 | controller | go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da 2026-06-11 20:05:03.443559 | controller | go: downloading github.com/evanphx/json-patch v5.9.0+incompatible 2026-06-11 20:05:03.452137 | controller | go: downloading github.com/prometheus/client_golang v1.18.0 2026-06-11 20:05:03.475048 | controller | go: downloading github.com/json-iterator/go v1.1.12 2026-06-11 20:05:03.551780 | controller | go: downloading google.golang.org/protobuf v1.34.1 2026-06-11 20:05:03.682875 | controller | go: downloading github.com/davecgh/go-spew v1.1.2-0.20180830191138-d8f796af33cc 2026-06-11 20:05:03.934773 | controller | go: downloading github.com/moby/spdystream v0.5.1 2026-06-11 20:05:03.934976 | controller | go: downloading golang.org/x/text v0.37.0 2026-06-11 20:05:03.993683 | controller | go: downloading github.com/google/go-cmp v0.6.0 2026-06-11 20:05:04.062004 | controller | go: downloading github.com/fsnotify/fsnotify v1.7.0 2026-06-11 20:05:04.146330 | controller | go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd 2026-06-11 20:05:04.146510 | controller | go: downloading github.com/modern-go/reflect2 v1.0.2 2026-06-11 20:05:04.146945 | controller | go: downloading github.com/prometheus/common v0.47.0 2026-06-11 20:05:04.146969 | controller | go: downloading github.com/prometheus/client_model v0.6.1 2026-06-11 20:05:04.147287 | controller | go: downloading github.com/pkg/errors v0.9.1 2026-06-11 20:05:04.189114 | controller | go: downloading github.com/mxk/go-flowrate v0.0.0-20140419014527-cca7078d478f 2026-06-11 20:05:04.191446 | controller | go: downloading github.com/beorn7/perks v1.0.1 2026-06-11 20:05:04.193121 | controller | go: downloading github.com/cespare/xxhash/v2 v2.3.0 2026-06-11 20:05:04.230215 | controller | go: downloading github.com/prometheus/procfs v0.15.0 2026-06-11 20:05:04.234924 | controller | go: downloading github.com/go-openapi/jsonreference v0.21.0 2026-06-11 20:05:04.236537 | controller | go: downloading github.com/go-openapi/swag v0.23.0 2026-06-11 20:05:04.276753 | controller | go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 2026-06-11 20:05:04.283531 | controller | go: downloading github.com/go-openapi/jsonpointer v0.21.0 2026-06-11 20:05:04.317441 | controller | go: downloading github.com/mailru/easyjson v0.7.7 2026-06-11 20:05:04.381156 | controller | go: downloading github.com/emicklei/go-restful/v3 v3.12.0 2026-06-11 20:05:04.383422 | controller | go: downloading github.com/josharian/intern v1.0.0 2026-06-11 20:05:37.413881 | controller | 2026-06-11T20:05:37-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:05:37.414006 | controller | 2026-06-11 20:05:37.429276 | controller | 2026-06-11T20:05:37-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:05:37.429362 | controller | 2026-06-11 20:05:37.996694 | controller | 2026-06-11T20:05:37-04:00 INFO Creating "admin-ssh-key" in sf 2026-06-11 20:05:38.001520 | controller | 2026-06-11T20:05:38-04:00 INFO "admin-ssh-key" created 2026-06-11 20:05:38.598427 | controller | 2026-06-11T20:05:38-04:00 INFO Creating "zuul-ssh-key" in sf 2026-06-11 20:05:38.602025 | controller | 2026-06-11T20:05:38-04:00 INFO "zuul-ssh-key" created 2026-06-11 20:05:38.603799 | controller | 2026-06-11T20:05:38-04:00 INFO Creating "gerrit-admin-api-key" in sf 2026-06-11 20:05:38.605412 | controller | 2026-06-11T20:05:38-04:00 INFO "gerrit-admin-api-key" created 2026-06-11 20:05:38.606904 | controller | 2026-06-11T20:05:38-04:00 INFO Creating "zuul-gerrit-api-key" in sf 2026-06-11 20:05:38.609113 | controller | 2026-06-11T20:05:38-04:00 INFO "zuul-gerrit-api-key" created 2026-06-11 20:05:38.610707 | controller | 2026-06-11T20:05:38-04:00 INFO Creating "gerrit-httpd" in sf 2026-06-11 20:05:38.617065 | controller | 2026-06-11T20:05:38-04:00 INFO "gerrit-httpd" created 2026-06-11 20:05:38.618857 | controller | 2026-06-11T20:05:38-04:00 INFO Creating "gerrit-sshd" in sf 2026-06-11 20:05:38.626925 | controller | 2026-06-11T20:05:38-04:00 INFO "gerrit-sshd" created 2026-06-11 20:05:38.629206 | controller | 2026-06-11T20:05:38-04:00 INFO managesf-resources 2026-06-11 20:05:38.629263 | controller | 2026-06-11T20:05:38-04:00 INFO Creating "managesf-resources-config-map" in sf 2026-06-11 20:05:38.631700 | controller | 2026-06-11T20:05:38-04:00 INFO "managesf-resources-config-map" created 2026-06-11 20:05:38.633990 | controller | 2026-06-11T20:05:38-04:00 INFO managesf-resources-tooling 2026-06-11 20:05:38.634022 | controller | 2026-06-11T20:05:38-04:00 INFO Creating "managesf-resources-tooling-config-map" in sf 2026-06-11 20:05:38.637033 | controller | 2026-06-11T20:05:38-04:00 INFO "managesf-resources-tooling-config-map" created 2026-06-11 20:05:38.640567 | controller | 2026-06-11T20:05:38-04:00 INFO Creating "gerrit" in sf 2026-06-11 20:05:38.647345 | controller | 2026-06-11T20:05:38-04:00 INFO "gerrit" created 2026-06-11 20:05:38.650145 | controller | 2026-06-11T20:05:38-04:00 INFO Waiting 10s for gerrit statefulset to be ready... 2026-06-11 20:05:48.654614 | controller | 2026-06-11T20:05:48-04:00 INFO Waiting 10s for gerrit statefulset to be ready... 2026-06-11 20:05:58.658832 | controller | 2026-06-11T20:05:58-04:00 INFO Waiting 10s for gerrit statefulset to be ready... 2026-06-11 20:06:08.665550 | controller | 2026-06-11T20:06:08-04:00 INFO Waiting 10s for gerrit statefulset to be ready... 2026-06-11 20:06:18.676932 | controller | 2026-06-11T20:06:18-04:00 INFO Waiting 10s for gerrit statefulset to be ready... 2026-06-11 20:06:28.690543 | controller | 2026-06-11T20:06:28-04:00 INFO Waiting 10s for gerrit statefulset to be ready... 2026-06-11 20:06:38.694221 | controller | 2026-06-11T20:06:38-04:00 INFO Waiting 10s for gerrit statefulset to be ready... 2026-06-11 20:06:48.702742 | controller | 2026-06-11T20:06:48-04:00 INFO Creating "post-init" in sf 2026-06-11 20:06:48.707891 | controller | 2026-06-11T20:06:48-04:00 INFO "post-init" created 2026-06-11 20:07:12.867746 | controller | 2026-06-11T20:07:12-04:00 INFO Creating "self-signed-cert" in sf 2026-06-11 20:07:12.871025 | controller | 2026-06-11T20:07:12-04:00 INFO "self-signed-cert" created 2026-06-11 20:07:12.874505 | controller | 2026-06-11T20:07:12-04:00 INFO Creating "gerrit-ingress" in sf 2026-06-11 20:07:12.886063 | controller | 2026-06-11T20:07:12-04:00 INFO "gerrit-ingress" created 2026-06-11 20:07:12.891636 | controller | 2026-06-11T20:07:12-04:00 INFO Creating "sf-ingress" in sf 2026-06-11 20:07:12.896256 | controller | 2026-06-11T20:07:12-04:00 INFO "sf-ingress" created 2026-06-11 20:07:12.897869 | controller | 2026-06-11T20:07:12-04:00 INFO Waiting for gerrit-ingress ... [attempt 1/25] 2026-06-11 20:07:19.907293 | controller | 2026-06-11T20:07:19-04:00 INFO Waiting for gerrit-ingress ... [attempt 2/25] 2026-06-11 20:07:26.917415 | controller | 2026-06-11T20:07:26-04:00 INFO Waiting for gerrit-ingress ... [attempt 3/25] 2026-06-11 20:07:33.925540 | controller | 2026-06-11T20:07:33-04:00 INFO Updating /etc/hosts 2026-06-11 20:07:33.925755 | controller | 2026-06-11T20:07:33-04:00 INFO Making sure Gerrit is up and ready... 2026-06-11 20:07:33.925769 | controller | 2026-06-11T20:07:33-04:00 INFO Querying Gerrit projects endpoint... [attempt 1/10] 2026-06-11 20:07:33.946114 | controller | 2026-06-11T20:07:33-04:00 INFO Gerrit is up and available 2026-06-11 20:07:33.946188 | controller | 2026-06-11T20:07:33-04:00 INFO Cloning config... 2026-06-11 20:07:33.949220 | controller | 2026-06-11T20:07:33-04:00 INFO Cloning repo https://admin:8dd554af-3469-4a00-985a-124645439f96@gerrit.sfop.me/a/config in deploy/config 2026-06-11 20:07:34.174873 | controller | 2026-06-11T20:07:34-04:00 INFO Configuring local repository for commits... 2026-06-11 20:07:34.189671 | controller | 2026-06-11T20:07:34-04:00 INFO Cloning demo-tenant-config... 2026-06-11 20:07:34.192390 | controller | 2026-06-11T20:07:34-04:00 INFO Cloning repo https://admin:8dd554af-3469-4a00-985a-124645439f96@gerrit.sfop.me/a/demo-tenant-config in deploy/demo-tenant-config 2026-06-11 20:07:34.264734 | controller | 2026-06-11T20:07:34-04:00 INFO Configuring local repository for commits... 2026-06-11 20:07:34.271733 | controller | 2026-06-11T20:07:34-04:00 INFO Cloning demo-project... 2026-06-11 20:07:34.273590 | controller | 2026-06-11T20:07:34-04:00 INFO Cloning repo https://admin:8dd554af-3469-4a00-985a-124645439f96@gerrit.sfop.me/a/demo-project in deploy/demo-project 2026-06-11 20:07:34.352172 | controller | 2026-06-11T20:07:34-04:00 INFO Configuring local repository for commits... 2026-06-11 20:07:34.361070 | controller | 2026-06-11T20:07:34-04:00 INFO Initialize demo-tenant's pipelines and jobs... 2026-06-11 20:07:34.368001 | controller | 2026-06-11T20:07:34-04:00 INFO Pushing local repo state to origin... 2026-06-11 20:07:34.545512 | controller | 2026-06-11T20:07:34-04:00 INFO Creating or updating tenant demo-tenant... 2026-06-11 20:07:34.555055 | controller | 2026-06-11T20:07:34-04:00 INFO Pushing local repo state to origin... 2026-06-11 20:07:34.681053 | controller | 2026-06-11T20:07:34-04:00 INFO Initialize demo-project's pipelines and jobs... 2026-06-11 20:07:34.690911 | controller | 2026-06-11T20:07:34-04:00 INFO Pushing local repo state to origin... 2026-06-11 20:07:34.813561 | controller | 2026-06-11T20:07:34-04:00 INFO Applying CRDs (did you run "make manifests" first?) 2026-06-11 20:07:35.198953 | controller | [+] Deploying sf-operator 2026-06-11 20:07:35.598294 | controller | 2026-06-11T20:07:35-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:07:35.598360 | controller | 2026-06-11 20:07:35.611780 | controller | 2026-06-11T20:07:35-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:07:35.611824 | controller | 2026-06-11 20:07:35.637962 | controller | 2026-06-11T20:07:35-04:00 INFO Deleting object, name: zookeeper 2026-06-11 20:07:35.643142 | controller | 2026-06-11T20:07:35-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:07:35.648907 | controller | 2026-06-11T20:07:35-04:00 INFO Creating secret, name: zuul-keystore-password 2026-06-11 20:07:35.648942 | controller | 2026-06-11T20:07:35-04:00 INFO Creating object, name: zuul-keystore-password 2026-06-11 20:07:35.653788 | controller | 2026-06-11T20:07:35-04:00 INFO Creating secret, name: zuul-auth-secret 2026-06-11 20:07:35.653825 | controller | 2026-06-11T20:07:35-04:00 INFO Creating object, name: zuul-auth-secret 2026-06-11 20:07:35.658214 | controller | 2026-06-11T20:07:35-04:00 INFO Creating config map name: zuul-scheduler-tooling-config-map 2026-06-11 20:07:35.658244 | controller | 2026-06-11T20:07:35-04:00 INFO Creating object, name: zuul-scheduler-tooling-config-map 2026-06-11 20:07:35.667120 | controller | 2026-06-11T20:07:35-04:00 INFO Creating config map name: git-server-pi-config-map 2026-06-11 20:07:35.667161 | controller | 2026-06-11T20:07:35-04:00 INFO Creating object, name: git-server-pi-config-map 2026-06-11 20:07:35.673867 | controller | 2026-06-11T20:07:35-04:00 INFO Creating object, name: git-server 2026-06-11 20:07:35.681465 | controller | 2026-06-11T20:07:35-04:00 INFO Creating secret, name: mariadb-root-password 2026-06-11 20:07:35.681529 | controller | 2026-06-11T20:07:35-04:00 INFO Creating object, name: mariadb-root-password 2026-06-11 20:07:35.686553 | controller | 2026-06-11T20:07:35-04:00 INFO Creating secret, name: mariadb-config-secrets 2026-06-11 20:07:35.686591 | controller | 2026-06-11T20:07:35-04:00 INFO Creating object, name: mariadb-config-secrets 2026-06-11 20:07:36.029931 | controller | 2026-06-11T20:07:36-04:00 INFO Creating secret, name: mariadb-initdb-secrets 2026-06-11 20:07:36.030006 | controller | 2026-06-11T20:07:36-04:00 INFO Creating object, name: mariadb-initdb-secrets 2026-06-11 20:07:36.234566 | controller | 2026-06-11T20:07:36-04:00 INFO Creating object, name: mariadb 2026-06-11 20:07:36.429539 | controller | 2026-06-11T20:07:36-04:00 INFO Creating ssh key, name: logserver-keys 2026-06-11 20:07:36.773571 | controller | 2026-06-11T20:07:36-04:00 INFO Creating object, name: logserver-keys 2026-06-11 20:07:36.829173 | controller | 2026-06-11T20:07:36-04:00 INFO Creating ssh key, name: logserver-uploader-keys 2026-06-11 20:07:38.211768 | controller | 2026-06-11T20:07:38-04:00 INFO Creating object, name: logserver-uploader-keys 2026-06-11 20:07:38.217825 | controller | 2026-06-11T20:07:38-04:00 INFO Creating ssh key, name: logserver-uploader-spare-keys 2026-06-11 20:07:38.831059 | controller | 2026-06-11T20:07:38-04:00 INFO Creating object, name: logserver-uploader-spare-keys 2026-06-11 20:07:38.837100 | controller | 2026-06-11T20:07:38-04:00 INFO Creating config map name: logserver-config-map 2026-06-11 20:07:38.837240 | controller | 2026-06-11T20:07:38-04:00 INFO Creating object, name: logserver-config-map 2026-06-11 20:07:38.841753 | controller | 2026-06-11T20:07:38-04:00 INFO Creating service, name: logserver 2026-06-11 20:07:38.841809 | controller | 2026-06-11T20:07:38-04:00 INFO Creating object, name: logserver 2026-06-11 20:07:38.856314 | controller | 2026-06-11T20:07:38-04:00 INFO Creating object, name: logserver 2026-06-11 20:07:38.861059 | controller | 2026-06-11T20:07:38-04:00 INFO Creating object, name: gateway 2026-06-11 20:07:38.870667 | controller | 2026-06-11T20:07:38-04:00 INFO Creating config map name: gateway-config-map 2026-06-11 20:07:38.870700 | controller | 2026-06-11T20:07:38-04:00 INFO Creating object, name: gateway-config-map 2026-06-11 20:07:38.873767 | controller | 2026-06-11T20:07:38-04:00 INFO Creating object, name: gateway 2026-06-11 20:07:38.883505 | controller | 2026-06-11T20:07:38-04:00 INFO Creating service, name: hound-search 2026-06-11 20:07:38.883538 | controller | 2026-06-11T20:07:38-04:00 INFO Creating object, name: hound-search 2026-06-11 20:07:38.898456 | controller | 2026-06-11T20:07:38-04:00 INFO Creating object, name: hound-search 2026-06-11 20:07:38.905972 | controller | 2026-06-11T20:07:38-04:00 INFO Creating object, name: logjuicer-pvc 2026-06-11 20:07:38.911209 | controller | 2026-06-11T20:07:38-04:00 INFO Creating object, name: logjuicer 2026-06-11 20:07:38.931192 | controller | 2026-06-11T20:07:38-04:00 INFO Creating object, name: logjuicer 2026-06-11 20:07:38.935445 | controller | 2026-06-11T20:07:38-04:00 INFO Deleting object, name: zookeeper-client-tls 2026-06-11 20:07:38.937505 | controller | 2026-06-11T20:07:38-04:00 INFO Deleting object, name: zookeeper-server-tls 2026-06-11 20:07:42.278785 | controller | 2026-06-11T20:07:42-04:00 INFO Creating object, name: zookeeper-client-tls 2026-06-11 20:07:42.699284 | controller | 2026-06-11T20:07:42-04:00 INFO Creating object, name: zookeeper-server-tls 2026-06-11 20:07:42.707990 | controller | 2026-06-11T20:07:42-04:00 INFO Creating config map name: zookeeper-pi-config-map 2026-06-11 20:07:42.708024 | controller | 2026-06-11T20:07:42-04:00 INFO Creating object, name: zookeeper-pi-config-map 2026-06-11 20:07:42.714340 | controller | 2026-06-11T20:07:42-04:00 INFO Creating service, name: zookeeper-headless 2026-06-11 20:07:42.714401 | controller | 2026-06-11T20:07:42-04:00 INFO Creating object, name: zookeeper-headless 2026-06-11 20:07:42.723293 | controller | 2026-06-11T20:07:42-04:00 INFO Creating service, name: zookeeper 2026-06-11 20:07:42.723346 | controller | 2026-06-11T20:07:42-04:00 INFO Creating object, name: zookeeper 2026-06-11 20:07:42.737230 | controller | 2026-06-11T20:07:42-04:00 INFO Creating object, name: zookeeper 2026-06-11 20:07:42.744346 | controller | 2026-06-11T20:07:42-04:00 INFO Waiting for Zookeeper service to be ready ... 2026-06-11 20:07:42.744435 | controller | 2026-06-11T20:07:42-04:00 INFO 2026-06-11 20:07:42.744454 | controller | - Config: Waiting ... 2026-06-11 20:07:42.744467 | controller | - Gateway: Waiting ... 2026-06-11 20:07:42.744479 | controller | - GitServer: Waiting ... 2026-06-11 20:07:42.744491 | controller | - HoundSearch: Waiting ... 2026-06-11 20:07:42.744503 | controller | - LogJuicer: Waiting ... 2026-06-11 20:07:42.744514 | controller | - Logserver: Waiting ... 2026-06-11 20:07:42.744526 | controller | - MariaDB: Waiting ... 2026-06-11 20:07:42.744538 | controller | - Zookeeper: Waiting ... 2026-06-11 20:07:42.744550 | controller | 2026-06-11 20:07:42.744570 | controller | 2026-06-11T20:07:42-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-11 20:07:47.753406 | controller | 2026-06-11T20:07:47-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:07:47.769988 | controller | 2026-06-11T20:07:47-04:00 INFO Creating service, name: git-server 2026-06-11 20:07:47.770032 | controller | 2026-06-11T20:07:47-04:00 INFO Creating object, name: git-server 2026-06-11 20:07:47.778962 | controller | 2026-06-11T20:07:47-04:00 INFO Creating service, name: git-server-rw 2026-06-11 20:07:47.779005 | controller | 2026-06-11T20:07:47-04:00 INFO Creating object, name: git-server-rw 2026-06-11 20:07:47.786947 | controller | 2026-06-11T20:07:47-04:00 INFO Waiting for statefulset, name: git-server 2026-06-11 20:08:01.851037 | controller | 2026-06-11T20:08:01-04:00 INFO Creating service, name: mariadb 2026-06-11 20:08:01.851110 | controller | 2026-06-11T20:08:01-04:00 INFO Creating object, name: mariadb 2026-06-11 20:08:01.893679 | controller | 2026-06-11T20:08:01-04:00 INFO Waiting for statefulset, name: mariadb 2026-06-11 20:08:28.001327 | controller | 2026-06-11T20:08:28-04:00 INFO Creating object, name: zuul-db-connection 2026-06-11 20:08:28.008793 | controller | 2026-06-11T20:08:28-04:00 INFO Creating object, name: zuul-db-provision 2026-06-11 20:08:28.060581 | controller | 2026-06-11T20:08:28-04:00 INFO Waiting for statefulset, name: logserver 2026-06-11 20:08:42.120954 | controller | 2026-06-11T20:08:42-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:08:42.233482 | controller | 2026-06-11T20:08:42-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:08:42.241639 | controller | 2026-06-11T20:08:42-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:08:42.241667 | controller | 2026-06-11T20:08:42-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:08:42.254474 | controller | 2026-06-11T20:08:42-04:00 INFO Waiting for statefulset, name: hound-search 2026-06-11 20:09:12.370927 | controller | 2026-06-11T20:09:12-04:00 INFO Statefulset "hound-search" not ready after 30s 2026-06-11 20:09:12.382043 | controller | 2026-06-11T20:09:12-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:09:12.382080 | controller | 2026-06-11T20:09:12-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:09:12.404112 | controller | 2026-06-11T20:09:12-04:00 INFO Waiting for GitServer and MariaDB services to be ready ... 2026-06-11 20:09:12.404183 | controller | 2026-06-11T20:09:12-04:00 INFO 2026-06-11 20:09:12.404196 | controller | - Config: Waiting ... 2026-06-11 20:09:12.404204 | controller | - Gateway: OK 2026-06-11 20:09:12.404213 | controller | - GitServer: OK 2026-06-11 20:09:12.404221 | controller | - HoundSearch: Waiting ... 2026-06-11 20:09:12.404228 | controller | - LogJuicer: OK 2026-06-11 20:09:12.404236 | controller | - Logserver: OK 2026-06-11 20:09:12.404244 | controller | - MariaDB: Waiting ... 2026-06-11 20:09:12.404252 | controller | - Zookeeper: OK 2026-06-11 20:09:12.404260 | controller | 2026-06-11 20:09:12.404271 | controller | 2026-06-11T20:09:12-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-11 20:09:17.413856 | controller | 2026-06-11T20:09:17-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:09:18.040345 | controller | 2026-06-11T20:09:18-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:09:18.041789 | controller | 2026-06-11T20:09:18-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:09:18.051787 | controller | 2026-06-11T20:09:18-04:00 INFO Waiting for statefulset, name: hound-search 2026-06-11 20:09:48.159120 | controller | 2026-06-11T20:09:48-04:00 INFO Statefulset "hound-search" not ready after 30s 2026-06-11 20:09:48.165636 | controller | 2026-06-11T20:09:48-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:09:48.165676 | controller | 2026-06-11T20:09:48-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:09:48.183927 | controller | 2026-06-11T20:09:48-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:09:48.185736 | controller | 2026-06-11T20:09:48-04:00 INFO Creating ssh key, name: zuul-spare-ssh-key 2026-06-11 20:09:48.356443 | controller | 2026-06-11T20:09:48-04:00 INFO Creating object, name: zuul-spare-ssh-key 2026-06-11 20:09:48.366508 | controller | 2026-06-11T20:09:48-04:00 INFO Creating config map name: np-statsd-config-map 2026-06-11 20:09:48.366594 | controller | 2026-06-11T20:09:48-04:00 INFO Creating object, name: np-statsd-config-map 2026-06-11 20:09:48.374464 | controller | 2026-06-11T20:09:48-04:00 INFO Creating config map name: nodepool-tooling-config-map 2026-06-11 20:09:48.374529 | controller | 2026-06-11T20:09:48-04:00 INFO Creating object, name: nodepool-tooling-config-map 2026-06-11 20:09:48.380815 | controller | 2026-06-11T20:09:48-04:00 INFO Creating config map name: nodepool-launcher-extra-config-config-map 2026-06-11 20:09:48.380860 | controller | 2026-06-11T20:09:48-04:00 INFO Creating object, name: nodepool-launcher-extra-config-config-map 2026-06-11 20:09:48.389779 | controller | 2026-06-11T20:09:48-04:00 INFO Creating object, name: nodepool-launcher 2026-06-11 20:09:48.397840 | controller | 2026-06-11T20:09:48-04:00 INFO Creating ssh key, name: nodepool-builder-ssh-key 2026-06-11 20:09:49.162189 | controller | 2026-06-11T20:09:49-04:00 INFO Creating object, name: nodepool-builder-ssh-key 2026-06-11 20:09:49.172145 | controller | 2026-06-11T20:09:49-04:00 INFO Creating config map name: nodepool-builder-extra-config-config-map 2026-06-11 20:09:49.172227 | controller | 2026-06-11T20:09:49-04:00 INFO Creating object, name: nodepool-builder-extra-config-config-map 2026-06-11 20:09:49.180379 | controller | 2026-06-11T20:09:49-04:00 INFO Creating service, name: nodepool-builder 2026-06-11 20:09:49.180431 | controller | 2026-06-11T20:09:49-04:00 INFO Creating object, name: nodepool-builder 2026-06-11 20:09:49.191731 | controller | 2026-06-11T20:09:49-04:00 INFO Creating object, name: nodepool-builder 2026-06-11 20:09:49.211628 | controller | 2026-06-11T20:09:49-04:00 INFO Creating secret, name: zuul-config 2026-06-11 20:09:49.211683 | controller | 2026-06-11T20:09:49-04:00 INFO Creating object, name: zuul-config 2026-06-11 20:09:49.215883 | controller | 2026-06-11T20:09:49-04:00 INFO Creating object, name: zuul-web 2026-06-11 20:09:49.224946 | controller | 2026-06-11T20:09:49-04:00 INFO Creating object, name: zuul-executor-headless 2026-06-11 20:09:49.234795 | controller | 2026-06-11T20:09:49-04:00 INFO Creating config map name: zuul-extra-config-map 2026-06-11 20:09:49.234847 | controller | 2026-06-11T20:09:49-04:00 INFO Creating object, name: zuul-extra-config-map 2026-06-11 20:09:49.567133 | controller | 2026-06-11T20:09:49-04:00 INFO Creating config map name: zuul-statsd-config-map 2026-06-11 20:09:49.567222 | controller | 2026-06-11T20:09:49-04:00 INFO Creating object, name: zuul-statsd-config-map 2026-06-11 20:09:49.966966 | controller | 2026-06-11T20:09:49-04:00 INFO Creating config map name: zuul-logging-config-map 2026-06-11 20:09:49.967053 | controller | 2026-06-11T20:09:49-04:00 INFO Creating object, name: zuul-logging-config-map 2026-06-11 20:09:50.171218 | controller | 2026-06-11T20:09:50-04:00 INFO Creating object, name: zuul-scheduler 2026-06-11 20:09:50.970953 | controller | 2026-06-11T20:09:50-04:00 INFO Creating object, name: zuul-executor 2026-06-11 20:09:51.770427 | controller | 2026-06-11T20:09:51-04:00 INFO Creating object, name: zuul-web 2026-06-11 20:09:52.574302 | controller | 2026-06-11T20:09:52-04:00 INFO Creating object, name: zuul-merger 2026-06-11 20:09:52.581305 | controller | 2026-06-11T20:09:52-04:00 INFO 2026-06-11 20:09:52.581349 | controller | - Config: Waiting ... 2026-06-11 20:09:52.581362 | controller | - Gateway: OK 2026-06-11 20:09:52.581403 | controller | - GitServer: OK 2026-06-11 20:09:52.581415 | controller | - HoundSearch: Waiting ... 2026-06-11 20:09:52.581426 | controller | - LogJuicer: OK 2026-06-11 20:09:52.581438 | controller | - Logserver: OK 2026-06-11 20:09:52.581449 | controller | - MariaDB: OK 2026-06-11 20:09:52.581460 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:09:52.581472 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:09:52.581483 | controller | - Zookeeper: OK 2026-06-11 20:09:52.581493 | controller | - Zuul: Waiting ... 2026-06-11 20:09:52.581504 | controller | - |_ Config Secrets: OK 2026-06-11 20:09:52.581515 | controller | - |_ Executor: Waiting ... 2026-06-11 20:09:52.581525 | controller | - |_ Merger: Waiting ... 2026-06-11 20:09:52.581536 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:09:52.581547 | controller | - |_ Web: Waiting ... 2026-06-11 20:09:52.581557 | controller | 2026-06-11 20:09:52.581569 | controller | 2026-06-11T20:09:52-04:00 INFO [attempt #3] Waiting 5s for the next reconcile call ... 2026-06-11 20:09:57.591411 | controller | 2026-06-11T20:09:57-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:09:58.205710 | controller | 2026-06-11T20:09:58-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:09:58.205791 | controller | 2026-06-11T20:09:58-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:09:58.216300 | controller | 2026-06-11T20:09:58-04:00 INFO Waiting for statefulset, name: hound-search 2026-06-11 20:10:28.316218 | controller | 2026-06-11T20:10:28-04:00 INFO Statefulset "hound-search" not ready after 30s 2026-06-11 20:10:28.327240 | controller | 2026-06-11T20:10:28-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:10:28.327325 | controller | 2026-06-11T20:10:28-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:10:28.341872 | controller | 2026-06-11T20:10:28-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:10:28.361177 | controller | 2026-06-11T20:10:28-04:00 INFO Creating object, name: nodepool-launcher 2026-06-11 20:10:28.367812 | controller | 2026-06-11T20:10:28-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:10:28.367860 | controller | 2026-06-11T20:10:28-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:10:28.940616 | controller | 2026-06-11T20:10:28-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:10:59.058627 | controller | 2026-06-11T20:10:59-04:00 INFO Statefulset "zuul-scheduler" not ready after 30s 2026-06-11 20:10:59.080407 | controller | 2026-06-11T20:10:59-04:00 INFO Waiting for statefulset, name: zuul-executor 2026-06-11 20:11:35.227433 | controller | 2026-06-11T20:11:35-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:11:35.227523 | controller | 2026-06-11T20:11:35-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:11:35.310358 | controller | 2026-06-11T20:11:35-04:00 INFO Waiting for statefulset, name: zuul-merger 2026-06-11 20:11:37.317465 | controller | 2026-06-11T20:11:37-04:00 INFO 2026-06-11 20:11:37.317869 | controller | - Config: Waiting ... 2026-06-11 20:11:37.317883 | controller | - Gateway: OK 2026-06-11 20:11:37.317891 | controller | - GitServer: OK 2026-06-11 20:11:37.317898 | controller | - HoundSearch: Waiting ... 2026-06-11 20:11:37.317905 | controller | - LogJuicer: OK 2026-06-11 20:11:37.317912 | controller | - Logserver: OK 2026-06-11 20:11:37.317920 | controller | - MariaDB: OK 2026-06-11 20:11:37.317927 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:11:37.317950 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:11:37.317958 | controller | - Zookeeper: OK 2026-06-11 20:11:37.317965 | controller | - Zuul: Waiting ... 2026-06-11 20:11:37.317973 | controller | - |_ Config Secrets: OK 2026-06-11 20:11:37.317980 | controller | - |_ Executor: OK 2026-06-11 20:11:37.317987 | controller | - |_ Merger: OK 2026-06-11 20:11:37.317994 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:11:37.318002 | controller | - |_ Web: Waiting ... 2026-06-11 20:11:37.318009 | controller | 2026-06-11 20:11:37.318017 | controller | 2026-06-11T20:11:37-04:00 INFO [attempt #4] Waiting 5s for the next reconcile call ... 2026-06-11 20:11:42.327123 | controller | 2026-06-11T20:11:42-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:11:42.945409 | controller | 2026-06-11T20:11:42-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:11:42.945572 | controller | 2026-06-11T20:11:42-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:11:42.958863 | controller | 2026-06-11T20:11:42-04:00 INFO Waiting for statefulset, name: hound-search 2026-06-11 20:12:09.065431 | controller | 2026-06-11T20:12:09-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:12:09.065503 | controller | 2026-06-11T20:12:09-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:12:09.085152 | controller | 2026-06-11T20:12:09-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:12:09.099846 | controller | 2026-06-11T20:12:09-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:12:09.099900 | controller | 2026-06-11T20:12:09-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:12:09.677312 | controller | 2026-06-11T20:12:09-04:00 INFO Creating object, name: zuul-weeder 2026-06-11 20:12:09.687310 | controller | 2026-06-11T20:12:09-04:00 INFO Creating object, name: zuul-weeder 2026-06-11 20:12:11.268215 | controller | 2026-06-11T20:12:11-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:12:11.268288 | controller | 2026-06-11T20:12:11-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:12:12.071894 | controller | 2026-06-11T20:12:12-04:00 INFO 2026-06-11 20:12:12.071949 | controller | - Config: Waiting ... 2026-06-11 20:12:12.071956 | controller | - Gateway: OK 2026-06-11 20:12:12.071962 | controller | - GitServer: OK 2026-06-11 20:12:12.071967 | controller | - HoundSearch: OK 2026-06-11 20:12:12.071973 | controller | - LogJuicer: OK 2026-06-11 20:12:12.071978 | controller | - Logserver: OK 2026-06-11 20:12:12.071983 | controller | - MariaDB: OK 2026-06-11 20:12:12.071989 | controller | - NodePoolBuilder: OK 2026-06-11 20:12:12.071994 | controller | - NodePoolLauncher: OK 2026-06-11 20:12:12.071999 | controller | - Zookeeper: OK 2026-06-11 20:12:12.072005 | controller | - Zuul: Waiting ... 2026-06-11 20:12:12.072010 | controller | - |_ Config Secrets: OK 2026-06-11 20:12:12.072015 | controller | - |_ Executor: OK 2026-06-11 20:12:12.072021 | controller | - |_ Merger: OK 2026-06-11 20:12:12.072026 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:12:12.072032 | controller | - |_ Web: OK 2026-06-11 20:12:12.072037 | controller | 2026-06-11 20:12:12.072043 | controller | 2026-06-11T20:12:12-04:00 INFO [attempt #5] Waiting 5s for the next reconcile call ... 2026-06-11 20:12:17.082351 | controller | 2026-06-11T20:12:17-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:12:17.700830 | controller | 2026-06-11T20:12:17-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:12:17.700905 | controller | 2026-06-11T20:12:17-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:12:17.730098 | controller | 2026-06-11T20:12:17-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:12:17.730160 | controller | 2026-06-11T20:12:17-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:12:18.102892 | controller | 2026-06-11T20:12:18-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:12:18.499288 | controller | 2026-06-11T20:12:18-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:12:18.499438 | controller | 2026-06-11T20:12:18-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:12:19.517502 | controller | 2026-06-11T20:12:19-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:12:19.517585 | controller | 2026-06-11T20:12:19-04:00 INFO deployment rollout not ok, name: zuul-weeder 2026-06-11 20:12:20.488301 | controller | 2026-06-11T20:12:20-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:12:20.488465 | controller | 2026-06-11T20:12:20-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:12:21.292112 | controller | 2026-06-11T20:12:21-04:00 INFO 2026-06-11 20:12:21.292190 | controller | - Config: Waiting ... 2026-06-11 20:12:21.292200 | controller | - Gateway: OK 2026-06-11 20:12:21.292209 | controller | - GitServer: OK 2026-06-11 20:12:21.292217 | controller | - HoundSearch: OK 2026-06-11 20:12:21.292225 | controller | - LogJuicer: OK 2026-06-11 20:12:21.292233 | controller | - Logserver: OK 2026-06-11 20:12:21.292240 | controller | - MariaDB: OK 2026-06-11 20:12:21.292248 | controller | - NodePoolBuilder: OK 2026-06-11 20:12:21.292256 | controller | - NodePoolLauncher: OK 2026-06-11 20:12:21.292264 | controller | - Zookeeper: OK 2026-06-11 20:12:21.292272 | controller | - Zuul: Waiting ... 2026-06-11 20:12:21.292279 | controller | - |_ Config Secrets: OK 2026-06-11 20:12:21.292287 | controller | - |_ Executor: OK 2026-06-11 20:12:21.292295 | controller | - |_ Merger: OK 2026-06-11 20:12:21.292303 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:12:21.292311 | controller | - |_ Web: OK 2026-06-11 20:12:21.292319 | controller | 2026-06-11 20:12:21.292393 | controller | 2026-06-11T20:12:21-04:00 INFO [attempt #6] Waiting 5s for the next reconcile call ... 2026-06-11 20:12:26.298907 | controller | 2026-06-11T20:12:26-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:12:26.917656 | controller | 2026-06-11T20:12:26-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:12:26.917720 | controller | 2026-06-11T20:12:26-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:12:26.939155 | controller | 2026-06-11T20:12:26-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:12:26.939261 | controller | 2026-06-11T20:12:26-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:12:27.309122 | controller | 2026-06-11T20:12:27-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:12:27.713050 | controller | 2026-06-11T20:12:27-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:12:27.713113 | controller | 2026-06-11T20:12:27-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:12:28.718291 | controller | 2026-06-11T20:12:28-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:12:28.718359 | controller | 2026-06-11T20:12:28-04:00 INFO deployment rollout not ok, name: zuul-weeder 2026-06-11 20:12:29.703248 | controller | 2026-06-11T20:12:29-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:12:29.703318 | controller | 2026-06-11T20:12:29-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:12:30.513427 | controller | 2026-06-11T20:12:30-04:00 INFO 2026-06-11 20:12:30.513555 | controller | - Config: Waiting ... 2026-06-11 20:12:30.513589 | controller | - Gateway: OK 2026-06-11 20:12:30.513609 | controller | - GitServer: OK 2026-06-11 20:12:30.513617 | controller | - HoundSearch: OK 2026-06-11 20:12:30.513625 | controller | - LogJuicer: OK 2026-06-11 20:12:30.513633 | controller | - Logserver: OK 2026-06-11 20:12:30.513640 | controller | - MariaDB: OK 2026-06-11 20:12:30.513670 | controller | - NodePoolBuilder: OK 2026-06-11 20:12:30.513678 | controller | - NodePoolLauncher: OK 2026-06-11 20:12:30.513685 | controller | - Zookeeper: OK 2026-06-11 20:12:30.513693 | controller | - Zuul: Waiting ... 2026-06-11 20:12:30.513709 | controller | - |_ Config Secrets: OK 2026-06-11 20:12:30.513717 | controller | - |_ Executor: OK 2026-06-11 20:12:30.513725 | controller | - |_ Merger: OK 2026-06-11 20:12:30.513733 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:12:30.513741 | controller | - |_ Web: OK 2026-06-11 20:12:30.513749 | controller | 2026-06-11 20:12:30.513757 | controller | 2026-06-11T20:12:30-04:00 INFO [attempt #7] Waiting 5s for the next reconcile call ... 2026-06-11 20:12:35.523416 | controller | 2026-06-11T20:12:35-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:12:36.147872 | controller | 2026-06-11T20:12:36-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:12:36.147953 | controller | 2026-06-11T20:12:36-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:12:36.175119 | controller | 2026-06-11T20:12:36-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:12:36.175193 | controller | 2026-06-11T20:12:36-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:12:36.543412 | controller | 2026-06-11T20:12:36-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:12:36.937003 | controller | 2026-06-11T20:12:36-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:12:36.937113 | controller | 2026-06-11T20:12:36-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:12:37.957096 | controller | 2026-06-11T20:12:37-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:12:37.957171 | controller | 2026-06-11T20:12:37-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:12:38.928190 | controller | 2026-06-11T20:12:38-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:12:38.928269 | controller | 2026-06-11T20:12:38-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:12:39.924772 | controller | 2026-06-11T20:12:39-04:00 INFO Creating config map name: pymod-sf-operator-config-map 2026-06-11 20:12:39.924859 | controller | 2026-06-11T20:12:39-04:00 INFO Creating object, name: pymod-sf-operator-config-map 2026-06-11 20:12:40.327555 | controller | 2026-06-11T20:12:40-04:00 INFO Creating object, name: config-updater 2026-06-11 20:12:40.338699 | controller | 2026-06-11T20:12:40-04:00 INFO Creating object, name: config-updater-role 2026-06-11 20:12:40.344301 | controller | 2026-06-11T20:12:40-04:00 INFO Creating object, name: config-updater 2026-06-11 20:12:40.349703 | controller | 2026-06-11T20:12:40-04:00 INFO Creating the config-update service account secret 2026-06-11 20:12:40.349747 | controller | 2026-06-11T20:12:40-04:00 INFO Creating object, name: config-update-secrets 2026-06-11 20:12:40.355479 | controller | 2026-06-11T20:12:40-04:00 INFO Creating base secret job 2026-06-11 20:12:40.356240 | controller | 2026-06-11T20:12:40-04:00 INFO Creating object, name: config-base-secret-1-857-ns 2026-06-11 20:12:40.361261 | controller | 2026-06-11T20:12:40-04:00 INFO 2026-06-11 20:12:40.361300 | controller | - Config: Waiting ... 2026-06-11 20:12:40.361311 | controller | - Gateway: OK 2026-06-11 20:12:40.361319 | controller | - GitServer: OK 2026-06-11 20:12:40.361327 | controller | - HoundSearch: OK 2026-06-11 20:12:40.361335 | controller | - LogJuicer: OK 2026-06-11 20:12:40.361343 | controller | - Logserver: OK 2026-06-11 20:12:40.361350 | controller | - MariaDB: OK 2026-06-11 20:12:40.361358 | controller | - NodePoolBuilder: OK 2026-06-11 20:12:40.361397 | controller | - NodePoolLauncher: OK 2026-06-11 20:12:40.361410 | controller | - Zookeeper: OK 2026-06-11 20:12:40.361419 | controller | - Zuul: OK 2026-06-11 20:12:40.361427 | controller | 2026-06-11 20:12:40.361435 | controller | 2026-06-11T20:12:40-04:00 INFO [attempt #8] Waiting 5s for the next reconcile call ... 2026-06-11 20:12:45.371222 | controller | 2026-06-11T20:12:45-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:12:45.992868 | controller | 2026-06-11T20:12:45-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:12:45.992975 | controller | 2026-06-11T20:12:45-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:12:46.018674 | controller | 2026-06-11T20:12:46-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:12:46.018770 | controller | 2026-06-11T20:12:46-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:12:46.386112 | controller | 2026-06-11T20:12:46-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:12:46.789588 | controller | 2026-06-11T20:12:46-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:12:46.789665 | controller | 2026-06-11T20:12:46-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:12:47.802725 | controller | 2026-06-11T20:12:47-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:12:47.802826 | controller | 2026-06-11T20:12:47-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:12:48.776231 | controller | 2026-06-11T20:12:48-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:12:48.776332 | controller | 2026-06-11T20:12:48-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:12:49.985913 | controller | 2026-06-11T20:12:49-04:00 INFO Running tenant-reconfigure for the 'internal' tenant 2026-06-11 20:12:50.172678 | controller | 2026-06-11T20:12:50-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [zuul-scheduler tenant-reconfigure internal] 2026-06-11 20:12:56.440365 | controller | 2026-06-11T20:12:56-04:00 INFO Deleting object, name: zuul-web 2026-06-11 20:12:56.445676 | controller | 2026-06-11T20:12:56-04:00 INFO Creating object, name: zs-internal-tenant-reconfigure 2026-06-11 20:12:56.449410 | controller | 2026-06-11T20:12:56-04:00 INFO 2026-06-11 20:12:56.449444 | controller | - Config: Waiting ... 2026-06-11 20:12:56.449455 | controller | - Gateway: OK 2026-06-11 20:12:56.449463 | controller | - GitServer: OK 2026-06-11 20:12:56.449485 | controller | - HoundSearch: OK 2026-06-11 20:12:56.449493 | controller | - LogJuicer: OK 2026-06-11 20:12:56.449501 | controller | - Logserver: OK 2026-06-11 20:12:56.449509 | controller | - MariaDB: OK 2026-06-11 20:12:56.449517 | controller | - NodePoolBuilder: OK 2026-06-11 20:12:56.449525 | controller | - NodePoolLauncher: OK 2026-06-11 20:12:56.449533 | controller | - Zookeeper: OK 2026-06-11 20:12:56.449541 | controller | - Zuul: OK 2026-06-11 20:12:56.449549 | controller | 2026-06-11 20:12:56.449592 | controller | 2026-06-11T20:12:56-04:00 INFO [attempt #9] Waiting 5s for the next reconcile call ... 2026-06-11 20:13:01.455331 | controller | 2026-06-11T20:13:01-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:13:02.071027 | controller | 2026-06-11T20:13:02-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:13:02.071094 | controller | 2026-06-11T20:13:02-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:13:02.089282 | controller | 2026-06-11T20:13:02-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:13:02.089354 | controller | 2026-06-11T20:13:02-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:13:02.469273 | controller | 2026-06-11T20:13:02-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:13:02.867552 | controller | 2026-06-11T20:13:02-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:13:02.867630 | controller | 2026-06-11T20:13:02-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:13:03.881409 | controller | 2026-06-11T20:13:03-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:13:03.881477 | controller | 2026-06-11T20:13:03-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:13:04.859113 | controller | 2026-06-11T20:13:04-04:00 INFO Creating object, name: zuul-web 2026-06-11 20:13:05.671541 | controller | 2026-06-11T20:13:05-04:00 INFO 2026-06-11 20:13:05.671612 | controller | - Config: Waiting ... 2026-06-11 20:13:05.671623 | controller | - Gateway: OK 2026-06-11 20:13:05.671631 | controller | - GitServer: OK 2026-06-11 20:13:05.671639 | controller | - HoundSearch: OK 2026-06-11 20:13:05.671647 | controller | - LogJuicer: OK 2026-06-11 20:13:05.671655 | controller | - Logserver: OK 2026-06-11 20:13:05.671663 | controller | - MariaDB: OK 2026-06-11 20:13:05.671671 | controller | - NodePoolBuilder: OK 2026-06-11 20:13:05.671679 | controller | - NodePoolLauncher: OK 2026-06-11 20:13:05.671686 | controller | - Zookeeper: OK 2026-06-11 20:13:05.671694 | controller | - Zuul: Waiting ... 2026-06-11 20:13:05.671702 | controller | - |_ Config Secrets: OK 2026-06-11 20:13:05.671710 | controller | - |_ Executor: OK 2026-06-11 20:13:05.671718 | controller | - |_ Merger: OK 2026-06-11 20:13:05.671736 | controller | - |_ Scheduler: OK 2026-06-11 20:13:05.671744 | controller | - |_ Web: Waiting ... 2026-06-11 20:13:05.671752 | controller | 2026-06-11 20:13:05.671771 | controller | 2026-06-11T20:13:05-04:00 INFO [attempt #10] Waiting 5s for the next reconcile call ... 2026-06-11 20:13:10.679747 | controller | 2026-06-11T20:13:10-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:13:11.301057 | controller | 2026-06-11T20:13:11-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:13:11.301171 | controller | 2026-06-11T20:13:11-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:13:11.324632 | controller | 2026-06-11T20:13:11-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:13:11.324729 | controller | 2026-06-11T20:13:11-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:13:11.686522 | controller | 2026-06-11T20:13:11-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:13:12.088200 | controller | 2026-06-11T20:13:12-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:13:12.088285 | controller | 2026-06-11T20:13:12-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:13:13.101032 | controller | 2026-06-11T20:13:13-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:13:13.101110 | controller | 2026-06-11T20:13:13-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:13:14.083343 | controller | 2026-06-11T20:13:14-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:13:14.083498 | controller | 2026-06-11T20:13:14-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:13:14.890716 | controller | 2026-06-11T20:13:14-04:00 INFO 2026-06-11 20:13:14.890778 | controller | - Config: Waiting ... 2026-06-11 20:13:14.890785 | controller | - Gateway: OK 2026-06-11 20:13:14.890803 | controller | - GitServer: OK 2026-06-11 20:13:14.890809 | controller | - HoundSearch: OK 2026-06-11 20:13:14.890813 | controller | - LogJuicer: OK 2026-06-11 20:13:14.890818 | controller | - Logserver: OK 2026-06-11 20:13:14.890823 | controller | - MariaDB: OK 2026-06-11 20:13:14.890828 | controller | - NodePoolBuilder: OK 2026-06-11 20:13:14.890832 | controller | - NodePoolLauncher: OK 2026-06-11 20:13:14.890837 | controller | - Zookeeper: OK 2026-06-11 20:13:14.890842 | controller | - Zuul: Waiting ... 2026-06-11 20:13:14.890847 | controller | - |_ Config Secrets: OK 2026-06-11 20:13:14.890852 | controller | - |_ Executor: OK 2026-06-11 20:13:14.890856 | controller | - |_ Merger: OK 2026-06-11 20:13:14.890861 | controller | - |_ Scheduler: OK 2026-06-11 20:13:14.890866 | controller | - |_ Web: Waiting ... 2026-06-11 20:13:14.890871 | controller | 2026-06-11 20:13:14.890908 | controller | 2026-06-11T20:13:14-04:00 INFO [attempt #11] Waiting 5s for the next reconcile call ... 2026-06-11 20:13:19.900236 | controller | 2026-06-11T20:13:19-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:13:20.513927 | controller | 2026-06-11T20:13:20-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:13:20.514010 | controller | 2026-06-11T20:13:20-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:13:20.529945 | controller | 2026-06-11T20:13:20-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:13:20.529994 | controller | 2026-06-11T20:13:20-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:13:20.913459 | controller | 2026-06-11T20:13:20-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:13:21.312852 | controller | 2026-06-11T20:13:21-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:13:21.312951 | controller | 2026-06-11T20:13:21-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:13:22.339524 | controller | 2026-06-11T20:13:22-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:13:22.339646 | controller | 2026-06-11T20:13:22-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:13:23.304973 | controller | 2026-06-11T20:13:23-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:13:23.305050 | controller | 2026-06-11T20:13:23-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:13:24.114685 | controller | 2026-06-11T20:13:24-04:00 INFO 2026-06-11 20:13:24.114762 | controller | - Config: Waiting ... 2026-06-11 20:13:24.114773 | controller | - Gateway: OK 2026-06-11 20:13:24.114782 | controller | - GitServer: OK 2026-06-11 20:13:24.114790 | controller | - HoundSearch: OK 2026-06-11 20:13:24.114798 | controller | - LogJuicer: OK 2026-06-11 20:13:24.114806 | controller | - Logserver: OK 2026-06-11 20:13:24.114816 | controller | - MariaDB: OK 2026-06-11 20:13:24.114824 | controller | - NodePoolBuilder: OK 2026-06-11 20:13:24.114832 | controller | - NodePoolLauncher: OK 2026-06-11 20:13:24.114840 | controller | - Zookeeper: OK 2026-06-11 20:13:24.114848 | controller | - Zuul: Waiting ... 2026-06-11 20:13:24.114855 | controller | - |_ Config Secrets: OK 2026-06-11 20:13:24.114863 | controller | - |_ Executor: OK 2026-06-11 20:13:24.114871 | controller | - |_ Merger: OK 2026-06-11 20:13:24.114879 | controller | - |_ Scheduler: OK 2026-06-11 20:13:24.114887 | controller | - |_ Web: Waiting ... 2026-06-11 20:13:24.114895 | controller | 2026-06-11 20:13:24.114939 | controller | 2026-06-11T20:13:24-04:00 INFO [attempt #12] Waiting 5s for the next reconcile call ... 2026-06-11 20:13:29.123204 | controller | 2026-06-11T20:13:29-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:13:29.744862 | controller | 2026-06-11T20:13:29-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:13:29.744965 | controller | 2026-06-11T20:13:29-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:13:29.767353 | controller | 2026-06-11T20:13:29-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:13:29.767464 | controller | 2026-06-11T20:13:29-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:13:30.136866 | controller | 2026-06-11T20:13:30-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:13:30.542145 | controller | 2026-06-11T20:13:30-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:13:30.542246 | controller | 2026-06-11T20:13:30-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:13:31.558105 | controller | 2026-06-11T20:13:31-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:13:31.558218 | controller | 2026-06-11T20:13:31-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:13:32.527220 | controller | 2026-06-11T20:13:32-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:13:32.527297 | controller | 2026-06-11T20:13:32-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:13:33.340743 | controller | 2026-06-11T20:13:33-04:00 INFO 2026-06-11 20:13:33.340813 | controller | - Config: Waiting ... 2026-06-11 20:13:33.340826 | controller | - Gateway: OK 2026-06-11 20:13:33.340834 | controller | - GitServer: OK 2026-06-11 20:13:33.340842 | controller | - HoundSearch: OK 2026-06-11 20:13:33.340850 | controller | - LogJuicer: OK 2026-06-11 20:13:33.340858 | controller | - Logserver: OK 2026-06-11 20:13:33.340865 | controller | - MariaDB: OK 2026-06-11 20:13:33.340873 | controller | - NodePoolBuilder: OK 2026-06-11 20:13:33.340881 | controller | - NodePoolLauncher: OK 2026-06-11 20:13:33.340888 | controller | - Zookeeper: OK 2026-06-11 20:13:33.340896 | controller | - Zuul: Waiting ... 2026-06-11 20:13:33.340904 | controller | - |_ Config Secrets: OK 2026-06-11 20:13:33.340912 | controller | - |_ Executor: OK 2026-06-11 20:13:33.340919 | controller | - |_ Merger: OK 2026-06-11 20:13:33.340927 | controller | - |_ Scheduler: OK 2026-06-11 20:13:33.340935 | controller | - |_ Web: Waiting ... 2026-06-11 20:13:33.340943 | controller | 2026-06-11 20:13:33.340951 | controller | 2026-06-11T20:13:33-04:00 INFO [attempt #13] Waiting 5s for the next reconcile call ... 2026-06-11 20:13:38.346329 | controller | 2026-06-11T20:13:38-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:13:38.966691 | controller | 2026-06-11T20:13:38-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:13:38.966823 | controller | 2026-06-11T20:13:38-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:13:38.986754 | controller | 2026-06-11T20:13:38-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:13:38.986846 | controller | 2026-06-11T20:13:38-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:13:39.361458 | controller | 2026-06-11T20:13:39-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:13:39.764343 | controller | 2026-06-11T20:13:39-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:13:39.764447 | controller | 2026-06-11T20:13:39-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:13:40.768266 | controller | 2026-06-11T20:13:40-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:13:40.768332 | controller | 2026-06-11T20:13:40-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:13:41.751136 | controller | 2026-06-11T20:13:41-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:13:41.751214 | controller | 2026-06-11T20:13:41-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:13:42.559587 | controller | 2026-06-11T20:13:42-04:00 INFO 2026-06-11 20:13:42.559663 | controller | - Config: Waiting ... 2026-06-11 20:13:42.559674 | controller | - Gateway: OK 2026-06-11 20:13:42.559683 | controller | - GitServer: OK 2026-06-11 20:13:42.559691 | controller | - HoundSearch: OK 2026-06-11 20:13:42.559699 | controller | - LogJuicer: OK 2026-06-11 20:13:42.559707 | controller | - Logserver: OK 2026-06-11 20:13:42.559715 | controller | - MariaDB: OK 2026-06-11 20:13:42.559723 | controller | - NodePoolBuilder: OK 2026-06-11 20:13:42.559730 | controller | - NodePoolLauncher: OK 2026-06-11 20:13:42.559738 | controller | - Zookeeper: OK 2026-06-11 20:13:42.559747 | controller | - Zuul: Waiting ... 2026-06-11 20:13:42.559754 | controller | - |_ Config Secrets: OK 2026-06-11 20:13:42.559765 | controller | - |_ Executor: OK 2026-06-11 20:13:42.559836 | controller | - |_ Merger: OK 2026-06-11 20:13:42.559853 | controller | - |_ Scheduler: OK 2026-06-11 20:13:42.559865 | controller | - |_ Web: Waiting ... 2026-06-11 20:13:42.559877 | controller | 2026-06-11 20:13:42.559931 | controller | 2026-06-11T20:13:42-04:00 INFO [attempt #14] Waiting 5s for the next reconcile call ... 2026-06-11 20:13:47.570311 | controller | 2026-06-11T20:13:47-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:13:48.186220 | controller | 2026-06-11T20:13:48-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:13:48.186304 | controller | 2026-06-11T20:13:48-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:13:48.206247 | controller | 2026-06-11T20:13:48-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:13:48.206298 | controller | 2026-06-11T20:13:48-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:13:48.589588 | controller | 2026-06-11T20:13:48-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:13:48.985942 | controller | 2026-06-11T20:13:48-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:13:48.986034 | controller | 2026-06-11T20:13:48-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:13:49.997796 | controller | 2026-06-11T20:13:49-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:13:49.997878 | controller | 2026-06-11T20:13:49-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:13:50.974537 | controller | 2026-06-11T20:13:50-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:13:50.974648 | controller | 2026-06-11T20:13:50-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:13:51.781966 | controller | 2026-06-11T20:13:51-04:00 INFO 2026-06-11 20:13:51.782058 | controller | - Config: Waiting ... 2026-06-11 20:13:51.782073 | controller | - Gateway: OK 2026-06-11 20:13:51.782085 | controller | - GitServer: OK 2026-06-11 20:13:51.782096 | controller | - HoundSearch: OK 2026-06-11 20:13:51.782104 | controller | - LogJuicer: OK 2026-06-11 20:13:51.782113 | controller | - Logserver: OK 2026-06-11 20:13:51.782121 | controller | - MariaDB: OK 2026-06-11 20:13:51.782130 | controller | - NodePoolBuilder: OK 2026-06-11 20:13:51.782138 | controller | - NodePoolLauncher: OK 2026-06-11 20:13:51.782147 | controller | - Zookeeper: OK 2026-06-11 20:13:51.782155 | controller | - Zuul: Waiting ... 2026-06-11 20:13:51.782164 | controller | - |_ Config Secrets: OK 2026-06-11 20:13:51.782172 | controller | - |_ Executor: OK 2026-06-11 20:13:51.782180 | controller | - |_ Merger: OK 2026-06-11 20:13:51.782189 | controller | - |_ Scheduler: OK 2026-06-11 20:13:51.782197 | controller | - |_ Web: Waiting ... 2026-06-11 20:13:51.782206 | controller | 2026-06-11 20:13:51.782215 | controller | 2026-06-11T20:13:51-04:00 INFO [attempt #15] Waiting 5s for the next reconcile call ... 2026-06-11 20:13:56.792752 | controller | 2026-06-11T20:13:56-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:13:57.405765 | controller | 2026-06-11T20:13:57-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:13:57.405835 | controller | 2026-06-11T20:13:57-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:13:57.422803 | controller | 2026-06-11T20:13:57-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:13:57.422857 | controller | 2026-06-11T20:13:57-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:13:57.807148 | controller | 2026-06-11T20:13:57-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:13:58.207786 | controller | 2026-06-11T20:13:58-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:13:58.207885 | controller | 2026-06-11T20:13:58-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:13:59.219578 | controller | 2026-06-11T20:13:59-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:13:59.219682 | controller | 2026-06-11T20:13:59-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:14:00.196197 | controller | 2026-06-11T20:14:00-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:14:00.196289 | controller | 2026-06-11T20:14:00-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:14:01.005266 | controller | 2026-06-11T20:14:01-04:00 INFO 2026-06-11 20:14:01.005341 | controller | - Config: Waiting ... 2026-06-11 20:14:01.005352 | controller | - Gateway: OK 2026-06-11 20:14:01.005361 | controller | - GitServer: OK 2026-06-11 20:14:01.005413 | controller | - HoundSearch: OK 2026-06-11 20:14:01.005422 | controller | - LogJuicer: OK 2026-06-11 20:14:01.005430 | controller | - Logserver: OK 2026-06-11 20:14:01.005438 | controller | - MariaDB: OK 2026-06-11 20:14:01.005446 | controller | - NodePoolBuilder: OK 2026-06-11 20:14:01.005454 | controller | - NodePoolLauncher: OK 2026-06-11 20:14:01.005461 | controller | - Zookeeper: OK 2026-06-11 20:14:01.005469 | controller | - Zuul: Waiting ... 2026-06-11 20:14:01.005477 | controller | - |_ Config Secrets: OK 2026-06-11 20:14:01.005485 | controller | - |_ Executor: OK 2026-06-11 20:14:01.005493 | controller | - |_ Merger: OK 2026-06-11 20:14:01.005501 | controller | - |_ Scheduler: OK 2026-06-11 20:14:01.005509 | controller | - |_ Web: Waiting ... 2026-06-11 20:14:01.005517 | controller | 2026-06-11 20:14:01.005525 | controller | 2026-06-11T20:14:01-04:00 INFO [attempt #16] Waiting 5s for the next reconcile call ... 2026-06-11 20:14:06.011222 | controller | 2026-06-11T20:14:06-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:14:06.629357 | controller | 2026-06-11T20:14:06-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:14:06.629492 | controller | 2026-06-11T20:14:06-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:14:06.650230 | controller | 2026-06-11T20:14:06-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:14:06.650317 | controller | 2026-06-11T20:14:06-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:14:07.027627 | controller | 2026-06-11T20:14:07-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:14:07.420573 | controller | 2026-06-11T20:14:07-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:14:07.420672 | controller | 2026-06-11T20:14:07-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:14:08.443271 | controller | 2026-06-11T20:14:08-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:14:08.443406 | controller | 2026-06-11T20:14:08-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:14:09.415564 | controller | 2026-06-11T20:14:09-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:14:09.415665 | controller | 2026-06-11T20:14:09-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:14:10.624346 | controller | 2026-06-11T20:14:10-04:00 INFO 2026-06-11 20:14:10.624475 | controller | - Config: OK 2026-06-11 20:14:10.624485 | controller | - Gateway: OK 2026-06-11 20:14:10.624494 | controller | - GitServer: OK 2026-06-11 20:14:10.624502 | controller | - HoundSearch: OK 2026-06-11 20:14:10.624510 | controller | - LogJuicer: OK 2026-06-11 20:14:10.624518 | controller | - Logserver: OK 2026-06-11 20:14:10.624525 | controller | - MariaDB: OK 2026-06-11 20:14:10.624533 | controller | - NodePoolBuilder: OK 2026-06-11 20:14:10.624541 | controller | - NodePoolLauncher: OK 2026-06-11 20:14:10.624549 | controller | - Zookeeper: OK 2026-06-11 20:14:10.624557 | controller | - Zuul: OK 2026-06-11 20:14:10.624565 | controller | 2026-06-11 20:14:10.624583 | controller | 2026-06-11T20:14:10-04:00 INFO Updating controller configmap ... 2026-06-11 20:14:11.014008 | controller | 2026-06-11T20:14:11-04:00 INFO Standalone reconcile done. 2026-06-12 00:14:11.073604 | controller | ok: Runtime: 0:09:16.701205 2026-06-12 00:14:11.086570 | 2026-06-12 00:14:11.086765 | PLAY RECAP 2026-06-12 00:14:11.086856 | controller | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-06-12 00:14:11.086899 | 2026-06-12 00:14:11.336770 | RUN END RESULT_NORMAL: [untrusted : softwarefactory-project.io/software-factory/sf-operator/playbooks/run-deploy.yaml@master] 2026-06-12 00:14:11.338609 | RUN START: [untrusted : softwarefactory-project.io/software-factory/sf-operator/playbooks/run-tests.yaml@master] 2026-06-12 00:14:12.193100 | 2026-06-12 00:14:12.193583 | PLAY [controller] 2026-06-12 00:14:12.237679 | 2026-06-12 00:14:12.237953 | TASK [Install test dependencies] 2026-06-12 00:14:13.357870 | controller | ok: Nothing to do 2026-06-12 00:14:13.364485 | 2026-06-12 00:14:13.364598 | TASK [setup-variables : Include global variables] 2026-06-12 00:14:13.415409 | controller | skipping: Conditional result was False 2026-06-12 00:14:13.421075 | 2026-06-12 00:14:13.421215 | TASK [setup-variables : Include zuul variables if zuul.executor is defined] 2026-06-12 00:14:13.451357 | controller | ok 2026-06-12 00:14:13.461144 | 2026-06-12 00:14:13.461277 | TASK [setup-nodepool-ns : Set up nodepool namespace] 2026-06-11 20:14:14.207085 | controller | 2026-06-11T20:14:14-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:14:14.207893 | controller | 2026-06-11 20:14:14.216321 | controller | 2026-06-11T20:14:14-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:14:14.216360 | controller | 2026-06-11 20:14:14.218599 | controller | 2026-06-11T20:14:14-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:14:14.218636 | controller | 2026-06-11 20:14:14.221811 | controller | 2026-06-11T20:14:14-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:14:14.221848 | controller | 2026-06-11 20:14:14.226056 | controller | 2026-06-11T20:14:14-04:00 INFO Creating "nodepool" in nodepool 2026-06-11 20:14:14.231512 | controller | 2026-06-11T20:14:14-04:00 INFO "nodepool" created 2026-06-11 20:14:14.232992 | controller | 2026-06-11T20:14:14-04:00 INFO Creating "nodepool-sa" in nodepool 2026-06-11 20:14:14.235805 | controller | 2026-06-11T20:14:14-04:00 INFO "nodepool-sa" created 2026-06-11 20:14:14.239757 | controller | 2026-06-11T20:14:14-04:00 INFO Creating "nodepool-role" in nodepool 2026-06-11 20:14:14.243019 | controller | 2026-06-11T20:14:14-04:00 INFO "nodepool-role" created 2026-06-11 20:14:14.244980 | controller | 2026-06-11T20:14:14-04:00 INFO Creating "nodepool-rb" in nodepool 2026-06-11 20:14:14.247552 | controller | 2026-06-11T20:14:14-04:00 INFO "nodepool-rb" created 2026-06-11 20:14:14.249858 | controller | 2026-06-11T20:14:14-04:00 INFO Creating "nodepool-token" in nodepool 2026-06-11 20:14:14.252205 | controller | 2026-06-11T20:14:14-04:00 INFO "nodepool-token" created 2026-06-11 20:14:15.258993 | controller | 2026-06-11T20:14:15-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:14:15.259085 | controller | 2026-06-11 20:14:15.263011 | controller | 2026-06-11T20:14:15-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:14:15.263049 | controller | 2026-06-11 20:14:15.267353 | controller | 2026-06-11T20:14:15-04:00 INFO Creating "nodepool-providers-secrets" in sf 2026-06-11 20:14:15.270000 | controller | 2026-06-11T20:14:15-04:00 INFO "nodepool-providers-secrets" created 2026-06-12 00:14:15.493847 | controller | ok: Runtime: 0:00:01.392462 2026-06-12 00:14:15.513323 | 2026-06-12 00:14:15.513634 | TASK [utils/get-gerrit-admin-user-api-key : Get Gerrit admin user API key] 2026-06-12 00:14:16.054639 | controller | ok: Runtime: 0:00:00.100737 2026-06-12 00:14:16.060955 | 2026-06-12 00:14:16.061120 | TASK [utils/get-gerrit-admin-user-api-key : Set fact for _gerrit_admin_api_key] 2026-06-12 00:14:16.095280 | controller | ok 2026-06-12 00:14:16.108462 | 2026-06-12 00:14:16.108621 | LOOP [utils/config-repo-reset : Config repo, reset] 2026-06-12 00:14:16.608843 | controller | Fetching origin 2026-06-12 00:14:16.609274 | controller | Fetching gerrit 2026-06-12 00:14:16.609334 | controller | From https://gerrit.sfop.me/a/config 2026-06-12 00:14:16.609380 | controller | * [new branch] master -> gerrit/master 2026-06-12 00:14:16.609495 | controller | ok: Item: git fetch --all Runtime: 0:00:00.166309 2026-06-12 00:14:16.843795 | controller | Already on 'master' 2026-06-12 00:14:16.843911 | controller | Your branch is up to date with 'origin/master'. 2026-06-12 00:14:16.843951 | controller | ok: Item: git checkout master Runtime: 0:00:00.007552 2026-06-12 00:14:17.002564 | controller | HEAD is now at f76c04a Automatic update 2026-06-12 00:14:17.002685 | controller | ok: Item: git reset --hard origin/master -- Runtime: 0:00:00.008064 2026-06-12 00:14:17.197035 | controller | ok: Item: git clean -f -d Runtime: 0:00:00.006284 2026-06-12 00:14:17.226955 | 2026-06-12 00:14:17.227159 | TASK [utils/setup-log-forwarding-stack : Deploy Loki via included role] 2026-06-12 00:14:17.249872 | controller | ok 2026-06-12 00:14:17.257557 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/utils/setup-log-forwarding-stack/tasks/deploy-loki.yaml 2026-06-12 00:14:17.263041 | 2026-06-12 00:14:17.263118 | TASK [utils/setup-log-forwarding-stack : Deploy Loki] 2026-06-11 20:14:17.773336 | controller | configmap/loki-config created 2026-06-11 20:14:17.780773 | controller | deployment.apps/test-loki created 2026-06-11 20:14:17.790308 | controller | service/loki-http created 2026-06-12 00:14:18.341243 | controller | ok: Runtime: 0:00:00.277426 2026-06-12 00:14:18.347831 | 2026-06-12 00:14:18.347933 | TASK [utils/setup-log-forwarding-stack : Wait for Loki deployment to be ready] 2026-06-12 00:14:29.032662 | controller | ok: Runtime: 0:00:00.054360 2026-06-12 00:14:29.039169 | 2026-06-12 00:14:29.039262 | TASK [utils/setup-log-forwarding-stack : Deploy Fluent Bit via included role] 2026-06-12 00:14:29.071096 | controller | ok 2026-06-12 00:14:29.077312 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/utils/setup-log-forwarding-stack/tasks/deploy-fluentbit.yaml 2026-06-12 00:14:29.083876 | 2026-06-12 00:14:29.083958 | TASK [utils/setup-log-forwarding-stack : Deploy Fluent Bit] 2026-06-11 20:14:29.569839 | controller | configmap/test-fluentbit-config created 2026-06-11 20:14:29.576201 | controller | pod/test-fluentbit created 2026-06-11 20:14:29.590590 | controller | service/fluent-bit-forward-input created 2026-06-12 00:14:29.748028 | controller | ok: Runtime: 0:00:00.281888 2026-06-12 00:14:29.757938 | 2026-06-12 00:14:29.758093 | TASK [utils/setup-log-forwarding-stack : Wait for Fluent Bit pod to be ready] 2026-06-12 00:14:40.531572 | controller | ok: Runtime: 0:00:00.108432 2026-06-12 00:14:40.539754 | 2026-06-12 00:14:40.539915 | TASK [utils/setup-log-forwarding-stack : Install LogCLI] 2026-06-12 00:14:40.563237 | controller | ok 2026-06-12 00:14:40.573547 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/utils/setup-log-forwarding-stack/tasks/install-logCLI.yaml 2026-06-12 00:14:40.582906 | 2026-06-12 00:14:40.583055 | TASK [utils/setup-log-forwarding-stack : check if logCLI is present] 2026-06-12 00:14:41.008608 | controller | ok 2026-06-12 00:14:41.013378 | 2026-06-12 00:14:41.013466 | TASK [utils/setup-log-forwarding-stack : download and unzip logCLI] 2026-06-12 00:14:42.928340 | controller | changed 2026-06-12 00:14:42.939776 | 2026-06-12 00:14:42.939950 | TASK [utils/setup-log-forwarding-stack : ensure ~/bin exists] 2026-06-12 00:14:43.425864 | controller | changed 2026-06-12 00:14:43.431749 | 2026-06-12 00:14:43.431834 | TASK [utils/setup-log-forwarding-stack : move logCLI to ~/bin/] 2026-06-12 00:14:43.970908 | controller | ok: Runtime: 0:00:00.005603 2026-06-12 00:14:43.988856 | 2026-06-12 00:14:43.989074 | TASK [run-operator-standalone : Ensure ~/zuul-output/logs] 2026-06-12 00:14:44.256126 | controller | ok 2026-06-12 00:14:44.260504 | 2026-06-12 00:14:44.260573 | TASK [run-operator-standalone : Clear previous log file] 2026-06-12 00:14:44.530549 | controller | ok 2026-06-12 00:14:44.539649 | 2026-06-12 00:14:44.539805 | TASK [run-operator-standalone : Run the operator in standalone mode] 2026-06-11 20:14:45.215478 | controller | 2026-06-11T20:14:45-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:14:45.215566 | controller | 2026-06-11 20:14:45.226891 | controller | 2026-06-11T20:14:45-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:14:45.226935 | controller | 2026-06-11 20:14:45.237944 | controller | 2026-06-11T20:14:45-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:14:45.854163 | controller | 2026-06-11T20:14:45-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:14:46.044737 | controller | 2026-06-11T20:14:46-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:14:46.053600 | controller | 2026-06-11T20:14:46-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:14:46.053670 | controller | 2026-06-11T20:14:46-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:14:46.074579 | controller | 2026-06-11T20:14:46-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:14:46.074649 | controller | 2026-06-11T20:14:46-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:14:46.251223 | controller | 2026-06-11T20:14:46-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:14:46.650995 | controller | 2026-06-11T20:14:46-04:00 INFO Creating object, name: zuul-capacity 2026-06-11 20:14:46.662680 | controller | 2026-06-11T20:14:46-04:00 INFO Statefulset "nodepool-launcher" configuration changed, applying... 2026-06-11 20:14:46.662746 | controller | 2026-06-11T20:14:46-04:00 INFO Updating object, name: nodepool-launcher 2026-06-11 20:14:46.857696 | controller | 2026-06-11T20:14:46-04:00 INFO Statefulset "nodepool-builder" configuration changed, applying... 2026-06-11 20:14:46.857790 | controller | 2026-06-11T20:14:46-04:00 INFO Updating object, name: nodepool-builder 2026-06-11 20:14:47.677715 | controller | 2026-06-11T20:14:47-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:14:47.677790 | controller | 2026-06-11T20:14:47-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:14:48.839427 | controller | 2026-06-11T20:14:48-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:14:48.839541 | controller | 2026-06-11T20:14:48-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:14:50.051220 | controller | 2026-06-11T20:14:50-04:00 INFO 2026-06-11 20:14:50.051309 | controller | - Config: OK 2026-06-11 20:14:50.051324 | controller | - Gateway: OK 2026-06-11 20:14:50.051336 | controller | - GitServer: OK 2026-06-11 20:14:50.051347 | controller | - HoundSearch: OK 2026-06-11 20:14:50.051359 | controller | - LogJuicer: OK 2026-06-11 20:14:50.051418 | controller | - Logserver: OK 2026-06-11 20:14:50.051427 | controller | - MariaDB: OK 2026-06-11 20:14:50.051435 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:14:50.051443 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:14:50.051452 | controller | - Zookeeper: OK 2026-06-11 20:14:50.051460 | controller | - Zuul: OK 2026-06-11 20:14:50.051468 | controller | 2026-06-11 20:14:50.051476 | controller | 2026-06-11T20:14:50-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-11 20:14:55.057709 | controller | 2026-06-11T20:14:55-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:14:55.678078 | controller | 2026-06-11T20:14:55-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:14:55.678153 | controller | 2026-06-11T20:14:55-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:14:55.702541 | controller | 2026-06-11T20:14:55-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:14:55.702618 | controller | 2026-06-11T20:14:55-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:14:56.075314 | controller | 2026-06-11T20:14:56-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:14:56.479212 | controller | 2026-06-11T20:14:56-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:14:56.479321 | controller | 2026-06-11T20:14:56-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:14:57.489214 | controller | 2026-06-11T20:14:57-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:14:57.489283 | controller | 2026-06-11T20:14:57-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:14:58.461425 | controller | 2026-06-11T20:14:58-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:14:58.461523 | controller | 2026-06-11T20:14:58-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:14:59.673564 | controller | 2026-06-11T20:14:59-04:00 INFO 2026-06-11 20:14:59.673662 | controller | - Config: OK 2026-06-11 20:14:59.673668 | controller | - Gateway: OK 2026-06-11 20:14:59.673673 | controller | - GitServer: OK 2026-06-11 20:14:59.673676 | controller | - HoundSearch: OK 2026-06-11 20:14:59.673680 | controller | - LogJuicer: OK 2026-06-11 20:14:59.673684 | controller | - Logserver: OK 2026-06-11 20:14:59.673687 | controller | - MariaDB: OK 2026-06-11 20:14:59.673693 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:14:59.673697 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:14:59.673701 | controller | - Zookeeper: OK 2026-06-11 20:14:59.673705 | controller | - Zuul: OK 2026-06-11 20:14:59.673708 | controller | 2026-06-11 20:14:59.673722 | controller | 2026-06-11T20:14:59-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-11 20:15:04.684320 | controller | 2026-06-11T20:15:04-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:15:05.306920 | controller | 2026-06-11T20:15:05-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:15:05.307044 | controller | 2026-06-11T20:15:05-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:15:05.326759 | controller | 2026-06-11T20:15:05-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:15:05.326804 | controller | 2026-06-11T20:15:05-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:15:05.699091 | controller | 2026-06-11T20:15:05-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:15:06.093843 | controller | 2026-06-11T20:15:06-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:15:06.093946 | controller | 2026-06-11T20:15:06-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:15:07.120400 | controller | 2026-06-11T20:15:07-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:15:07.120496 | controller | 2026-06-11T20:15:07-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:15:08.088415 | controller | 2026-06-11T20:15:08-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:15:08.088480 | controller | 2026-06-11T20:15:08-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:15:09.297681 | controller | 2026-06-11T20:15:09-04:00 INFO 2026-06-11 20:15:09.297771 | controller | - Config: OK 2026-06-11 20:15:09.297783 | controller | - Gateway: OK 2026-06-11 20:15:09.297793 | controller | - GitServer: OK 2026-06-11 20:15:09.297801 | controller | - HoundSearch: OK 2026-06-11 20:15:09.297810 | controller | - LogJuicer: OK 2026-06-11 20:15:09.297819 | controller | - Logserver: OK 2026-06-11 20:15:09.297827 | controller | - MariaDB: OK 2026-06-11 20:15:09.297836 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:15:09.297845 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:15:09.297853 | controller | - Zookeeper: OK 2026-06-11 20:15:09.297862 | controller | - Zuul: OK 2026-06-11 20:15:09.297871 | controller | 2026-06-11 20:15:09.297882 | controller | 2026-06-11T20:15:09-04:00 INFO [attempt #3] Waiting 5s for the next reconcile call ... 2026-06-11 20:15:14.305034 | controller | 2026-06-11T20:15:14-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:15:14.927872 | controller | 2026-06-11T20:15:14-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:15:14.927916 | controller | 2026-06-11T20:15:14-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:15:14.950777 | controller | 2026-06-11T20:15:14-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:15:14.950871 | controller | 2026-06-11T20:15:14-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:15:15.323696 | controller | 2026-06-11T20:15:15-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:15:15.725058 | controller | 2026-06-11T20:15:15-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:15:15.725158 | controller | 2026-06-11T20:15:15-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:15:16.740469 | controller | 2026-06-11T20:15:16-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:15:16.740516 | controller | 2026-06-11T20:15:16-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:15:17.710001 | controller | 2026-06-11T20:15:17-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:15:17.710092 | controller | 2026-06-11T20:15:17-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:15:18.919626 | controller | 2026-06-11T20:15:18-04:00 INFO 2026-06-11 20:15:18.919699 | controller | - Config: OK 2026-06-11 20:15:18.919712 | controller | - Gateway: OK 2026-06-11 20:15:18.919716 | controller | - GitServer: OK 2026-06-11 20:15:18.919720 | controller | - HoundSearch: OK 2026-06-11 20:15:18.919723 | controller | - LogJuicer: OK 2026-06-11 20:15:18.919727 | controller | - Logserver: OK 2026-06-11 20:15:18.919730 | controller | - MariaDB: OK 2026-06-11 20:15:18.919734 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:15:18.919737 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:15:18.919741 | controller | - Zookeeper: OK 2026-06-11 20:15:18.919745 | controller | - Zuul: OK 2026-06-11 20:15:18.919748 | controller | 2026-06-11 20:15:18.919754 | controller | 2026-06-11T20:15:18-04:00 INFO [attempt #4] Waiting 5s for the next reconcile call ... 2026-06-11 20:15:23.925799 | controller | 2026-06-11T20:15:23-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:15:24.535678 | controller | 2026-06-11T20:15:24-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:15:24.536201 | controller | 2026-06-11T20:15:24-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:15:24.550345 | controller | 2026-06-11T20:15:24-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:15:24.550401 | controller | 2026-06-11T20:15:24-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:15:24.941683 | controller | 2026-06-11T20:15:24-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:15:25.343892 | controller | 2026-06-11T20:15:25-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:15:25.344002 | controller | 2026-06-11T20:15:25-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:15:26.365317 | controller | 2026-06-11T20:15:26-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:15:26.365441 | controller | 2026-06-11T20:15:26-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:15:27.329848 | controller | 2026-06-11T20:15:27-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:15:27.329916 | controller | 2026-06-11T20:15:27-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:15:28.538859 | controller | 2026-06-11T20:15:28-04:00 INFO 2026-06-11 20:15:28.538950 | controller | - Config: OK 2026-06-11 20:15:28.538961 | controller | - Gateway: OK 2026-06-11 20:15:28.538970 | controller | - GitServer: OK 2026-06-11 20:15:28.538978 | controller | - HoundSearch: OK 2026-06-11 20:15:28.538986 | controller | - LogJuicer: OK 2026-06-11 20:15:28.538994 | controller | - Logserver: OK 2026-06-11 20:15:28.539002 | controller | - MariaDB: OK 2026-06-11 20:15:28.539010 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:15:28.539018 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:15:28.539026 | controller | - Zookeeper: OK 2026-06-11 20:15:28.539034 | controller | - Zuul: OK 2026-06-11 20:15:28.539042 | controller | 2026-06-11 20:15:28.539050 | controller | 2026-06-11T20:15:28-04:00 INFO [attempt #5] Waiting 5s for the next reconcile call ... 2026-06-11 20:15:33.549070 | controller | 2026-06-11T20:15:33-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:15:34.167071 | controller | 2026-06-11T20:15:34-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:15:34.167139 | controller | 2026-06-11T20:15:34-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:15:34.190509 | controller | 2026-06-11T20:15:34-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:15:34.190565 | controller | 2026-06-11T20:15:34-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:15:34.564461 | controller | 2026-06-11T20:15:34-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:15:34.961660 | controller | 2026-06-11T20:15:34-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:15:34.961713 | controller | 2026-06-11T20:15:34-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:15:35.981342 | controller | 2026-06-11T20:15:35-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:15:35.981436 | controller | 2026-06-11T20:15:35-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:15:36.954033 | controller | 2026-06-11T20:15:36-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:15:36.954095 | controller | 2026-06-11T20:15:36-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:15:38.161861 | controller | 2026-06-11T20:15:38-04:00 INFO 2026-06-11 20:15:38.161943 | controller | - Config: OK 2026-06-11 20:15:38.161955 | controller | - Gateway: OK 2026-06-11 20:15:38.161964 | controller | - GitServer: OK 2026-06-11 20:15:38.161986 | controller | - HoundSearch: OK 2026-06-11 20:15:38.161994 | controller | - LogJuicer: OK 2026-06-11 20:15:38.162002 | controller | - Logserver: OK 2026-06-11 20:15:38.162010 | controller | - MariaDB: OK 2026-06-11 20:15:38.162018 | controller | - NodePoolBuilder: OK 2026-06-11 20:15:38.162026 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:15:38.162034 | controller | - Zookeeper: OK 2026-06-11 20:15:38.162042 | controller | - Zuul: OK 2026-06-11 20:15:38.162050 | controller | 2026-06-11 20:15:38.162058 | controller | 2026-06-11T20:15:38-04:00 INFO [attempt #6] Waiting 5s for the next reconcile call ... 2026-06-11 20:15:43.168870 | controller | 2026-06-11T20:15:43-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:15:43.789179 | controller | 2026-06-11T20:15:43-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:15:43.789324 | controller | 2026-06-11T20:15:43-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:15:43.815885 | controller | 2026-06-11T20:15:43-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:15:43.815971 | controller | 2026-06-11T20:15:43-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:15:44.182849 | controller | 2026-06-11T20:15:44-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:15:44.588585 | controller | 2026-06-11T20:15:44-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:15:44.588701 | controller | 2026-06-11T20:15:44-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:15:45.602881 | controller | 2026-06-11T20:15:45-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:15:45.602980 | controller | 2026-06-11T20:15:45-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:15:46.574019 | controller | 2026-06-11T20:15:46-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:15:46.574122 | controller | 2026-06-11T20:15:46-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:15:47.781834 | controller | 2026-06-11T20:15:47-04:00 INFO 2026-06-11 20:15:47.781901 | controller | - Config: OK 2026-06-11 20:15:47.781913 | controller | - Gateway: OK 2026-06-11 20:15:47.781921 | controller | - GitServer: OK 2026-06-11 20:15:47.781929 | controller | - HoundSearch: OK 2026-06-11 20:15:47.781937 | controller | - LogJuicer: OK 2026-06-11 20:15:47.781945 | controller | - Logserver: OK 2026-06-11 20:15:47.781953 | controller | - MariaDB: OK 2026-06-11 20:15:47.781961 | controller | - NodePoolBuilder: OK 2026-06-11 20:15:47.781999 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:15:47.782007 | controller | - Zookeeper: OK 2026-06-11 20:15:47.782015 | controller | - Zuul: OK 2026-06-11 20:15:47.782024 | controller | 2026-06-11 20:15:47.782039 | controller | 2026-06-11T20:15:47-04:00 INFO [attempt #7] Waiting 5s for the next reconcile call ... 2026-06-11 20:15:52.789231 | controller | 2026-06-11T20:15:52-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:15:53.411084 | controller | 2026-06-11T20:15:53-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:15:53.411163 | controller | 2026-06-11T20:15:53-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:15:53.435163 | controller | 2026-06-11T20:15:53-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:15:53.435221 | controller | 2026-06-11T20:15:53-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:15:53.806097 | controller | 2026-06-11T20:15:53-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:15:54.211935 | controller | 2026-06-11T20:15:54-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:15:54.211991 | controller | 2026-06-11T20:15:54-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:15:55.216984 | controller | 2026-06-11T20:15:55-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:15:55.217041 | controller | 2026-06-11T20:15:55-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:15:56.194721 | controller | 2026-06-11T20:15:56-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:15:56.194811 | controller | 2026-06-11T20:15:56-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:15:57.402334 | controller | 2026-06-11T20:15:57-04:00 INFO 2026-06-11 20:15:57.402446 | controller | - Config: OK 2026-06-11 20:15:57.402458 | controller | - Gateway: OK 2026-06-11 20:15:57.402467 | controller | - GitServer: OK 2026-06-11 20:15:57.402475 | controller | - HoundSearch: OK 2026-06-11 20:15:57.402483 | controller | - LogJuicer: OK 2026-06-11 20:15:57.402492 | controller | - Logserver: OK 2026-06-11 20:15:57.402516 | controller | - MariaDB: OK 2026-06-11 20:15:57.402525 | controller | - NodePoolBuilder: OK 2026-06-11 20:15:57.402533 | controller | - NodePoolLauncher: OK 2026-06-11 20:15:57.402541 | controller | - Zookeeper: OK 2026-06-11 20:15:57.402548 | controller | - Zuul: OK 2026-06-11 20:15:57.402557 | controller | 2026-06-11 20:15:57.402622 | controller | 2026-06-11T20:15:57-04:00 INFO Updating controller configmap ... 2026-06-11 20:15:57.791121 | controller | 2026-06-11T20:15:57-04:00 INFO Standalone reconcile done. 2026-06-12 00:15:58.175409 | controller | ok: Runtime: 0:01:12.960968 2026-06-12 00:15:58.183004 | 2026-06-12 00:15:58.183105 | TASK [run-operator-standalone : Copy current spec] 2026-06-12 00:15:58.719746 | controller | ok: Runtime: 0:00:00.008108 2026-06-12 00:15:58.727315 | 2026-06-12 00:15:58.727382 | TASK [golang-integration-tests : Run integration tests] 2026-06-11 20:15:59.035770 | controller | go test -timeout 0 -v ./tests/... -args --ginkgo.v --ginkgo.no-color 2026-06-11 20:15:59.062722 | controller | go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 2026-06-11 20:15:59.062814 | controller | go: downloading github.com/onsi/ginkgo/v2 v2.17.2 2026-06-11 20:15:59.064665 | controller | go: downloading github.com/onsi/gomega v1.33.1 2026-06-11 20:16:07.737218 | controller | === RUN TestSFOP 2026-06-11 20:16:07.738035 | controller | Running Suite: Software Factory CI - /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests 2026-06-11 20:16:07.738063 | controller | ======================================================================================================================== 2026-06-11 20:16:07.738074 | controller | Random Seed: 1781223367 2026-06-11 20:16:07.738082 | controller | 2026-06-11 20:16:07.738094 | controller | Will run 16 of 16 specs 2026-06-11 20:16:07.738102 | controller | ------------------------------ 2026-06-11 20:16:07.738137 | controller | [BeforeSuite] 2026-06-11 20:16:07.738148 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/main_test.go:55 2026-06-11 20:16:07.741236 | controller | 2026-06-11T20:16:07-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:16:07.741256 | controller | 2026-06-11 20:16:07.759802 | controller | 2026-06-11T20:16:07-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:16:07.759848 | controller | 2026-06-11 20:16:07.768412 | controller | [BeforeSuite] PASSED [0.030 seconds] 2026-06-11 20:16:07.768450 | controller | ------------------------------ 2026-06-11 20:16:07.768543 | controller | Test Env Has namespace 2026-06-11 20:16:07.768578 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/main_test.go:167 2026-06-11 20:16:07.768697 | controller | • [0.000 seconds] 2026-06-11 20:16:07.768718 | controller | ------------------------------ 2026-06-11 20:16:07.768735 | controller | Project Private Keys Rotation ensures no config errors 2026-06-11 20:16:07.768748 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/project_private_keys_rotation_test.go:33 2026-06-11 20:16:07.769447 | controller | STEP: Ensuring tenant have no config errors @ 06/11/26 20:16:07.769 2026-06-11 20:16:07.769654 | controller | 2026-06-11T20:16:07-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [curl -s zuul-web:9000/api/tenant/internal/config-errors] 2026-06-11 20:16:07.947139 | controller | 2026-06-11T20:16:07-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [curl -s zuul-web:9000/api/tenant/demo-tenant/config-errors] 2026-06-11 20:16:08.135721 | controller | • [0.367 seconds] 2026-06-11 20:16:08.135802 | controller | ------------------------------ 2026-06-11 20:16:08.135813 | controller | Project Private Keys Rotation inject new secret in demo-project 2026-06-11 20:16:08.135823 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/project_private_keys_rotation_test.go:37 2026-06-11 20:16:08.135839 | controller | STEP: Ensure a test ssh key is available @ 06/11/26 20:16:08.135 2026-06-11 20:16:08.147298 | controller | STEP: Loading test secret from fixture (fake SSH key) @ 06/11/26 20:16:08.147 2026-06-11 20:16:08.147358 | controller | STEP: Writing test secret into zuul-scheduler pod and encrypting with zuul-client @ 06/11/26 20:16:08.147 2026-06-11 20:16:08.147388 | controller | 2026-06-11T20:16:08-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [bash -c cat > /tmp/secret-to-encrypt.txt] 2026-06-11 20:16:08.285470 | controller | 2026-06-11T20:16:08-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [bash -c cat /tmp/secret-to-encrypt.txt | zuul-client encrypt --tenant demo-tenant --project demo-project] 2026-06-11 20:16:08.968100 | controller | writing RSA key 2026-06-11 20:16:09.066171 | controller | STEP: Replacing placeholders in secrets.yaml @ 06/11/26 20:16:09.065 2026-06-11 20:16:09.168943 | controller | STEP: Writing .zuul.d/secrets.yaml in repo @ 06/11/26 20:16:09.168 2026-06-11 20:16:09.169145 | controller | STEP: Committing and pushing locally as admin (HTTPS) @ 06/11/26 20:16:09.169 2026-06-11 20:16:09.381040 | controller | • [1.245 seconds] 2026-06-11 20:16:09.381136 | controller | ------------------------------ 2026-06-11 20:16:09.381144 | controller | Project Private Keys Rotation runs rotate-projects-private-keys 2026-06-11 20:16:09.381171 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/project_private_keys_rotation_test.go:84 2026-06-11 20:16:09.381189 | controller | STEP: Fetching project private keys state from ZooKeeper (to validate change after) @ 06/11/26 20:16:09.38 2026-06-11 20:16:09.381196 | controller | 2026-06-11T20:16:09-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [bash -c python3 << 'PYEOF' 2026-06-11 20:16:09.381201 | controller | import configparser 2026-06-11 20:16:09.381206 | controller | import hashlib 2026-06-11 20:16:09.381211 | controller | from zuul.zk import ZooKeeperClient 2026-06-11 20:16:09.381217 | controller | from zuul.lib.keystorage import KeyStorage 2026-06-11 20:16:09.381222 | controller | from zuul.lib import encryption 2026-06-11 20:16:09.381227 | controller | 2026-06-11 20:16:09.381232 | controller | config = configparser.ConfigParser() 2026-06-11 20:16:09.381237 | controller | config.read("/etc/zuul/zuul.conf") 2026-06-11 20:16:09.381243 | controller | password = config["keystore"]["password"].encode("utf-8") 2026-06-11 20:16:09.381248 | controller | zk_client = ZooKeeperClient.fromConfig(config) 2026-06-11 20:16:09.381254 | controller | zk_client.connect() 2026-06-11 20:16:09.381259 | controller | lines = [] 2026-06-11 20:16:09.381264 | controller | for path, obj in KeyStorage(zk_client, "unused").exportKeys().get("keys", {}).items(): 2026-06-11 20:16:09.381270 | controller | if path.endswith("/secrets") and "keys" in obj and len(obj.get("keys", [])) == 1: 2026-06-11 20:16:09.381275 | controller | created = obj["keys"][0]["created"] 2026-06-11 20:16:09.381280 | controller | priv_pem = obj["keys"][0]["private_key"] 2026-06-11 20:16:09.381285 | controller | fingerprint = hashlib.sha256(priv_pem.encode()).hexdigest()[:16] 2026-06-11 20:16:09.381291 | controller | lines.append(f"{path} {created} {fingerprint}") 2026-06-11 20:16:09.381296 | controller | if "demo-project" in path: 2026-06-11 20:16:09.381302 | controller | priv, _ = encryption.deserialize_rsa_keypair(priv_pem.encode("utf-8"), password) 2026-06-11 20:16:09.381307 | controller | pem = encryption.serialize_rsa_private_key(priv, None) 2026-06-11 20:16:09.381312 | controller | with open("/tmp/demo-project.key", "wb") as f: 2026-06-11 20:16:09.381317 | controller | f.write(pem) 2026-06-11 20:16:09.381322 | controller | print("\n".join(sorted(lines))) 2026-06-11 20:16:09.381327 | controller | PYEOF 2026-06-11 20:16:09.381332 | controller | ] 2026-06-11 20:16:10.964856 | controller | STEP: Project keys before rotation: /keystorage/gerrit/config/config/secrets 1781223077 535d3488087f6da2 2026-06-11 20:16:10.964946 | controller | /keystorage/gerrit/demo-project/demo-project/secrets 1781223073 1bedd9bd09abf119 2026-06-11 20:16:10.964958 | controller | /keystorage/gerrit/demo-tenant-config/demo-tenant-config/secrets 1781223070 acf17bd9b35f5297 2026-06-11 20:16:10.964966 | controller | /keystorage/git-server/system-config/system-config/secrets 1781223077 c0f5e8ac83ea2530 2026-06-11 20:16:10.964974 | controller | /keystorage/opendev.org/zuul/zuul%2Fzuul-jobs/secrets 1781223073 f34870670577c89b 2026-06-11 20:16:10.964982 | controller | @ 06/11/26 20:16:10.964 2026-06-11 20:16:10.964991 | controller | STEP: Preparing SSH key for rotation from zuul-ssh-key secret @ 06/11/26 20:16:10.964 2026-06-11 20:16:10.968072 | controller | STEP: Running rotate-projects-private-keys @ 06/11/26 20:16:10.967 2026-06-11 20:16:10.973118 | controller | 2026-06-11T20:16:10-04:00 INFO Creating object, name: zuul-kazoo 2026-06-11 20:16:11.989710 | controller | 2026-06-11T20:16:11-04:00 INFO Deleting object, name: config-base-secret-1-857-ns 2026-06-11 20:16:11.994317 | controller | 2026-06-11T20:16:11-04:00 INFO KubeAPIWarningLogger child pods are preserved by default when jobs are deleted; set propagationPolicy=Background to remove them or set propagationPolicy=Orphan to suppress this warning 2026-06-11 20:16:11.994355 | controller | 2026-06-11T20:16:11-04:00 INFO Deleting object, name: zs-internal-tenant-reconfigure 2026-06-11 20:16:12.000961 | controller | 2026-06-11T20:16:12-04:00 INFO Creating config map name: zk-clients-need-refresh-config-map 2026-06-11 20:16:12.001009 | controller | 2026-06-11T20:16:12-04:00 INFO Creating object, name: zk-clients-need-refresh-config-map 2026-06-11 20:16:12.006911 | controller | 2026-06-11T20:16:12-04:00 INFO Creating config map name: zuul-needs-full-reconfigure-config-map 2026-06-11 20:16:12.006971 | controller | 2026-06-11T20:16:12-04:00 INFO Creating object, name: zuul-needs-full-reconfigure-config-map 2026-06-11 20:16:12.010843 | controller | 2026-06-11T20:16:12-04:00 INFO Running pod execution pod: zuul-kazoo, command: [bash -c cat > /tmp/rotate-projects-private-keys.py && chmod 755 /tmp/*.py] 2026-06-11 20:16:12.148846 | controller | 2026-06-11T20:16:12-04:00 INFO Running pod execution pod: zuul-kazoo, command: [bash -c cat > /var/lib/zuul/.ssh_push_key && chmod 0600 /var/lib/zuul/.ssh_push_key] 2026-06-11 20:16:12.266766 | controller | 2026-06-11T20:16:12-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [cat /var/lib/zuul/main.yaml] 2026-06-11 20:16:12.372187 | controller | 2026-06-11T20:16:12-04:00 INFO Running pod execution pod: zuul-kazoo, command: [bash -c cat > /var/lib/zuul/main.yaml] 2026-06-11 20:16:12.487828 | controller | 2026-06-11T20:16:12-04:00 INFO Running pod execution pod: zuul-kazoo, command: [env PYTHONUNBUFFERED=1 /tmp/rotate-projects-private-keys.py --age 9223372036854775807 --author zuul --email zuul@sfop.me --logserver-key LS0tLS1CRUdJTiBSU0EgUFJJVkFURSBLRVktLS0tLQpNSUlKSndJQkFBS0NBZ0VBemwvdXVhalhqQXJEQzRmRTFISVdXOEV1cUJCaVQzd0xFejBXYzdHM29YOWNVeHczClE4TmJ6UXlhd2FtQXBycXlNMng2Y09FS2YxL3VOcXpjWHd0c1BzY3B3eUF1T2tyK25wT255VjZCVU1GRkx5VDgKbGlBY1NXR01td2Q3WU93bm52U2JtYjRHZHBVT3pkQ2hZQzdOR3FONjlsRmg0N3VvNW1xcnNET2tCSUlVRHBMZwpXZjJ6Y0xnYmpYN3RzR1gwV1Uzd0VUUDc5ZW81dzg2a2s4VXRVVW91ZlhIaEUyTFNqMlNnOEJ4allETkE0am5wCmxGM0xpNi9VcTkxTmF4bVJMMDB3WVRSV2hyeFRJcUlBMjVEaGdscTd4N3Y2a2UydHU5cjZ6bG9EK0VPbGw5SDMKcFRpd2c3MUpuNjYyWkxaY3c4anYrc2VVQk9zRzlJcEgvNXdCeXNqR0NMaXRtM3IyWEFkMmdmNzZuZ0dBL3VqVwpOaFVVWEMycXlIWFAyVnl4eVU0cDlkNndNR0tsRHltWEFJMFZ4TlNHUG12V1VHaEJPSlJncHVobkV5c09MUVdZClFCSUpBTHlpVHBEeS9nTytRZ2NJTWZ5eUovVVhlOUNnYlZIUkJqZHJERHU1U1QwNnZpd3JGUVA3ejVoa2J1SncKUjQrM3piZkpWTWUyTnRjMGVCV2VSZVQvNUpxOU9Od3FDTUZSRHIwNVdTSzM3TmNzMTlxMXh6N2c1YnA2aldkaApDbHB4WE1JSTUxWndQekwzZkEwQXpacldjUnY2UURqMVlXN082K1k0eTJhbEt5MEpQOElhc1ZRUDNuVVE4RzZKCjBWWktwSTJySW50TXUvRlZPU2YyYjFQT0VUcUpLVlhNaExuMXcxQjJldGNWOC9DcnNHQWNRSVBtMnMwQ0F3RUEKQVFLQ0FnQXN5WU4rdmM1M2VTOXVqV3F4TzBnd1pmcVk1U05jd2h3S013L3dFRUc4bGU0RXFHTXkvTTdycjJCWApocEJodnJNbE4xWFVNUGFOQVpYcVBqWCtGM1hJb3dMa2NwT3R1WEJNSEZuRnVSR0I0OHUrcVQxNjNDR2ZhRUR5Ck5SdTR3MDl1N3dGa3ltbFBLMWFnNG5YZk1KRDVCc0VNKzBqdCtpQXp6ek1PNUlva0kxRzBmdm9hOVpUUGNka2kKNmtpdHAxYXgyZGp2ZHRObndVc0RmRkZaczJrOEVzZ0hsK01EaU1jTzhRVC9UdjNmRndodUFDajV0cWhSbXBsaQpLZjhlN3RmRUJ2R29xc25iYUR2M2tHWjB3QnE4cGpISjdUajZHZldDQndvMnBiRG1YRkh2NHBTbXdlaUcwcG5MCmdvaFpUMzFPelFrTnFPbnQ3azZlVy9NM25SVURGOVFDOE9xSW9GcWp5c0NxTWRjK3pxbHI4bjBOQ291UzZXdk0KUXhZd1BwUUhPeTJPY1VRMmFqVUx0UmhSbkY0R2RTdStXRnJwRXhuWnEvOHNOaThMeUVxVE9reS9OOTl1RTRLZgo0QlBIRWJMNW5MU3NZVi9HdFMxaStEbGhnWGtlV0k2NFFFRlNTMXl2TSsxVzlOVXNYL2VFU281eVdZMngwcmdwCmdXRG53RXA2eWlNR214R0lCam5NYyt5aFE0YUtIMWJlK1ErRTBnUUxsNGE5WjVVQW9NVUJLYUlYdEdYL0xlNHIKV3E5KzRUbUZxbTJpdFFXRXJuTWdQeVZ1Wnk4Vm02aXJuRklsOGcvRC9EYW1kTFZYVHhWSzNYUVc1S1ZtRjVGSwoyaDRjNUtMQzNnRnYvV3dHTWRMZnZrSm9ZeGZpM2hQOTdFRHZ5d25BNXJDMUJwdGlNUUtDQVFFQStoS25FVmR3ClY3S1RYV2RyTTFRUCtuU29KRTZ0QVY0VTJuOTV4UXAyeUlrOUFwcUNRdElTa0dCMVFZdGlGZE9kQW5jdlVMYSsKNGkyb0tPajJ5Y2tJbnF1dzl5RHFKMUZ1cCtBbTBGRTJwTnF6RjRIY1IxZE80eUgxUWRtY1ZQTTlsVXhxYUxsdQoyVjl0SDFnUzIvbWZsR0sweGQ2MEFoV0xGM0VSWXUvVVFuQTBraEh4OERtOStlZzN3eUVyOFo5TzA5aXcwTlIzClNVNmtEc1VRYW1QdDNGcytKRFRBdGFmQW0vQk1OVmkzWjhCNVcyOERtN2QzV1o0NFVieUUyYTY4NmE3STE3c0cKSWcrTGE3UmQ4UWd3dkk0U0JxbmlCeDY4VDlWRGdqWmMrUFNrTU5HaStmR01RT3VzVnRxNVQzYWxma3VRdXJBVwpnelVMbU9WTWpvL1I4UUtDQVFFQTAwUWk0TGJrUTAybEZPQnpBR0YzV0hXbGhWanBndDFsZk1NSXNYUzE2bFJzCndiR2N0cWxPeEhvSW8rbTJxKzVYSG9lbExyODZjVmpYMlRDVDdrUTVvemNGTnJNYUlVTHAwd3had0VCUFRWSWQKRjFNN3IxNEYrWTRHM1N6bmlOaE1GRWlqRTF2MnVnbXpJRjdxTWpHZS9oVVpRQkJGVjNiTFNhN0pXQTBQeHJKNApUY1lqTDIxSU1tWjhOR2ZXVG1aUStHMzhJV2hQVmlLdHlTdmlPKys5MzVpS2RJazhFVisyeDdiLzNYbkN1RHRhCjFsWXlBTHlrUVFQb09EQmNUdWJMNGQwVG1XckZxa1pTZjMxZ0ZWcGdUNzFoaTJJOVBmeGpvS2lKWDlHM2drdGMKVWpwM0M3UWIzSmd6STBGazNXTElJSFZRa1ZWRjhoYzNnREVjMzhxNm5RS0NBUUFqQUh0YjVRWTNjQ3BLTjVCOApwYlo2MHRzNkFiMGJaT1M4VkgxaHcvNHVRVzlGcndTdWY2TFRqSHk5Q05wWXZiN0xPbzFuMmJ4TUFpSDRYK3N6CkFTMXdzQTFiK2NKc2NHeHhtT0UxNVRnbHlPcXFUcVhiWW5BTFFKU0lmQUh5cmYwZnFZdDNUd1VoN2NaalRidU8KQ0psNmRucGcrN1BzV3NHV0xXQkduZFR5MjZ1d0NrejMxODBzYm9GbmtYd0tITWMyeGF5eC9oc1lLcWF4M29sVwpxdGYvTU5JNDFSMW9ENnZZNThCeTh4RHd0N01FeGp3V0RvN28vMGxZdjI5RTNMMWFZL2wrb0pIU01LVE9GWGZVCnBkWFVmbm90YnBmUmNVN2dTYlJpUkdPdEFPaitZRWxVZktlcDZwSzdzVytnbkxXN1FLNW9RdjlUckJnTWRZUEsKckh5eEFvSUJBQUN1SUhxZXZCOW5XWmUyblVnc0NDbFZ2Nkd0UnBzd1FVcGtpbHVmNTVJSWtZMFNHRklTTzNtdwpkdVNvTlBsYXZCY1NFcnNTeklwZTRkc0dLQVBGWG5ZakVEWTczMktxQjN5eGRueUMrSDVrUEVtOTc5eEJyajArCmN0RTFlczFhL091M3pDYWN6aStOSm5GOVBMM0tvUnRxVC9sLzArbFRMWlpnSksvTzR2VWR6L3RZSHZiaElERmgKV1JjR0dvK0lEc3l0OWZqWmtCL1Qzc0ZlRGMxcG1TL21HdFFET1JsSk9KcHVBV2JpSkhsWlg1Si9Gb3dnRDF0UwpPdVlyYWJDclY0Nnptb09NNzNQNzQvb2JHanNYWG1ZRFV4UVN6ZVdzTVZuc0VQMG8vTEZEc3RsazdNc3gya0VjCmtGV1Z1VkJwS0FIS3Z1YW80cC9ENlY3VlNhV0N6cFVDZ2dFQVRXNXVTb3ZqTm9aZGlCR2FQQUFSdEVQeC9uclgKdXl3ck5XZjg2bnVRSXN3QWlyc1NILytKQ3QyVWpPei9iU1dhZWtKUDJLdjlyeXcxbDRLbUhPVWNvaEJZcDlrYgpYWDdGdmh2bHhxdHdzTklmZmtwTDg2cmJmd3pENG9IYzNOMHJPRmhheEdOblBUS2twS0RkNmt2ZkhOREJaKzZhCnlFUC9NZ3RCTnZUMUhhOEtjOEExS1RDZTBUZ1hLMS9BaGZvaW56Z2l5V21WMm5EUEt4UlhXeWRzdnVOVWtPZWIKd2lqZzBKbU51T3pyOTdYeVVqVFc5dEhCSXhINFVVdjV5T1MyZm84MHdIbTk1ZC9ZOXB3L211cHlScDAyMng0NgpiYnFEdFJwUkNmNTY3SmIyVCtKR2IycVRNNW9Ba2kwN1gxeWxSSHRvRlIwbGdaSHlURE1QSGRQL3lBPT0KLS0tLS1FTkQgUlNBIFBSSVZBVEUgS0VZLS0tLS0K] 2026-06-11 20:16:13.016552 | controller | [+] Collecting keys from ZooKeeper 2026-06-11 20:16:13.067637 | controller | [+] Deleting /keystorage/opendev.org/zuul/zuul%2Fzuul-jobs/ssh because Non secrets private key 2026-06-11 20:16:13.072075 | controller | [+] Deleting /keystorage/gerrit/demo-tenant-config/demo-tenant-config/ssh because Non secrets private key 2026-06-11 20:16:13.074591 | controller | [+] Deleting /keystorage/gerrit/demo-project/demo-project/ssh because Non secrets private key 2026-06-11 20:16:13.076306 | controller | [+] Deleting /keystorage/gerrit/config/config/ssh because Non secrets private key 2026-06-11 20:16:13.078598 | controller | [+] Deleting /keystorage/git-server/system-config/system-config/ssh because Non secrets private key 2026-06-11 20:16:13.080694 | controller | [+] Deleting /keystorage2/tenant/internal/ssh because Non secrets private key 2026-06-11 20:16:13.082409 | controller | [+] Deleting /keystorage2/tenant/demo-tenant/ssh because Non secrets private key 2026-06-11 20:16:13.084210 | controller | [+] Deleting /keystorage/opendev.org/zuul/zuul%2Fzuul-jobs/secrets because zuul-jobs do not have secrets 2026-06-11 20:16:13.089306 | controller | [+] Cloning ssh://zuul@gerrit-sshd.sf:29418/demo-tenant-config to /tmp/current-repo 2026-06-11 20:16:13.095100 | controller | Cloning into '/tmp/current-repo'... 2026-06-11 20:16:13.160540 | controller | Warning: Permanently added '[gerrit-sshd.sf]:29418' (ED25519) to the list of known hosts. 2026-06-11 20:16:13.311086 | controller | Total 9 (delta 0), reused 9 (delta 0) 2026-06-11 20:16:13.364002 | controller | [+] Deleting /keystorage/gerrit/demo-tenant-config/demo-tenant-config/secrets because project had no secret 2026-06-11 20:16:13.371642 | controller | [+] Cloning ssh://zuul@gerrit-sshd.sf:29418/demo-project to /tmp/current-repo 2026-06-11 20:16:13.377775 | controller | Cloning into '/tmp/current-repo'... 2026-06-11 20:16:13.509561 | controller | Total 10 (delta 0), reused 10 (delta 0) 2026-06-11 20:16:13.935749 | controller | [+] Re-Encrypting secret(s) in /tmp/current-repo/.zuul.d/secrets.yaml 2026-06-11 20:16:13.945936 | controller | [master f82ab53] Automatic secret re-encryption 2026-06-11 20:16:13.945979 | controller | 1 file changed, 10 insertions(+), 10 deletions(-) 2026-06-11 20:16:14.160771 | controller | remote: remote: Processing changes: refs: 1 remote: Processing changes: refs: 1 remote: Processing changes: refs: 1, done 2026-06-11 20:16:14.161757 | controller | To ssh://gerrit-sshd.sf:29418/demo-project 2026-06-11 20:16:14.161797 | controller | af3a464..f82ab53 master -> master 2026-06-11 20:16:14.162841 | controller | [+] Updating key for /keystorage/gerrit/demo-project/demo-project/secrets 2026-06-11 20:16:14.252555 | controller | [+] Cloning ssh://zuul@gerrit-sshd.sf:29418/config to /tmp/current-repo 2026-06-11 20:16:14.259339 | controller | Cloning into '/tmp/current-repo'... 2026-06-11 20:16:14.480647 | controller | Total 5 (delta 0), reused 5 (delta 0) 2026-06-11 20:16:14.489459 | controller | [+] Deleting /keystorage/gerrit/config/config/secrets because project had no secret 2026-06-11 20:16:14.493546 | controller | [+] Deleting /keystorage/git-server/system-config/system-config/secrets because internal repo will be handled in reconcile 2026-06-11 20:16:14.616136 | controller | STEP: Reconciling @ 06/11/26 20:16:14.615 2026-06-11 20:16:14.659725 | controller | 2026-06-11T20:16:14-04:00 INFO Warning: Killing ZooKeeper client: nodepool-builder-0 nodepool-builder 2026-06-11 20:16:14.659821 | controller | 2026-06-11T20:16:14-04:00 INFO Running pod execution pod: nodepool-builder-0, command: [kill -9 1] 2026-06-11 20:16:14.771495 | controller | 2026-06-11T20:16:14-04:00 INFO Deleting object, name: nodepool-builder 2026-06-11 20:16:14.778763 | controller | 2026-06-11T20:16:14-04:00 INFO Warning: Killing ZooKeeper client: nodepool-launcher-6d769b7f4d-9bh24 launcher 2026-06-11 20:16:14.778823 | controller | 2026-06-11T20:16:14-04:00 INFO Running pod execution pod: nodepool-launcher-6d769b7f4d-9bh24, command: [kill -9 1] 2026-06-11 20:16:14.936993 | controller | 2026-06-11T20:16:14-04:00 INFO Deleting object, name: launcher 2026-06-11 20:16:14.939904 | controller | 2026-06-11T20:16:14-04:00 INFO Warning: Killing ZooKeeper client: zuul-db-provision-74d9p mariadb-client 2026-06-11 20:16:14.939959 | controller | 2026-06-11T20:16:14-04:00 INFO Running pod execution pod: zuul-db-provision-74d9p, command: [kill -9 1] 2026-06-11 20:16:14.968373 | controller | 2026-06-11T20:16:14-04:00 INFO Deleting object, name: mariadb-client 2026-06-11 20:16:14.970996 | controller | 2026-06-11T20:16:14-04:00 INFO Warning: Killing ZooKeeper client: zuul-executor-0 zuul-executor 2026-06-11 20:16:14.971035 | controller | 2026-06-11T20:16:14-04:00 INFO Running pod execution pod: zuul-executor-0, command: [kill -9 1] 2026-06-11 20:16:15.028750 | controller | 2026-06-11T20:16:15-04:00 INFO Deleting object, name: zuul-executor 2026-06-11 20:16:15.032983 | controller | 2026-06-11T20:16:15-04:00 INFO Warning: Killing ZooKeeper client: zuul-kazoo zuul-kazoo 2026-06-11 20:16:15.033076 | controller | 2026-06-11T20:16:15-04:00 INFO Running pod execution pod: zuul-kazoo, command: [kill -9 1] 2026-06-11 20:16:15.148545 | controller | 2026-06-11T20:16:15-04:00 INFO Deleting object, name: zuul-kazoo 2026-06-11 20:16:15.150896 | controller | 2026-06-11T20:16:15-04:00 INFO Warning: Killing ZooKeeper client: zuul-merger-0 zuul-merger 2026-06-11 20:16:15.150914 | controller | 2026-06-11T20:16:15-04:00 INFO Running pod execution pod: zuul-merger-0, command: [kill -9 1] 2026-06-11 20:16:15.223905 | controller | 2026-06-11T20:16:15-04:00 INFO Deleting object, name: zuul-merger 2026-06-11 20:16:15.228000 | controller | 2026-06-11T20:16:15-04:00 INFO Warning: Killing ZooKeeper client: zuul-scheduler-0 zuul-scheduler 2026-06-11 20:16:15.228018 | controller | 2026-06-11T20:16:15-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [kill -9 1] 2026-06-11 20:16:15.314065 | controller | 2026-06-11T20:16:15-04:00 INFO Deleting object, name: zuul-scheduler 2026-06-11 20:16:15.318417 | controller | 2026-06-11T20:16:15-04:00 INFO Warning: Killing ZooKeeper client: zuul-web-6c87c99b48-qn47b zuul-web 2026-06-11 20:16:15.318436 | controller | 2026-06-11T20:16:15-04:00 INFO Running pod execution pod: zuul-web-6c87c99b48-qn47b, command: [kill -9 1] 2026-06-11 20:16:15.410576 | controller | 2026-06-11T20:16:15-04:00 INFO Deleting object, name: zuul-web 2026-06-11 20:16:15.413826 | controller | 2026-06-11T20:16:15-04:00 INFO Warning: Killing ZooKeeper client: zuul-weeder-57c6567f5f-w8r9l zuul-weeder 2026-06-11 20:16:15.413845 | controller | 2026-06-11T20:16:15-04:00 INFO Running pod execution pod: zuul-weeder-57c6567f5f-w8r9l, command: [kill -9 1] 2026-06-11 20:16:15.505543 | controller | 2026-06-11T20:16:15-04:00 INFO Deleting object, name: zuul-weeder 2026-06-11 20:16:15.508983 | controller | 2026-06-11T20:16:15-04:00 INFO Deleting object, name: zk-clients-need-refresh-config-map 2026-06-11 20:16:15.511614 | controller | 2026-06-11T20:16:15-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:16:15.922301 | controller | 2026-06-11T20:16:15-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:16:15.922437 | controller | 2026-06-11T20:16:15-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:16:15.930375 | controller | 2026-06-11T20:16:15-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:16:16.024391 | controller | 2026-06-11T20:16:16-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:16:16.031074 | controller | 2026-06-11T20:16:16-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:16:16.031157 | controller | 2026-06-11T20:16:16-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:16:16.064896 | controller | 2026-06-11T20:16:16-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:16:16.064979 | controller | 2026-06-11T20:16:16-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:16:16.335174 | controller | 2026-06-11T20:16:16-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:16:16.729356 | controller | 2026-06-11T20:16:16-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:16:16.729430 | controller | 2026-06-11T20:16:16-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:16:16.931494 | controller | 2026-06-11T20:16:16-04:00 INFO Creating object, name: nodepool-builder 2026-06-11 20:16:17.738179 | controller | 2026-06-11T20:16:17-04:00 INFO Creating object, name: zuul-scheduler 2026-06-11 20:16:18.114809 | controller | 2026-06-11T20:16:18-04:00 INFO Creating object, name: zuul-executor 2026-06-11 20:16:18.916326 | controller | 2026-06-11T20:16:18-04:00 INFO Creating object, name: zuul-web 2026-06-11 20:16:19.716685 | controller | 2026-06-11T20:16:19-04:00 INFO Creating object, name: zuul-merger 2026-06-11 20:16:19.722448 | controller | 2026-06-11T20:16:19-04:00 INFO 2026-06-11 20:16:19.722492 | controller | - Config: Waiting ... 2026-06-11 20:16:19.722502 | controller | - Gateway: OK 2026-06-11 20:16:19.722511 | controller | - GitServer: OK 2026-06-11 20:16:19.722519 | controller | - HoundSearch: OK 2026-06-11 20:16:19.722526 | controller | - LogJuicer: OK 2026-06-11 20:16:19.722534 | controller | - Logserver: OK 2026-06-11 20:16:19.722542 | controller | - MariaDB: OK 2026-06-11 20:16:19.722550 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:16:19.722558 | controller | - NodePoolLauncher: OK 2026-06-11 20:16:19.722566 | controller | - Zookeeper: OK 2026-06-11 20:16:19.722573 | controller | - Zuul: Waiting ... 2026-06-11 20:16:19.722581 | controller | - |_ Config Secrets: OK 2026-06-11 20:16:19.722589 | controller | - |_ Executor: Waiting ... 2026-06-11 20:16:19.722597 | controller | - |_ Merger: Waiting ... 2026-06-11 20:16:19.722610 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:16:19.722619 | controller | - |_ Web: Waiting ... 2026-06-11 20:16:19.722627 | controller | 2026-06-11 20:16:20.727804 | controller | 2026-06-11T20:16:20-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:16:21.334597 | controller | 2026-06-11T20:16:21-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:16:21.334920 | controller | 2026-06-11T20:16:21-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:16:21.351345 | controller | 2026-06-11T20:16:21-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:16:21.351437 | controller | 2026-06-11T20:16:21-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:16:21.379632 | controller | 2026-06-11T20:16:21-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:16:21.379707 | controller | 2026-06-11T20:16:21-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:16:21.745704 | controller | 2026-06-11T20:16:21-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:16:22.146640 | controller | 2026-06-11T20:16:22-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:16:22.146692 | controller | 2026-06-11T20:16:22-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:16:23.520199 | controller | 2026-06-11T20:16:23-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:16:53.654787 | controller | 2026-06-11T20:16:53-04:00 INFO Statefulset "zuul-scheduler" not ready after 30s 2026-06-11 20:16:53.694724 | controller | 2026-06-11T20:16:53-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:16:53.694799 | controller | 2026-06-11T20:16:53-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:16:54.070413 | controller | 2026-06-11T20:16:54-04:00 INFO 2026-06-11 20:16:54.070489 | controller | - Config: Waiting ... 2026-06-11 20:16:54.070501 | controller | - Gateway: OK 2026-06-11 20:16:54.070510 | controller | - GitServer: OK 2026-06-11 20:16:54.070519 | controller | - HoundSearch: OK 2026-06-11 20:16:54.070528 | controller | - LogJuicer: OK 2026-06-11 20:16:54.070553 | controller | - Logserver: OK 2026-06-11 20:16:54.070562 | controller | - MariaDB: OK 2026-06-11 20:16:54.070571 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:16:54.070592 | controller | - NodePoolLauncher: OK 2026-06-11 20:16:54.070601 | controller | - Zookeeper: OK 2026-06-11 20:16:54.070610 | controller | - Zuul: Waiting ... 2026-06-11 20:16:54.070618 | controller | - |_ Config Secrets: OK 2026-06-11 20:16:54.070626 | controller | - |_ Executor: OK 2026-06-11 20:16:54.070635 | controller | - |_ Merger: OK 2026-06-11 20:16:54.070643 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:16:54.070652 | controller | - |_ Web: Waiting ... 2026-06-11 20:16:54.070660 | controller | 2026-06-11 20:16:55.076355 | controller | 2026-06-11T20:16:55-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:16:55.680918 | controller | 2026-06-11T20:16:55-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:16:55.680990 | controller | 2026-06-11T20:16:55-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:16:55.692615 | controller | 2026-06-11T20:16:55-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:16:55.692662 | controller | 2026-06-11T20:16:55-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:16:55.714093 | controller | 2026-06-11T20:16:55-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:16:55.714142 | controller | 2026-06-11T20:16:55-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:16:56.095110 | controller | 2026-06-11T20:16:56-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:16:56.495505 | controller | 2026-06-11T20:16:56-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:16:56.495580 | controller | 2026-06-11T20:16:56-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:16:57.867903 | controller | 2026-06-11T20:16:57-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:17:19.974812 | controller | 2026-06-11T20:17:19-04:00 INFO Creating object, name: zuul-weeder 2026-06-11 20:17:20.027158 | controller | 2026-06-11T20:17:20-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:17:20.027231 | controller | 2026-06-11T20:17:20-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:17:20.395181 | controller | 2026-06-11T20:17:20-04:00 INFO 2026-06-11 20:17:20.395244 | controller | - Config: Waiting ... 2026-06-11 20:17:20.395249 | controller | - Gateway: OK 2026-06-11 20:17:20.395253 | controller | - GitServer: OK 2026-06-11 20:17:20.395257 | controller | - HoundSearch: OK 2026-06-11 20:17:20.395260 | controller | - LogJuicer: OK 2026-06-11 20:17:20.395264 | controller | - Logserver: OK 2026-06-11 20:17:20.395267 | controller | - MariaDB: OK 2026-06-11 20:17:20.395270 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:17:20.395274 | controller | - NodePoolLauncher: OK 2026-06-11 20:17:20.395278 | controller | - Zookeeper: OK 2026-06-11 20:17:20.395281 | controller | - Zuul: Waiting ... 2026-06-11 20:17:20.395285 | controller | - |_ Config Secrets: OK 2026-06-11 20:17:20.395288 | controller | - |_ Executor: OK 2026-06-11 20:17:20.395291 | controller | - |_ Merger: OK 2026-06-11 20:17:20.395295 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:17:20.395298 | controller | - |_ Web: Waiting ... 2026-06-11 20:17:20.395302 | controller | 2026-06-11 20:17:21.402790 | controller | 2026-06-11T20:17:21-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:17:22.004388 | controller | 2026-06-11T20:17:22-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:17:22.004445 | controller | 2026-06-11T20:17:22-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:17:22.012284 | controller | 2026-06-11T20:17:22-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:17:22.012319 | controller | 2026-06-11T20:17:22-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:17:22.024392 | controller | 2026-06-11T20:17:22-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:17:22.024420 | controller | 2026-06-11T20:17:22-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:17:22.417832 | controller | 2026-06-11T20:17:22-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:17:22.819446 | controller | 2026-06-11T20:17:22-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:17:22.819523 | controller | 2026-06-11T20:17:22-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:17:24.199320 | controller | 2026-06-11T20:17:24-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:17:24.199425 | controller | 2026-06-11T20:17:24-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:17:25.788368 | controller | 2026-06-11T20:17:25-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:17:25.788493 | controller | 2026-06-11T20:17:25-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:17:26.994398 | controller | 2026-06-11T20:17:26-04:00 INFO Creating base secret job 2026-06-11 20:17:26.994903 | controller | 2026-06-11T20:17:26-04:00 INFO Creating object, name: config-base-secret-1-857-ns 2026-06-11 20:17:26.998037 | controller | 2026-06-11T20:17:26-04:00 INFO 2026-06-11 20:17:26.998073 | controller | - Config: Waiting ... 2026-06-11 20:17:26.998084 | controller | - Gateway: OK 2026-06-11 20:17:26.998093 | controller | - GitServer: OK 2026-06-11 20:17:26.998101 | controller | - HoundSearch: OK 2026-06-11 20:17:26.998110 | controller | - LogJuicer: OK 2026-06-11 20:17:26.998118 | controller | - Logserver: OK 2026-06-11 20:17:26.998126 | controller | - MariaDB: OK 2026-06-11 20:17:26.998135 | controller | - NodePoolBuilder: OK 2026-06-11 20:17:26.998143 | controller | - NodePoolLauncher: OK 2026-06-11 20:17:26.998152 | controller | - Zookeeper: OK 2026-06-11 20:17:26.998160 | controller | - Zuul: OK 2026-06-11 20:17:26.998169 | controller | 2026-06-11 20:17:28.003542 | controller | 2026-06-11T20:17:28-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:17:28.609838 | controller | 2026-06-11T20:17:28-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:17:28.609936 | controller | 2026-06-11T20:17:28-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:17:28.623872 | controller | 2026-06-11T20:17:28-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:17:28.623951 | controller | 2026-06-11T20:17:28-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:17:28.646973 | controller | 2026-06-11T20:17:28-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:17:28.647050 | controller | 2026-06-11T20:17:28-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:17:29.017085 | controller | 2026-06-11T20:17:29-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:17:29.426090 | controller | 2026-06-11T20:17:29-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:17:29.426202 | controller | 2026-06-11T20:17:29-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:17:30.806052 | controller | 2026-06-11T20:17:30-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:17:30.806131 | controller | 2026-06-11T20:17:30-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:17:32.386611 | controller | 2026-06-11T20:17:32-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:17:32.386713 | controller | 2026-06-11T20:17:32-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:17:33.596862 | controller | 2026-06-11T20:17:33-04:00 INFO Running tenant-reconfigure for the 'internal' tenant 2026-06-11 20:17:33.783964 | controller | 2026-06-11T20:17:33-04:00 INFO Deleting object, name: zuul-needs-full-reconfigure-config-map 2026-06-11 20:17:33.986145 | controller | 2026-06-11T20:17:33-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [zuul-scheduler full-reconfigure] 2026-06-11 20:17:41.746691 | controller | 2026-06-11T20:17:41-04:00 INFO Deleting object, name: zuul-web 2026-06-11 20:17:41.751269 | controller | 2026-06-11T20:17:41-04:00 INFO Creating object, name: zs-internal-tenant-reconfigure 2026-06-11 20:17:41.757243 | controller | 2026-06-11T20:17:41-04:00 INFO 2026-06-11 20:17:41.757290 | controller | - Config: Waiting ... 2026-06-11 20:17:41.757306 | controller | - Gateway: OK 2026-06-11 20:17:41.757319 | controller | - GitServer: OK 2026-06-11 20:17:41.757351 | controller | - HoundSearch: OK 2026-06-11 20:17:41.757364 | controller | - LogJuicer: OK 2026-06-11 20:17:41.757411 | controller | - Logserver: OK 2026-06-11 20:17:41.757423 | controller | - MariaDB: OK 2026-06-11 20:17:41.757435 | controller | - NodePoolBuilder: OK 2026-06-11 20:17:41.757447 | controller | - NodePoolLauncher: OK 2026-06-11 20:17:41.757459 | controller | - Zookeeper: OK 2026-06-11 20:17:41.757470 | controller | - Zuul: OK 2026-06-11 20:17:41.757483 | controller | 2026-06-11 20:17:42.764345 | controller | 2026-06-11T20:17:42-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:17:43.369689 | controller | 2026-06-11T20:17:43-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:17:43.369765 | controller | 2026-06-11T20:17:43-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:17:43.383082 | controller | 2026-06-11T20:17:43-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:17:43.383119 | controller | 2026-06-11T20:17:43-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:17:43.403413 | controller | 2026-06-11T20:17:43-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:17:43.403450 | controller | 2026-06-11T20:17:43-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:17:43.780055 | controller | 2026-06-11T20:17:43-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:17:44.179832 | controller | 2026-06-11T20:17:44-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:17:44.179913 | controller | 2026-06-11T20:17:44-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:17:45.203338 | controller | 2026-06-11T20:17:45-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:17:45.203510 | controller | 2026-06-11T20:17:45-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:17:46.167130 | controller | 2026-06-11T20:17:46-04:00 INFO Creating object, name: zuul-web 2026-06-11 20:17:46.986192 | controller | 2026-06-11T20:17:46-04:00 INFO 2026-06-11 20:17:46.986252 | controller | - Config: Waiting ... 2026-06-11 20:17:46.986263 | controller | - Gateway: OK 2026-06-11 20:17:46.986271 | controller | - GitServer: OK 2026-06-11 20:17:46.986279 | controller | - HoundSearch: OK 2026-06-11 20:17:46.986287 | controller | - LogJuicer: OK 2026-06-11 20:17:46.986295 | controller | - Logserver: OK 2026-06-11 20:17:46.986303 | controller | - MariaDB: OK 2026-06-11 20:17:46.986310 | controller | - NodePoolBuilder: OK 2026-06-11 20:17:46.986318 | controller | - NodePoolLauncher: OK 2026-06-11 20:17:46.986326 | controller | - Zookeeper: OK 2026-06-11 20:17:46.986333 | controller | - Zuul: Waiting ... 2026-06-11 20:17:46.986341 | controller | - |_ Config Secrets: OK 2026-06-11 20:17:46.986349 | controller | - |_ Executor: OK 2026-06-11 20:17:46.986356 | controller | - |_ Merger: OK 2026-06-11 20:17:46.986364 | controller | - |_ Scheduler: OK 2026-06-11 20:17:46.986419 | controller | - |_ Web: Waiting ... 2026-06-11 20:17:46.986427 | controller | 2026-06-11 20:17:47.993043 | controller | 2026-06-11T20:17:47-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:17:48.596561 | controller | 2026-06-11T20:17:48-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:17:48.596663 | controller | 2026-06-11T20:17:48-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:17:48.612182 | controller | 2026-06-11T20:17:48-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:17:48.612231 | controller | 2026-06-11T20:17:48-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:17:48.633138 | controller | 2026-06-11T20:17:48-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:17:48.633176 | controller | 2026-06-11T20:17:48-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:17:49.013887 | controller | 2026-06-11T20:17:49-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:17:49.414850 | controller | 2026-06-11T20:17:49-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:17:49.414912 | controller | 2026-06-11T20:17:49-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:17:50.780012 | controller | 2026-06-11T20:17:50-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:17:50.780089 | controller | 2026-06-11T20:17:50-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:17:52.367359 | controller | 2026-06-11T20:17:52-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:17:52.367463 | controller | 2026-06-11T20:17:52-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:17:53.180464 | controller | 2026-06-11T20:17:53-04:00 INFO 2026-06-11 20:17:53.180547 | controller | - Config: Waiting ... 2026-06-11 20:17:53.180558 | controller | - Gateway: OK 2026-06-11 20:17:53.180566 | controller | - GitServer: OK 2026-06-11 20:17:53.180574 | controller | - HoundSearch: OK 2026-06-11 20:17:53.180582 | controller | - LogJuicer: OK 2026-06-11 20:17:53.180608 | controller | - Logserver: OK 2026-06-11 20:17:53.180616 | controller | - MariaDB: OK 2026-06-11 20:17:53.180624 | controller | - NodePoolBuilder: OK 2026-06-11 20:17:53.180632 | controller | - NodePoolLauncher: OK 2026-06-11 20:17:53.180639 | controller | - Zookeeper: OK 2026-06-11 20:17:53.180647 | controller | - Zuul: Waiting ... 2026-06-11 20:17:53.180655 | controller | - |_ Config Secrets: OK 2026-06-11 20:17:53.180662 | controller | - |_ Executor: OK 2026-06-11 20:17:53.180670 | controller | - |_ Merger: OK 2026-06-11 20:17:53.180678 | controller | - |_ Scheduler: OK 2026-06-11 20:17:53.180685 | controller | - |_ Web: Waiting ... 2026-06-11 20:17:53.180693 | controller | 2026-06-11 20:17:54.186784 | controller | 2026-06-11T20:17:54-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:17:54.790519 | controller | 2026-06-11T20:17:54-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:17:54.790593 | controller | 2026-06-11T20:17:54-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:17:54.801891 | controller | 2026-06-11T20:17:54-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:17:54.801940 | controller | 2026-06-11T20:17:54-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:17:54.820246 | controller | 2026-06-11T20:17:54-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:17:54.820283 | controller | 2026-06-11T20:17:54-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:17:55.204206 | controller | 2026-06-11T20:17:55-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:17:55.610631 | controller | 2026-06-11T20:17:55-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:17:55.610740 | controller | 2026-06-11T20:17:55-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:17:56.980652 | controller | 2026-06-11T20:17:56-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:17:56.980729 | controller | 2026-06-11T20:17:56-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:17:58.568218 | controller | 2026-06-11T20:17:58-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:17:58.568292 | controller | 2026-06-11T20:17:58-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:17:59.376025 | controller | 2026-06-11T20:17:59-04:00 INFO 2026-06-11 20:17:59.376087 | controller | - Config: Waiting ... 2026-06-11 20:17:59.376093 | controller | - Gateway: OK 2026-06-11 20:17:59.376098 | controller | - GitServer: OK 2026-06-11 20:17:59.376102 | controller | - HoundSearch: OK 2026-06-11 20:17:59.376107 | controller | - LogJuicer: OK 2026-06-11 20:17:59.376111 | controller | - Logserver: OK 2026-06-11 20:17:59.376116 | controller | - MariaDB: OK 2026-06-11 20:17:59.376120 | controller | - NodePoolBuilder: OK 2026-06-11 20:17:59.376125 | controller | - NodePoolLauncher: OK 2026-06-11 20:17:59.376129 | controller | - Zookeeper: OK 2026-06-11 20:17:59.376133 | controller | - Zuul: Waiting ... 2026-06-11 20:17:59.376138 | controller | - |_ Config Secrets: OK 2026-06-11 20:17:59.376142 | controller | - |_ Executor: OK 2026-06-11 20:17:59.376146 | controller | - |_ Merger: OK 2026-06-11 20:17:59.376151 | controller | - |_ Scheduler: OK 2026-06-11 20:17:59.376155 | controller | - |_ Web: Waiting ... 2026-06-11 20:17:59.376160 | controller | 2026-06-11 20:18:00.381399 | controller | 2026-06-11T20:18:00-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:18:00.988335 | controller | 2026-06-11T20:18:00-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:18:00.988512 | controller | 2026-06-11T20:18:00-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:18:01.003669 | controller | 2026-06-11T20:18:01-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:18:01.003740 | controller | 2026-06-11T20:18:01-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:18:01.028357 | controller | 2026-06-11T20:18:01-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:18:01.028492 | controller | 2026-06-11T20:18:01-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:18:01.399834 | controller | 2026-06-11T20:18:01-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:18:01.801307 | controller | 2026-06-11T20:18:01-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:18:01.801443 | controller | 2026-06-11T20:18:01-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:18:03.179952 | controller | 2026-06-11T20:18:03-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:18:03.180144 | controller | 2026-06-11T20:18:03-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:18:04.768276 | controller | 2026-06-11T20:18:04-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:18:04.768387 | controller | 2026-06-11T20:18:04-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:18:05.578807 | controller | 2026-06-11T20:18:05-04:00 INFO 2026-06-11 20:18:05.579859 | controller | - Config: Waiting ... 2026-06-11 20:18:05.579901 | controller | - Gateway: OK 2026-06-11 20:18:05.579908 | controller | - GitServer: OK 2026-06-11 20:18:05.579913 | controller | - HoundSearch: OK 2026-06-11 20:18:05.579919 | controller | - LogJuicer: OK 2026-06-11 20:18:05.579924 | controller | - Logserver: OK 2026-06-11 20:18:05.579929 | controller | - MariaDB: OK 2026-06-11 20:18:05.579933 | controller | - NodePoolBuilder: OK 2026-06-11 20:18:05.579938 | controller | - NodePoolLauncher: OK 2026-06-11 20:18:05.579943 | controller | - Zookeeper: OK 2026-06-11 20:18:05.579948 | controller | - Zuul: Waiting ... 2026-06-11 20:18:05.579953 | controller | - |_ Config Secrets: OK 2026-06-11 20:18:05.579958 | controller | - |_ Executor: OK 2026-06-11 20:18:05.579962 | controller | - |_ Merger: OK 2026-06-11 20:18:05.579967 | controller | - |_ Scheduler: OK 2026-06-11 20:18:05.579972 | controller | - |_ Web: Waiting ... 2026-06-11 20:18:05.579978 | controller | 2026-06-11 20:18:06.586650 | controller | 2026-06-11T20:18:06-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:18:07.193120 | controller | 2026-06-11T20:18:07-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:18:07.193196 | controller | 2026-06-11T20:18:07-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:18:07.213536 | controller | 2026-06-11T20:18:07-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:18:07.213582 | controller | 2026-06-11T20:18:07-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:18:07.236365 | controller | 2026-06-11T20:18:07-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:18:07.236406 | controller | 2026-06-11T20:18:07-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:18:07.600835 | controller | 2026-06-11T20:18:07-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:18:08.015515 | controller | 2026-06-11T20:18:08-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:18:08.015609 | controller | 2026-06-11T20:18:08-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:18:09.383351 | controller | 2026-06-11T20:18:09-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:18:09.383448 | controller | 2026-06-11T20:18:09-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:18:10.968899 | controller | 2026-06-11T20:18:10-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:18:10.968993 | controller | 2026-06-11T20:18:10-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:18:11.780090 | controller | 2026-06-11T20:18:11-04:00 INFO 2026-06-11 20:18:11.780171 | controller | - Config: Waiting ... 2026-06-11 20:18:11.780187 | controller | - Gateway: OK 2026-06-11 20:18:11.780200 | controller | - GitServer: OK 2026-06-11 20:18:11.780211 | controller | - HoundSearch: OK 2026-06-11 20:18:11.780222 | controller | - LogJuicer: OK 2026-06-11 20:18:11.780232 | controller | - Logserver: OK 2026-06-11 20:18:11.780243 | controller | - MariaDB: OK 2026-06-11 20:18:11.780254 | controller | - NodePoolBuilder: OK 2026-06-11 20:18:11.780264 | controller | - NodePoolLauncher: OK 2026-06-11 20:18:11.780275 | controller | - Zookeeper: OK 2026-06-11 20:18:11.780286 | controller | - Zuul: Waiting ... 2026-06-11 20:18:11.780297 | controller | - |_ Config Secrets: OK 2026-06-11 20:18:11.780307 | controller | - |_ Executor: OK 2026-06-11 20:18:11.780318 | controller | - |_ Merger: OK 2026-06-11 20:18:11.780329 | controller | - |_ Scheduler: OK 2026-06-11 20:18:11.780339 | controller | - |_ Web: Waiting ... 2026-06-11 20:18:11.780351 | controller | 2026-06-11 20:18:12.787045 | controller | 2026-06-11T20:18:12-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:18:13.393029 | controller | 2026-06-11T20:18:13-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:18:13.393126 | controller | 2026-06-11T20:18:13-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:18:13.411218 | controller | 2026-06-11T20:18:13-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:18:13.411288 | controller | 2026-06-11T20:18:13-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:18:13.438694 | controller | 2026-06-11T20:18:13-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:18:13.438769 | controller | 2026-06-11T20:18:13-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:18:13.804256 | controller | 2026-06-11T20:18:13-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:18:14.209873 | controller | 2026-06-11T20:18:14-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:18:14.209948 | controller | 2026-06-11T20:18:14-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:18:15.581326 | controller | 2026-06-11T20:18:15-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:18:15.581421 | controller | 2026-06-11T20:18:15-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:18:17.169137 | controller | 2026-06-11T20:18:17-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:18:17.169273 | controller | 2026-06-11T20:18:17-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:18:17.976058 | controller | 2026-06-11T20:18:17-04:00 INFO 2026-06-11 20:18:17.976154 | controller | - Config: Waiting ... 2026-06-11 20:18:17.976159 | controller | - Gateway: OK 2026-06-11 20:18:17.976164 | controller | - GitServer: OK 2026-06-11 20:18:17.976167 | controller | - HoundSearch: OK 2026-06-11 20:18:17.976171 | controller | - LogJuicer: OK 2026-06-11 20:18:17.976175 | controller | - Logserver: OK 2026-06-11 20:18:17.976178 | controller | - MariaDB: OK 2026-06-11 20:18:17.976182 | controller | - NodePoolBuilder: OK 2026-06-11 20:18:17.976185 | controller | - NodePoolLauncher: OK 2026-06-11 20:18:17.976189 | controller | - Zookeeper: OK 2026-06-11 20:18:17.976192 | controller | - Zuul: Waiting ... 2026-06-11 20:18:17.976196 | controller | - |_ Config Secrets: OK 2026-06-11 20:18:17.976199 | controller | - |_ Executor: OK 2026-06-11 20:18:17.976203 | controller | - |_ Merger: OK 2026-06-11 20:18:17.976206 | controller | - |_ Scheduler: OK 2026-06-11 20:18:17.976210 | controller | - |_ Web: Waiting ... 2026-06-11 20:18:17.976214 | controller | 2026-06-11 20:18:18.982587 | controller | 2026-06-11T20:18:18-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:18:19.587455 | controller | 2026-06-11T20:18:19-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:18:19.587532 | controller | 2026-06-11T20:18:19-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:18:19.600542 | controller | 2026-06-11T20:18:19-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:18:19.600579 | controller | 2026-06-11T20:18:19-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:18:19.621645 | controller | 2026-06-11T20:18:19-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:18:19.621680 | controller | 2026-06-11T20:18:19-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:18:20.000320 | controller | 2026-06-11T20:18:20-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:18:20.402163 | controller | 2026-06-11T20:18:20-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:18:20.402241 | controller | 2026-06-11T20:18:20-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:18:21.781436 | controller | 2026-06-11T20:18:21-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:18:21.781511 | controller | 2026-06-11T20:18:21-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:18:23.369263 | controller | 2026-06-11T20:18:23-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:18:23.369482 | controller | 2026-06-11T20:18:23-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:18:24.179649 | controller | 2026-06-11T20:18:24-04:00 INFO 2026-06-11 20:18:24.179739 | controller | - Config: Waiting ... 2026-06-11 20:18:24.179750 | controller | - Gateway: OK 2026-06-11 20:18:24.179759 | controller | - GitServer: OK 2026-06-11 20:18:24.179767 | controller | - HoundSearch: OK 2026-06-11 20:18:24.179777 | controller | - LogJuicer: OK 2026-06-11 20:18:24.179788 | controller | - Logserver: OK 2026-06-11 20:18:24.179799 | controller | - MariaDB: OK 2026-06-11 20:18:24.179810 | controller | - NodePoolBuilder: OK 2026-06-11 20:18:24.179821 | controller | - NodePoolLauncher: OK 2026-06-11 20:18:24.179853 | controller | - Zookeeper: OK 2026-06-11 20:18:24.179864 | controller | - Zuul: Waiting ... 2026-06-11 20:18:24.179874 | controller | - |_ Config Secrets: OK 2026-06-11 20:18:24.179885 | controller | - |_ Executor: OK 2026-06-11 20:18:24.179896 | controller | - |_ Merger: OK 2026-06-11 20:18:24.179907 | controller | - |_ Scheduler: OK 2026-06-11 20:18:24.179917 | controller | - |_ Web: Waiting ... 2026-06-11 20:18:24.179927 | controller | 2026-06-11 20:18:25.185945 | controller | 2026-06-11T20:18:25-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:18:25.795178 | controller | 2026-06-11T20:18:25-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:18:25.795254 | controller | 2026-06-11T20:18:25-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:18:25.810900 | controller | 2026-06-11T20:18:25-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:18:25.811053 | controller | 2026-06-11T20:18:25-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:18:25.831988 | controller | 2026-06-11T20:18:25-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:18:25.832035 | controller | 2026-06-11T20:18:25-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:18:26.202908 | controller | 2026-06-11T20:18:26-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:18:26.605507 | controller | 2026-06-11T20:18:26-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:18:26.606083 | controller | 2026-06-11T20:18:26-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:18:27.985100 | controller | 2026-06-11T20:18:27-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:18:27.985173 | controller | 2026-06-11T20:18:27-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:18:29.568508 | controller | 2026-06-11T20:18:29-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:18:29.568597 | controller | 2026-06-11T20:18:29-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:18:30.378724 | controller | 2026-06-11T20:18:30-04:00 INFO 2026-06-11 20:18:30.378795 | controller | - Config: Waiting ... 2026-06-11 20:18:30.378804 | controller | - Gateway: OK 2026-06-11 20:18:30.378811 | controller | - GitServer: OK 2026-06-11 20:18:30.378817 | controller | - HoundSearch: OK 2026-06-11 20:18:30.378824 | controller | - LogJuicer: OK 2026-06-11 20:18:30.378830 | controller | - Logserver: OK 2026-06-11 20:18:30.378836 | controller | - MariaDB: OK 2026-06-11 20:18:30.378843 | controller | - NodePoolBuilder: OK 2026-06-11 20:18:30.378849 | controller | - NodePoolLauncher: OK 2026-06-11 20:18:30.378856 | controller | - Zookeeper: OK 2026-06-11 20:18:30.378862 | controller | - Zuul: Waiting ... 2026-06-11 20:18:30.378869 | controller | - |_ Config Secrets: OK 2026-06-11 20:18:30.378875 | controller | - |_ Executor: OK 2026-06-11 20:18:30.378881 | controller | - |_ Merger: OK 2026-06-11 20:18:30.378888 | controller | - |_ Scheduler: OK 2026-06-11 20:18:30.378894 | controller | - |_ Web: Waiting ... 2026-06-11 20:18:30.378900 | controller | 2026-06-11 20:18:31.385771 | controller | 2026-06-11T20:18:31-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:18:31.992037 | controller | 2026-06-11T20:18:31-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:18:31.992113 | controller | 2026-06-11T20:18:31-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:18:32.006597 | controller | 2026-06-11T20:18:32-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:18:32.006683 | controller | 2026-06-11T20:18:32-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:18:32.029800 | controller | 2026-06-11T20:18:32-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:18:32.029888 | controller | 2026-06-11T20:18:32-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:18:32.400891 | controller | 2026-06-11T20:18:32-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:18:32.801837 | controller | 2026-06-11T20:18:32-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:18:32.801910 | controller | 2026-06-11T20:18:32-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:18:34.183315 | controller | 2026-06-11T20:18:34-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:18:34.183402 | controller | 2026-06-11T20:18:34-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:18:35.768781 | controller | 2026-06-11T20:18:35-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:18:35.768844 | controller | 2026-06-11T20:18:35-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:18:36.582552 | controller | 2026-06-11T20:18:36-04:00 INFO 2026-06-11 20:18:36.582630 | controller | - Config: Waiting ... 2026-06-11 20:18:36.582641 | controller | - Gateway: OK 2026-06-11 20:18:36.582649 | controller | - GitServer: OK 2026-06-11 20:18:36.582658 | controller | - HoundSearch: OK 2026-06-11 20:18:36.582665 | controller | - LogJuicer: OK 2026-06-11 20:18:36.582673 | controller | - Logserver: OK 2026-06-11 20:18:36.582680 | controller | - MariaDB: OK 2026-06-11 20:18:36.582688 | controller | - NodePoolBuilder: OK 2026-06-11 20:18:36.582696 | controller | - NodePoolLauncher: OK 2026-06-11 20:18:36.582703 | controller | - Zookeeper: OK 2026-06-11 20:18:36.582711 | controller | - Zuul: Waiting ... 2026-06-11 20:18:36.582719 | controller | - |_ Config Secrets: OK 2026-06-11 20:18:36.582726 | controller | - |_ Executor: OK 2026-06-11 20:18:36.582734 | controller | - |_ Merger: OK 2026-06-11 20:18:36.582741 | controller | - |_ Scheduler: OK 2026-06-11 20:18:36.582749 | controller | - |_ Web: Waiting ... 2026-06-11 20:18:36.582757 | controller | 2026-06-11 20:18:37.588529 | controller | 2026-06-11T20:18:37-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:18:38.193762 | controller | 2026-06-11T20:18:38-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:18:38.193843 | controller | 2026-06-11T20:18:38-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:18:38.208811 | controller | 2026-06-11T20:18:38-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:18:38.208880 | controller | 2026-06-11T20:18:38-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:18:38.229508 | controller | 2026-06-11T20:18:38-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:18:38.229585 | controller | 2026-06-11T20:18:38-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:18:38.603756 | controller | 2026-06-11T20:18:38-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:18:39.009196 | controller | 2026-06-11T20:18:39-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:18:39.009274 | controller | 2026-06-11T20:18:39-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:18:40.381807 | controller | 2026-06-11T20:18:40-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:18:40.381880 | controller | 2026-06-11T20:18:40-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:18:41.966644 | controller | 2026-06-11T20:18:41-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:18:41.966725 | controller | 2026-06-11T20:18:41-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:18:42.777589 | controller | 2026-06-11T20:18:42-04:00 INFO 2026-06-11 20:18:42.777658 | controller | - Config: Waiting ... 2026-06-11 20:18:42.777667 | controller | - Gateway: OK 2026-06-11 20:18:42.777675 | controller | - GitServer: OK 2026-06-11 20:18:42.777682 | controller | - HoundSearch: OK 2026-06-11 20:18:42.777690 | controller | - LogJuicer: OK 2026-06-11 20:18:42.777697 | controller | - Logserver: OK 2026-06-11 20:18:42.777704 | controller | - MariaDB: OK 2026-06-11 20:18:42.777711 | controller | - NodePoolBuilder: OK 2026-06-11 20:18:42.777718 | controller | - NodePoolLauncher: OK 2026-06-11 20:18:42.777726 | controller | - Zookeeper: OK 2026-06-11 20:18:42.777733 | controller | - Zuul: Waiting ... 2026-06-11 20:18:42.777740 | controller | - |_ Config Secrets: OK 2026-06-11 20:18:42.777747 | controller | - |_ Executor: OK 2026-06-11 20:18:42.777755 | controller | - |_ Merger: OK 2026-06-11 20:18:42.777762 | controller | - |_ Scheduler: OK 2026-06-11 20:18:42.777769 | controller | - |_ Web: Waiting ... 2026-06-11 20:18:42.777777 | controller | 2026-06-11 20:18:43.783467 | controller | 2026-06-11T20:18:43-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:18:44.389114 | controller | 2026-06-11T20:18:44-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:18:44.389192 | controller | 2026-06-11T20:18:44-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:18:44.410171 | controller | 2026-06-11T20:18:44-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:18:44.410222 | controller | 2026-06-11T20:18:44-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:18:44.433954 | controller | 2026-06-11T20:18:44-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:18:44.434014 | controller | 2026-06-11T20:18:44-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:18:44.796266 | controller | 2026-06-11T20:18:44-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:18:45.202442 | controller | 2026-06-11T20:18:45-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:18:45.202532 | controller | 2026-06-11T20:18:45-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:18:46.582513 | controller | 2026-06-11T20:18:46-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:18:46.582618 | controller | 2026-06-11T20:18:46-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:18:48.167950 | controller | 2026-06-11T20:18:48-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:18:48.168026 | controller | 2026-06-11T20:18:48-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:18:49.377457 | controller | 2026-06-11T20:18:49-04:00 INFO 2026-06-11 20:18:49.377539 | controller | - Config: OK 2026-06-11 20:18:49.377549 | controller | - Gateway: OK 2026-06-11 20:18:49.377558 | controller | - GitServer: OK 2026-06-11 20:18:49.377566 | controller | - HoundSearch: OK 2026-06-11 20:18:49.377574 | controller | - LogJuicer: OK 2026-06-11 20:18:49.377582 | controller | - Logserver: OK 2026-06-11 20:18:49.377590 | controller | - MariaDB: OK 2026-06-11 20:18:49.377597 | controller | - NodePoolBuilder: OK 2026-06-11 20:18:49.377605 | controller | - NodePoolLauncher: OK 2026-06-11 20:18:49.377613 | controller | - Zookeeper: OK 2026-06-11 20:18:49.377621 | controller | - Zuul: OK 2026-06-11 20:18:49.377630 | controller | 2026-06-11 20:18:49.377863 | controller | • [159.997 seconds] 2026-06-11 20:18:49.377881 | controller | ------------------------------ 2026-06-11 20:18:49.377972 | controller | Project Private Keys Rotation zuul-web config-errors remain empty after rotation 2026-06-11 20:18:49.377986 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/project_private_keys_rotation_test.go:103 2026-06-11 20:18:49.378170 | controller | STEP: Ensuring tenant have no config errors @ 06/11/26 20:18:49.378 2026-06-11 20:18:49.378261 | controller | 2026-06-11T20:18:49-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [curl -s zuul-web:9000/api/tenant/internal/config-errors] 2026-06-11 20:18:49.553789 | controller | 2026-06-11T20:18:49-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [curl -s zuul-web:9000/api/tenant/demo-tenant/config-errors] 2026-06-11 20:18:49.746825 | controller | • [0.369 seconds] 2026-06-11 20:18:49.746913 | controller | ------------------------------ 2026-06-11 20:18:49.746938 | controller | Project Private Keys Rotation project private keys changed when rotation was applied 2026-06-11 20:18:49.746949 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/project_private_keys_rotation_test.go:107 2026-06-11 20:18:49.746978 | controller | 2026-06-11T20:18:49-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [bash -c python3 << 'PYEOF' 2026-06-11 20:18:49.746991 | controller | import configparser 2026-06-11 20:18:49.747002 | controller | import hashlib 2026-06-11 20:18:49.747014 | controller | from zuul.zk import ZooKeeperClient 2026-06-11 20:18:49.747026 | controller | from zuul.lib.keystorage import KeyStorage 2026-06-11 20:18:49.747037 | controller | from zuul.lib import encryption 2026-06-11 20:18:49.747049 | controller | 2026-06-11 20:18:49.747060 | controller | config = configparser.ConfigParser() 2026-06-11 20:18:49.747076 | controller | config.read("/etc/zuul/zuul.conf") 2026-06-11 20:18:49.747088 | controller | password = config["keystore"]["password"].encode("utf-8") 2026-06-11 20:18:49.747099 | controller | zk_client = ZooKeeperClient.fromConfig(config) 2026-06-11 20:18:49.747110 | controller | zk_client.connect() 2026-06-11 20:18:49.747121 | controller | lines = [] 2026-06-11 20:18:49.747133 | controller | for path, obj in KeyStorage(zk_client, "unused").exportKeys().get("keys", {}).items(): 2026-06-11 20:18:49.747144 | controller | if path.endswith("/secrets") and "keys" in obj and len(obj.get("keys", [])) == 1: 2026-06-11 20:18:49.747155 | controller | created = obj["keys"][0]["created"] 2026-06-11 20:18:49.747166 | controller | priv_pem = obj["keys"][0]["private_key"] 2026-06-11 20:18:49.747177 | controller | fingerprint = hashlib.sha256(priv_pem.encode()).hexdigest()[:16] 2026-06-11 20:18:49.747203 | controller | lines.append(f"{path} {created} {fingerprint}") 2026-06-11 20:18:49.747215 | controller | if "demo-project" in path: 2026-06-11 20:18:49.747226 | controller | priv, _ = encryption.deserialize_rsa_keypair(priv_pem.encode("utf-8"), password) 2026-06-11 20:18:49.747237 | controller | pem = encryption.serialize_rsa_private_key(priv, None) 2026-06-11 20:18:49.747248 | controller | with open("/tmp/demo-project.key", "wb") as f: 2026-06-11 20:18:49.747259 | controller | f.write(pem) 2026-06-11 20:18:49.747276 | controller | print("\n".join(sorted(lines))) 2026-06-11 20:18:49.747287 | controller | PYEOF 2026-06-11 20:18:49.747298 | controller | ] 2026-06-11 20:18:51.182883 | controller | STEP: Project keys after rotation: /keystorage/gerrit/config/config/secrets 1781223396 2fa9d996a1295ff2 2026-06-11 20:18:51.182962 | controller | /keystorage/gerrit/demo-project/demo-project/secrets 1781223373 64961e44f5866acb 2026-06-11 20:18:51.182976 | controller | /keystorage/gerrit/demo-tenant-config/demo-tenant-config/secrets 1781223393 89d1e03a81db1784 2026-06-11 20:18:51.182985 | controller | /keystorage/git-server/system-config/system-config/secrets 1781223397 9e35f316ff40a9e2 2026-06-11 20:18:51.182994 | controller | /keystorage/opendev.org/zuul/zuul%2Fzuul-jobs/secrets 1781223394 1f95a069679c93fe 2026-06-11 20:18:51.183003 | controller | @ 06/11/26 20:18:51.182 2026-06-11 20:18:51.183012 | controller | STEP: Pulling latest demo-project and reading .zuul.d/secrets.yaml @ 06/11/26 20:18:51.182 2026-06-11 20:18:51.296265 | controller | STEP: Writing secrets.yaml into zuul-scheduler pod for decryption @ 06/11/26 20:18:51.296 2026-06-11 20:18:51.296314 | controller | 2026-06-11T20:18:51-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [bash -c cat > /tmp/secrets.yaml] 2026-06-11 20:18:51.440697 | controller | STEP: Loading project keys state (writes demo-project key to /tmp/demo-project.key) @ 06/11/26 20:18:51.44 2026-06-11 20:18:51.440779 | controller | 2026-06-11T20:18:51-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [bash -c python3 << 'PYEOF' 2026-06-11 20:18:51.440790 | controller | import configparser 2026-06-11 20:18:51.440799 | controller | import hashlib 2026-06-11 20:18:51.440808 | controller | from zuul.zk import ZooKeeperClient 2026-06-11 20:18:51.440817 | controller | from zuul.lib.keystorage import KeyStorage 2026-06-11 20:18:51.440825 | controller | from zuul.lib import encryption 2026-06-11 20:18:51.440834 | controller | 2026-06-11 20:18:51.440842 | controller | config = configparser.ConfigParser() 2026-06-11 20:18:51.440850 | controller | config.read("/etc/zuul/zuul.conf") 2026-06-11 20:18:51.440858 | controller | password = config["keystore"]["password"].encode("utf-8") 2026-06-11 20:18:51.440866 | controller | zk_client = ZooKeeperClient.fromConfig(config) 2026-06-11 20:18:51.440874 | controller | zk_client.connect() 2026-06-11 20:18:51.440882 | controller | lines = [] 2026-06-11 20:18:51.440890 | controller | for path, obj in KeyStorage(zk_client, "unused").exportKeys().get("keys", {}).items(): 2026-06-11 20:18:51.440899 | controller | if path.endswith("/secrets") and "keys" in obj and len(obj.get("keys", [])) == 1: 2026-06-11 20:18:51.440907 | controller | created = obj["keys"][0]["created"] 2026-06-11 20:18:51.440915 | controller | priv_pem = obj["keys"][0]["private_key"] 2026-06-11 20:18:51.440923 | controller | fingerprint = hashlib.sha256(priv_pem.encode()).hexdigest()[:16] 2026-06-11 20:18:51.440931 | controller | lines.append(f"{path} {created} {fingerprint}") 2026-06-11 20:18:51.440939 | controller | if "demo-project" in path: 2026-06-11 20:18:51.440947 | controller | priv, _ = encryption.deserialize_rsa_keypair(priv_pem.encode("utf-8"), password) 2026-06-11 20:18:51.440955 | controller | pem = encryption.serialize_rsa_private_key(priv, None) 2026-06-11 20:18:51.440963 | controller | with open("/tmp/demo-project.key", "wb") as f: 2026-06-11 20:18:51.440971 | controller | f.write(pem) 2026-06-11 20:18:51.440979 | controller | print("\n".join(sorted(lines))) 2026-06-11 20:18:51.440987 | controller | PYEOF 2026-06-11 20:18:51.440995 | controller | ] 2026-06-11 20:18:53.179940 | controller | STEP: Decrypting with Zuul library @ 06/11/26 20:18:53.179 2026-06-11 20:18:53.180015 | controller | 2026-06-11T20:18:53-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [bash -c python3 << 'PYEOF' 2026-06-11 20:18:53.180047 | controller | from zuul.lib import encryption 2026-06-11 20:18:53.180057 | controller | import zuul.configloader 2026-06-11 20:18:53.180065 | controller | import zuul.model 2026-06-11 20:18:53.180073 | controller | 2026-06-11 20:18:53.180082 | controller | with open("/tmp/demo-project.key", "rb") as f: 2026-06-11 20:18:53.180090 | controller | private_secrets_key, _ = encryption.deserialize_rsa_keypair(f.read()) 2026-06-11 20:18:53.180099 | controller | with open("/tmp/secrets.yaml") as f: 2026-06-11 20:18:53.180106 | controller | yaml_content = f.read() 2026-06-11 20:18:53.180114 | controller | 2026-06-11 20:18:53.180122 | controller | parser = zuul.configloader.SecretParser(None) 2026-06-11 20:18:53.180130 | controller | sc = zuul.model.SourceContext(None, "project", None, "master", "path") 2026-06-11 20:18:53.180138 | controller | data = zuul.configloader.safe_load_yaml(yaml_content, sc) 2026-06-11 20:18:53.180146 | controller | for element in data: 2026-06-11 20:18:53.180192 | controller | if "secret" not in element: 2026-06-11 20:18:53.180201 | controller | continue 2026-06-11 20:18:53.180208 | controller | secret = parser.fromYaml(element["secret"]) 2026-06-11 20:18:53.180216 | controller | decrypted = secret.decrypt(private_secrets_key).secret_data 2026-06-11 20:18:53.180224 | controller | if isinstance(decrypted, dict) and "password" in decrypted: 2026-06-11 20:18:53.180232 | controller | print(decrypted["password"], end="") 2026-06-11 20:18:53.180240 | controller | elif isinstance(decrypted, str): 2026-06-11 20:18:53.180255 | controller | print(decrypted, end="") 2026-06-11 20:18:53.180263 | controller | else: 2026-06-11 20:18:53.180271 | controller | print(decrypted, end="") 2026-06-11 20:18:53.180279 | controller | break 2026-06-11 20:18:53.180287 | controller | PYEOF 2026-06-11 20:18:53.180295 | controller | ] 2026-06-11 20:18:54.583893 | controller | STEP: Decrypted secret: -----BEGIN OPENSSH PRIVATE KEY----- 2026-06-11 20:18:54.583984 | controller | b3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAAAMwAAAAtzc2gtZW 2026-06-11 20:18:54.584001 | controller | QyNTUxOQAAACBJC/TVjIpbQrQNeaUDGvx0nUwUmZ7PP8LjuY7AkqNKsAAAAKjFzz4txc8+ 2026-06-11 20:18:54.584014 | controller | LQAAAAtzc2gtZWQyNTUxOQAAACBJC/TVjIpbQrQNeaUDGvx0nUwUmZ7PP8LjuY7AkqNKsA 2026-06-11 20:18:54.584026 | controller | AAAEBJ/INrzvj06MENbBKfXqfWFcVYt3Q4um4Tbf7dBdldJ0kL9NWMiltCtA15pQMa/HSd 2026-06-11 20:18:54.584038 | controller | TBSZns8/wuO5jsCSo0qwAAAAInp1dWwtd29ya2VyQG5wMDAwMDA3MTMyNi5ub3ZhbG9jYW 2026-06-11 20:18:54.584049 | controller | wBAgM= 2026-06-11 20:18:54.584062 | controller | -----END OPENSSH PRIVATE KEY----- @ 06/11/26 20:18:54.583 2026-06-11 20:18:54.584085 | controller | • [4.837 seconds] 2026-06-11 20:18:54.584099 | controller | ------------------------------ 2026-06-11 20:18:54.584111 | controller | Secret Rotations zuul-auth works 2026-06-11 20:18:54.584127 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/secrets_rotation_test.go:60 2026-06-11 20:18:54.590898 | controller | STEP: Deleting secrets not rotated by the CLI @ 06/11/26 20:18:54.59 2026-06-11 20:18:54.599658 | controller | STEP: Running secret rotation CLI @ 06/11/26 20:18:54.599 2026-06-11 20:18:54.610806 | controller | 2026-06-11T20:18:54-04:00 INFO Warning: At least one executor running, this may cause issues when rotating Zookeeper secrets. 2026-06-11 20:18:54.610870 | controller | 2026-06-11T20:18:54-04:00 INFO Rotating Keystore password... 2026-06-11 20:18:54.619828 | controller | 2026-06-11T20:18:54-04:00 INFO Creating secret, name: zuul-keystore-password-new 2026-06-11 20:18:54.619894 | controller | 2026-06-11T20:18:54-04:00 INFO Creating object, name: zuul-keystore-password-new 2026-06-11 20:18:55.362423 | controller | 2026-06-11T20:18:55-04:00 INFO Running pod execution pod: zuul-kazoo, command: [cat /var/lib/zuul/keys-backup.json] 2026-06-11 20:18:55.495474 | controller | 2026-06-11T20:18:55-04:00 INFO Updating object, name: zuul-keystore-password 2026-06-11 20:18:55.499529 | controller | 2026-06-11T20:18:55-04:00 INFO Deleting object, name: zuul-keystore-password-new 2026-06-11 20:18:55.506124 | controller | 2026-06-11T20:18:55-04:00 INFO Deleting object, name: zuul-kazoo 2026-06-11 20:18:55.510013 | controller | 2026-06-11T20:18:55-04:00 INFO Killing every kazoo client... 2026-06-11 20:18:55.540833 | controller | 2026-06-11T20:18:55-04:00 INFO Warning: Killing ZooKeeper client: nodepool-builder-0 nodepool-builder 2026-06-11 20:18:55.540918 | controller | 2026-06-11T20:18:55-04:00 INFO Running pod execution pod: nodepool-builder-0, command: [kill -9 1] 2026-06-11 20:18:55.674827 | controller | 2026-06-11T20:18:55-04:00 INFO Deleting object, name: nodepool-builder 2026-06-11 20:18:55.680181 | controller | 2026-06-11T20:18:55-04:00 INFO Warning: Killing ZooKeeper client: nodepool-launcher-6d769b7f4d-9bh24 launcher 2026-06-11 20:18:55.680244 | controller | 2026-06-11T20:18:55-04:00 INFO Running pod execution pod: nodepool-launcher-6d769b7f4d-9bh24, command: [kill -9 1] 2026-06-11 20:18:55.816406 | controller | 2026-06-11T20:18:55-04:00 INFO Deleting object, name: launcher 2026-06-11 20:18:55.819501 | controller | 2026-06-11T20:18:55-04:00 INFO Warning: Killing ZooKeeper client: zuul-db-provision-74d9p mariadb-client 2026-06-11 20:18:55.819528 | controller | 2026-06-11T20:18:55-04:00 INFO Running pod execution pod: zuul-db-provision-74d9p, command: [kill -9 1] 2026-06-11 20:18:55.839795 | controller | 2026-06-11T20:18:55-04:00 INFO Deleting object, name: mariadb-client 2026-06-11 20:18:55.843550 | controller | 2026-06-11T20:18:55-04:00 INFO Warning: Killing ZooKeeper client: zuul-executor-0 zuul-executor 2026-06-11 20:18:55.843583 | controller | 2026-06-11T20:18:55-04:00 INFO Running pod execution pod: zuul-executor-0, command: [kill -9 1] 2026-06-11 20:19:57.802338 | controller | 2026-06-11T20:19:57-04:00 INFO Deleting object, name: zuul-executor 2026-06-11 20:19:57.805545 | controller | 2026-06-11T20:19:57-04:00 INFO Warning: Killing ZooKeeper client: zuul-kazoo zuul-kazoo 2026-06-11 20:19:57.805593 | controller | 2026-06-11T20:19:57-04:00 INFO Running pod execution pod: zuul-kazoo, command: [kill -9 1] 2026-06-11 20:19:57.818013 | controller | 2026-06-11T20:19:57-04:00 INFO Deleting object, name: zuul-kazoo 2026-06-11 20:19:57.821555 | controller | 2026-06-11T20:19:57-04:00 INFO Warning: Killing ZooKeeper client: zuul-merger-0 zuul-merger 2026-06-11 20:19:57.821606 | controller | 2026-06-11T20:19:57-04:00 INFO Running pod execution pod: zuul-merger-0, command: [kill -9 1] 2026-06-11 20:19:57.948641 | controller | 2026-06-11T20:19:57-04:00 INFO Deleting object, name: zuul-merger 2026-06-11 20:19:57.952498 | controller | 2026-06-11T20:19:57-04:00 INFO Warning: Killing ZooKeeper client: zuul-scheduler-0 zuul-scheduler 2026-06-11 20:19:57.952545 | controller | 2026-06-11T20:19:57-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [kill -9 1] 2026-06-11 20:19:58.077870 | controller | 2026-06-11T20:19:58-04:00 INFO Deleting object, name: zuul-scheduler 2026-06-11 20:19:58.082399 | controller | 2026-06-11T20:19:58-04:00 INFO Warning: Killing ZooKeeper client: zuul-web-6c87c99b48-j59jz zuul-web 2026-06-11 20:19:58.082456 | controller | 2026-06-11T20:19:58-04:00 INFO Running pod execution pod: zuul-web-6c87c99b48-j59jz, command: [kill -9 1] 2026-06-11 20:19:58.210645 | controller | 2026-06-11T20:19:58-04:00 INFO Deleting object, name: zuul-web 2026-06-11 20:19:58.215080 | controller | 2026-06-11T20:19:58-04:00 INFO Warning: Killing ZooKeeper client: zuul-weeder-57c6567f5f-c7pfc zuul-weeder 2026-06-11 20:19:58.215147 | controller | 2026-06-11T20:19:58-04:00 INFO Running pod execution pod: zuul-weeder-57c6567f5f-c7pfc, command: [kill -9 1] 2026-06-11 20:19:58.308924 | controller | 2026-06-11T20:19:58-04:00 INFO Deleting object, name: zuul-weeder 2026-06-11 20:19:58.311997 | controller | 2026-06-11T20:19:58-04:00 INFO Deleting object, name: zookeeper 2026-06-11 20:19:58.315165 | controller | 2026-06-11T20:19:58-04:00 INFO Rotating Zuul Client Authenticator secret... 2026-06-11 20:19:58.316678 | controller | 2026-06-11T20:19:58-04:00 INFO Deleting object, name: zuul-auth-secret 2026-06-11 20:19:58.321203 | controller | 2026-06-11T20:19:58-04:00 INFO Creating secret, name: zuul-auth-secret 2026-06-11 20:19:58.321268 | controller | 2026-06-11T20:19:58-04:00 INFO Creating object, name: zuul-auth-secret 2026-06-11 20:19:58.323024 | controller | 2026-06-11T20:19:58-04:00 INFO Rotating Zuul DB Connection secret... 2026-06-11 20:19:58.325472 | controller | 2026-06-11T20:19:58-04:00 INFO Deleting object, name: zuul-db-connection 2026-06-11 20:19:58.327321 | controller | 2026-06-11T20:19:58-04:00 INFO Rotating Zookeeper certificates... 2026-06-11 20:19:58.331790 | controller | 2026-06-11T20:19:58-04:00 INFO Deleting object, name: zookeeper-client-tls 2026-06-11 20:19:58.335543 | controller | 2026-06-11T20:19:58-04:00 INFO Deleting object, name: zookeeper-server-tls 2026-06-11 20:19:58.339416 | controller | 2026-06-11T20:19:58-04:00 INFO Force Restart impacted services... 2026-06-11 20:19:58.339456 | controller | 2026-06-11T20:19:58-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 20:19:58.341870 | controller | 2026-06-11T20:19:58-04:00 INFO Deleting object, name: zuul-web-6c87c99b48-j59jz 2026-06-11 20:19:58.344908 | controller | STEP: Reconciling @ 06/11/26 20:19:58.344 2026-06-11 20:19:58.535233 | controller | 2026-06-11T20:19:58-04:00 INFO Warning: Killing ZooKeeper client: nodepool-launcher-6d769b7f4d-9bh24 launcher 2026-06-11 20:19:58.535336 | controller | 2026-06-11T20:19:58-04:00 INFO Running pod execution pod: nodepool-launcher-6d769b7f4d-9bh24, command: [kill -9 1] 2026-06-11 20:19:58.624394 | controller | 2026-06-11T20:19:58-04:00 INFO Deleting object, name: launcher 2026-06-11 20:19:58.626611 | controller | 2026-06-11T20:19:58-04:00 INFO Warning: Killing ZooKeeper client: zuul-db-provision-74d9p mariadb-client 2026-06-11 20:19:58.626651 | controller | 2026-06-11T20:19:58-04:00 INFO Running pod execution pod: zuul-db-provision-74d9p, command: [kill -9 1] 2026-06-11 20:19:58.647079 | controller | 2026-06-11T20:19:58-04:00 INFO Deleting object, name: mariadb-client 2026-06-11 20:19:58.649560 | controller | 2026-06-11T20:19:58-04:00 INFO Warning: Killing ZooKeeper client: zuul-executor-0 zuul-executor 2026-06-11 20:19:58.649594 | controller | 2026-06-11T20:19:58-04:00 INFO Running pod execution pod: zuul-executor-0, command: [kill -9 1] 2026-06-11 20:19:58.670883 | controller | 2026-06-11T20:19:58-04:00 INFO Deleting object, name: zuul-executor 2026-06-11 20:19:58.673271 | controller | 2026-06-11T20:19:58-04:00 INFO Warning: Killing ZooKeeper client: zuul-merger-0 zuul-merger 2026-06-11 20:19:58.673302 | controller | 2026-06-11T20:19:58-04:00 INFO Running pod execution pod: zuul-merger-0, command: [kill -9 1] 2026-06-11 20:19:59.451793 | controller | 2026-06-11T20:19:59-04:00 INFO Deleting object, name: zuul-merger 2026-06-11 20:19:59.455018 | controller | 2026-06-11T20:19:59-04:00 INFO Warning: Killing ZooKeeper client: zuul-scheduler-0 zuul-scheduler 2026-06-11 20:19:59.455235 | controller | 2026-06-11T20:19:59-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [kill -9 1] 2026-06-11 20:20:28.288777 | controller | 2026-06-11T20:20:28-04:00 INFO Deleting object, name: zuul-scheduler 2026-06-11 20:20:28.292685 | controller | 2026-06-11T20:20:28-04:00 INFO Warning: Killing ZooKeeper client: zuul-web-6c87c99b48-j59jz zuul-web 2026-06-11 20:20:28.292863 | controller | 2026-06-11T20:20:28-04:00 INFO Running pod execution pod: zuul-web-6c87c99b48-j59jz, command: [kill -9 1] 2026-06-11 20:20:28.441271 | controller | 2026-06-11T20:20:28-04:00 INFO Deleting object, name: zuul-web 2026-06-11 20:20:28.444301 | controller | 2026-06-11T20:20:28-04:00 INFO Warning: Killing ZooKeeper client: zuul-weeder-57c6567f5f-c7pfc zuul-weeder 2026-06-11 20:20:28.444438 | controller | 2026-06-11T20:20:28-04:00 INFO Running pod execution pod: zuul-weeder-57c6567f5f-c7pfc, command: [kill -9 1] 2026-06-11 20:20:28.457314 | controller | 2026-06-11T20:20:28-04:00 INFO Deleting object, name: zuul-weeder 2026-06-11 20:20:28.460327 | controller | 2026-06-11T20:20:28-04:00 INFO Deleting object, name: zookeeper 2026-06-11 20:20:28.465399 | controller | 2026-06-11T20:20:28-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:20:28.517286 | controller | 2026-06-11T20:20:28-04:00 INFO Creating object, name: zuul-db-connection 2026-06-11 20:20:28.523052 | controller | 2026-06-11T20:20:28-04:00 INFO Re-provisioning db password 2026-06-11 20:20:28.523080 | controller | 2026-06-11T20:20:28-04:00 INFO Deleting object, name: zuul-db-provision 2026-06-11 20:20:28.526398 | controller | 2026-06-11T20:20:28-04:00 INFO Creating object, name: zuul-db-provision 2026-06-11 20:20:29.074902 | controller | 2026-06-11T20:20:29-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:20:29.074964 | controller | 2026-06-11T20:20:29-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:20:29.082902 | controller | 2026-06-11T20:20:29-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:20:29.242071 | controller | 2026-06-11T20:20:29-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:20:29.248936 | controller | 2026-06-11T20:20:29-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:20:29.248999 | controller | 2026-06-11T20:20:29-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:20:29.266648 | controller | 2026-06-11T20:20:29-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:20:29.266698 | controller | 2026-06-11T20:20:29-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:20:29.268888 | controller | 2026-06-11T20:20:29-04:00 INFO Deleting object, name: zookeeper-client-tls 2026-06-11 20:20:29.469773 | controller | 2026-06-11T20:20:29-04:00 INFO Deleting object, name: zookeeper-server-tls 2026-06-11 20:20:32.275838 | controller | 2026-06-11T20:20:32-04:00 INFO Creating object, name: zookeeper-client-tls 2026-06-11 20:20:33.049440 | controller | 2026-06-11T20:20:33-04:00 INFO Creating object, name: zookeeper-server-tls 2026-06-11 20:20:33.064093 | controller | 2026-06-11T20:20:33-04:00 INFO Creating object, name: zookeeper 2026-06-11 20:20:33.070555 | controller | 2026-06-11T20:20:33-04:00 INFO Waiting for Zookeeper service to be ready ... 2026-06-11 20:20:33.070679 | controller | 2026-06-11T20:20:33-04:00 INFO 2026-06-11 20:20:33.070693 | controller | - Config: Waiting ... 2026-06-11 20:20:33.070702 | controller | - Gateway: OK 2026-06-11 20:20:33.070711 | controller | - GitServer: OK 2026-06-11 20:20:33.070719 | controller | - HoundSearch: OK 2026-06-11 20:20:33.070772 | controller | - LogJuicer: OK 2026-06-11 20:20:33.070782 | controller | - Logserver: OK 2026-06-11 20:20:33.070790 | controller | - MariaDB: Waiting ... 2026-06-11 20:20:33.070798 | controller | - Zookeeper: Waiting ... 2026-06-11 20:20:33.070806 | controller | 2026-06-11 20:20:34.077359 | controller | 2026-06-11T20:20:34-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:20:34.129762 | controller | 2026-06-11T20:20:34-04:00 INFO Creating object, name: zuul-db-provision 2026-06-11 20:20:34.681911 | controller | 2026-06-11T20:20:34-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:20:34.681990 | controller | 2026-06-11T20:20:34-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:20:34.696208 | controller | 2026-06-11T20:20:34-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:20:34.696263 | controller | 2026-06-11T20:20:34-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:20:34.717031 | controller | 2026-06-11T20:20:34-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:20:34.717082 | controller | 2026-06-11T20:20:34-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:20:35.089755 | controller | 2026-06-11T20:20:35-04:00 INFO Waiting for statefulset, name: zookeeper 2026-06-11 20:20:51.158740 | controller | 2026-06-11T20:20:51-04:00 INFO Waiting for GitServer and MariaDB services to be ready ... 2026-06-11 20:20:51.158808 | controller | 2026-06-11T20:20:51-04:00 INFO 2026-06-11 20:20:51.158819 | controller | - Config: Waiting ... 2026-06-11 20:20:51.158828 | controller | - Gateway: OK 2026-06-11 20:20:51.158836 | controller | - GitServer: OK 2026-06-11 20:20:51.158844 | controller | - HoundSearch: OK 2026-06-11 20:20:51.158852 | controller | - LogJuicer: OK 2026-06-11 20:20:51.158860 | controller | - Logserver: OK 2026-06-11 20:20:51.158867 | controller | - MariaDB: Waiting ... 2026-06-11 20:20:51.158875 | controller | - Zookeeper: OK 2026-06-11 20:20:51.158883 | controller | 2026-06-11 20:20:52.164907 | controller | 2026-06-11T20:20:52-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:20:52.769553 | controller | 2026-06-11T20:20:52-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:20:52.769634 | controller | 2026-06-11T20:20:52-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:20:52.783419 | controller | 2026-06-11T20:20:52-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:20:52.783496 | controller | 2026-06-11T20:20:52-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:20:52.807365 | controller | 2026-06-11T20:20:52-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:20:52.807472 | controller | 2026-06-11T20:20:52-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:20:53.182215 | controller | 2026-06-11T20:20:53-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:20:53.583728 | controller | 2026-06-11T20:20:53-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:20:53.583794 | controller | 2026-06-11T20:20:53-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:20:53.778000 | controller | 2026-06-11T20:20:53-04:00 INFO Creating object, name: nodepool-builder 2026-06-11 20:20:54.562998 | controller | 2026-06-11T20:20:54-04:00 INFO Updating secret, name: zuul-config 2026-06-11 20:20:54.563076 | controller | 2026-06-11T20:20:54-04:00 INFO Updating object, name: zuul-config 2026-06-11 20:20:54.787973 | controller | 2026-06-11T20:20:54-04:00 INFO Creating object, name: zuul-scheduler 2026-06-11 20:20:54.815011 | controller | 2026-06-11T20:20:54-04:00 INFO Creating object, name: zuul-executor 2026-06-11 20:20:55.568268 | controller | 2026-06-11T20:20:55-04:00 INFO Creating object, name: zuul-web 2026-06-11 20:20:56.369157 | controller | 2026-06-11T20:20:56-04:00 INFO Creating object, name: zuul-merger 2026-06-11 20:20:56.376466 | controller | 2026-06-11T20:20:56-04:00 INFO 2026-06-11 20:20:56.376512 | controller | - Config: Waiting ... 2026-06-11 20:20:56.376522 | controller | - Gateway: OK 2026-06-11 20:20:56.376530 | controller | - GitServer: OK 2026-06-11 20:20:56.376538 | controller | - HoundSearch: OK 2026-06-11 20:20:56.376544 | controller | - LogJuicer: OK 2026-06-11 20:20:56.376551 | controller | - Logserver: OK 2026-06-11 20:20:56.376558 | controller | - MariaDB: OK 2026-06-11 20:20:56.376564 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:20:56.376570 | controller | - NodePoolLauncher: OK 2026-06-11 20:20:56.376574 | controller | - Zookeeper: OK 2026-06-11 20:20:56.376579 | controller | - Zuul: Waiting ... 2026-06-11 20:20:56.376584 | controller | - |_ Config Secrets: OK 2026-06-11 20:20:56.376589 | controller | - |_ Executor: Waiting ... 2026-06-11 20:20:56.376594 | controller | - |_ Merger: Waiting ... 2026-06-11 20:20:56.376599 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:20:56.376604 | controller | - |_ Web: Waiting ... 2026-06-11 20:20:56.376609 | controller | 2026-06-11 20:20:57.383965 | controller | 2026-06-11T20:20:57-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:20:57.988872 | controller | 2026-06-11T20:20:57-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:20:57.988926 | controller | 2026-06-11T20:20:57-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:20:58.001093 | controller | 2026-06-11T20:20:58-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:20:58.001135 | controller | 2026-06-11T20:20:58-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:20:58.023576 | controller | 2026-06-11T20:20:58-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:20:58.023632 | controller | 2026-06-11T20:20:58-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:20:58.399189 | controller | 2026-06-11T20:20:58-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:20:58.797122 | controller | 2026-06-11T20:20:58-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:20:58.797196 | controller | 2026-06-11T20:20:58-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:21:00.175281 | controller | 2026-06-11T20:21:00-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:21:30.287741 | controller | 2026-06-11T20:21:30-04:00 INFO Statefulset "zuul-scheduler" not ready after 30s 2026-06-11 20:21:30.327465 | controller | 2026-06-11T20:21:30-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:21:30.327539 | controller | 2026-06-11T20:21:30-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:21:30.707110 | controller | 2026-06-11T20:21:30-04:00 INFO 2026-06-11 20:21:30.707192 | controller | - Config: Waiting ... 2026-06-11 20:21:30.707206 | controller | - Gateway: OK 2026-06-11 20:21:30.707218 | controller | - GitServer: OK 2026-06-11 20:21:30.707229 | controller | - HoundSearch: OK 2026-06-11 20:21:30.707240 | controller | - LogJuicer: OK 2026-06-11 20:21:30.707251 | controller | - Logserver: OK 2026-06-11 20:21:30.707258 | controller | - MariaDB: OK 2026-06-11 20:21:30.707267 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:21:30.707275 | controller | - NodePoolLauncher: OK 2026-06-11 20:21:30.707283 | controller | - Zookeeper: OK 2026-06-11 20:21:30.707290 | controller | - Zuul: Waiting ... 2026-06-11 20:21:30.707298 | controller | - |_ Config Secrets: OK 2026-06-11 20:21:30.707306 | controller | - |_ Executor: OK 2026-06-11 20:21:30.707314 | controller | - |_ Merger: OK 2026-06-11 20:21:30.707321 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:21:30.707329 | controller | - |_ Web: Waiting ... 2026-06-11 20:21:30.707347 | controller | 2026-06-11 20:21:31.713659 | controller | 2026-06-11T20:21:31-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:21:32.321424 | controller | 2026-06-11T20:21:32-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:21:32.321528 | controller | 2026-06-11T20:21:32-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:21:32.335074 | controller | 2026-06-11T20:21:32-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:21:32.335119 | controller | 2026-06-11T20:21:32-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:21:32.359102 | controller | 2026-06-11T20:21:32-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:21:32.359203 | controller | 2026-06-11T20:21:32-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:21:32.729809 | controller | 2026-06-11T20:21:32-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:21:33.132203 | controller | 2026-06-11T20:21:33-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:21:33.132276 | controller | 2026-06-11T20:21:33-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:21:34.504577 | controller | 2026-06-11T20:21:34-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:21:56.604052 | controller | 2026-06-11T20:21:56-04:00 INFO Creating object, name: zuul-weeder 2026-06-11 20:21:56.663125 | controller | 2026-06-11T20:21:56-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:21:56.663202 | controller | 2026-06-11T20:21:56-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:21:57.025865 | controller | 2026-06-11T20:21:57-04:00 INFO 2026-06-11 20:21:57.025955 | controller | - Config: Waiting ... 2026-06-11 20:21:57.025970 | controller | - Gateway: OK 2026-06-11 20:21:57.025978 | controller | - GitServer: OK 2026-06-11 20:21:57.025987 | controller | - HoundSearch: OK 2026-06-11 20:21:57.025994 | controller | - LogJuicer: OK 2026-06-11 20:21:57.026002 | controller | - Logserver: OK 2026-06-11 20:21:57.026009 | controller | - MariaDB: OK 2026-06-11 20:21:57.026017 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:21:57.026026 | controller | - NodePoolLauncher: OK 2026-06-11 20:21:57.026034 | controller | - Zookeeper: OK 2026-06-11 20:21:57.026041 | controller | - Zuul: Waiting ... 2026-06-11 20:21:57.026066 | controller | - |_ Config Secrets: OK 2026-06-11 20:21:57.026074 | controller | - |_ Executor: OK 2026-06-11 20:21:57.026082 | controller | - |_ Merger: OK 2026-06-11 20:21:57.026089 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:21:57.026097 | controller | - |_ Web: OK 2026-06-11 20:21:57.026105 | controller | 2026-06-11 20:21:58.031810 | controller | 2026-06-11T20:21:58-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:21:58.641012 | controller | 2026-06-11T20:21:58-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:21:58.641094 | controller | 2026-06-11T20:21:58-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:21:58.655152 | controller | 2026-06-11T20:21:58-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:21:58.655195 | controller | 2026-06-11T20:21:58-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:21:58.677869 | controller | 2026-06-11T20:21:58-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:21:58.677924 | controller | 2026-06-11T20:21:58-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:21:59.049173 | controller | 2026-06-11T20:21:59-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:21:59.455918 | controller | 2026-06-11T20:21:59-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:21:59.455990 | controller | 2026-06-11T20:21:59-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:22:00.826535 | controller | 2026-06-11T20:22:00-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:22:00.826612 | controller | 2026-06-11T20:22:00-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:22:02.415856 | controller | 2026-06-11T20:22:02-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:22:02.415952 | controller | 2026-06-11T20:22:02-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:22:03.625149 | controller | 2026-06-11T20:22:03-04:00 INFO Creating base secret job 2026-06-11 20:22:03.625754 | controller | 2026-06-11T20:22:03-04:00 INFO Creating object, name: config-base-secret-1-2691-ns 2026-06-11 20:22:03.630904 | controller | 2026-06-11T20:22:03-04:00 INFO 2026-06-11 20:22:03.630942 | controller | - Config: Waiting ... 2026-06-11 20:22:03.630993 | controller | - Gateway: OK 2026-06-11 20:22:03.631039 | controller | - GitServer: OK 2026-06-11 20:22:03.631094 | controller | - HoundSearch: OK 2026-06-11 20:22:03.631140 | controller | - LogJuicer: OK 2026-06-11 20:22:03.631185 | controller | - Logserver: OK 2026-06-11 20:22:03.631255 | controller | - MariaDB: OK 2026-06-11 20:22:03.631321 | controller | - NodePoolBuilder: OK 2026-06-11 20:22:03.631397 | controller | - NodePoolLauncher: OK 2026-06-11 20:22:03.631450 | controller | - Zookeeper: OK 2026-06-11 20:22:03.631506 | controller | - Zuul: OK 2026-06-11 20:22:03.631529 | controller | 2026-06-11 20:22:04.638387 | controller | 2026-06-11T20:22:04-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:22:05.245684 | controller | 2026-06-11T20:22:05-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:22:05.245767 | controller | 2026-06-11T20:22:05-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:22:05.265459 | controller | 2026-06-11T20:22:05-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:22:05.265540 | controller | 2026-06-11T20:22:05-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:22:05.292521 | controller | 2026-06-11T20:22:05-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:22:05.292607 | controller | 2026-06-11T20:22:05-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:22:05.656688 | controller | 2026-06-11T20:22:05-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:22:06.052442 | controller | 2026-06-11T20:22:06-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:22:06.052518 | controller | 2026-06-11T20:22:06-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:22:07.428168 | controller | 2026-06-11T20:22:07-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:22:07.428242 | controller | 2026-06-11T20:22:07-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:22:09.014717 | controller | 2026-06-11T20:22:09-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:22:09.014802 | controller | 2026-06-11T20:22:09-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:22:10.224650 | controller | 2026-06-11T20:22:10-04:00 INFO Running tenant-reconfigure for the 'internal' tenant 2026-06-11 20:22:10.411973 | controller | 2026-06-11T20:22:10-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [zuul-scheduler tenant-reconfigure internal] 2026-06-11 20:22:17.552196 | controller | 2026-06-11T20:22:17-04:00 INFO Deleting object, name: zuul-web 2026-06-11 20:22:17.557152 | controller | 2026-06-11T20:22:17-04:00 INFO Updating object, name: zs-internal-tenant-reconfigure 2026-06-11 20:22:17.559957 | controller | 2026-06-11T20:22:17-04:00 INFO 2026-06-11 20:22:17.559978 | controller | - Config: Waiting ... 2026-06-11 20:22:17.559985 | controller | - Gateway: OK 2026-06-11 20:22:17.559990 | controller | - GitServer: OK 2026-06-11 20:22:17.559995 | controller | - HoundSearch: OK 2026-06-11 20:22:17.559999 | controller | - LogJuicer: OK 2026-06-11 20:22:17.560004 | controller | - Logserver: OK 2026-06-11 20:22:17.560009 | controller | - MariaDB: OK 2026-06-11 20:22:17.560013 | controller | - NodePoolBuilder: OK 2026-06-11 20:22:17.560018 | controller | - NodePoolLauncher: OK 2026-06-11 20:22:17.560023 | controller | - Zookeeper: OK 2026-06-11 20:22:17.560027 | controller | - Zuul: OK 2026-06-11 20:22:17.560032 | controller | 2026-06-11 20:22:18.566420 | controller | 2026-06-11T20:22:18-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:22:19.174614 | controller | 2026-06-11T20:22:19-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:22:19.174682 | controller | 2026-06-11T20:22:19-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:22:19.188727 | controller | 2026-06-11T20:22:19-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:22:19.188751 | controller | 2026-06-11T20:22:19-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:22:19.207953 | controller | 2026-06-11T20:22:19-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:22:19.207979 | controller | 2026-06-11T20:22:19-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:22:19.577877 | controller | 2026-06-11T20:22:19-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:22:19.986138 | controller | 2026-06-11T20:22:19-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:22:19.986239 | controller | 2026-06-11T20:22:19-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:22:20.999350 | controller | 2026-06-11T20:22:20-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:22:20.999460 | controller | 2026-06-11T20:22:20-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:22:21.969602 | controller | 2026-06-11T20:22:21-04:00 INFO Creating object, name: zuul-web 2026-06-11 20:22:22.781122 | controller | 2026-06-11T20:22:22-04:00 INFO 2026-06-11 20:22:22.781186 | controller | - Config: Waiting ... 2026-06-11 20:22:22.781193 | controller | - Gateway: OK 2026-06-11 20:22:22.781198 | controller | - GitServer: OK 2026-06-11 20:22:22.781203 | controller | - HoundSearch: OK 2026-06-11 20:22:22.781208 | controller | - LogJuicer: OK 2026-06-11 20:22:22.781213 | controller | - Logserver: OK 2026-06-11 20:22:22.781218 | controller | - MariaDB: OK 2026-06-11 20:22:22.781223 | controller | - NodePoolBuilder: OK 2026-06-11 20:22:22.781227 | controller | - NodePoolLauncher: OK 2026-06-11 20:22:22.781232 | controller | - Zookeeper: OK 2026-06-11 20:22:22.781237 | controller | - Zuul: Waiting ... 2026-06-11 20:22:22.781242 | controller | - |_ Config Secrets: OK 2026-06-11 20:22:22.781246 | controller | - |_ Executor: OK 2026-06-11 20:22:22.781251 | controller | - |_ Merger: OK 2026-06-11 20:22:22.781256 | controller | - |_ Scheduler: OK 2026-06-11 20:22:22.781261 | controller | - |_ Web: Waiting ... 2026-06-11 20:22:22.781266 | controller | 2026-06-11 20:22:23.786142 | controller | 2026-06-11T20:22:23-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:22:24.391977 | controller | 2026-06-11T20:22:24-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:22:24.392043 | controller | 2026-06-11T20:22:24-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:22:24.404316 | controller | 2026-06-11T20:22:24-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:22:24.404362 | controller | 2026-06-11T20:22:24-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:22:24.430100 | controller | 2026-06-11T20:22:24-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:22:24.430179 | controller | 2026-06-11T20:22:24-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:22:24.802804 | controller | 2026-06-11T20:22:24-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:22:25.207291 | controller | 2026-06-11T20:22:25-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:22:25.207397 | controller | 2026-06-11T20:22:25-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:22:26.582160 | controller | 2026-06-11T20:22:26-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:22:26.582261 | controller | 2026-06-11T20:22:26-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:22:28.169646 | controller | 2026-06-11T20:22:28-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:22:28.169713 | controller | 2026-06-11T20:22:28-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:22:28.981821 | controller | 2026-06-11T20:22:28-04:00 INFO 2026-06-11 20:22:28.981907 | controller | - Config: Waiting ... 2026-06-11 20:22:28.981922 | controller | - Gateway: OK 2026-06-11 20:22:28.981934 | controller | - GitServer: OK 2026-06-11 20:22:28.981945 | controller | - HoundSearch: OK 2026-06-11 20:22:28.981956 | controller | - LogJuicer: OK 2026-06-11 20:22:28.981966 | controller | - Logserver: OK 2026-06-11 20:22:28.981977 | controller | - MariaDB: OK 2026-06-11 20:22:28.981987 | controller | - NodePoolBuilder: OK 2026-06-11 20:22:28.981998 | controller | - NodePoolLauncher: OK 2026-06-11 20:22:28.982009 | controller | - Zookeeper: OK 2026-06-11 20:22:28.982020 | controller | - Zuul: Waiting ... 2026-06-11 20:22:28.982044 | controller | - |_ Config Secrets: OK 2026-06-11 20:22:28.982055 | controller | - |_ Executor: OK 2026-06-11 20:22:28.982066 | controller | - |_ Merger: OK 2026-06-11 20:22:28.982077 | controller | - |_ Scheduler: OK 2026-06-11 20:22:28.982087 | controller | - |_ Web: Waiting ... 2026-06-11 20:22:28.982099 | controller | 2026-06-11 20:22:29.987997 | controller | 2026-06-11T20:22:29-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:22:30.592692 | controller | 2026-06-11T20:22:30-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:22:30.592775 | controller | 2026-06-11T20:22:30-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:22:30.607546 | controller | 2026-06-11T20:22:30-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:22:30.607594 | controller | 2026-06-11T20:22:30-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:22:30.630426 | controller | 2026-06-11T20:22:30-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:22:30.630478 | controller | 2026-06-11T20:22:30-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:22:30.999023 | controller | 2026-06-11T20:22:30-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:22:31.405852 | controller | 2026-06-11T20:22:31-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:22:31.405924 | controller | 2026-06-11T20:22:31-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:22:32.782007 | controller | 2026-06-11T20:22:32-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:22:32.782118 | controller | 2026-06-11T20:22:32-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:22:34.370225 | controller | 2026-06-11T20:22:34-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:22:34.370311 | controller | 2026-06-11T20:22:34-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:22:35.174823 | controller | 2026-06-11T20:22:35-04:00 INFO 2026-06-11 20:22:35.174903 | controller | - Config: Waiting ... 2026-06-11 20:22:35.174914 | controller | - Gateway: OK 2026-06-11 20:22:35.174922 | controller | - GitServer: OK 2026-06-11 20:22:35.174930 | controller | - HoundSearch: OK 2026-06-11 20:22:35.174937 | controller | - LogJuicer: OK 2026-06-11 20:22:35.174945 | controller | - Logserver: OK 2026-06-11 20:22:35.174952 | controller | - MariaDB: OK 2026-06-11 20:22:35.174960 | controller | - NodePoolBuilder: OK 2026-06-11 20:22:35.174967 | controller | - NodePoolLauncher: OK 2026-06-11 20:22:35.174975 | controller | - Zookeeper: OK 2026-06-11 20:22:35.174982 | controller | - Zuul: Waiting ... 2026-06-11 20:22:35.174990 | controller | - |_ Config Secrets: OK 2026-06-11 20:22:35.174997 | controller | - |_ Executor: OK 2026-06-11 20:22:35.175004 | controller | - |_ Merger: OK 2026-06-11 20:22:35.175012 | controller | - |_ Scheduler: OK 2026-06-11 20:22:35.175019 | controller | - |_ Web: Waiting ... 2026-06-11 20:22:35.175027 | controller | 2026-06-11 20:22:36.181321 | controller | 2026-06-11T20:22:36-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:22:36.786521 | controller | 2026-06-11T20:22:36-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:22:36.786592 | controller | 2026-06-11T20:22:36-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:22:36.801025 | controller | 2026-06-11T20:22:36-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:22:36.801096 | controller | 2026-06-11T20:22:36-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:22:36.822811 | controller | 2026-06-11T20:22:36-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:22:36.822873 | controller | 2026-06-11T20:22:36-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:22:37.196585 | controller | 2026-06-11T20:22:37-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:22:37.602023 | controller | 2026-06-11T20:22:37-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:22:37.602105 | controller | 2026-06-11T20:22:37-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:22:38.982038 | controller | 2026-06-11T20:22:38-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:22:38.982115 | controller | 2026-06-11T20:22:38-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:22:40.571167 | controller | 2026-06-11T20:22:40-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:22:40.571244 | controller | 2026-06-11T20:22:40-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:22:41.380179 | controller | 2026-06-11T20:22:41-04:00 INFO 2026-06-11 20:22:41.380255 | controller | - Config: Waiting ... 2026-06-11 20:22:41.380266 | controller | - Gateway: OK 2026-06-11 20:22:41.380275 | controller | - GitServer: OK 2026-06-11 20:22:41.380283 | controller | - HoundSearch: OK 2026-06-11 20:22:41.380291 | controller | - LogJuicer: OK 2026-06-11 20:22:41.380310 | controller | - Logserver: OK 2026-06-11 20:22:41.380318 | controller | - MariaDB: OK 2026-06-11 20:22:41.380326 | controller | - NodePoolBuilder: OK 2026-06-11 20:22:41.380333 | controller | - NodePoolLauncher: OK 2026-06-11 20:22:41.380341 | controller | - Zookeeper: OK 2026-06-11 20:22:41.380348 | controller | - Zuul: Waiting ... 2026-06-11 20:22:41.380356 | controller | - |_ Config Secrets: OK 2026-06-11 20:22:41.380364 | controller | - |_ Executor: OK 2026-06-11 20:22:41.380422 | controller | - |_ Merger: OK 2026-06-11 20:22:41.380430 | controller | - |_ Scheduler: OK 2026-06-11 20:22:41.380438 | controller | - |_ Web: Waiting ... 2026-06-11 20:22:41.380446 | controller | 2026-06-11 20:22:42.386186 | controller | 2026-06-11T20:22:42-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:22:42.990192 | controller | 2026-06-11T20:22:42-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:22:42.990269 | controller | 2026-06-11T20:22:42-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:22:43.004819 | controller | 2026-06-11T20:22:43-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:22:43.004890 | controller | 2026-06-11T20:22:43-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:22:43.024066 | controller | 2026-06-11T20:22:43-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:22:43.024143 | controller | 2026-06-11T20:22:43-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:22:43.402985 | controller | 2026-06-11T20:22:43-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:22:43.804397 | controller | 2026-06-11T20:22:43-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:22:43.804468 | controller | 2026-06-11T20:22:43-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:22:45.182919 | controller | 2026-06-11T20:22:45-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:22:45.182996 | controller | 2026-06-11T20:22:45-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:22:46.771939 | controller | 2026-06-11T20:22:46-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:22:46.772062 | controller | 2026-06-11T20:22:46-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:22:47.586572 | controller | 2026-06-11T20:22:47-04:00 INFO 2026-06-11 20:22:47.586639 | controller | - Config: Waiting ... 2026-06-11 20:22:47.586646 | controller | - Gateway: OK 2026-06-11 20:22:47.586651 | controller | - GitServer: OK 2026-06-11 20:22:47.586656 | controller | - HoundSearch: OK 2026-06-11 20:22:47.586662 | controller | - LogJuicer: OK 2026-06-11 20:22:47.586668 | controller | - Logserver: OK 2026-06-11 20:22:47.586673 | controller | - MariaDB: OK 2026-06-11 20:22:47.586678 | controller | - NodePoolBuilder: OK 2026-06-11 20:22:47.586684 | controller | - NodePoolLauncher: OK 2026-06-11 20:22:47.586689 | controller | - Zookeeper: OK 2026-06-11 20:22:47.586694 | controller | - Zuul: Waiting ... 2026-06-11 20:22:47.586699 | controller | - |_ Config Secrets: OK 2026-06-11 20:22:47.586703 | controller | - |_ Executor: OK 2026-06-11 20:22:47.586708 | controller | - |_ Merger: OK 2026-06-11 20:22:47.586713 | controller | - |_ Scheduler: OK 2026-06-11 20:22:47.586717 | controller | - |_ Web: Waiting ... 2026-06-11 20:22:47.586722 | controller | 2026-06-11 20:22:48.593103 | controller | 2026-06-11T20:22:48-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:22:49.196807 | controller | 2026-06-11T20:22:49-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:22:49.196893 | controller | 2026-06-11T20:22:49-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:22:49.211306 | controller | 2026-06-11T20:22:49-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:22:49.211418 | controller | 2026-06-11T20:22:49-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:22:49.231189 | controller | 2026-06-11T20:22:49-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:22:49.231263 | controller | 2026-06-11T20:22:49-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:22:49.607590 | controller | 2026-06-11T20:22:49-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:22:50.013628 | controller | 2026-06-11T20:22:50-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:22:50.013704 | controller | 2026-06-11T20:22:50-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:22:51.380649 | controller | 2026-06-11T20:22:51-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:22:51.380709 | controller | 2026-06-11T20:22:51-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:22:52.970221 | controller | 2026-06-11T20:22:52-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:22:52.970305 | controller | 2026-06-11T20:22:52-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:22:53.781508 | controller | 2026-06-11T20:22:53-04:00 INFO 2026-06-11 20:22:53.781580 | controller | - Config: Waiting ... 2026-06-11 20:22:53.781591 | controller | - Gateway: OK 2026-06-11 20:22:53.781600 | controller | - GitServer: OK 2026-06-11 20:22:53.781608 | controller | - HoundSearch: OK 2026-06-11 20:22:53.781615 | controller | - LogJuicer: OK 2026-06-11 20:22:53.781623 | controller | - Logserver: OK 2026-06-11 20:22:53.781630 | controller | - MariaDB: OK 2026-06-11 20:22:53.781638 | controller | - NodePoolBuilder: OK 2026-06-11 20:22:53.781645 | controller | - NodePoolLauncher: OK 2026-06-11 20:22:53.781653 | controller | - Zookeeper: OK 2026-06-11 20:22:53.781660 | controller | - Zuul: Waiting ... 2026-06-11 20:22:53.781668 | controller | - |_ Config Secrets: OK 2026-06-11 20:22:53.781675 | controller | - |_ Executor: OK 2026-06-11 20:22:53.781682 | controller | - |_ Merger: OK 2026-06-11 20:22:53.781690 | controller | - |_ Scheduler: OK 2026-06-11 20:22:53.781697 | controller | - |_ Web: Waiting ... 2026-06-11 20:22:53.781705 | controller | 2026-06-11 20:22:54.787678 | controller | 2026-06-11T20:22:54-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:22:55.392633 | controller | 2026-06-11T20:22:55-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:22:55.392711 | controller | 2026-06-11T20:22:55-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:22:55.405968 | controller | 2026-06-11T20:22:55-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:22:55.406041 | controller | 2026-06-11T20:22:55-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:22:55.427601 | controller | 2026-06-11T20:22:55-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:22:55.427667 | controller | 2026-06-11T20:22:55-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:22:55.804841 | controller | 2026-06-11T20:22:55-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:22:56.203008 | controller | 2026-06-11T20:22:56-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:22:56.203069 | controller | 2026-06-11T20:22:56-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:22:57.579250 | controller | 2026-06-11T20:22:57-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:22:57.579324 | controller | 2026-06-11T20:22:57-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:22:59.171087 | controller | 2026-06-11T20:22:59-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:22:59.171169 | controller | 2026-06-11T20:22:59-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:22:59.981332 | controller | 2026-06-11T20:22:59-04:00 INFO 2026-06-11 20:22:59.981441 | controller | - Config: Waiting ... 2026-06-11 20:22:59.981453 | controller | - Gateway: OK 2026-06-11 20:22:59.981462 | controller | - GitServer: OK 2026-06-11 20:22:59.981470 | controller | - HoundSearch: OK 2026-06-11 20:22:59.981477 | controller | - LogJuicer: OK 2026-06-11 20:22:59.981485 | controller | - Logserver: OK 2026-06-11 20:22:59.981493 | controller | - MariaDB: OK 2026-06-11 20:22:59.981500 | controller | - NodePoolBuilder: OK 2026-06-11 20:22:59.981508 | controller | - NodePoolLauncher: OK 2026-06-11 20:22:59.981516 | controller | - Zookeeper: OK 2026-06-11 20:22:59.981523 | controller | - Zuul: Waiting ... 2026-06-11 20:22:59.981531 | controller | - |_ Config Secrets: OK 2026-06-11 20:22:59.981538 | controller | - |_ Executor: OK 2026-06-11 20:22:59.981546 | controller | - |_ Merger: OK 2026-06-11 20:22:59.981554 | controller | - |_ Scheduler: OK 2026-06-11 20:22:59.981561 | controller | - |_ Web: Waiting ... 2026-06-11 20:22:59.981569 | controller | 2026-06-11 20:23:00.986357 | controller | 2026-06-11T20:23:00-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:23:01.591887 | controller | 2026-06-11T20:23:01-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:23:01.591965 | controller | 2026-06-11T20:23:01-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:23:01.605528 | controller | 2026-06-11T20:23:01-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:23:01.605580 | controller | 2026-06-11T20:23:01-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:23:01.625960 | controller | 2026-06-11T20:23:01-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:23:01.626010 | controller | 2026-06-11T20:23:01-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:23:02.004610 | controller | 2026-06-11T20:23:02-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:23:02.407896 | controller | 2026-06-11T20:23:02-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:23:02.407968 | controller | 2026-06-11T20:23:02-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:23:03.781310 | controller | 2026-06-11T20:23:03-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:23:03.781426 | controller | 2026-06-11T20:23:03-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:23:05.370230 | controller | 2026-06-11T20:23:05-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:23:05.370338 | controller | 2026-06-11T20:23:05-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:23:06.180487 | controller | 2026-06-11T20:23:06-04:00 INFO 2026-06-11 20:23:06.180556 | controller | - Config: Waiting ... 2026-06-11 20:23:06.180565 | controller | - Gateway: OK 2026-06-11 20:23:06.180573 | controller | - GitServer: OK 2026-06-11 20:23:06.180579 | controller | - HoundSearch: OK 2026-06-11 20:23:06.180586 | controller | - LogJuicer: OK 2026-06-11 20:23:06.180593 | controller | - Logserver: OK 2026-06-11 20:23:06.180600 | controller | - MariaDB: OK 2026-06-11 20:23:06.180607 | controller | - NodePoolBuilder: OK 2026-06-11 20:23:06.180613 | controller | - NodePoolLauncher: OK 2026-06-11 20:23:06.180620 | controller | - Zookeeper: OK 2026-06-11 20:23:06.180627 | controller | - Zuul: Waiting ... 2026-06-11 20:23:06.180633 | controller | - |_ Config Secrets: OK 2026-06-11 20:23:06.180640 | controller | - |_ Executor: OK 2026-06-11 20:23:06.180647 | controller | - |_ Merger: OK 2026-06-11 20:23:06.180654 | controller | - |_ Scheduler: OK 2026-06-11 20:23:06.180661 | controller | - |_ Web: Waiting ... 2026-06-11 20:23:06.180668 | controller | 2026-06-11 20:23:07.187189 | controller | 2026-06-11T20:23:07-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:23:07.792105 | controller | 2026-06-11T20:23:07-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:23:07.792180 | controller | 2026-06-11T20:23:07-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:23:07.805217 | controller | 2026-06-11T20:23:07-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:23:07.805282 | controller | 2026-06-11T20:23:07-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:23:07.824483 | controller | 2026-06-11T20:23:07-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:23:07.824563 | controller | 2026-06-11T20:23:07-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:23:08.199107 | controller | 2026-06-11T20:23:08-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:23:08.605669 | controller | 2026-06-11T20:23:08-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:23:08.605768 | controller | 2026-06-11T20:23:08-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:23:09.985514 | controller | 2026-06-11T20:23:09-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:23:09.985613 | controller | 2026-06-11T20:23:09-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:23:11.569937 | controller | 2026-06-11T20:23:11-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:23:11.570049 | controller | 2026-06-11T20:23:11-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:23:12.379941 | controller | 2026-06-11T20:23:12-04:00 INFO 2026-06-11 20:23:12.380036 | controller | - Config: Waiting ... 2026-06-11 20:23:12.380047 | controller | - Gateway: OK 2026-06-11 20:23:12.380058 | controller | - GitServer: OK 2026-06-11 20:23:12.380131 | controller | - HoundSearch: OK 2026-06-11 20:23:12.380162 | controller | - LogJuicer: OK 2026-06-11 20:23:12.380216 | controller | - Logserver: OK 2026-06-11 20:23:12.380298 | controller | - MariaDB: OK 2026-06-11 20:23:12.380313 | controller | - NodePoolBuilder: OK 2026-06-11 20:23:12.380360 | controller | - NodePoolLauncher: OK 2026-06-11 20:23:12.380456 | controller | - Zookeeper: OK 2026-06-11 20:23:12.380517 | controller | - Zuul: Waiting ... 2026-06-11 20:23:12.380532 | controller | - |_ Config Secrets: OK 2026-06-11 20:23:12.380610 | controller | - |_ Executor: OK 2026-06-11 20:23:12.380640 | controller | - |_ Merger: OK 2026-06-11 20:23:12.380705 | controller | - |_ Scheduler: OK 2026-06-11 20:23:12.380771 | controller | - |_ Web: Waiting ... 2026-06-11 20:23:12.380785 | controller | 2026-06-11 20:23:13.387245 | controller | 2026-06-11T20:23:13-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:23:13.992633 | controller | 2026-06-11T20:23:13-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:23:13.992707 | controller | 2026-06-11T20:23:13-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:23:14.006841 | controller | 2026-06-11T20:23:14-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:23:14.006922 | controller | 2026-06-11T20:23:14-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:23:14.028882 | controller | 2026-06-11T20:23:14-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:23:14.028938 | controller | 2026-06-11T20:23:14-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:23:14.402451 | controller | 2026-06-11T20:23:14-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:23:14.801023 | controller | 2026-06-11T20:23:14-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:23:14.801106 | controller | 2026-06-11T20:23:14-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:23:16.180938 | controller | 2026-06-11T20:23:16-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:23:16.181025 | controller | 2026-06-11T20:23:16-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:23:17.770721 | controller | 2026-06-11T20:23:17-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:23:17.770796 | controller | 2026-06-11T20:23:17-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:23:18.579431 | controller | 2026-06-11T20:23:18-04:00 INFO 2026-06-11 20:23:18.579502 | controller | - Config: Waiting ... 2026-06-11 20:23:18.579512 | controller | - Gateway: OK 2026-06-11 20:23:18.579521 | controller | - GitServer: OK 2026-06-11 20:23:18.579529 | controller | - HoundSearch: OK 2026-06-11 20:23:18.579537 | controller | - LogJuicer: OK 2026-06-11 20:23:18.579544 | controller | - Logserver: OK 2026-06-11 20:23:18.579552 | controller | - MariaDB: OK 2026-06-11 20:23:18.579560 | controller | - NodePoolBuilder: OK 2026-06-11 20:23:18.579567 | controller | - NodePoolLauncher: OK 2026-06-11 20:23:18.579575 | controller | - Zookeeper: OK 2026-06-11 20:23:18.579582 | controller | - Zuul: Waiting ... 2026-06-11 20:23:18.579590 | controller | - |_ Config Secrets: OK 2026-06-11 20:23:18.579597 | controller | - |_ Executor: OK 2026-06-11 20:23:18.579605 | controller | - |_ Merger: OK 2026-06-11 20:23:18.579612 | controller | - |_ Scheduler: OK 2026-06-11 20:23:18.579620 | controller | - |_ Web: Waiting ... 2026-06-11 20:23:18.579628 | controller | 2026-06-11 20:23:19.585788 | controller | 2026-06-11T20:23:19-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:23:20.192591 | controller | 2026-06-11T20:23:20-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:23:20.192710 | controller | 2026-06-11T20:23:20-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:23:20.205875 | controller | 2026-06-11T20:23:20-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:23:20.205946 | controller | 2026-06-11T20:23:20-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:23:20.228667 | controller | 2026-06-11T20:23:20-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:23:20.228729 | controller | 2026-06-11T20:23:20-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:23:20.600581 | controller | 2026-06-11T20:23:20-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:23:21.005748 | controller | 2026-06-11T20:23:21-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:23:21.005837 | controller | 2026-06-11T20:23:21-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:23:22.385896 | controller | 2026-06-11T20:23:22-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:23:22.385975 | controller | 2026-06-11T20:23:22-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:23:23.971194 | controller | 2026-06-11T20:23:23-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:23:23.971283 | controller | 2026-06-11T20:23:23-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:23:25.179081 | controller | 2026-06-11T20:23:25-04:00 INFO 2026-06-11 20:23:25.179152 | controller | - Config: OK 2026-06-11 20:23:25.179167 | controller | - Gateway: OK 2026-06-11 20:23:25.179179 | controller | - GitServer: OK 2026-06-11 20:23:25.179190 | controller | - HoundSearch: OK 2026-06-11 20:23:25.179202 | controller | - LogJuicer: OK 2026-06-11 20:23:25.179214 | controller | - Logserver: OK 2026-06-11 20:23:25.179226 | controller | - MariaDB: OK 2026-06-11 20:23:25.179237 | controller | - NodePoolBuilder: OK 2026-06-11 20:23:25.179249 | controller | - NodePoolLauncher: OK 2026-06-11 20:23:25.179259 | controller | - Zookeeper: OK 2026-06-11 20:23:25.179270 | controller | - Zuul: OK 2026-06-11 20:23:25.179282 | controller | 2026-06-11 20:23:25.179351 | controller | STEP: Validating secret changed @ 06/11/26 20:23:25.179 2026-06-11 20:23:25.189546 | controller | 2026-06-11T20:23:25-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [cat /etc/zuul/zuul.conf] 2026-06-11 20:23:25.314125 | controller | STEP: Checking the secret is in the zuul.conf @ 06/11/26 20:23:25.313 2026-06-11 20:23:25.317040 | controller | STEP: Checking zuul-client works @ 06/11/26 20:23:25.316 2026-06-11 20:23:25.317086 | controller | 2026-06-11T20:23:25-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [bash -c zuul-client -v autohold --tenant internal --project system-config --job testytest --reason testy 2>&1] 2026-06-11 20:23:26.073927 | controller | • [271.490 seconds] 2026-06-11 20:23:26.074013 | controller | ------------------------------ 2026-06-11 20:23:26.074025 | controller | Secret Rotations zuul-db works 2026-06-11 20:23:26.074034 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/secrets_rotation_test.go:71 2026-06-11 20:23:26.074086 | controller | STEP: Checking the secret is in the zuul.conf @ 06/11/26 20:23:26.073 2026-06-11 20:23:26.076656 | controller | STEP: Checking zuul-web works @ 06/11/26 20:23:26.076 2026-06-11 20:23:26.076696 | controller | 2026-06-11T20:23:26-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [curl zuul-web:9000/api/tenant/demo-tenant/builds] 2026-06-11 20:23:26.169801 | controller | % Total % Received % Xferd Average Speed Time Time Time Current 2026-06-11 20:23:26.169873 | controller | Dload Upload Total Spent Left Speed 2026-06-11 20:23:26.236419 | controller | 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 1854 100 1854 0 0 28090 0 --:--:-- --:--:-- --:--:-- 28090 2026-06-11 20:23:26.242657 | controller | • [0.169 seconds] 2026-06-11 20:23:26.242696 | controller | ------------------------------ 2026-06-11 20:23:26.242707 | controller | Secret Rotations zuul-zk works 2026-06-11 20:23:26.242716 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/secrets_rotation_test.go:81 2026-06-11 20:23:26.242776 | controller | STEP: Checking the key in zuul pod @ 06/11/26 20:23:26.242 2026-06-11 20:23:26.242834 | controller | 2026-06-11T20:23:26-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [cat /tls/client/tls.key] 2026-06-11 20:23:26.382619 | controller | STEP: Connecting with kazoo @ 06/11/26 20:23:26.382 2026-06-11 20:23:26.382711 | controller | 2026-06-11T20:23:26-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [python3 -c import os, kazoo.client; os.chdir('/tls/client'); hosts=list(filter(lambda l: l.startswith('hosts'), open('/etc/zuul/zuul.conf').readlines()))[0].split('=')[1].strip(); client = kazoo.client.KazooClient(hosts, use_ssl=True, keyfile='tls.key', certfile='tls.crt', ca='ca.crt'); client.start(); print(client.get_children('/keystorage2'))] 2026-06-11 20:23:26.846833 | controller | • [0.604 seconds] 2026-06-11 20:23:26.846903 | controller | ------------------------------ 2026-06-11 20:23:26.846954 | controller | Deploy Tests Reconcile default 2026-06-11 20:23:26.846966 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/deploy_test.go:11 2026-06-11 20:23:26.852092 | controller | 2026-06-11T20:23:26-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:23:27.583953 | controller | 2026-06-11T20:23:27-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:23:27.584053 | controller | 2026-06-11T20:23:27-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:23:27.591762 | controller | 2026-06-11T20:23:27-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:23:27.744865 | controller | 2026-06-11T20:23:27-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:23:27.753232 | controller | 2026-06-11T20:23:27-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:23:27.753271 | controller | 2026-06-11T20:23:27-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:23:27.774365 | controller | 2026-06-11T20:23:27-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:23:27.774442 | controller | 2026-06-11T20:23:27-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:23:27.993494 | controller | 2026-06-11T20:23:27-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:23:28.398744 | controller | 2026-06-11T20:23:28-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:23:28.398828 | controller | 2026-06-11T20:23:28-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:23:29.410267 | controller | 2026-06-11T20:23:29-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:23:29.410359 | controller | 2026-06-11T20:23:29-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:23:30.569522 | controller | 2026-06-11T20:23:30-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:23:30.569597 | controller | 2026-06-11T20:23:30-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:23:31.781794 | controller | 2026-06-11T20:23:31-04:00 INFO 2026-06-11 20:23:31.781857 | controller | - Config: OK 2026-06-11 20:23:31.781864 | controller | - Gateway: OK 2026-06-11 20:23:31.781869 | controller | - GitServer: OK 2026-06-11 20:23:31.781874 | controller | - HoundSearch: OK 2026-06-11 20:23:31.781879 | controller | - LogJuicer: OK 2026-06-11 20:23:31.781884 | controller | - Logserver: OK 2026-06-11 20:23:31.781888 | controller | - MariaDB: OK 2026-06-11 20:23:31.781893 | controller | - NodePoolBuilder: OK 2026-06-11 20:23:31.781898 | controller | - NodePoolLauncher: OK 2026-06-11 20:23:31.781902 | controller | - Zookeeper: OK 2026-06-11 20:23:31.781907 | controller | - Zuul: OK 2026-06-11 20:23:31.781912 | controller | 2026-06-11 20:23:31.781958 | controller | • [4.935 seconds] 2026-06-11 20:23:31.781966 | controller | ------------------------------ 2026-06-11 20:23:31.781971 | controller | Deploy Tests Match zuul secrets 2026-06-11 20:23:31.781977 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/deploy_test.go:14 2026-06-11 20:23:31.783931 | controller | 2026-06-11T20:23:31-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [cat /etc/zuul/zuul.conf] 2026-06-11 20:23:31.941059 | controller | • [0.159 seconds] 2026-06-11 20:23:31.941130 | controller | ------------------------------ 2026-06-11 20:23:31.941140 | controller | Deploy Tests Connect to services 2026-06-11 20:23:31.941150 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/deploy_test.go:17 2026-06-11 20:23:32.128092 | controller | • [0.187 seconds] 2026-06-11 20:23:32.128148 | controller | ------------------------------ 2026-06-11 20:23:32.128162 | controller | gateway tests When setting up extra gateway configuration for a maintenance Should reconcile 2026-06-11 20:23:32.128197 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/gateway_test.go:28 2026-06-11 20:23:32.128354 | controller | 2026-06-11T20:23:32-04:00 INFO Creating object, name: maintenance-config 2026-06-11 20:23:32.132354 | controller | 2026-06-11T20:23:32-04:00 INFO Creating object, name: maintenance-static-files 2026-06-11 20:23:32.367108 | controller | 2026-06-11T20:23:32-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:23:32.980194 | controller | 2026-06-11T20:23:32-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:23:32.980280 | controller | 2026-06-11T20:23:32-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:23:32.989412 | controller | 2026-06-11T20:23:32-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:23:33.139444 | controller | 2026-06-11T20:23:33-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:23:33.571539 | controller | 2026-06-11T20:23:33-04:00 INFO Statefulset "gateway" configuration changed, applying... 2026-06-11 20:23:33.571618 | controller | 2026-06-11T20:23:33-04:00 DEBUG Reason: annotation 'config-hash' changed from '90a6261c7272ad73ee593bd22fc08aa0b50c9e09eb380107181e1e58b851202b' to 'c04b8e5064e2a2985ef09fcc1ab4c2dda05fbcb2cd18006ff3d01f2b963e17d8' 2026-06-11 20:23:33.571629 | controller | 2026-06-11T20:23:33-04:00 INFO Updating object, name: gateway 2026-06-11 20:23:33.971576 | controller | 2026-06-11T20:23:33-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:23:33.971648 | controller | 2026-06-11T20:23:33-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:23:34.182442 | controller | 2026-06-11T20:23:34-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:23:34.977432 | controller | 2026-06-11T20:23:34-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:23:34.977509 | controller | 2026-06-11T20:23:34-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:23:36.380981 | controller | 2026-06-11T20:23:36-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:23:36.381067 | controller | 2026-06-11T20:23:36-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:23:37.968447 | controller | 2026-06-11T20:23:37-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:23:37.968504 | controller | 2026-06-11T20:23:37-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:23:39.180984 | controller | 2026-06-11T20:23:39-04:00 INFO 2026-06-11 20:23:39.181054 | controller | - Config: OK 2026-06-11 20:23:39.181065 | controller | - Gateway: Waiting ... 2026-06-11 20:23:39.181074 | controller | - GitServer: OK 2026-06-11 20:23:39.181081 | controller | - HoundSearch: OK 2026-06-11 20:23:39.181089 | controller | - LogJuicer: OK 2026-06-11 20:23:39.181097 | controller | - Logserver: OK 2026-06-11 20:23:39.181104 | controller | - MariaDB: OK 2026-06-11 20:23:39.181112 | controller | - NodePoolBuilder: OK 2026-06-11 20:23:39.181120 | controller | - NodePoolLauncher: OK 2026-06-11 20:23:39.181127 | controller | - Zookeeper: OK 2026-06-11 20:23:39.181135 | controller | - Zuul: OK 2026-06-11 20:23:39.181143 | controller | 2026-06-11 20:23:40.186793 | controller | 2026-06-11T20:23:40-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:23:40.792843 | controller | 2026-06-11T20:23:40-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:23:40.792904 | controller | 2026-06-11T20:23:40-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:23:40.811053 | controller | 2026-06-11T20:23:40-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:23:40.811128 | controller | 2026-06-11T20:23:40-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:23:40.969949 | controller | 2026-06-11T20:23:40-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:23:40.970026 | controller | 2026-06-11T20:23:40-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:23:41.202744 | controller | 2026-06-11T20:23:41-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:23:41.974413 | controller | 2026-06-11T20:23:41-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:23:41.974488 | controller | 2026-06-11T20:23:41-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:23:43.383134 | controller | 2026-06-11T20:23:43-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:23:43.383209 | controller | 2026-06-11T20:23:43-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:23:44.971655 | controller | 2026-06-11T20:23:44-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:23:44.971742 | controller | 2026-06-11T20:23:44-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:23:46.180759 | controller | 2026-06-11T20:23:46-04:00 INFO 2026-06-11 20:23:46.180835 | controller | - Config: OK 2026-06-11 20:23:46.180846 | controller | - Gateway: OK 2026-06-11 20:23:46.180854 | controller | - GitServer: OK 2026-06-11 20:23:46.180862 | controller | - HoundSearch: OK 2026-06-11 20:23:46.180870 | controller | - LogJuicer: OK 2026-06-11 20:23:46.180877 | controller | - Logserver: OK 2026-06-11 20:23:46.180885 | controller | - MariaDB: OK 2026-06-11 20:23:46.180892 | controller | - NodePoolBuilder: OK 2026-06-11 20:23:46.180914 | controller | - NodePoolLauncher: OK 2026-06-11 20:23:46.180922 | controller | - Zookeeper: OK 2026-06-11 20:23:46.180930 | controller | - Zuul: OK 2026-06-11 20:23:46.180938 | controller | 2026-06-11 20:23:46.180952 | controller | • [14.053 seconds] 2026-06-11 20:23:46.180961 | controller | ------------------------------ 2026-06-11 20:23:46.180969 | controller | gateway tests When setting up extra gateway configuration for a maintenance Should serve HTTP 503 and the expected content 2026-06-11 20:23:46.180978 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/gateway_test.go:55 2026-06-11 20:23:46.180986 | controller | 2026-06-11T20:23:46-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [curl -o - -I gateway:8080/zuul/] 2026-06-11 20:23:46.340305 | controller | % Total % Received % Xferd Average Speed Time Time Time Current 2026-06-11 20:23:46.340414 | controller | Dload Upload Total Spent Left Speed 2026-06-11 20:23:46.342624 | controller | 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 17 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2026-06-11 20:23:46.344916 | controller | 2026-06-11T20:23:46-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [curl gateway:8080/zuul/api/components] 2026-06-11 20:23:46.535415 | controller | % Total % Received % Xferd Average Speed Time Time Time Current 2026-06-11 20:23:46.535501 | controller | Dload Upload Total Spent Left Speed 2026-06-11 20:23:46.537750 | controller | 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 17 100 17 0 0 8500 0 --:--:-- --:--:-- --:--:-- 8500 2026-06-11 20:23:46.541202 | controller | • [0.360 seconds] 2026-06-11 20:23:46.541266 | controller | ------------------------------ 2026-06-11 20:23:46.541299 | controller | gateway tests When removing the gateway's extra config Should reconcile 2026-06-11 20:23:46.541311 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/gateway_test.go:65 2026-06-11 20:23:46.549930 | controller | 2026-06-11T20:23:46-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:23:47.151965 | controller | 2026-06-11T20:23:47-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:23:47.152042 | controller | 2026-06-11T20:23:47-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:23:47.162761 | controller | 2026-06-11T20:23:47-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:23:47.337459 | controller | 2026-06-11T20:23:47-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:23:47.345892 | controller | 2026-06-11T20:23:47-04:00 INFO Statefulset "gateway" configuration changed, applying... 2026-06-11 20:23:47.345946 | controller | 2026-06-11T20:23:47-04:00 DEBUG Reason: annotation 'config-hash' changed from 'c04b8e5064e2a2985ef09fcc1ab4c2dda05fbcb2cd18006ff3d01f2b963e17d8' to '90a6261c7272ad73ee593bd22fc08aa0b50c9e09eb380107181e1e58b851202b' 2026-06-11 20:23:47.345958 | controller | 2026-06-11T20:23:47-04:00 INFO Updating object, name: gateway 2026-06-11 20:23:47.569251 | controller | 2026-06-11T20:23:47-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:23:47.569315 | controller | 2026-06-11T20:23:47-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:23:47.781487 | controller | 2026-06-11T20:23:47-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:23:48.579900 | controller | 2026-06-11T20:23:48-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:23:48.579977 | controller | 2026-06-11T20:23:48-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:23:49.983722 | controller | 2026-06-11T20:23:49-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:23:49.983801 | controller | 2026-06-11T20:23:49-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:23:51.569821 | controller | 2026-06-11T20:23:51-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:23:51.569903 | controller | 2026-06-11T20:23:51-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:23:52.782284 | controller | 2026-06-11T20:23:52-04:00 INFO 2026-06-11 20:23:52.782422 | controller | - Config: OK 2026-06-11 20:23:52.782437 | controller | - Gateway: Waiting ... 2026-06-11 20:23:52.782448 | controller | - GitServer: OK 2026-06-11 20:23:52.782456 | controller | - HoundSearch: OK 2026-06-11 20:23:52.782464 | controller | - LogJuicer: OK 2026-06-11 20:23:52.782471 | controller | - Logserver: OK 2026-06-11 20:23:52.782478 | controller | - MariaDB: OK 2026-06-11 20:23:52.782486 | controller | - NodePoolBuilder: OK 2026-06-11 20:23:52.782494 | controller | - NodePoolLauncher: OK 2026-06-11 20:23:52.782501 | controller | - Zookeeper: OK 2026-06-11 20:23:52.782509 | controller | - Zuul: OK 2026-06-11 20:23:52.782517 | controller | 2026-06-11 20:23:53.789322 | controller | 2026-06-11T20:23:53-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:23:54.393240 | controller | 2026-06-11T20:23:54-04:00 DEBUG Inspecting volume logserver-logserver-0 2026-06-11 20:23:54.393340 | controller | 2026-06-11T20:23:54-04:00 DEBUG Volume logserver-logserver-0 at expected size, nothing to do 2026-06-11 20:23:54.406568 | controller | 2026-06-11T20:23:54-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:23:54.406629 | controller | 2026-06-11T20:23:54-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:23:54.428202 | controller | 2026-06-11T20:23:54-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:23:54.428278 | controller | 2026-06-11T20:23:54-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:23:54.804259 | controller | 2026-06-11T20:23:54-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:23:55.207822 | controller | 2026-06-11T20:23:55-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:23:55.207904 | controller | 2026-06-11T20:23:55-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:23:56.582918 | controller | 2026-06-11T20:23:56-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:23:56.583001 | controller | 2026-06-11T20:23:56-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:23:58.172777 | controller | 2026-06-11T20:23:58-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:23:58.172861 | controller | 2026-06-11T20:23:58-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:23:59.377508 | controller | 2026-06-11T20:23:59-04:00 INFO 2026-06-11 20:23:59.377593 | controller | - Config: OK 2026-06-11 20:23:59.377608 | controller | - Gateway: OK 2026-06-11 20:23:59.377619 | controller | - GitServer: OK 2026-06-11 20:23:59.377630 | controller | - HoundSearch: OK 2026-06-11 20:23:59.377640 | controller | - LogJuicer: OK 2026-06-11 20:23:59.377651 | controller | - Logserver: OK 2026-06-11 20:23:59.377661 | controller | - MariaDB: OK 2026-06-11 20:23:59.377672 | controller | - NodePoolBuilder: OK 2026-06-11 20:23:59.377692 | controller | - NodePoolLauncher: OK 2026-06-11 20:23:59.377703 | controller | - Zookeeper: OK 2026-06-11 20:23:59.377713 | controller | - Zuul: OK 2026-06-11 20:23:59.377724 | controller | 2026-06-11 20:23:59.377735 | controller | • [12.837 seconds] 2026-06-11 20:23:59.377746 | controller | ------------------------------ 2026-06-11 20:23:59.377757 | controller | gateway tests When removing the gateway's extra config Should serve the regular content 2026-06-11 20:23:59.377769 | controller | /home/zuul-worker/src/softwarefactory-project.io/software-factory/sf-operator/tests/gateway_test.go:71 2026-06-11 20:23:59.377784 | controller | 2026-06-11T20:23:59-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [curl -o - -I gateway:8080/zuul/api/components] 2026-06-11 20:23:59.546823 | controller | % Total % Received % Xferd Average Speed Time Time Time Current 2026-06-11 20:23:59.546890 | controller | Dload Upload Total Spent Left Speed 2026-06-11 20:23:59.553502 | controller | 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 537 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2026-06-11 20:23:59.556164 | controller | 2026-06-11T20:23:59-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [curl gateway:8080/zuul/api/components] 2026-06-11 20:23:59.740758 | controller | % Total % Received % Xferd Average Speed Time Time Time Current 2026-06-11 20:23:59.740851 | controller | Dload Upload Total Spent Left Speed 2026-06-11 20:23:59.747105 | controller | 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 537 100 537 0 0 89500 0 --:--:-- --:--:-- --:--:-- 89500 2026-06-11 20:23:59.749969 | controller | • [0.372 seconds] 2026-06-11 20:23:59.750011 | controller | ------------------------------ 2026-06-11 20:23:59.750021 | controller | 2026-06-11 20:23:59.750030 | controller | Ran 16 of 16 Specs in 472.012 seconds 2026-06-11 20:23:59.750044 | controller | SUCCESS! -- 16 Passed | 0 Failed | 0 Pending | 0 Skipped 2026-06-11 20:23:59.750052 | controller | --- PASS: TestSFOP (472.01s) 2026-06-11 20:23:59.750076 | controller | PASS 2026-06-11 20:23:59.755040 | controller | ok github.com/softwarefactory-project/sf-operator/tests 472.047s 2026-06-12 00:23:59.893855 | controller | ok: Runtime: 0:08:00.885357 2026-06-12 00:23:59.915350 | 2026-06-12 00:23:59.915476 | TASK [health-check/test-standalone-update : Create a temporary directory for generated CRs] 2026-06-12 00:24:00.324049 | controller | changed 2026-06-12 00:24:00.334543 | 2026-06-12 00:24:00.334718 | TASK [health-check/test-standalone-update : Generate initial CR] 2026-06-12 00:24:01.272201 | controller | changed 2026-06-12 00:24:01.281763 | 2026-06-12 00:24:01.281903 | TASK [Run standalone operator with initial config] 2026-06-12 00:24:01.319556 | controller | ok 2026-06-12 00:24:01.352360 | 2026-06-12 00:24:01.352484 | TASK [run-operator-standalone : Ensure ~/zuul-output/logs] 2026-06-12 00:24:01.626761 | controller | ok 2026-06-12 00:24:01.632871 | 2026-06-12 00:24:01.632960 | TASK [run-operator-standalone : Clear previous log file] 2026-06-12 00:24:01.900619 | controller | changed 2026-06-12 00:24:01.910553 | 2026-06-12 00:24:01.910689 | TASK [run-operator-standalone : Run the operator in standalone mode] 2026-06-11 20:24:02.545669 | controller | 2026-06-11T20:24:02-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:24:02.545968 | controller | 2026-06-11 20:24:02.563585 | controller | 2026-06-11T20:24:02-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:24:02.563624 | controller | 2026-06-11 20:24:02.577124 | controller | 2026-06-11T20:24:02-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:24:02.588216 | controller | 2026-06-11T20:24:02-04:00 INFO Updating configmap, name: zuul-scheduler-tooling-config-map 2026-06-11 20:24:02.588263 | controller | 2026-06-11T20:24:02-04:00 INFO Updating object, name: zuul-scheduler-tooling-config-map 2026-06-11 20:24:02.606672 | controller | 2026-06-11T20:24:02-04:00 INFO Statefulset "git-server" configuration changed, applying... 2026-06-11 20:24:02.606750 | controller | 2026-06-11T20:24:02-04:00 INFO Updating object, name: git-server 2026-06-11 20:24:03.179901 | controller | 2026-06-11T20:24:03-04:00 INFO Statefulset "logserver" configuration changed, applying... 2026-06-11 20:24:03.179982 | controller | 2026-06-11T20:24:03-04:00 INFO Updating object, name: logserver 2026-06-11 20:24:03.194142 | controller | 2026-06-11T20:24:03-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:24:03.194216 | controller | 2026-06-11T20:24:03-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:24:03.228459 | controller | 2026-06-11T20:24:03-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:24:03.228538 | controller | 2026-06-11T20:24:03-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:24:03.597207 | controller | 2026-06-11T20:24:03-04:00 INFO Waiting for GitServer and MariaDB services to be ready ... 2026-06-11 20:24:03.597329 | controller | 2026-06-11T20:24:03-04:00 INFO 2026-06-11 20:24:03.597342 | controller | - Config: Waiting ... 2026-06-11 20:24:03.597351 | controller | - Gateway: OK 2026-06-11 20:24:03.597360 | controller | - GitServer: Waiting ... 2026-06-11 20:24:03.597419 | controller | - HoundSearch: OK 2026-06-11 20:24:03.597438 | controller | - LogJuicer: OK 2026-06-11 20:24:03.597449 | controller | - Logserver: Waiting ... 2026-06-11 20:24:03.597457 | controller | - MariaDB: OK 2026-06-11 20:24:03.597465 | controller | - Zookeeper: OK 2026-06-11 20:24:03.597473 | controller | 2026-06-11 20:24:03.597481 | controller | 2026-06-11T20:24:03-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-11 20:24:08.606818 | controller | 2026-06-11T20:24:08-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:24:08.640340 | controller | 2026-06-11T20:24:08-04:00 INFO Waiting for statefulset, name: git-server 2026-06-11 20:24:26.766106 | controller | 2026-06-11T20:24:26-04:00 INFO Waiting for statefulset, name: logserver 2026-06-11 20:24:56.882722 | controller | 2026-06-11T20:24:56-04:00 INFO Statefulset "logserver" not ready after 30s 2026-06-11 20:24:56.891952 | controller | 2026-06-11T20:24:56-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:24:56.892003 | controller | 2026-06-11T20:24:56-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:24:56.914541 | controller | 2026-06-11T20:24:56-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:24:56.914610 | controller | 2026-06-11T20:24:56-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:24:56.936472 | controller | 2026-06-11T20:24:56-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:24:56.962664 | controller | 2026-06-11T20:24:56-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:24:56.962752 | controller | 2026-06-11T20:24:56-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:24:57.105476 | controller | 2026-06-11T20:24:57-04:00 INFO Updating secret, name: zuul-config 2026-06-11 20:24:57.105554 | controller | 2026-06-11T20:24:57-04:00 INFO Updating object, name: zuul-config 2026-06-11 20:24:57.894027 | controller | 2026-06-11T20:24:57-04:00 INFO Statefulset "zuul-scheduler" configuration changed, applying... 2026-06-11 20:24:57.894082 | controller | 2026-06-11T20:24:57-04:00 INFO Updating object, name: zuul-scheduler 2026-06-11 20:24:59.492514 | controller | 2026-06-11T20:24:59-04:00 INFO Statefulset "zuul-web" configuration changed, applying... 2026-06-11 20:24:59.492580 | controller | 2026-06-11T20:24:59-04:00 INFO Updating object, name: zuul-web 2026-06-11 20:25:00.300792 | controller | 2026-06-11T20:25:00-04:00 INFO 2026-06-11 20:25:00.300856 | controller | - Config: Waiting ... 2026-06-11 20:25:00.300870 | controller | - Gateway: OK 2026-06-11 20:25:00.300904 | controller | - GitServer: OK 2026-06-11 20:25:00.300917 | controller | - HoundSearch: OK 2026-06-11 20:25:00.300928 | controller | - LogJuicer: OK 2026-06-11 20:25:00.300939 | controller | - Logserver: Waiting ... 2026-06-11 20:25:00.300950 | controller | - MariaDB: OK 2026-06-11 20:25:00.300963 | controller | - NodePoolBuilder: OK 2026-06-11 20:25:00.300974 | controller | - NodePoolLauncher: OK 2026-06-11 20:25:00.300985 | controller | - Zookeeper: OK 2026-06-11 20:25:00.300997 | controller | - Zuul: Waiting ... 2026-06-11 20:25:00.301008 | controller | - |_ Config Secrets: OK 2026-06-11 20:25:00.301020 | controller | - |_ Executor: OK 2026-06-11 20:25:00.301031 | controller | - |_ Merger: OK 2026-06-11 20:25:00.301043 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:25:00.301054 | controller | - |_ Web: Waiting ... 2026-06-11 20:25:00.301065 | controller | 2026-06-11 20:25:00.301077 | controller | 2026-06-11T20:25:00-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-11 20:25:05.309511 | controller | 2026-06-11T20:25:05-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:25:05.928000 | controller | 2026-06-11T20:25:05-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:25:06.078094 | controller | 2026-06-11T20:25:06-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:25:06.084884 | controller | 2026-06-11T20:25:06-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:25:06.084922 | controller | 2026-06-11T20:25:06-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:25:06.107146 | controller | 2026-06-11T20:25:06-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:25:06.107211 | controller | 2026-06-11T20:25:06-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:25:06.327607 | controller | 2026-06-11T20:25:06-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:25:06.730223 | controller | 2026-06-11T20:25:06-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:25:06.730284 | controller | 2026-06-11T20:25:06-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:25:07.741046 | controller | 2026-06-11T20:25:07-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:25:37.857395 | controller | 2026-06-11T20:25:37-04:00 INFO Statefulset "zuul-scheduler" not ready after 30s 2026-06-11 20:25:37.902345 | controller | 2026-06-11T20:25:37-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:25:37.902472 | controller | 2026-06-11T20:25:37-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:25:38.270988 | controller | 2026-06-11T20:25:38-04:00 INFO 2026-06-11 20:25:38.271056 | controller | - Config: Waiting ... 2026-06-11 20:25:38.271065 | controller | - Gateway: OK 2026-06-11 20:25:38.271073 | controller | - GitServer: OK 2026-06-11 20:25:38.271080 | controller | - HoundSearch: OK 2026-06-11 20:25:38.271087 | controller | - LogJuicer: OK 2026-06-11 20:25:38.271095 | controller | - Logserver: OK 2026-06-11 20:25:38.271102 | controller | - MariaDB: OK 2026-06-11 20:25:38.271109 | controller | - NodePoolBuilder: OK 2026-06-11 20:25:38.271116 | controller | - NodePoolLauncher: OK 2026-06-11 20:25:38.271123 | controller | - Zookeeper: OK 2026-06-11 20:25:38.271130 | controller | - Zuul: Waiting ... 2026-06-11 20:25:38.271137 | controller | - |_ Config Secrets: OK 2026-06-11 20:25:38.271144 | controller | - |_ Executor: OK 2026-06-11 20:25:38.271151 | controller | - |_ Merger: OK 2026-06-11 20:25:38.271158 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:25:38.271166 | controller | - |_ Web: Waiting ... 2026-06-11 20:25:38.271173 | controller | 2026-06-11 20:25:38.271187 | controller | 2026-06-11T20:25:38-04:00 INFO [attempt #3] Waiting 5s for the next reconcile call ... 2026-06-11 20:25:43.281780 | controller | 2026-06-11T20:25:43-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:25:43.905290 | controller | 2026-06-11T20:25:43-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:25:43.905408 | controller | 2026-06-11T20:25:43-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:25:43.930154 | controller | 2026-06-11T20:25:43-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:25:43.930227 | controller | 2026-06-11T20:25:43-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:25:44.301145 | controller | 2026-06-11T20:25:44-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:25:44.696097 | controller | 2026-06-11T20:25:44-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:25:44.696166 | controller | 2026-06-11T20:25:44-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:25:45.703860 | controller | 2026-06-11T20:25:45-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:26:01.772996 | controller | 2026-06-11T20:26:01-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:26:01.773084 | controller | 2026-06-11T20:26:01-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:26:01.808529 | controller | 2026-06-11T20:26:01-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:26:01.808597 | controller | 2026-06-11T20:26:01-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:26:02.590511 | controller | 2026-06-11T20:26:02-04:00 INFO 2026-06-11 20:26:02.590598 | controller | - Config: OK 2026-06-11 20:26:02.590612 | controller | - Gateway: OK 2026-06-11 20:26:02.590624 | controller | - GitServer: OK 2026-06-11 20:26:02.590634 | controller | - HoundSearch: OK 2026-06-11 20:26:02.590646 | controller | - LogJuicer: OK 2026-06-11 20:26:02.590657 | controller | - Logserver: OK 2026-06-11 20:26:02.590668 | controller | - MariaDB: OK 2026-06-11 20:26:02.590678 | controller | - NodePoolBuilder: OK 2026-06-11 20:26:02.590689 | controller | - NodePoolLauncher: OK 2026-06-11 20:26:02.590700 | controller | - Zookeeper: OK 2026-06-11 20:26:02.590711 | controller | - Zuul: OK 2026-06-11 20:26:02.590723 | controller | 2026-06-11 20:26:02.590735 | controller | 2026-06-11T20:26:02-04:00 INFO Updating controller configmap ... 2026-06-11 20:26:02.976682 | controller | 2026-06-11T20:26:02-04:00 INFO Standalone reconcile done. 2026-06-12 00:26:03.105249 | controller | ok: Runtime: 0:02:00.784303 2026-06-12 00:26:03.110667 | 2026-06-12 00:26:03.110735 | TASK [run-operator-standalone : Copy current spec] 2026-06-12 00:26:03.639528 | controller | ok: Runtime: 0:00:00.008840 2026-06-12 00:26:03.654110 | 2026-06-12 00:26:03.654255 | TASK [health-check/test-standalone-update : Get standalone owner configmap after initial creation] 2026-06-11 20:26:03.969004 | controller | fqdn: test-initial.sf.io 2026-06-11 20:26:03.969111 | controller | fluentbitlogforwarding: null 2026-06-11 20:26:03.969127 | controller | storagedefault: 2026-06-11 20:26:03.969136 | controller | classname: "" 2026-06-11 20:26:03.969144 | controller | extraannotations: {} 2026-06-11 20:26:03.969153 | controller | extralabels: {} 2026-06-11 20:26:03.969162 | controller | configrepositorylocation: 2026-06-11 20:26:03.969173 | controller | name: config 2026-06-11 20:26:03.969183 | controller | branch: "" 2026-06-11 20:26:03.969193 | controller | zuulconnectionname: gerrit 2026-06-11 20:26:03.969201 | controller | clusterapiurl: "" 2026-06-11 20:26:03.969211 | controller | logserverhost: "" 2026-06-11 20:26:03.969219 | controller | zuul: 2026-06-11 20:26:03.969227 | controller | oidcauthenticators: [] 2026-06-11 20:26:03.969235 | controller | defaultauthenticator: "" 2026-06-11 20:26:03.969243 | controller | gerritconns: 2026-06-11 20:26:03.969251 | controller | - name: gerrit 2026-06-11 20:26:03.969264 | controller | hostname: gerrit-sshd.sf 2026-06-11 20:26:03.969272 | controller | port: 0 2026-06-11 20:26:03.969284 | controller | puburl: https://gerrit.sfop.me 2026-06-11 20:26:03.969292 | controller | username: zuul 2026-06-11 20:26:03.969300 | controller | canonicalhostname: "" 2026-06-11 20:26:03.969310 | controller | password: "" 2026-06-11 20:26:03.969318 | controller | sshkey: "" 2026-06-11 20:26:03.969325 | controller | gitoverssh: false 2026-06-11 20:26:03.969333 | controller | verifyssl: false 2026-06-11 20:26:03.969342 | controller | streamevents: null 2026-06-11 20:26:03.969349 | controller | githubconns: [] 2026-06-11 20:26:03.969357 | controller | gitlabconns: [] 2026-06-11 20:26:03.969402 | controller | gitconns: [] 2026-06-11 20:26:03.969424 | controller | pagureconns: [] 2026-06-11 20:26:03.969436 | controller | elasticsearchconns: [] 2026-06-11 20:26:03.969447 | controller | smtpconns: [] 2026-06-11 20:26:03.969459 | controller | executor: 2026-06-11 20:26:03.969471 | controller | storage: 2026-06-11 20:26:03.969482 | controller | size: 2026-06-11 20:26:03.969494 | controller | format: "" 2026-06-11 20:26:03.969502 | controller | classname: "" 2026-06-11 20:26:03.969510 | controller | loglevel: DEBUG 2026-06-11 20:26:03.969518 | controller | enabled: true 2026-06-11 20:26:03.969526 | controller | standalone: null 2026-06-11 20:26:03.969534 | controller | limits: null 2026-06-11 20:26:03.969542 | controller | disklimitperjob: 0 2026-06-11 20:26:03.969549 | controller | ansiblesetuptimeout: 0 2026-06-11 20:26:03.969564 | controller | terminationgraceperiodseconds: 0 2026-06-11 20:26:03.969619 | controller | scheduler: 2026-06-11 20:26:03.969632 | controller | storage: 2026-06-11 20:26:03.969640 | controller | size: 2026-06-11 20:26:03.969648 | controller | format: "" 2026-06-11 20:26:03.969655 | controller | classname: "" 2026-06-11 20:26:03.969663 | controller | statsdtarget: "" 2026-06-11 20:26:03.969671 | controller | loglevel: DEBUG 2026-06-11 20:26:03.969679 | controller | limits: null 2026-06-11 20:26:03.969687 | controller | defaultholdexpiration: null 2026-06-11 20:26:03.969695 | controller | maxholdexpiration: null 2026-06-11 20:26:03.969703 | controller | web: 2026-06-11 20:26:03.969710 | controller | loglevel: DEBUG 2026-06-11 20:26:03.969718 | controller | limits: null 2026-06-11 20:26:03.969726 | controller | merger: 2026-06-11 20:26:03.969733 | controller | gitusername: "" 2026-06-11 20:26:03.969741 | controller | gituseremail: "" 2026-06-11 20:26:03.969749 | controller | githttplowspeedlimit: 0 2026-06-11 20:26:03.969757 | controller | githttplowspeedtime: 0 2026-06-11 20:26:03.969764 | controller | gittimeout: 0 2026-06-11 20:26:03.969772 | controller | storage: 2026-06-11 20:26:03.969780 | controller | size: 2026-06-11 20:26:03.969788 | controller | format: "" 2026-06-11 20:26:03.969795 | controller | classname: "" 2026-06-11 20:26:03.969803 | controller | loglevel: DEBUG 2026-06-11 20:26:03.969811 | controller | limits: null 2026-06-11 20:26:03.969818 | controller | nodepool: 2026-06-11 20:26:03.969826 | controller | launcher: 2026-06-11 20:26:03.969834 | controller | loglevel: "" 2026-06-11 20:26:03.969841 | controller | limits: null 2026-06-11 20:26:03.969849 | controller | builder: 2026-06-11 20:26:03.969857 | controller | storage: 2026-06-11 20:26:03.969864 | controller | size: 2026-06-11 20:26:03.969872 | controller | format: "" 2026-06-11 20:26:03.969880 | controller | classname: "" 2026-06-11 20:26:03.969887 | controller | loglevel: "" 2026-06-11 20:26:03.969904 | controller | limits: null 2026-06-11 20:26:03.969912 | controller | statsdtarget: "" 2026-06-11 20:26:03.969920 | controller | zookeeper: 2026-06-11 20:26:03.969928 | controller | storage: 2026-06-11 20:26:03.969935 | controller | size: 2026-06-11 20:26:03.969943 | controller | format: "" 2026-06-11 20:26:03.969951 | controller | classname: "" 2026-06-11 20:26:03.969958 | controller | limits: null 2026-06-11 20:26:03.969966 | controller | logserver: 2026-06-11 20:26:03.969974 | controller | retentiondays: 30 2026-06-11 20:26:03.969981 | controller | loopdelay: 3600 2026-06-11 20:26:03.970028 | controller | storage: 2026-06-11 20:26:03.970041 | controller | size: 2026-06-11 20:26:03.970049 | controller | format: BinarySI 2026-06-11 20:26:03.970057 | controller | classname: "" 2026-06-11 20:26:03.970064 | controller | podannotations: {} 2026-06-11 20:26:03.970072 | controller | logjuicer: 2026-06-11 20:26:03.970080 | controller | size: 2026-06-11 20:26:03.970088 | controller | format: "" 2026-06-11 20:26:03.970095 | controller | classname: "" 2026-06-11 20:26:03.970103 | controller | mariadb: 2026-06-11 20:26:03.970111 | controller | dbstorage: 2026-06-11 20:26:03.970118 | controller | size: 2026-06-11 20:26:03.970126 | controller | format: "" 2026-06-11 20:26:03.970134 | controller | classname: "" 2026-06-11 20:26:03.970141 | controller | logstorage: 2026-06-11 20:26:03.970149 | controller | size: 2026-06-11 20:26:03.970157 | controller | format: "" 2026-06-11 20:26:03.970165 | controller | classname: "" 2026-06-11 20:26:03.970173 | controller | limits: null 2026-06-11 20:26:03.970180 | controller | gitserver: 2026-06-11 20:26:03.970188 | controller | storage: 2026-06-11 20:26:03.970196 | controller | size: 2026-06-11 20:26:03.970204 | controller | format: "" 2026-06-11 20:26:03.970212 | controller | classname: "" 2026-06-11 20:26:03.970220 | controller | codesearch: 2026-06-11 20:26:03.970227 | controller | storage: 2026-06-11 20:26:03.970235 | controller | size: 2026-06-11 20:26:03.970243 | controller | format: "" 2026-06-11 20:26:03.970251 | controller | classname: "" 2026-06-11 20:26:03.970258 | controller | limits: null 2026-06-11 20:26:03.970266 | controller | enabled: null 2026-06-11 20:26:03.970274 | controller | hostaliases: [] 2026-06-11 20:26:03.970282 | controller | gateway: null 2026-06-12 00:26:04.191662 | controller | ok: Runtime: 0:00:00.073585 2026-06-12 00:26:04.206791 | 2026-06-12 00:26:04.206969 | TASK [health-check/test-standalone-update : Verify initial spec in configmap] 2026-06-12 00:26:04.247154 | controller | ok: All assertions passed 2026-06-12 00:26:04.258936 | 2026-06-12 00:26:04.259130 | TASK [health-check/test-standalone-update : Get standalone owner configmap annotation after initial creation] 2026-06-12 00:26:04.799396 | controller | ok: Runtime: 0:00:00.064508 2026-06-12 00:26:04.806702 | 2026-06-12 00:26:04.806795 | TASK [health-check/test-standalone-update : Pause for 2 seconds to ensure timestamp difference] 2026-06-12 00:26:06.850100 | controller | ok 2026-06-12 00:26:06.855952 | 2026-06-12 00:26:06.856057 | TASK [health-check/test-standalone-update : Generate updated CR] 2026-06-12 00:26:07.611556 | controller | changed 2026-06-12 00:26:07.623942 | 2026-06-12 00:26:07.624387 | TASK [Run standalone operator with updated config] 2026-06-12 00:26:07.659927 | controller | ok 2026-06-12 00:26:07.694044 | 2026-06-12 00:26:07.694236 | TASK [run-operator-standalone : Ensure ~/zuul-output/logs] 2026-06-12 00:26:07.971514 | controller | ok 2026-06-12 00:26:07.981391 | 2026-06-12 00:26:07.981577 | TASK [run-operator-standalone : Clear previous log file] 2026-06-12 00:26:08.259904 | controller | changed 2026-06-12 00:26:08.265161 | 2026-06-12 00:26:08.265242 | TASK [run-operator-standalone : Run the operator in standalone mode] 2026-06-11 20:26:08.778629 | controller | 2026-06-11T20:26:08-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:26:08.778735 | controller | 2026-06-11 20:26:08.793179 | controller | 2026-06-11T20:26:08-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:26:08.793224 | controller | 2026-06-11 20:26:08.803743 | controller | 2026-06-11T20:26:08-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:26:08.811443 | controller | 2026-06-11T20:26:08-04:00 INFO Updating configmap, name: zuul-scheduler-tooling-config-map 2026-06-11 20:26:08.811497 | controller | 2026-06-11T20:26:08-04:00 INFO Updating object, name: zuul-scheduler-tooling-config-map 2026-06-11 20:26:08.823753 | controller | 2026-06-11T20:26:08-04:00 INFO Statefulset "git-server" configuration changed, applying... 2026-06-11 20:26:08.823811 | controller | 2026-06-11T20:26:08-04:00 INFO Updating object, name: git-server 2026-06-11 20:26:09.407656 | controller | 2026-06-11T20:26:09-04:00 INFO Statefulset "logserver" configuration changed, applying... 2026-06-11 20:26:09.407736 | controller | 2026-06-11T20:26:09-04:00 INFO Updating object, name: logserver 2026-06-11 20:26:09.421668 | controller | 2026-06-11T20:26:09-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:26:09.421737 | controller | 2026-06-11T20:26:09-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:26:09.450429 | controller | 2026-06-11T20:26:09-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:26:09.450499 | controller | 2026-06-11T20:26:09-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:26:09.824140 | controller | 2026-06-11T20:26:09-04:00 INFO Waiting for GitServer and MariaDB services to be ready ... 2026-06-11 20:26:09.824228 | controller | 2026-06-11T20:26:09-04:00 INFO 2026-06-11 20:26:09.824243 | controller | - Config: Waiting ... 2026-06-11 20:26:09.824252 | controller | - Gateway: OK 2026-06-11 20:26:09.824260 | controller | - GitServer: Waiting ... 2026-06-11 20:26:09.824268 | controller | - HoundSearch: OK 2026-06-11 20:26:09.824276 | controller | - LogJuicer: OK 2026-06-11 20:26:09.824284 | controller | - Logserver: Waiting ... 2026-06-11 20:26:09.824292 | controller | - MariaDB: OK 2026-06-11 20:26:09.824300 | controller | - Zookeeper: OK 2026-06-11 20:26:09.824308 | controller | 2026-06-11 20:26:09.824316 | controller | 2026-06-11T20:26:09-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-11 20:26:14.831469 | controller | 2026-06-11T20:26:14-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:26:14.861845 | controller | 2026-06-11T20:26:14-04:00 INFO Waiting for statefulset, name: git-server 2026-06-11 20:26:32.982466 | controller | 2026-06-11T20:26:32-04:00 INFO Waiting for statefulset, name: logserver 2026-06-11 20:27:03.098529 | controller | 2026-06-11T20:27:03-04:00 INFO Statefulset "logserver" not ready after 30s 2026-06-11 20:27:03.107059 | controller | 2026-06-11T20:27:03-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:27:03.107119 | controller | 2026-06-11T20:27:03-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:27:03.126724 | controller | 2026-06-11T20:27:03-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:27:03.126776 | controller | 2026-06-11T20:27:03-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:27:03.143183 | controller | 2026-06-11T20:27:03-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:27:03.164214 | controller | 2026-06-11T20:27:03-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:27:03.164287 | controller | 2026-06-11T20:27:03-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:27:03.327000 | controller | 2026-06-11T20:27:03-04:00 INFO Updating secret, name: zuul-config 2026-06-11 20:27:03.327088 | controller | 2026-06-11T20:27:03-04:00 INFO Updating object, name: zuul-config 2026-06-11 20:27:04.107200 | controller | 2026-06-11T20:27:04-04:00 INFO Statefulset "zuul-scheduler" configuration changed, applying... 2026-06-11 20:27:04.107263 | controller | 2026-06-11T20:27:04-04:00 INFO Updating object, name: zuul-scheduler 2026-06-11 20:27:05.706892 | controller | 2026-06-11T20:27:05-04:00 INFO Statefulset "zuul-web" configuration changed, applying... 2026-06-11 20:27:05.706944 | controller | 2026-06-11T20:27:05-04:00 INFO Updating object, name: zuul-web 2026-06-11 20:27:06.518308 | controller | 2026-06-11T20:27:06-04:00 INFO 2026-06-11 20:27:06.518420 | controller | - Config: Waiting ... 2026-06-11 20:27:06.518443 | controller | - Gateway: OK 2026-06-11 20:27:06.518481 | controller | - GitServer: OK 2026-06-11 20:27:06.518491 | controller | - HoundSearch: OK 2026-06-11 20:27:06.518500 | controller | - LogJuicer: OK 2026-06-11 20:27:06.518508 | controller | - Logserver: Waiting ... 2026-06-11 20:27:06.518517 | controller | - MariaDB: OK 2026-06-11 20:27:06.518527 | controller | - NodePoolBuilder: OK 2026-06-11 20:27:06.518536 | controller | - NodePoolLauncher: OK 2026-06-11 20:27:06.518544 | controller | - Zookeeper: OK 2026-06-11 20:27:06.518553 | controller | - Zuul: Waiting ... 2026-06-11 20:27:06.518561 | controller | - |_ Config Secrets: OK 2026-06-11 20:27:06.518570 | controller | - |_ Executor: OK 2026-06-11 20:27:06.518579 | controller | - |_ Merger: OK 2026-06-11 20:27:06.518587 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:27:06.518595 | controller | - |_ Web: Waiting ... 2026-06-11 20:27:06.518604 | controller | 2026-06-11 20:27:06.518613 | controller | 2026-06-11T20:27:06-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-11 20:27:11.526674 | controller | 2026-06-11T20:27:11-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:27:12.141698 | controller | 2026-06-11T20:27:12-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:27:12.279744 | controller | 2026-06-11T20:27:12-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:27:12.287167 | controller | 2026-06-11T20:27:12-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:27:12.287216 | controller | 2026-06-11T20:27:12-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:27:12.306902 | controller | 2026-06-11T20:27:12-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:27:12.306947 | controller | 2026-06-11T20:27:12-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:27:12.544212 | controller | 2026-06-11T20:27:12-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:27:12.960157 | controller | 2026-06-11T20:27:12-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:27:12.960264 | controller | 2026-06-11T20:27:12-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:27:13.963536 | controller | 2026-06-11T20:27:13-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:27:44.078578 | controller | 2026-06-11T20:27:44-04:00 INFO Statefulset "zuul-scheduler" not ready after 30s 2026-06-11 20:27:44.115000 | controller | 2026-06-11T20:27:44-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:27:44.115066 | controller | 2026-06-11T20:27:44-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:27:44.493297 | controller | 2026-06-11T20:27:44-04:00 INFO 2026-06-11 20:27:44.493449 | controller | - Config: Waiting ... 2026-06-11 20:27:44.493463 | controller | - Gateway: OK 2026-06-11 20:27:44.493472 | controller | - GitServer: OK 2026-06-11 20:27:44.493480 | controller | - HoundSearch: OK 2026-06-11 20:27:44.493488 | controller | - LogJuicer: OK 2026-06-11 20:27:44.493496 | controller | - Logserver: OK 2026-06-11 20:27:44.493504 | controller | - MariaDB: OK 2026-06-11 20:27:44.493512 | controller | - NodePoolBuilder: OK 2026-06-11 20:27:44.493520 | controller | - NodePoolLauncher: OK 2026-06-11 20:27:44.493527 | controller | - Zookeeper: OK 2026-06-11 20:27:44.493535 | controller | - Zuul: Waiting ... 2026-06-11 20:27:44.493543 | controller | - |_ Config Secrets: OK 2026-06-11 20:27:44.493551 | controller | - |_ Executor: OK 2026-06-11 20:27:44.493559 | controller | - |_ Merger: OK 2026-06-11 20:27:44.493566 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:27:44.493574 | controller | - |_ Web: Waiting ... 2026-06-11 20:27:44.493582 | controller | 2026-06-11 20:27:44.493601 | controller | 2026-06-11T20:27:44-04:00 INFO [attempt #3] Waiting 5s for the next reconcile call ... 2026-06-11 20:27:49.504650 | controller | 2026-06-11T20:27:49-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:27:50.126529 | controller | 2026-06-11T20:27:50-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:27:50.126626 | controller | 2026-06-11T20:27:50-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:27:50.150622 | controller | 2026-06-11T20:27:50-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:27:50.150679 | controller | 2026-06-11T20:27:50-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:27:50.521607 | controller | 2026-06-11T20:27:50-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:27:50.920806 | controller | 2026-06-11T20:27:50-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:27:50.920866 | controller | 2026-06-11T20:27:50-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:27:51.916154 | controller | 2026-06-11T20:27:51-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:28:07.985598 | controller | 2026-06-11T20:28:07-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:28:07.985725 | controller | 2026-06-11T20:28:07-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:28:08.023798 | controller | 2026-06-11T20:28:08-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:28:08.023868 | controller | 2026-06-11T20:28:08-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:28:08.802010 | controller | 2026-06-11T20:28:08-04:00 INFO 2026-06-11 20:28:08.802065 | controller | - Config: OK 2026-06-11 20:28:08.802078 | controller | - Gateway: OK 2026-06-11 20:28:08.802088 | controller | - GitServer: OK 2026-06-11 20:28:08.802097 | controller | - HoundSearch: OK 2026-06-11 20:28:08.802106 | controller | - LogJuicer: OK 2026-06-11 20:28:08.802114 | controller | - Logserver: OK 2026-06-11 20:28:08.802123 | controller | - MariaDB: OK 2026-06-11 20:28:08.802132 | controller | - NodePoolBuilder: OK 2026-06-11 20:28:08.802140 | controller | - NodePoolLauncher: OK 2026-06-11 20:28:08.802149 | controller | - Zookeeper: OK 2026-06-11 20:28:08.802157 | controller | - Zuul: OK 2026-06-11 20:28:08.802167 | controller | 2026-06-11 20:28:08.802176 | controller | 2026-06-11T20:28:08-04:00 INFO Updating controller configmap ... 2026-06-11 20:28:09.190944 | controller | 2026-06-11T20:28:09-04:00 INFO Standalone reconcile done. 2026-06-12 00:28:09.504613 | controller | ok: Runtime: 0:02:00.703061 2026-06-12 00:28:09.511012 | 2026-06-12 00:28:09.511113 | TASK [run-operator-standalone : Copy current spec] 2026-06-12 00:28:10.045120 | controller | ok: Runtime: 0:00:00.007911 2026-06-12 00:28:10.057002 | 2026-06-12 00:28:10.057104 | TASK [health-check/test-standalone-update : Get standalone owner configmap after update] 2026-06-11 20:28:10.407345 | controller | fqdn: test-updated.sf.io 2026-06-11 20:28:10.407478 | controller | fluentbitlogforwarding: null 2026-06-11 20:28:10.407494 | controller | storagedefault: 2026-06-11 20:28:10.407504 | controller | classname: "" 2026-06-11 20:28:10.407512 | controller | extraannotations: {} 2026-06-11 20:28:10.407521 | controller | extralabels: {} 2026-06-11 20:28:10.407529 | controller | configrepositorylocation: 2026-06-11 20:28:10.407539 | controller | name: config 2026-06-11 20:28:10.407549 | controller | branch: "" 2026-06-11 20:28:10.407559 | controller | zuulconnectionname: gerrit 2026-06-11 20:28:10.407567 | controller | clusterapiurl: "" 2026-06-11 20:28:10.407577 | controller | logserverhost: "" 2026-06-11 20:28:10.407613 | controller | zuul: 2026-06-11 20:28:10.407622 | controller | oidcauthenticators: [] 2026-06-11 20:28:10.407630 | controller | defaultauthenticator: "" 2026-06-11 20:28:10.407638 | controller | gerritconns: 2026-06-11 20:28:10.407645 | controller | - name: gerrit 2026-06-11 20:28:10.407659 | controller | hostname: gerrit-sshd.sf 2026-06-11 20:28:10.407668 | controller | port: 0 2026-06-11 20:28:10.407679 | controller | puburl: https://gerrit.sfop.me 2026-06-11 20:28:10.407687 | controller | username: zuul 2026-06-11 20:28:10.407695 | controller | canonicalhostname: "" 2026-06-11 20:28:10.407703 | controller | password: "" 2026-06-11 20:28:10.407711 | controller | sshkey: "" 2026-06-11 20:28:10.407718 | controller | gitoverssh: false 2026-06-11 20:28:10.407726 | controller | verifyssl: false 2026-06-11 20:28:10.407734 | controller | streamevents: null 2026-06-11 20:28:10.407741 | controller | githubconns: [] 2026-06-11 20:28:10.407749 | controller | gitlabconns: [] 2026-06-11 20:28:10.407756 | controller | gitconns: [] 2026-06-11 20:28:10.407764 | controller | pagureconns: [] 2026-06-11 20:28:10.407772 | controller | elasticsearchconns: [] 2026-06-11 20:28:10.407779 | controller | smtpconns: [] 2026-06-11 20:28:10.407787 | controller | executor: 2026-06-11 20:28:10.407795 | controller | storage: 2026-06-11 20:28:10.407802 | controller | size: 2026-06-11 20:28:10.407810 | controller | format: "" 2026-06-11 20:28:10.407817 | controller | classname: "" 2026-06-11 20:28:10.407825 | controller | loglevel: DEBUG 2026-06-11 20:28:10.407833 | controller | enabled: true 2026-06-11 20:28:10.407840 | controller | standalone: null 2026-06-11 20:28:10.407848 | controller | limits: null 2026-06-11 20:28:10.407855 | controller | disklimitperjob: 0 2026-06-11 20:28:10.407863 | controller | ansiblesetuptimeout: 0 2026-06-11 20:28:10.407874 | controller | terminationgraceperiodseconds: 0 2026-06-11 20:28:10.407882 | controller | scheduler: 2026-06-11 20:28:10.407890 | controller | storage: 2026-06-11 20:28:10.407897 | controller | size: 2026-06-11 20:28:10.407905 | controller | format: "" 2026-06-11 20:28:10.407913 | controller | classname: "" 2026-06-11 20:28:10.407920 | controller | statsdtarget: "" 2026-06-11 20:28:10.407928 | controller | loglevel: DEBUG 2026-06-11 20:28:10.407935 | controller | limits: null 2026-06-11 20:28:10.407943 | controller | defaultholdexpiration: null 2026-06-11 20:28:10.407951 | controller | maxholdexpiration: null 2026-06-11 20:28:10.407958 | controller | web: 2026-06-11 20:28:10.407966 | controller | loglevel: DEBUG 2026-06-11 20:28:10.407973 | controller | limits: null 2026-06-11 20:28:10.407981 | controller | merger: 2026-06-11 20:28:10.407989 | controller | gitusername: "" 2026-06-11 20:28:10.407996 | controller | gituseremail: "" 2026-06-11 20:28:10.408004 | controller | githttplowspeedlimit: 0 2026-06-11 20:28:10.408011 | controller | githttplowspeedtime: 0 2026-06-11 20:28:10.408019 | controller | gittimeout: 0 2026-06-11 20:28:10.408026 | controller | storage: 2026-06-11 20:28:10.408034 | controller | size: 2026-06-11 20:28:10.408041 | controller | format: "" 2026-06-11 20:28:10.408049 | controller | classname: "" 2026-06-11 20:28:10.408056 | controller | loglevel: DEBUG 2026-06-11 20:28:10.408064 | controller | limits: null 2026-06-11 20:28:10.408071 | controller | nodepool: 2026-06-11 20:28:10.408079 | controller | launcher: 2026-06-11 20:28:10.408086 | controller | loglevel: "" 2026-06-11 20:28:10.408094 | controller | limits: null 2026-06-11 20:28:10.408101 | controller | builder: 2026-06-11 20:28:10.408109 | controller | storage: 2026-06-11 20:28:10.408116 | controller | size: 2026-06-11 20:28:10.408124 | controller | format: "" 2026-06-11 20:28:10.408132 | controller | classname: "" 2026-06-11 20:28:10.408139 | controller | loglevel: "" 2026-06-11 20:28:10.408155 | controller | limits: null 2026-06-11 20:28:10.408163 | controller | statsdtarget: "" 2026-06-11 20:28:10.408171 | controller | zookeeper: 2026-06-11 20:28:10.408179 | controller | storage: 2026-06-11 20:28:10.408186 | controller | size: 2026-06-11 20:28:10.408194 | controller | format: "" 2026-06-11 20:28:10.408201 | controller | classname: "" 2026-06-11 20:28:10.408209 | controller | limits: null 2026-06-11 20:28:10.408217 | controller | logserver: 2026-06-11 20:28:10.408224 | controller | retentiondays: 30 2026-06-11 20:28:10.408232 | controller | loopdelay: 3600 2026-06-11 20:28:10.408240 | controller | storage: 2026-06-11 20:28:10.408247 | controller | size: 2026-06-11 20:28:10.408255 | controller | format: BinarySI 2026-06-11 20:28:10.408263 | controller | classname: "" 2026-06-11 20:28:10.408271 | controller | podannotations: {} 2026-06-11 20:28:10.408278 | controller | logjuicer: 2026-06-11 20:28:10.408286 | controller | size: 2026-06-11 20:28:10.408294 | controller | format: "" 2026-06-11 20:28:10.408301 | controller | classname: "" 2026-06-11 20:28:10.408309 | controller | mariadb: 2026-06-11 20:28:10.408317 | controller | dbstorage: 2026-06-11 20:28:10.408324 | controller | size: 2026-06-11 20:28:10.408332 | controller | format: "" 2026-06-11 20:28:10.408340 | controller | classname: "" 2026-06-11 20:28:10.408347 | controller | logstorage: 2026-06-11 20:28:10.408355 | controller | size: 2026-06-11 20:28:10.408363 | controller | format: "" 2026-06-11 20:28:10.408376 | controller | classname: "" 2026-06-11 20:28:10.408412 | controller | limits: null 2026-06-11 20:28:10.408432 | controller | gitserver: 2026-06-11 20:28:10.408445 | controller | storage: 2026-06-11 20:28:10.408453 | controller | size: 2026-06-11 20:28:10.408461 | controller | format: "" 2026-06-11 20:28:10.408468 | controller | classname: "" 2026-06-11 20:28:10.408476 | controller | codesearch: 2026-06-11 20:28:10.408484 | controller | storage: 2026-06-11 20:28:10.408491 | controller | size: 2026-06-11 20:28:10.408499 | controller | format: "" 2026-06-11 20:28:10.408507 | controller | classname: "" 2026-06-11 20:28:10.408514 | controller | limits: null 2026-06-11 20:28:10.408522 | controller | enabled: null 2026-06-11 20:28:10.408529 | controller | hostaliases: [] 2026-06-11 20:28:10.408537 | controller | gateway: null 2026-06-12 00:28:10.601182 | controller | ok: Runtime: 0:00:00.097841 2026-06-12 00:28:10.611814 | 2026-06-12 00:28:10.611954 | TASK [health-check/test-standalone-update : Verify updated spec in configmap] 2026-06-12 00:28:10.658316 | controller | ok: All assertions passed 2026-06-12 00:28:10.667615 | 2026-06-12 00:28:10.667756 | TASK [health-check/test-standalone-update : Get standalone owner configmap annotation after update] 2026-06-12 00:28:11.212087 | controller | ok: Runtime: 0:00:00.089609 2026-06-12 00:28:11.221577 | 2026-06-12 00:28:11.221727 | TASK [health-check/test-standalone-update : Verify that the last-reconcile annotation has changed] 2026-06-12 00:28:11.261084 | controller | ok: All assertions passed 2026-06-12 00:28:11.275263 | 2026-06-12 00:28:11.275689 | TASK [Restore original state] 2026-06-12 00:28:11.311984 | controller | ok 2026-06-12 00:28:11.344928 | 2026-06-12 00:28:11.345085 | TASK [run-operator-standalone : Ensure ~/zuul-output/logs] 2026-06-12 00:28:11.617858 | controller | ok 2026-06-12 00:28:11.622728 | 2026-06-12 00:28:11.622803 | TASK [run-operator-standalone : Clear previous log file] 2026-06-12 00:28:11.886181 | controller | changed 2026-06-12 00:28:11.891546 | 2026-06-12 00:28:11.891644 | TASK [run-operator-standalone : Run the operator in standalone mode] 2026-06-11 20:28:12.544311 | controller | 2026-06-11T20:28:12-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:28:12.544445 | controller | 2026-06-11 20:28:12.555344 | controller | 2026-06-11T20:28:12-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:28:12.555396 | controller | 2026-06-11 20:28:12.568628 | controller | 2026-06-11T20:28:12-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:28:12.578872 | controller | 2026-06-11T20:28:12-04:00 INFO Updating configmap, name: zuul-scheduler-tooling-config-map 2026-06-11 20:28:12.578952 | controller | 2026-06-11T20:28:12-04:00 INFO Updating object, name: zuul-scheduler-tooling-config-map 2026-06-11 20:28:12.592950 | controller | 2026-06-11T20:28:12-04:00 INFO Statefulset "git-server" configuration changed, applying... 2026-06-11 20:28:12.593009 | controller | 2026-06-11T20:28:12-04:00 INFO Updating object, name: git-server 2026-06-11 20:28:13.174147 | controller | 2026-06-11T20:28:13-04:00 INFO Statefulset "logserver" configuration changed, applying... 2026-06-11 20:28:13.174211 | controller | 2026-06-11T20:28:13-04:00 INFO Updating object, name: logserver 2026-06-11 20:28:13.195004 | controller | 2026-06-11T20:28:13-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:28:13.195070 | controller | 2026-06-11T20:28:13-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:28:13.224727 | controller | 2026-06-11T20:28:13-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:28:13.224802 | controller | 2026-06-11T20:28:13-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:28:13.587592 | controller | 2026-06-11T20:28:13-04:00 INFO Waiting for GitServer and MariaDB services to be ready ... 2026-06-11 20:28:13.587689 | controller | 2026-06-11T20:28:13-04:00 INFO 2026-06-11 20:28:13.587710 | controller | - Config: Waiting ... 2026-06-11 20:28:13.587722 | controller | - Gateway: OK 2026-06-11 20:28:13.587733 | controller | - GitServer: Waiting ... 2026-06-11 20:28:13.587744 | controller | - HoundSearch: OK 2026-06-11 20:28:13.587754 | controller | - LogJuicer: OK 2026-06-11 20:28:13.587765 | controller | - Logserver: Waiting ... 2026-06-11 20:28:13.587776 | controller | - MariaDB: OK 2026-06-11 20:28:13.587786 | controller | - Zookeeper: OK 2026-06-11 20:28:13.587797 | controller | 2026-06-11 20:28:13.587808 | controller | 2026-06-11T20:28:13-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-11 20:28:18.598868 | controller | 2026-06-11T20:28:18-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:28:18.627841 | controller | 2026-06-11T20:28:18-04:00 INFO Waiting for statefulset, name: git-server 2026-06-11 20:28:36.762437 | controller | 2026-06-11T20:28:36-04:00 INFO Waiting for statefulset, name: logserver 2026-06-11 20:29:06.881644 | controller | 2026-06-11T20:29:06-04:00 INFO Statefulset "logserver" not ready after 30s 2026-06-11 20:29:06.890299 | controller | 2026-06-11T20:29:06-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:29:06.890352 | controller | 2026-06-11T20:29:06-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:29:06.913302 | controller | 2026-06-11T20:29:06-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:29:06.913358 | controller | 2026-06-11T20:29:06-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:29:06.933748 | controller | 2026-06-11T20:29:06-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:29:06.962474 | controller | 2026-06-11T20:29:06-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:29:06.962563 | controller | 2026-06-11T20:29:06-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:29:07.110949 | controller | 2026-06-11T20:29:07-04:00 INFO Updating secret, name: zuul-config 2026-06-11 20:29:07.111019 | controller | 2026-06-11T20:29:07-04:00 INFO Updating object, name: zuul-config 2026-06-11 20:29:07.892891 | controller | 2026-06-11T20:29:07-04:00 INFO Statefulset "zuul-scheduler" configuration changed, applying... 2026-06-11 20:29:07.892957 | controller | 2026-06-11T20:29:07-04:00 INFO Updating object, name: zuul-scheduler 2026-06-11 20:29:09.491410 | controller | 2026-06-11T20:29:09-04:00 INFO Statefulset "zuul-web" configuration changed, applying... 2026-06-11 20:29:09.491496 | controller | 2026-06-11T20:29:09-04:00 INFO Updating object, name: zuul-web 2026-06-11 20:29:10.303222 | controller | 2026-06-11T20:29:10-04:00 INFO 2026-06-11 20:29:10.303287 | controller | - Config: Waiting ... 2026-06-11 20:29:10.303298 | controller | - Gateway: OK 2026-06-11 20:29:10.303324 | controller | - GitServer: OK 2026-06-11 20:29:10.303332 | controller | - HoundSearch: OK 2026-06-11 20:29:10.303340 | controller | - LogJuicer: OK 2026-06-11 20:29:10.303348 | controller | - Logserver: Waiting ... 2026-06-11 20:29:10.303356 | controller | - MariaDB: OK 2026-06-11 20:29:10.303407 | controller | - NodePoolBuilder: OK 2026-06-11 20:29:10.303426 | controller | - NodePoolLauncher: OK 2026-06-11 20:29:10.303447 | controller | - Zookeeper: OK 2026-06-11 20:29:10.303455 | controller | - Zuul: Waiting ... 2026-06-11 20:29:10.303463 | controller | - |_ Config Secrets: OK 2026-06-11 20:29:10.303479 | controller | - |_ Executor: OK 2026-06-11 20:29:10.303495 | controller | - |_ Merger: OK 2026-06-11 20:29:10.303503 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:29:10.303511 | controller | - |_ Web: Waiting ... 2026-06-11 20:29:10.303519 | controller | 2026-06-11 20:29:10.303535 | controller | 2026-06-11T20:29:10-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-11 20:29:15.311851 | controller | 2026-06-11T20:29:15-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:29:15.923772 | controller | 2026-06-11T20:29:15-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:29:16.053649 | controller | 2026-06-11T20:29:16-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:29:16.061663 | controller | 2026-06-11T20:29:16-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:29:16.061700 | controller | 2026-06-11T20:29:16-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:29:16.082600 | controller | 2026-06-11T20:29:16-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:29:16.082643 | controller | 2026-06-11T20:29:16-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:29:16.324446 | controller | 2026-06-11T20:29:16-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:29:16.728399 | controller | 2026-06-11T20:29:16-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:29:16.728481 | controller | 2026-06-11T20:29:16-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:29:17.741359 | controller | 2026-06-11T20:29:17-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:29:47.859352 | controller | 2026-06-11T20:29:47-04:00 INFO Statefulset "zuul-scheduler" not ready after 30s 2026-06-11 20:29:47.908619 | controller | 2026-06-11T20:29:47-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:29:47.908684 | controller | 2026-06-11T20:29:47-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:29:48.277081 | controller | 2026-06-11T20:29:48-04:00 INFO 2026-06-11 20:29:48.277172 | controller | - Config: Waiting ... 2026-06-11 20:29:48.277187 | controller | - Gateway: OK 2026-06-11 20:29:48.277199 | controller | - GitServer: OK 2026-06-11 20:29:48.277210 | controller | - HoundSearch: OK 2026-06-11 20:29:48.277221 | controller | - LogJuicer: OK 2026-06-11 20:29:48.277232 | controller | - Logserver: OK 2026-06-11 20:29:48.277242 | controller | - MariaDB: OK 2026-06-11 20:29:48.277252 | controller | - NodePoolBuilder: OK 2026-06-11 20:29:48.277263 | controller | - NodePoolLauncher: OK 2026-06-11 20:29:48.277274 | controller | - Zookeeper: OK 2026-06-11 20:29:48.277284 | controller | - Zuul: Waiting ... 2026-06-11 20:29:48.277295 | controller | - |_ Config Secrets: OK 2026-06-11 20:29:48.277306 | controller | - |_ Executor: OK 2026-06-11 20:29:48.277317 | controller | - |_ Merger: OK 2026-06-11 20:29:48.277328 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:29:48.277338 | controller | - |_ Web: Waiting ... 2026-06-11 20:29:48.277349 | controller | 2026-06-11 20:29:48.277360 | controller | 2026-06-11T20:29:48-04:00 INFO [attempt #3] Waiting 5s for the next reconcile call ... 2026-06-11 20:29:53.285997 | controller | 2026-06-11T20:29:53-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:29:53.902561 | controller | 2026-06-11T20:29:53-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:29:53.902613 | controller | 2026-06-11T20:29:53-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:29:53.923958 | controller | 2026-06-11T20:29:53-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:29:53.924003 | controller | 2026-06-11T20:29:53-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:29:54.301810 | controller | 2026-06-11T20:29:54-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:29:54.702824 | controller | 2026-06-11T20:29:54-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:29:54.702895 | controller | 2026-06-11T20:29:54-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:29:55.709827 | controller | 2026-06-11T20:29:55-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:30:13.791401 | controller | 2026-06-11T20:30:13-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:30:13.791464 | controller | 2026-06-11T20:30:13-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:30:13.825025 | controller | 2026-06-11T20:30:13-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:30:13.825070 | controller | 2026-06-11T20:30:13-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:30:14.605087 | controller | 2026-06-11T20:30:14-04:00 INFO 2026-06-11 20:30:14.605148 | controller | - Config: OK 2026-06-11 20:30:14.605154 | controller | - Gateway: OK 2026-06-11 20:30:14.605159 | controller | - GitServer: OK 2026-06-11 20:30:14.605163 | controller | - HoundSearch: OK 2026-06-11 20:30:14.605167 | controller | - LogJuicer: OK 2026-06-11 20:30:14.605172 | controller | - Logserver: OK 2026-06-11 20:30:14.605176 | controller | - MariaDB: OK 2026-06-11 20:30:14.605181 | controller | - NodePoolBuilder: OK 2026-06-11 20:30:14.605185 | controller | - NodePoolLauncher: OK 2026-06-11 20:30:14.605189 | controller | - Zookeeper: OK 2026-06-11 20:30:14.605194 | controller | - Zuul: OK 2026-06-11 20:30:14.605198 | controller | 2026-06-11 20:30:14.605209 | controller | 2026-06-11T20:30:14-04:00 INFO Updating controller configmap ... 2026-06-11 20:30:14.997794 | controller | 2026-06-11T20:30:14-04:00 INFO Standalone reconcile done. 2026-06-12 00:30:15.086092 | controller | ok: Runtime: 0:02:02.833052 2026-06-12 00:30:15.097591 | 2026-06-12 00:30:15.097755 | TASK [run-operator-standalone : Copy current spec] 2026-06-12 00:30:15.636510 | controller | ok: Runtime: 0:00:00.006394 2026-06-12 00:30:15.655230 | 2026-06-12 00:30:15.655403 | TASK [health-check/test-standalone-update : Remove temporary directory] 2026-06-12 00:30:15.925666 | controller | changed 2026-06-12 00:30:15.948096 | 2026-06-12 00:30:15.948279 | TASK [health-check/check-zuul-weeder : Get zuul-weeder status] 2026-06-12 00:30:16.764827 | controller | ok: OK (unknown bytes) 2026-06-12 00:30:16.822227 | 2026-06-12 00:30:16.822399 | TASK [scale down zuul components] 2026-06-12 00:30:16.853515 | controller | ok 2026-06-12 00:30:16.871661 | 2026-06-12 00:30:16.871830 | LOOP [health-check/scale-resources : Scaling resources] 2026-06-12 00:30:16.903197 | controller | ok: 2026-06-12 00:30:16.903574 | controller | { 2026-06-12 00:30:16.903615 | controller | "kind": "sts", 2026-06-12 00:30:16.903645 | controller | "name": "zuul-executor", 2026-06-12 00:30:16.903671 | controller | "replicas": 0 2026-06-12 00:30:16.903698 | controller | } 2026-06-12 00:30:16.903748 | controller | changed: All items complete 2026-06-12 00:30:16.903779 | 2026-06-12 00:30:16.909246 | controller | ok: 2026-06-12 00:30:16.909321 | controller | { 2026-06-12 00:30:16.909355 | controller | "kind": "sts", 2026-06-12 00:30:16.909382 | controller | "name": "zuul-merger", 2026-06-12 00:30:16.909408 | controller | "replicas": 0 2026-06-12 00:30:16.909481 | controller | } 2026-06-12 00:30:16.914131 | controller | ok: 2026-06-12 00:30:16.914226 | controller | { 2026-06-12 00:30:16.914261 | controller | "kind": "sts", 2026-06-12 00:30:16.914291 | controller | "name": "zuul-scheduler", 2026-06-12 00:30:16.914317 | controller | "replicas": 0 2026-06-12 00:30:16.914344 | controller | } 2026-06-12 00:30:16.919184 | controller | ok: 2026-06-12 00:30:16.919306 | controller | { 2026-06-12 00:30:16.919338 | controller | "kind": "deployment", 2026-06-12 00:30:16.919365 | controller | "name": "zuul-web", 2026-06-12 00:30:16.919392 | controller | "replicas": 0 2026-06-12 00:30:16.919417 | controller | } 2026-06-12 00:30:16.937733 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/scale-resources/tasks/scale.yaml 2026-06-12 00:30:16.945056 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/scale-resources/tasks/scale.yaml 2026-06-12 00:30:16.950299 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/scale-resources/tasks/scale.yaml 2026-06-12 00:30:16.953905 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/scale-resources/tasks/scale.yaml 2026-06-12 00:30:17.013235 | 2026-06-12 00:30:17.013372 | TASK [health-check/scale-resources : Get initial replica count for zuul-executor] 2026-06-12 00:30:17.538693 | controller | ok: Runtime: 0:00:00.088783 2026-06-12 00:30:17.546918 | 2026-06-12 00:30:17.547018 | TASK [health-check/scale-resources : Collect sts log before executing the scale command] 2026-06-11 20:30:17.901768 | controller | Defaulted container "zuul-executor" out of: zuul-executor, zuul-executor-nodeexporter 2026-06-12 00:30:18.084249 | controller | ok: Runtime: 0:00:00.098178 2026-06-12 00:30:18.097184 | 2026-06-12 00:30:18.097376 | TASK [health-check/scale-resources : Scale on sts zuul-executor] 2026-06-11 20:30:18.496739 | controller | statefulset.apps/zuul-executor scaled 2026-06-12 00:30:18.648413 | controller | ok: Runtime: 0:00:00.111891 2026-06-12 00:30:18.656526 | 2026-06-12 00:30:18.656647 | TASK [health-check/scale-resources : Get replica count for zuul-executor] 2026-06-12 00:30:29.495294 | controller | ok: Runtime: 0:00:00.089285 2026-06-12 00:30:29.500880 | 2026-06-12 00:30:29.500952 | TASK [health-check/scale-resources : Get initial replica count for zuul-merger] 2026-06-12 00:30:30.028857 | controller | ok: Runtime: 0:00:00.087706 2026-06-12 00:30:30.041308 | 2026-06-12 00:30:30.041529 | TASK [health-check/scale-resources : Collect sts log before executing the scale command] 2026-06-11 20:30:30.425426 | controller | Defaulted container "zuul-merger" out of: zuul-merger, zuul-merger-nodeexporter 2026-06-12 00:30:30.593877 | controller | ok: Runtime: 0:00:00.123740 2026-06-12 00:30:30.605931 | 2026-06-12 00:30:30.606131 | TASK [health-check/scale-resources : Scale on sts zuul-merger] 2026-06-11 20:30:31.076694 | controller | statefulset.apps/zuul-merger scaled 2026-06-12 00:30:31.154395 | controller | ok: Runtime: 0:00:00.087901 2026-06-12 00:30:31.169880 | 2026-06-12 00:30:31.170058 | TASK [health-check/scale-resources : Get replica count for zuul-merger] 2026-06-12 00:30:41.971604 | controller | ok: Runtime: 0:00:00.108078 2026-06-12 00:30:41.983243 | 2026-06-12 00:30:41.983384 | TASK [health-check/scale-resources : Get initial replica count for zuul-scheduler] 2026-06-12 00:30:42.528124 | controller | ok: Runtime: 0:00:00.098915 2026-06-12 00:30:42.539588 | 2026-06-12 00:30:42.539751 | TASK [health-check/scale-resources : Collect sts log before executing the scale command] 2026-06-11 20:30:42.937308 | controller | Defaulted container "zuul-scheduler" out of: zuul-scheduler, zuul-statsd, zuul-scheduler-nodeexporter, init-scheduler-config (init) 2026-06-12 00:30:43.096426 | controller | ok: Runtime: 0:00:00.117202 2026-06-12 00:30:43.111385 | 2026-06-12 00:30:43.111568 | TASK [health-check/scale-resources : Scale on sts zuul-scheduler] 2026-06-11 20:30:43.586286 | controller | statefulset.apps/zuul-scheduler scaled 2026-06-12 00:30:43.703266 | controller | ok: Runtime: 0:00:00.107143 2026-06-12 00:30:43.711605 | 2026-06-12 00:30:43.711744 | TASK [health-check/scale-resources : Get replica count for zuul-scheduler] 2026-06-12 00:30:54.496395 | controller | ok: Runtime: 0:00:00.101623 2026-06-12 00:30:54.505751 | 2026-06-12 00:30:54.505893 | TASK [health-check/scale-resources : Get initial replica count for zuul-web] 2026-06-12 00:30:55.049131 | controller | ok: Runtime: 0:00:00.097290 2026-06-12 00:30:55.061645 | 2026-06-12 00:30:55.061849 | TASK [health-check/scale-resources : Collect deployment log before executing the scale command] 2026-06-12 00:30:55.606294 | controller | ok: Runtime: 0:00:00.117965 2026-06-12 00:30:55.612178 | 2026-06-12 00:30:55.612284 | TASK [health-check/scale-resources : Scale on deployment zuul-web] 2026-06-11 20:30:55.954611 | controller | deployment.apps/zuul-web scaled 2026-06-12 00:30:56.144285 | controller | ok: Runtime: 0:00:00.071966 2026-06-12 00:30:56.156870 | 2026-06-12 00:30:56.157022 | TASK [health-check/scale-resources : Get replica count for zuul-web] 2026-06-12 00:30:56.707539 | controller | ok: Runtime: 0:00:00.108676 2026-06-12 00:30:56.727527 | 2026-06-12 00:30:56.727717 | TASK [Enable log forwarding] 2026-06-12 00:30:56.763527 | controller | ok 2026-06-12 00:30:56.794611 | 2026-06-12 00:30:56.794700 | TASK [update-custom-resource : read current crd] 2026-06-12 00:30:57.247826 | controller | ok 2026-06-12 00:30:57.259327 | 2026-06-12 00:30:57.259577 | TASK [update-custom-resource : merge the new cr] 2026-06-12 00:30:58.072491 | controller | changed 2026-06-12 00:30:58.082356 | 2026-06-12 00:30:58.082600 | TASK [run the operator in standalone mode] 2026-06-12 00:30:58.106916 | controller | ok 2026-06-12 00:30:58.129410 | 2026-06-12 00:30:58.129611 | TASK [run-operator-standalone : Ensure ~/zuul-output/logs] 2026-06-12 00:30:58.156856 | controller | skipping: Conditional result was False 2026-06-12 00:30:58.166777 | 2026-06-12 00:30:58.166976 | TASK [run-operator-standalone : Clear previous log file] 2026-06-12 00:30:58.194558 | controller | skipping: Conditional result was False 2026-06-12 00:30:58.205980 | 2026-06-12 00:30:58.206164 | TASK [run-operator-standalone : Run the operator in standalone mode] 2026-06-11 20:30:58.791738 | controller | 2026-06-11T20:30:58-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:30:58.791818 | controller | 2026-06-11 20:30:58.805131 | controller | 2026-06-11T20:30:58-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:30:58.805196 | controller | 2026-06-11 20:30:58.816529 | controller | 2026-06-11T20:30:58-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:30:58.851129 | controller | 2026-06-11T20:30:58-04:00 INFO Creating config map name: fluentbit-mariadb-cfg-config-map 2026-06-11 20:30:58.851222 | controller | 2026-06-11T20:30:58-04:00 INFO Creating object, name: fluentbit-mariadb-cfg-config-map 2026-06-11 20:30:58.856190 | controller | 2026-06-11T20:30:58-04:00 INFO Statefulset "mariadb" configuration changed, applying... 2026-06-11 20:30:58.856302 | controller | 2026-06-11T20:30:58-04:00 INFO Updating object, name: mariadb 2026-06-11 20:30:59.232132 | controller | 2026-06-11T20:30:59-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:30:59.356584 | controller | 2026-06-11T20:30:59-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:30:59.365276 | controller | 2026-06-11T20:30:59-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:30:59.365342 | controller | 2026-06-11T20:30:59-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:30:59.388467 | controller | 2026-06-11T20:30:59-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:30:59.388551 | controller | 2026-06-11T20:30:59-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:30:59.629089 | controller | 2026-06-11T20:30:59-04:00 INFO Creating config map name: fluentbit-zk-cfg-config-map 2026-06-11 20:30:59.629180 | controller | 2026-06-11T20:30:59-04:00 INFO Creating object, name: fluentbit-zk-cfg-config-map 2026-06-11 20:30:59.637467 | controller | 2026-06-11T20:30:59-04:00 INFO Statefulset "zookeeper" configuration changed, applying... 2026-06-11 20:30:59.637531 | controller | 2026-06-11T20:30:59-04:00 INFO Updating object, name: zookeeper 2026-06-11 20:30:59.647325 | controller | 2026-06-11T20:30:59-04:00 INFO Waiting for Zookeeper service to be ready ... 2026-06-11 20:30:59.647426 | controller | 2026-06-11T20:30:59-04:00 INFO 2026-06-11 20:30:59.647443 | controller | - Config: Waiting ... 2026-06-11 20:30:59.647452 | controller | - Gateway: OK 2026-06-11 20:30:59.647460 | controller | - GitServer: OK 2026-06-11 20:30:59.647468 | controller | - HoundSearch: OK 2026-06-11 20:30:59.647476 | controller | - LogJuicer: OK 2026-06-11 20:30:59.647483 | controller | - Logserver: OK 2026-06-11 20:30:59.647491 | controller | - MariaDB: Waiting ... 2026-06-11 20:30:59.647499 | controller | - Zookeeper: Waiting ... 2026-06-11 20:30:59.647506 | controller | 2026-06-11 20:30:59.647523 | controller | 2026-06-11T20:30:59-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-11 20:31:04.662670 | controller | 2026-06-11T20:31:04-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:31:04.717293 | controller | 2026-06-11T20:31:04-04:00 INFO Waiting for statefulset, name: mariadb 2026-06-11 20:31:06.785506 | controller | 2026-06-11T20:31:06-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:31:06.785592 | controller | 2026-06-11T20:31:06-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:31:06.809558 | controller | 2026-06-11T20:31:06-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:31:06.810318 | controller | 2026-06-11T20:31:06-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:31:06.832090 | controller | 2026-06-11T20:31:06-04:00 INFO Waiting for statefulset, name: zookeeper 2026-06-11 20:31:18.885754 | controller | 2026-06-11T20:31:18-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:31:18.904452 | controller | 2026-06-11T20:31:18-04:00 INFO Updating configmap, name: nodepool-launcher-extra-config-config-map 2026-06-11 20:31:18.904524 | controller | 2026-06-11T20:31:18-04:00 INFO Updating object, name: nodepool-launcher-extra-config-config-map 2026-06-11 20:31:18.915102 | controller | 2026-06-11T20:31:18-04:00 INFO Statefulset "nodepool-launcher" configuration changed, applying... 2026-06-11 20:31:18.915154 | controller | 2026-06-11T20:31:18-04:00 INFO Updating object, name: nodepool-launcher 2026-06-11 20:31:18.936696 | controller | 2026-06-11T20:31:18-04:00 INFO Updating configmap, name: nodepool-builder-extra-config-config-map 2026-06-11 20:31:18.936768 | controller | 2026-06-11T20:31:18-04:00 INFO Updating object, name: nodepool-builder-extra-config-config-map 2026-06-11 20:31:18.945674 | controller | 2026-06-11T20:31:18-04:00 INFO Creating config map name: fluentbit-dib-cfg-config-map 2026-06-11 20:31:18.945720 | controller | 2026-06-11T20:31:18-04:00 INFO Creating object, name: fluentbit-dib-cfg-config-map 2026-06-11 20:31:19.103541 | controller | 2026-06-11T20:31:19-04:00 INFO Statefulset "nodepool-builder" configuration changed, applying... 2026-06-11 20:31:19.103628 | controller | 2026-06-11T20:31:19-04:00 INFO Updating object, name: nodepool-builder 2026-06-11 20:31:19.897572 | controller | 2026-06-11T20:31:19-04:00 INFO Updating configmap, name: zuul-logging-config-map 2026-06-11 20:31:19.897645 | controller | 2026-06-11T20:31:19-04:00 INFO Updating object, name: zuul-logging-config-map 2026-06-11 20:31:20.099637 | controller | 2026-06-11T20:31:20-04:00 INFO Statefulset "zuul-scheduler" configuration changed, applying... 2026-06-11 20:31:20.099725 | controller | 2026-06-11T20:31:20-04:00 INFO Updating object, name: zuul-scheduler 2026-06-11 20:31:20.900431 | controller | 2026-06-11T20:31:20-04:00 INFO Statefulset "zuul-executor" configuration changed, applying... 2026-06-11 20:31:20.900517 | controller | 2026-06-11T20:31:20-04:00 INFO Updating object, name: zuul-executor 2026-06-11 20:31:21.701684 | controller | 2026-06-11T20:31:21-04:00 INFO Statefulset "zuul-web" configuration changed, applying... 2026-06-11 20:31:21.701765 | controller | 2026-06-11T20:31:21-04:00 INFO Updating object, name: zuul-web 2026-06-11 20:31:22.501711 | controller | 2026-06-11T20:31:22-04:00 INFO Statefulset "zuul-merger" configuration changed, applying... 2026-06-11 20:31:22.501795 | controller | 2026-06-11T20:31:22-04:00 INFO Updating object, name: zuul-merger 2026-06-11 20:31:22.511614 | controller | 2026-06-11T20:31:22-04:00 INFO 2026-06-11 20:31:22.511681 | controller | - Config: Waiting ... 2026-06-11 20:31:22.511697 | controller | - Gateway: OK 2026-06-11 20:31:22.511710 | controller | - GitServer: OK 2026-06-11 20:31:22.511723 | controller | - HoundSearch: OK 2026-06-11 20:31:22.511735 | controller | - LogJuicer: OK 2026-06-11 20:31:22.511747 | controller | - Logserver: OK 2026-06-11 20:31:22.511759 | controller | - MariaDB: OK 2026-06-11 20:31:22.511771 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:31:22.511783 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:31:22.511795 | controller | - Zookeeper: OK 2026-06-11 20:31:22.511806 | controller | - Zuul: Waiting ... 2026-06-11 20:31:22.511818 | controller | - |_ Config Secrets: OK 2026-06-11 20:31:22.511830 | controller | - |_ Executor: Waiting ... 2026-06-11 20:31:22.511842 | controller | - |_ Merger: Waiting ... 2026-06-11 20:31:22.511854 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:31:22.511866 | controller | - |_ Web: Waiting ... 2026-06-11 20:31:22.511878 | controller | 2026-06-11 20:31:22.511900 | controller | 2026-06-11T20:31:22-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-11 20:31:27.520962 | controller | 2026-06-11T20:31:27-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:31:28.138082 | controller | 2026-06-11T20:31:28-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:31:28.138167 | controller | 2026-06-11T20:31:28-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:31:28.159761 | controller | 2026-06-11T20:31:28-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:31:28.159825 | controller | 2026-06-11T20:31:28-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:31:28.540218 | controller | 2026-06-11T20:31:28-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:31:28.942363 | controller | 2026-06-11T20:31:28-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:31:28.942484 | controller | 2026-06-11T20:31:28-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:31:29.947688 | controller | 2026-06-11T20:31:29-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:31:29.947767 | controller | 2026-06-11T20:31:29-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:31:31.525291 | controller | 2026-06-11T20:31:31-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:31:32.735732 | controller | 2026-06-11T20:31:32-04:00 INFO 2026-06-11 20:31:32.735793 | controller | - Config: OK 2026-06-11 20:31:32.735804 | controller | - Gateway: OK 2026-06-11 20:31:32.735813 | controller | - GitServer: OK 2026-06-11 20:31:32.735821 | controller | - HoundSearch: OK 2026-06-11 20:31:32.735829 | controller | - LogJuicer: OK 2026-06-11 20:31:32.735850 | controller | - Logserver: OK 2026-06-11 20:31:32.735858 | controller | - MariaDB: OK 2026-06-11 20:31:32.735866 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:31:32.735875 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:31:32.735883 | controller | - Zookeeper: OK 2026-06-11 20:31:32.735891 | controller | - Zuul: OK 2026-06-11 20:31:32.735899 | controller | 2026-06-11 20:31:32.735913 | controller | 2026-06-11T20:31:32-04:00 INFO [attempt #3] Waiting 5s for the next reconcile call ... 2026-06-11 20:31:37.744005 | controller | 2026-06-11T20:31:37-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:31:38.366725 | controller | 2026-06-11T20:31:38-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:31:38.366794 | controller | 2026-06-11T20:31:38-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:31:38.389002 | controller | 2026-06-11T20:31:38-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:31:38.389052 | controller | 2026-06-11T20:31:38-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:31:38.766090 | controller | 2026-06-11T20:31:38-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:31:39.159087 | controller | 2026-06-11T20:31:39-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:31:39.159186 | controller | 2026-06-11T20:31:39-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:31:40.174038 | controller | 2026-06-11T20:31:40-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:31:40.174129 | controller | 2026-06-11T20:31:40-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:31:41.748482 | controller | 2026-06-11T20:31:41-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:31:42.956576 | controller | 2026-06-11T20:31:42-04:00 INFO 2026-06-11 20:31:42.956628 | controller | - Config: OK 2026-06-11 20:31:42.956640 | controller | - Gateway: OK 2026-06-11 20:31:42.956648 | controller | - GitServer: OK 2026-06-11 20:31:42.956657 | controller | - HoundSearch: OK 2026-06-11 20:31:42.956665 | controller | - LogJuicer: OK 2026-06-11 20:31:42.956673 | controller | - Logserver: OK 2026-06-11 20:31:42.956681 | controller | - MariaDB: OK 2026-06-11 20:31:42.956689 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:31:42.956697 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:31:42.956705 | controller | - Zookeeper: OK 2026-06-11 20:31:42.956714 | controller | - Zuul: OK 2026-06-11 20:31:42.956722 | controller | 2026-06-11 20:31:42.956730 | controller | 2026-06-11T20:31:42-04:00 INFO [attempt #4] Waiting 5s for the next reconcile call ... 2026-06-11 20:31:47.966129 | controller | 2026-06-11T20:31:47-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:31:48.583057 | controller | 2026-06-11T20:31:48-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:31:48.583134 | controller | 2026-06-11T20:31:48-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:31:48.604078 | controller | 2026-06-11T20:31:48-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:31:48.604129 | controller | 2026-06-11T20:31:48-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:31:48.996396 | controller | 2026-06-11T20:31:48-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:31:49.382912 | controller | 2026-06-11T20:31:49-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:31:49.382971 | controller | 2026-06-11T20:31:49-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:31:50.395891 | controller | 2026-06-11T20:31:50-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:31:50.395972 | controller | 2026-06-11T20:31:50-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:31:51.970324 | controller | 2026-06-11T20:31:51-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:31:53.178723 | controller | 2026-06-11T20:31:53-04:00 INFO 2026-06-11 20:31:53.178777 | controller | - Config: OK 2026-06-11 20:31:53.178789 | controller | - Gateway: OK 2026-06-11 20:31:53.178798 | controller | - GitServer: OK 2026-06-11 20:31:53.178806 | controller | - HoundSearch: OK 2026-06-11 20:31:53.178814 | controller | - LogJuicer: OK 2026-06-11 20:31:53.178822 | controller | - Logserver: OK 2026-06-11 20:31:53.178831 | controller | - MariaDB: OK 2026-06-11 20:31:53.178839 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:31:53.178847 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:31:53.178855 | controller | - Zookeeper: OK 2026-06-11 20:31:53.178863 | controller | - Zuul: OK 2026-06-11 20:31:53.178872 | controller | 2026-06-11 20:31:53.178943 | controller | 2026-06-11T20:31:53-04:00 INFO [attempt #5] Waiting 5s for the next reconcile call ... 2026-06-11 20:31:58.185935 | controller | 2026-06-11T20:31:58-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:31:58.803513 | controller | 2026-06-11T20:31:58-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:31:58.803581 | controller | 2026-06-11T20:31:58-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:31:58.828945 | controller | 2026-06-11T20:31:58-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:31:58.829024 | controller | 2026-06-11T20:31:58-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:31:59.205953 | controller | 2026-06-11T20:31:59-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:31:59.607102 | controller | 2026-06-11T20:31:59-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:31:59.607192 | controller | 2026-06-11T20:31:59-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:32:00.615708 | controller | 2026-06-11T20:32:00-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:32:00.615763 | controller | 2026-06-11T20:32:00-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:32:02.191970 | controller | 2026-06-11T20:32:02-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:32:03.399135 | controller | 2026-06-11T20:32:03-04:00 INFO 2026-06-11 20:32:03.399221 | controller | - Config: OK 2026-06-11 20:32:03.399233 | controller | - Gateway: OK 2026-06-11 20:32:03.399241 | controller | - GitServer: OK 2026-06-11 20:32:03.399249 | controller | - HoundSearch: OK 2026-06-11 20:32:03.399257 | controller | - LogJuicer: OK 2026-06-11 20:32:03.399265 | controller | - Logserver: OK 2026-06-11 20:32:03.399273 | controller | - MariaDB: OK 2026-06-11 20:32:03.399281 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:32:03.399290 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:32:03.399298 | controller | - Zookeeper: OK 2026-06-11 20:32:03.399306 | controller | - Zuul: OK 2026-06-11 20:32:03.399315 | controller | 2026-06-11 20:32:03.399323 | controller | 2026-06-11T20:32:03-04:00 INFO [attempt #6] Waiting 5s for the next reconcile call ... 2026-06-11 20:32:08.408768 | controller | 2026-06-11T20:32:08-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:32:09.031109 | controller | 2026-06-11T20:32:09-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:32:09.031171 | controller | 2026-06-11T20:32:09-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:32:09.057681 | controller | 2026-06-11T20:32:09-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:32:09.057765 | controller | 2026-06-11T20:32:09-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:32:09.425545 | controller | 2026-06-11T20:32:09-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:32:09.830241 | controller | 2026-06-11T20:32:09-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:32:09.830356 | controller | 2026-06-11T20:32:09-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:32:10.841488 | controller | 2026-06-11T20:32:10-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:32:10.841587 | controller | 2026-06-11T20:32:10-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:32:12.414845 | controller | 2026-06-11T20:32:12-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:32:13.621766 | controller | 2026-06-11T20:32:13-04:00 INFO 2026-06-11 20:32:13.621834 | controller | - Config: OK 2026-06-11 20:32:13.621846 | controller | - Gateway: OK 2026-06-11 20:32:13.621865 | controller | - GitServer: OK 2026-06-11 20:32:13.621874 | controller | - HoundSearch: OK 2026-06-11 20:32:13.621929 | controller | - LogJuicer: OK 2026-06-11 20:32:13.621942 | controller | - Logserver: OK 2026-06-11 20:32:13.621954 | controller | - MariaDB: OK 2026-06-11 20:32:13.621965 | controller | - NodePoolBuilder: OK 2026-06-11 20:32:13.621977 | controller | - NodePoolLauncher: OK 2026-06-11 20:32:13.621988 | controller | - Zookeeper: OK 2026-06-11 20:32:13.622000 | controller | - Zuul: OK 2026-06-11 20:32:13.622012 | controller | 2026-06-11 20:32:13.622032 | controller | 2026-06-11T20:32:13-04:00 INFO Updating controller configmap ... 2026-06-11 20:32:14.011327 | controller | 2026-06-11T20:32:14-04:00 INFO Standalone reconcile done. 2026-06-12 00:32:14.339863 | controller | ok: Runtime: 0:01:15.551087 2026-06-12 00:32:14.352717 | 2026-06-12 00:32:14.352877 | TASK [run-operator-standalone : Copy current spec] 2026-06-12 00:32:14.892044 | controller | skipping: Conditional result was False 2026-06-12 00:32:14.920774 | 2026-06-12 00:32:14.921036 | TASK [scale zuul components back up to defaults] 2026-06-12 00:32:14.956638 | controller | ok 2026-06-12 00:32:14.991080 | 2026-06-12 00:32:14.991294 | LOOP [health-check/scale-resources : Scaling resources] 2026-06-12 00:32:15.023675 | controller | ok: 2026-06-12 00:32:15.024038 | controller | { 2026-06-12 00:32:15.024076 | controller | "kind": "sts", 2026-06-12 00:32:15.024103 | controller | "name": "zuul-executor", 2026-06-12 00:32:15.024128 | controller | "replicas": 1 2026-06-12 00:32:15.024151 | controller | } 2026-06-12 00:32:15.028685 | controller | ok: 2026-06-12 00:32:15.028768 | controller | { 2026-06-12 00:32:15.028821 | controller | "kind": "sts", 2026-06-12 00:32:15.028866 | controller | "name": "zuul-merger", 2026-06-12 00:32:15.028908 | controller | "replicas": 1 2026-06-12 00:32:15.028949 | controller | } 2026-06-12 00:32:15.035284 | controller | ok: 2026-06-12 00:32:15.035348 | controller | { 2026-06-12 00:32:15.035381 | controller | "kind": "sts", 2026-06-12 00:32:15.035408 | controller | "name": "zuul-scheduler", 2026-06-12 00:32:15.035471 | controller | "replicas": 1 2026-06-12 00:32:15.035504 | controller | } 2026-06-12 00:32:15.128702 | controller | ok: 2026-06-12 00:32:15.128832 | controller | { 2026-06-12 00:32:15.128855 | controller | "kind": "deployment", 2026-06-12 00:32:15.128874 | controller | "name": "zuul-web", 2026-06-12 00:32:15.128892 | controller | "replicas": 1 2026-06-12 00:32:15.128909 | controller | } 2026-06-12 00:32:15.148215 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/scale-resources/tasks/scale.yaml 2026-06-12 00:32:15.153922 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/scale-resources/tasks/scale.yaml 2026-06-12 00:32:15.160599 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/scale-resources/tasks/scale.yaml 2026-06-12 00:32:15.166631 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/scale-resources/tasks/scale.yaml 2026-06-12 00:32:15.177423 | 2026-06-12 00:32:15.177553 | TASK [health-check/scale-resources : Get initial replica count for zuul-executor] 2026-06-12 00:32:15.713813 | controller | ok: Runtime: 0:00:00.103059 2026-06-12 00:32:15.725787 | 2026-06-12 00:32:15.726100 | TASK [health-check/scale-resources : Collect sts log before executing the scale command] 2026-06-12 00:32:16.267054 | controller | skipping: Conditional result was False 2026-06-12 00:32:16.288382 | 2026-06-12 00:32:16.288733 | TASK [health-check/scale-resources : Scale on sts zuul-executor] 2026-06-11 20:32:16.691665 | controller | statefulset.apps/zuul-executor scaled 2026-06-12 00:32:16.839553 | controller | ok: Runtime: 0:00:00.093630 2026-06-12 00:32:16.847222 | 2026-06-12 00:32:16.847316 | TASK [health-check/scale-resources : Get replica count for zuul-executor] 2026-06-12 00:32:38.144889 | controller | ok: Runtime: 0:00:00.095366 2026-06-12 00:32:38.156060 | 2026-06-12 00:32:38.156199 | TASK [health-check/scale-resources : Get initial replica count for zuul-merger] 2026-06-12 00:32:38.704846 | controller | ok: Runtime: 0:00:00.071619 2026-06-12 00:32:38.717913 | 2026-06-12 00:32:38.718076 | TASK [health-check/scale-resources : Collect sts log before executing the scale command] 2026-06-12 00:32:39.259908 | controller | skipping: Conditional result was False 2026-06-12 00:32:39.273807 | 2026-06-12 00:32:39.274011 | TASK [health-check/scale-resources : Scale on sts zuul-merger] 2026-06-11 20:32:39.637678 | controller | statefulset.apps/zuul-merger scaled 2026-06-12 00:32:39.822849 | controller | ok: Runtime: 0:00:00.105488 2026-06-12 00:32:39.833739 | 2026-06-12 00:32:39.833877 | TASK [health-check/scale-resources : Get replica count for zuul-merger] 2026-06-12 00:33:00.950166 | controller | ok: Runtime: 0:00:00.093835 2026-06-12 00:33:00.956278 | 2026-06-12 00:33:00.956357 | TASK [health-check/scale-resources : Get initial replica count for zuul-scheduler] 2026-06-12 00:33:01.487553 | controller | ok: Runtime: 0:00:00.106295 2026-06-12 00:33:01.499249 | 2026-06-12 00:33:01.499391 | TASK [health-check/scale-resources : Collect sts log before executing the scale command] 2026-06-12 00:33:02.040743 | controller | skipping: Conditional result was False 2026-06-12 00:33:02.053755 | 2026-06-12 00:33:02.053948 | TASK [health-check/scale-resources : Scale on sts zuul-scheduler] 2026-06-11 20:33:02.475188 | controller | statefulset.apps/zuul-scheduler scaled 2026-06-12 00:33:02.601761 | controller | ok: Runtime: 0:00:00.138086 2026-06-12 00:33:02.614342 | 2026-06-12 00:33:02.614536 | TASK [health-check/scale-resources : Get replica count for zuul-scheduler] 2026-06-12 00:34:05.067268 | controller | ok: Runtime: 0:00:00.078838 2026-06-12 00:34:05.082170 | 2026-06-12 00:34:05.082348 | TASK [health-check/scale-resources : Get initial replica count for zuul-web] 2026-06-12 00:34:05.675370 | controller | ok: Runtime: 0:00:00.106053 2026-06-12 00:34:05.683955 | 2026-06-12 00:34:05.684067 | TASK [health-check/scale-resources : Collect deployment log before executing the scale command] 2026-06-12 00:34:06.216125 | controller | skipping: Conditional result was False 2026-06-12 00:34:06.231563 | 2026-06-12 00:34:06.231744 | TASK [health-check/scale-resources : Scale on deployment zuul-web] 2026-06-11 20:34:06.598799 | controller | deployment.apps/zuul-web scaled 2026-06-12 00:34:06.784065 | controller | ok: Runtime: 0:00:00.089514 2026-06-12 00:34:06.796075 | 2026-06-12 00:34:06.796223 | TASK [health-check/scale-resources : Get replica count for zuul-web] 2026-06-12 00:35:09.297035 | controller | ok: Runtime: 0:00:00.067269 2026-06-12 00:35:09.326316 | 2026-06-12 00:35:09.326672 | LOOP [health-check/scale-resources : Scaling resources] 2026-06-12 00:35:09.350233 | controller | ok: 2026-06-12 00:35:09.350556 | controller | { 2026-06-12 00:35:09.350584 | controller | "kind": "sts", 2026-06-12 00:35:09.350603 | controller | "name": "zuul-executor", 2026-06-12 00:35:09.350621 | controller | "replicas": 2 2026-06-12 00:35:09.350637 | controller | } 2026-06-12 00:35:09.350670 | controller | ok: All items complete 2026-06-12 00:35:09.350690 | 2026-06-12 00:35:09.355451 | controller | ok: 2026-06-12 00:35:09.355495 | controller | { 2026-06-12 00:35:09.355517 | controller | "kind": "sts", 2026-06-12 00:35:09.355535 | controller | "name": "zuul-merger", 2026-06-12 00:35:09.355551 | controller | "replicas": 2 2026-06-12 00:35:09.355568 | controller | } 2026-06-12 00:35:09.379827 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/scale-resources/tasks/scale.yaml 2026-06-12 00:35:09.383928 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/scale-resources/tasks/scale.yaml 2026-06-12 00:35:09.391464 | 2026-06-12 00:35:09.391569 | TASK [health-check/scale-resources : Get initial replica count for zuul-executor] 2026-06-12 00:35:09.929905 | controller | ok: Runtime: 0:00:00.096577 2026-06-12 00:35:09.943302 | 2026-06-12 00:35:09.943527 | TASK [health-check/scale-resources : Collect sts log before executing the scale command] 2026-06-11 20:35:10.379605 | controller | Defaulted container "zuul-executor" out of: zuul-executor, zuul-executor-nodeexporter 2026-06-12 00:35:10.492390 | controller | ok: Runtime: 0:00:00.115336 2026-06-12 00:35:10.500862 | 2026-06-12 00:35:10.500971 | TASK [health-check/scale-resources : Scale on sts zuul-executor] 2026-06-11 20:35:10.856966 | controller | statefulset.apps/zuul-executor scaled 2026-06-12 00:35:11.037107 | controller | ok: Runtime: 0:00:00.065298 2026-06-12 00:35:11.049036 | 2026-06-12 00:35:11.049223 | TASK [health-check/scale-resources : Get replica count for zuul-executor] 2026-06-12 00:35:32.133983 | controller | ok: Runtime: 0:00:00.102515 2026-06-12 00:35:32.140411 | 2026-06-12 00:35:32.140525 | TASK [health-check/scale-resources : Get initial replica count for zuul-merger] 2026-06-12 00:35:32.672598 | controller | ok: Runtime: 0:00:00.103104 2026-06-12 00:35:32.684936 | 2026-06-12 00:35:32.685104 | TASK [health-check/scale-resources : Collect sts log before executing the scale command] 2026-06-11 20:35:33.094433 | controller | Defaulted container "zuul-merger" out of: zuul-merger, zuul-merger-nodeexporter 2026-06-12 00:35:33.233550 | controller | ok: Runtime: 0:00:00.141831 2026-06-12 00:35:33.246680 | 2026-06-12 00:35:33.246916 | TASK [health-check/scale-resources : Scale on sts zuul-merger] 2026-06-11 20:35:33.706900 | controller | statefulset.apps/zuul-merger scaled 2026-06-12 00:35:33.802820 | controller | ok: Runtime: 0:00:00.101178 2026-06-12 00:35:33.819094 | 2026-06-12 00:35:33.819308 | TASK [health-check/scale-resources : Get replica count for zuul-merger] 2026-06-12 00:35:54.983615 | controller | ok: Runtime: 0:00:00.094248 2026-06-12 00:35:55.002095 | 2026-06-12 00:35:55.002247 | LOOP [health-check/zuul-components : Check zuul components sequentially] 2026-06-12 00:35:55.044402 | controller | ok: 2026-06-12 00:35:55.044938 | controller | { 2026-06-12 00:35:55.045007 | controller | "component": "web", 2026-06-12 00:35:55.045049 | controller | "kind": "deployment" 2026-06-12 00:35:55.045087 | controller | } 2026-06-12 00:35:55.052608 | controller | ok: 2026-06-12 00:35:55.052756 | controller | { 2026-06-12 00:35:55.052823 | controller | "component": "scheduler", 2026-06-12 00:35:55.052863 | controller | "kind": "statefulset" 2026-06-12 00:35:55.052899 | controller | } 2026-06-12 00:35:55.060942 | controller | ok: 2026-06-12 00:35:55.061045 | controller | { 2026-06-12 00:35:55.061095 | controller | "component": "merger", 2026-06-12 00:35:55.061136 | controller | "kind": "statefulset" 2026-06-12 00:35:55.061182 | controller | } 2026-06-12 00:35:55.067983 | controller | ok: 2026-06-12 00:35:55.068092 | controller | { 2026-06-12 00:35:55.068150 | controller | "component": "executor", 2026-06-12 00:35:55.068197 | controller | "kind": "statefulset" 2026-06-12 00:35:55.068241 | controller | } 2026-06-12 00:35:55.086842 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/zuul-components/tasks/check-component.yaml 2026-06-12 00:35:55.092090 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/zuul-components/tasks/check-component.yaml 2026-06-12 00:35:55.096984 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/zuul-components/tasks/check-component.yaml 2026-06-12 00:35:55.102243 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/zuul-components/tasks/check-component.yaml 2026-06-12 00:35:55.112510 | 2026-06-12 00:35:55.112619 | TASK [health-check/zuul-components : Get expected replica count for zuul-web] 2026-06-12 00:35:55.650843 | controller | ok: Runtime: 0:00:00.097557 2026-06-12 00:35:55.665534 | 2026-06-12 00:35:55.665813 | TASK [health-check/zuul-components : Wait until all of zuul-web replicas are ready] 2026-06-12 00:35:56.219004 | controller | ok: Runtime: 0:00:00.099709 2026-06-12 00:35:56.231110 | 2026-06-12 00:35:56.231261 | TASK [health-check/zuul-components : Validate zuul-web Component(s)] 2026-06-12 00:35:56.919639 | controller | ok: OK (799 bytes) 2026-06-12 00:35:56.933132 | 2026-06-12 00:35:56.933301 | TASK [health-check/zuul-components : Get expected replica count for zuul-scheduler] 2026-06-12 00:35:57.475133 | controller | ok: Runtime: 0:00:00.101773 2026-06-12 00:35:57.488096 | 2026-06-12 00:35:57.488282 | TASK [health-check/zuul-components : Wait until all of zuul-scheduler replicas are ready] 2026-06-12 00:35:58.034791 | controller | ok: Runtime: 0:00:00.090518 2026-06-12 00:35:58.042504 | 2026-06-12 00:35:58.042606 | TASK [health-check/zuul-components : Validate zuul-scheduler Component(s)] 2026-06-12 00:35:58.677008 | controller | ok: OK (799 bytes) 2026-06-12 00:35:58.689421 | 2026-06-12 00:35:58.689623 | TASK [health-check/zuul-components : Get expected replica count for zuul-merger] 2026-06-12 00:35:59.236550 | controller | ok: Runtime: 0:00:00.063400 2026-06-12 00:35:59.248505 | 2026-06-12 00:35:59.248682 | TASK [health-check/zuul-components : Wait until all of zuul-merger replicas are ready] 2026-06-12 00:35:59.796864 | controller | ok: Runtime: 0:00:00.089227 2026-06-12 00:35:59.809769 | 2026-06-12 00:35:59.809939 | TASK [health-check/zuul-components : Validate zuul-merger Component(s)] 2026-06-12 00:36:00.517226 | controller | ok: OK (799 bytes) 2026-06-12 00:36:00.531701 | 2026-06-12 00:36:00.531865 | TASK [health-check/zuul-components : Get expected replica count for zuul-executor] 2026-06-12 00:36:01.079238 | controller | ok: Runtime: 0:00:00.096034 2026-06-12 00:36:01.096711 | 2026-06-12 00:36:01.096879 | TASK [health-check/zuul-components : Wait until all of zuul-executor replicas are ready] 2026-06-12 00:36:01.711194 | controller | ok: Runtime: 0:00:00.096488 2026-06-12 00:36:01.717898 | 2026-06-12 00:36:01.717987 | TASK [health-check/zuul-components : Validate zuul-executor Component(s)] 2026-06-12 00:36:02.260941 | controller | ok: OK (799 bytes) 2026-06-12 00:36:02.280941 | 2026-06-12 00:36:02.281192 | TASK [health-check/zuul-connections : Setting Dummy Connections] 2026-06-12 00:36:02.319223 | controller | ok 2026-06-12 00:36:02.331210 | 2026-06-12 00:36:02.331364 | TASK [health-check/zuul-connections : Create SMTP Connection Secret] 2026-06-12 00:36:03.423099 | controller | changed 2026-06-12 00:36:03.434939 | 2026-06-12 00:36:03.435129 | TASK [health-check/zuul-connections : Create ElasticSearch Connection Secret] 2026-06-12 00:36:04.275347 | controller | changed 2026-06-12 00:36:04.286475 | 2026-06-12 00:36:04.286624 | TASK [health-check/zuul-connections : Create Gerrit Connection Secret] 2026-06-12 00:36:05.128402 | controller | changed 2026-06-12 00:36:05.139810 | 2026-06-12 00:36:05.140087 | TASK [health-check/zuul-connections : Create GitHub Connection Secret] 2026-06-12 00:36:05.996256 | controller | changed 2026-06-12 00:36:06.007172 | 2026-06-12 00:36:06.007319 | TASK [health-check/zuul-connections : Create GitLab Connection Secret] 2026-06-12 00:36:06.841978 | controller | changed 2026-06-12 00:36:06.856410 | 2026-06-12 00:36:06.856734 | TASK [health-check/zuul-connections : Create Pagure Connection Secret] 2026-06-12 00:36:07.670775 | controller | changed 2026-06-12 00:36:07.681651 | 2026-06-12 00:36:07.681851 | TASK [health-check/zuul-connections : set_fact] 2026-06-12 00:36:07.718057 | controller | ok 2026-06-12 00:36:07.730654 | 2026-06-12 00:36:07.730826 | TASK [Add dummy Zuul connections] 2026-06-12 00:36:07.757729 | controller | ok 2026-06-12 00:36:07.774046 | 2026-06-12 00:36:07.774158 | TASK [update-custom-resource : read current crd] 2026-06-12 00:36:08.002592 | controller | ok 2026-06-12 00:36:08.014012 | 2026-06-12 00:36:08.014283 | TASK [update-custom-resource : merge the new cr] 2026-06-12 00:36:08.792103 | controller | changed 2026-06-12 00:36:08.804763 | 2026-06-12 00:36:08.804896 | TASK [run the operator in standalone mode] 2026-06-12 00:36:08.841237 | controller | ok 2026-06-12 00:36:08.874088 | 2026-06-12 00:36:08.874258 | TASK [run-operator-standalone : Ensure ~/zuul-output/logs] 2026-06-12 00:36:08.910612 | controller | skipping: Conditional result was False 2026-06-12 00:36:08.921718 | 2026-06-12 00:36:08.921863 | TASK [run-operator-standalone : Clear previous log file] 2026-06-12 00:36:08.949987 | controller | skipping: Conditional result was False 2026-06-12 00:36:08.962186 | 2026-06-12 00:36:08.962345 | TASK [run-operator-standalone : Run the operator in standalone mode] 2026-06-11 20:36:09.598038 | controller | 2026-06-11T20:36:09-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:36:09.598147 | controller | 2026-06-11 20:36:09.611633 | controller | 2026-06-11T20:36:09-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:36:09.611672 | controller | 2026-06-11 20:36:09.625901 | controller | 2026-06-11T20:36:09-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:36:09.641465 | controller | 2026-06-11T20:36:09-04:00 INFO Updating configmap, name: git-server-pi-config-map 2026-06-11 20:36:09.641517 | controller | 2026-06-11T20:36:09-04:00 INFO Updating object, name: git-server-pi-config-map 2026-06-11 20:36:09.648497 | controller | 2026-06-11T20:36:09-04:00 INFO Statefulset "git-server" configuration changed, applying... 2026-06-11 20:36:09.648535 | controller | 2026-06-11T20:36:09-04:00 INFO Updating object, name: git-server 2026-06-11 20:36:11.041532 | controller | 2026-06-11T20:36:11-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:36:11.163423 | controller | 2026-06-11T20:36:11-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:36:11.172444 | controller | 2026-06-11T20:36:11-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:36:11.172512 | controller | 2026-06-11T20:36:11-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:36:11.192878 | controller | 2026-06-11T20:36:11-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:36:11.192948 | controller | 2026-06-11T20:36:11-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:36:11.446818 | controller | 2026-06-11T20:36:11-04:00 INFO Waiting for GitServer and MariaDB services to be ready ... 2026-06-11 20:36:11.446884 | controller | 2026-06-11T20:36:11-04:00 INFO 2026-06-11 20:36:11.446898 | controller | - Config: Waiting ... 2026-06-11 20:36:11.446906 | controller | - Gateway: OK 2026-06-11 20:36:11.446915 | controller | - GitServer: Waiting ... 2026-06-11 20:36:11.446923 | controller | - HoundSearch: OK 2026-06-11 20:36:11.446931 | controller | - LogJuicer: OK 2026-06-11 20:36:11.446938 | controller | - Logserver: OK 2026-06-11 20:36:11.446946 | controller | - MariaDB: OK 2026-06-11 20:36:11.446954 | controller | - Zookeeper: OK 2026-06-11 20:36:11.446962 | controller | 2026-06-11 20:36:11.446971 | controller | 2026-06-11T20:36:11-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-11 20:36:16.456202 | controller | 2026-06-11T20:36:16-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:36:16.494633 | controller | 2026-06-11T20:36:16-04:00 INFO Waiting for statefulset, name: git-server 2026-06-11 20:36:34.621445 | controller | 2026-06-11T20:36:34-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:36:34.621587 | controller | 2026-06-11T20:36:34-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:36:34.642017 | controller | 2026-06-11T20:36:34-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:36:34.642106 | controller | 2026-06-11T20:36:34-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:36:34.663470 | controller | 2026-06-11T20:36:34-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:36:34.988613 | controller | 2026-06-11T20:36:34-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:36:34.988681 | controller | 2026-06-11T20:36:34-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:36:35.583610 | controller | 2026-06-11T20:36:35-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:36:35.587888 | controller | 2026-06-11T20:36:35-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:36:37.968035 | controller | 2026-06-11T20:36:37-04:00 INFO Updating secret, name: zuul-config 2026-06-11 20:36:37.968165 | controller | 2026-06-11T20:36:37-04:00 INFO Updating object, name: zuul-config 2026-06-11 20:36:38.196184 | controller | 2026-06-11T20:36:38-04:00 INFO Statefulset "zuul-scheduler" configuration changed, applying... 2026-06-11 20:36:38.196289 | controller | 2026-06-11T20:36:38-04:00 INFO Updating object, name: zuul-scheduler 2026-06-11 20:36:38.228175 | controller | 2026-06-11T20:36:38-04:00 INFO Statefulset "zuul-executor" configuration changed, applying... 2026-06-11 20:36:38.228281 | controller | 2026-06-11T20:36:38-04:00 INFO Updating object, name: zuul-executor 2026-06-11 20:36:38.581132 | controller | 2026-06-11T20:36:38-04:00 INFO Statefulset "zuul-web" configuration changed, applying... 2026-06-11 20:36:38.581270 | controller | 2026-06-11T20:36:38-04:00 INFO Updating object, name: zuul-web 2026-06-11 20:36:39.380629 | controller | 2026-06-11T20:36:39-04:00 INFO Statefulset "zuul-merger" configuration changed, applying... 2026-06-11 20:36:39.380735 | controller | 2026-06-11T20:36:39-04:00 INFO Updating object, name: zuul-merger 2026-06-11 20:36:39.388433 | controller | 2026-06-11T20:36:39-04:00 INFO 2026-06-11 20:36:39.388466 | controller | - Config: Waiting ... 2026-06-11 20:36:39.388474 | controller | - Gateway: OK 2026-06-11 20:36:39.388480 | controller | - GitServer: OK 2026-06-11 20:36:39.388485 | controller | - HoundSearch: OK 2026-06-11 20:36:39.388490 | controller | - LogJuicer: OK 2026-06-11 20:36:39.388496 | controller | - Logserver: OK 2026-06-11 20:36:39.388501 | controller | - MariaDB: OK 2026-06-11 20:36:39.388506 | controller | - NodePoolBuilder: OK 2026-06-11 20:36:39.388511 | controller | - NodePoolLauncher: OK 2026-06-11 20:36:39.388519 | controller | - Zookeeper: OK 2026-06-11 20:36:39.388525 | controller | - Zuul: Waiting ... 2026-06-11 20:36:39.388530 | controller | - |_ Config Secrets: OK 2026-06-11 20:36:39.388536 | controller | - |_ Executor: Waiting ... 2026-06-11 20:36:39.388541 | controller | - |_ Merger: Waiting ... 2026-06-11 20:36:39.388546 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:36:39.388551 | controller | - |_ Web: Waiting ... 2026-06-11 20:36:39.388557 | controller | 2026-06-11 20:36:39.388563 | controller | 2026-06-11T20:36:39-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-11 20:36:44.398869 | controller | 2026-06-11T20:36:44-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:36:45.821920 | controller | 2026-06-11T20:36:45-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:36:45.822008 | controller | 2026-06-11T20:36:45-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:36:45.853188 | controller | 2026-06-11T20:36:45-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:36:45.853272 | controller | 2026-06-11T20:36:45-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:36:46.212524 | controller | 2026-06-11T20:36:46-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:36:46.618561 | controller | 2026-06-11T20:36:46-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:36:46.618657 | controller | 2026-06-11T20:36:46-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:36:46.819002 | controller | 2026-06-11T20:36:46-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:36:47.196485 | controller | 2026-06-11T20:36:47-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:36:49.615441 | controller | 2026-06-11T20:36:49-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:37:19.742047 | controller | 2026-06-11T20:37:19-04:00 INFO Statefulset "zuul-scheduler" not ready after 30s 2026-06-11 20:37:19.780838 | controller | 2026-06-11T20:37:19-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:37:19.780915 | controller | 2026-06-11T20:37:19-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:37:20.157619 | controller | 2026-06-11T20:37:20-04:00 INFO 2026-06-11 20:37:20.157680 | controller | - Config: Waiting ... 2026-06-11 20:37:20.157692 | controller | - Gateway: OK 2026-06-11 20:37:20.157701 | controller | - GitServer: OK 2026-06-11 20:37:20.157711 | controller | - HoundSearch: OK 2026-06-11 20:37:20.157732 | controller | - LogJuicer: OK 2026-06-11 20:37:20.157742 | controller | - Logserver: OK 2026-06-11 20:37:20.157751 | controller | - MariaDB: OK 2026-06-11 20:37:20.157760 | controller | - NodePoolBuilder: OK 2026-06-11 20:37:20.157769 | controller | - NodePoolLauncher: OK 2026-06-11 20:37:20.157777 | controller | - Zookeeper: OK 2026-06-11 20:37:20.157786 | controller | - Zuul: Waiting ... 2026-06-11 20:37:20.157795 | controller | - |_ Config Secrets: OK 2026-06-11 20:37:20.157803 | controller | - |_ Executor: OK 2026-06-11 20:37:20.157812 | controller | - |_ Merger: OK 2026-06-11 20:37:20.157820 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:37:20.157829 | controller | - |_ Web: Waiting ... 2026-06-11 20:37:20.157838 | controller | 2026-06-11 20:37:20.157847 | controller | 2026-06-11T20:37:20-04:00 INFO [attempt #3] Waiting 5s for the next reconcile call ... 2026-06-11 20:37:25.165882 | controller | 2026-06-11T20:37:25-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:37:26.581405 | controller | 2026-06-11T20:37:26-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:37:26.581486 | controller | 2026-06-11T20:37:26-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:37:26.595665 | controller | 2026-06-11T20:37:26-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:37:26.595734 | controller | 2026-06-11T20:37:26-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:37:26.982803 | controller | 2026-06-11T20:37:26-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:37:27.378031 | controller | 2026-06-11T20:37:27-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:37:27.378106 | controller | 2026-06-11T20:37:27-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:37:27.577688 | controller | 2026-06-11T20:37:27-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:37:27.962069 | controller | 2026-06-11T20:37:27-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:37:30.389783 | controller | 2026-06-11T20:37:30-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:37:44.463450 | controller | 2026-06-11T20:37:44-04:00 INFO Statefulset "zuul-weeder" configuration changed, applying... 2026-06-11 20:37:44.463533 | controller | 2026-06-11T20:37:44-04:00 INFO Updating object, name: zuul-weeder 2026-06-11 20:37:44.518563 | controller | 2026-06-11T20:37:44-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:37:44.518632 | controller | 2026-06-11T20:37:44-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:37:44.887252 | controller | 2026-06-11T20:37:44-04:00 INFO 2026-06-11 20:37:44.887332 | controller | - Config: Waiting ... 2026-06-11 20:37:44.887342 | controller | - Gateway: OK 2026-06-11 20:37:44.887351 | controller | - GitServer: OK 2026-06-11 20:37:44.887359 | controller | - HoundSearch: OK 2026-06-11 20:37:44.887390 | controller | - LogJuicer: OK 2026-06-11 20:37:44.887402 | controller | - Logserver: OK 2026-06-11 20:37:44.887410 | controller | - MariaDB: OK 2026-06-11 20:37:44.887418 | controller | - NodePoolBuilder: OK 2026-06-11 20:37:44.887426 | controller | - NodePoolLauncher: OK 2026-06-11 20:37:44.887434 | controller | - Zookeeper: OK 2026-06-11 20:37:44.887441 | controller | - Zuul: Waiting ... 2026-06-11 20:37:44.887449 | controller | - |_ Config Secrets: OK 2026-06-11 20:37:44.887457 | controller | - |_ Executor: OK 2026-06-11 20:37:44.887464 | controller | - |_ Merger: OK 2026-06-11 20:37:44.887472 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:37:44.887480 | controller | - |_ Web: OK 2026-06-11 20:37:44.887488 | controller | 2026-06-11 20:37:44.887506 | controller | 2026-06-11T20:37:44-04:00 INFO [attempt #4] Waiting 5s for the next reconcile call ... 2026-06-11 20:37:49.892626 | controller | 2026-06-11T20:37:49-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:37:51.307832 | controller | 2026-06-11T20:37:51-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:37:51.307889 | controller | 2026-06-11T20:37:51-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:37:51.325199 | controller | 2026-06-11T20:37:51-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:37:51.325252 | controller | 2026-06-11T20:37:51-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:37:51.709266 | controller | 2026-06-11T20:37:51-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:37:52.110409 | controller | 2026-06-11T20:37:52-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:37:52.110474 | controller | 2026-06-11T20:37:52-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:37:52.310715 | controller | 2026-06-11T20:37:52-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:37:52.691608 | controller | 2026-06-11T20:37:52-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:37:55.119740 | controller | 2026-06-11T20:37:55-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:37:55.119822 | controller | 2026-06-11T20:37:55-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:37:55.505190 | controller | 2026-06-11T20:37:55-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:37:55.505258 | controller | 2026-06-11T20:37:55-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:37:56.714774 | controller | 2026-06-11T20:37:56-04:00 INFO Running tenant-reconfigure for the 'internal' tenant 2026-06-11 20:37:56.900190 | controller | 2026-06-11T20:37:56-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [zuul-scheduler tenant-reconfigure internal] 2026-06-11 20:38:03.050572 | controller | 2026-06-11T20:38:03-04:00 INFO Deleting object, name: zuul-web 2026-06-11 20:38:03.055877 | controller | 2026-06-11T20:38:03-04:00 INFO Updating object, name: zs-internal-tenant-reconfigure 2026-06-11 20:38:03.059294 | controller | 2026-06-11T20:38:03-04:00 INFO 2026-06-11 20:38:03.059319 | controller | - Config: Waiting ... 2026-06-11 20:38:03.059325 | controller | - Gateway: OK 2026-06-11 20:38:03.059330 | controller | - GitServer: OK 2026-06-11 20:38:03.059335 | controller | - HoundSearch: OK 2026-06-11 20:38:03.059341 | controller | - LogJuicer: OK 2026-06-11 20:38:03.059346 | controller | - Logserver: OK 2026-06-11 20:38:03.059351 | controller | - MariaDB: OK 2026-06-11 20:38:03.059356 | controller | - NodePoolBuilder: OK 2026-06-11 20:38:03.059361 | controller | - NodePoolLauncher: OK 2026-06-11 20:38:03.059378 | controller | - Zookeeper: OK 2026-06-11 20:38:03.059384 | controller | - Zuul: OK 2026-06-11 20:38:03.059390 | controller | 2026-06-11 20:38:03.059395 | controller | 2026-06-11T20:38:03-04:00 INFO [attempt #5] Waiting 5s for the next reconcile call ... 2026-06-11 20:38:08.070625 | controller | 2026-06-11T20:38:08-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:38:09.486580 | controller | 2026-06-11T20:38:09-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:38:09.486686 | controller | 2026-06-11T20:38:09-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:38:09.507480 | controller | 2026-06-11T20:38:09-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:38:09.507592 | controller | 2026-06-11T20:38:09-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:38:09.886134 | controller | 2026-06-11T20:38:09-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:38:10.284536 | controller | 2026-06-11T20:38:10-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:38:10.284602 | controller | 2026-06-11T20:38:10-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:38:10.485663 | controller | 2026-06-11T20:38:10-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:38:10.867240 | controller | 2026-06-11T20:38:10-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:38:13.303445 | controller | 2026-06-11T20:38:13-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:38:13.303534 | controller | 2026-06-11T20:38:13-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:38:13.679283 | controller | 2026-06-11T20:38:13-04:00 INFO Creating object, name: zuul-web 2026-06-11 20:38:14.494020 | controller | 2026-06-11T20:38:14-04:00 INFO 2026-06-11 20:38:14.494075 | controller | - Config: Waiting ... 2026-06-11 20:38:14.494082 | controller | - Gateway: OK 2026-06-11 20:38:14.494088 | controller | - GitServer: OK 2026-06-11 20:38:14.494093 | controller | - HoundSearch: OK 2026-06-11 20:38:14.494098 | controller | - LogJuicer: OK 2026-06-11 20:38:14.494103 | controller | - Logserver: OK 2026-06-11 20:38:14.494108 | controller | - MariaDB: OK 2026-06-11 20:38:14.494113 | controller | - NodePoolBuilder: OK 2026-06-11 20:38:14.494117 | controller | - NodePoolLauncher: OK 2026-06-11 20:38:14.494122 | controller | - Zookeeper: OK 2026-06-11 20:38:14.494127 | controller | - Zuul: Waiting ... 2026-06-11 20:38:14.494132 | controller | - |_ Config Secrets: OK 2026-06-11 20:38:14.494137 | controller | - |_ Executor: OK 2026-06-11 20:38:14.494142 | controller | - |_ Merger: OK 2026-06-11 20:38:14.494147 | controller | - |_ Scheduler: OK 2026-06-11 20:38:14.494152 | controller | - |_ Web: Waiting ... 2026-06-11 20:38:14.494157 | controller | 2026-06-11 20:38:14.494164 | controller | 2026-06-11T20:38:14-04:00 INFO [attempt #6] Waiting 5s for the next reconcile call ... 2026-06-11 20:38:19.503150 | controller | 2026-06-11T20:38:19-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:38:20.920756 | controller | 2026-06-11T20:38:20-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:38:20.920851 | controller | 2026-06-11T20:38:20-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:38:20.948295 | controller | 2026-06-11T20:38:20-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:38:20.948360 | controller | 2026-06-11T20:38:20-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:38:21.316003 | controller | 2026-06-11T20:38:21-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:38:21.728231 | controller | 2026-06-11T20:38:21-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:38:21.728294 | controller | 2026-06-11T20:38:21-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:38:21.921649 | controller | 2026-06-11T20:38:21-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:38:22.302971 | controller | 2026-06-11T20:38:22-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:38:24.736316 | controller | 2026-06-11T20:38:24-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:38:24.736445 | controller | 2026-06-11T20:38:24-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:38:25.112426 | controller | 2026-06-11T20:38:25-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:38:25.112502 | controller | 2026-06-11T20:38:25-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:38:25.920072 | controller | 2026-06-11T20:38:25-04:00 INFO 2026-06-11 20:38:25.920144 | controller | - Config: Waiting ... 2026-06-11 20:38:25.920150 | controller | - Gateway: OK 2026-06-11 20:38:25.920154 | controller | - GitServer: OK 2026-06-11 20:38:25.920158 | controller | - HoundSearch: OK 2026-06-11 20:38:25.920161 | controller | - LogJuicer: OK 2026-06-11 20:38:25.920166 | controller | - Logserver: OK 2026-06-11 20:38:25.920169 | controller | - MariaDB: OK 2026-06-11 20:38:25.920173 | controller | - NodePoolBuilder: OK 2026-06-11 20:38:25.920176 | controller | - NodePoolLauncher: OK 2026-06-11 20:38:25.920180 | controller | - Zookeeper: OK 2026-06-11 20:38:25.920184 | controller | - Zuul: Waiting ... 2026-06-11 20:38:25.920187 | controller | - |_ Config Secrets: OK 2026-06-11 20:38:25.920191 | controller | - |_ Executor: OK 2026-06-11 20:38:25.920194 | controller | - |_ Merger: OK 2026-06-11 20:38:25.920197 | controller | - |_ Scheduler: OK 2026-06-11 20:38:25.920201 | controller | - |_ Web: Waiting ... 2026-06-11 20:38:25.920205 | controller | 2026-06-11 20:38:25.920215 | controller | 2026-06-11T20:38:25-04:00 INFO [attempt #7] Waiting 5s for the next reconcile call ... 2026-06-11 20:38:30.929149 | controller | 2026-06-11T20:38:30-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:38:32.347731 | controller | 2026-06-11T20:38:32-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:38:32.347810 | controller | 2026-06-11T20:38:32-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:38:32.367806 | controller | 2026-06-11T20:38:32-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:38:32.367855 | controller | 2026-06-11T20:38:32-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:38:32.749053 | controller | 2026-06-11T20:38:32-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:38:33.148283 | controller | 2026-06-11T20:38:33-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:38:33.148418 | controller | 2026-06-11T20:38:33-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:38:33.353801 | controller | 2026-06-11T20:38:33-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:38:33.727132 | controller | 2026-06-11T20:38:33-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:38:36.162719 | controller | 2026-06-11T20:38:36-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:38:36.162817 | controller | 2026-06-11T20:38:36-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:38:36.537558 | controller | 2026-06-11T20:38:36-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:38:36.537687 | controller | 2026-06-11T20:38:36-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:38:37.347709 | controller | 2026-06-11T20:38:37-04:00 INFO 2026-06-11 20:38:37.347796 | controller | - Config: Waiting ... 2026-06-11 20:38:37.347808 | controller | - Gateway: OK 2026-06-11 20:38:37.347816 | controller | - GitServer: OK 2026-06-11 20:38:37.347825 | controller | - HoundSearch: OK 2026-06-11 20:38:37.347833 | controller | - LogJuicer: OK 2026-06-11 20:38:37.347841 | controller | - Logserver: OK 2026-06-11 20:38:37.347864 | controller | - MariaDB: OK 2026-06-11 20:38:37.347872 | controller | - NodePoolBuilder: OK 2026-06-11 20:38:37.347880 | controller | - NodePoolLauncher: OK 2026-06-11 20:38:37.347888 | controller | - Zookeeper: OK 2026-06-11 20:38:37.347896 | controller | - Zuul: Waiting ... 2026-06-11 20:38:37.347904 | controller | - |_ Config Secrets: OK 2026-06-11 20:38:37.347912 | controller | - |_ Executor: OK 2026-06-11 20:38:37.347919 | controller | - |_ Merger: OK 2026-06-11 20:38:37.347927 | controller | - |_ Scheduler: OK 2026-06-11 20:38:37.347935 | controller | - |_ Web: Waiting ... 2026-06-11 20:38:37.347943 | controller | 2026-06-11 20:38:37.347961 | controller | 2026-06-11T20:38:37-04:00 INFO [attempt #8] Waiting 5s for the next reconcile call ... 2026-06-11 20:38:42.355362 | controller | 2026-06-11T20:38:42-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:38:43.769157 | controller | 2026-06-11T20:38:43-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:38:43.769259 | controller | 2026-06-11T20:38:43-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:38:43.787954 | controller | 2026-06-11T20:38:43-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:38:43.788124 | controller | 2026-06-11T20:38:43-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:38:44.171675 | controller | 2026-06-11T20:38:44-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:38:44.572632 | controller | 2026-06-11T20:38:44-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:38:44.572736 | controller | 2026-06-11T20:38:44-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:38:44.772199 | controller | 2026-06-11T20:38:44-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:38:45.152247 | controller | 2026-06-11T20:38:45-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:38:47.593119 | controller | 2026-06-11T20:38:47-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:38:47.593225 | controller | 2026-06-11T20:38:47-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:38:47.964187 | controller | 2026-06-11T20:38:47-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:38:47.964252 | controller | 2026-06-11T20:38:47-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:38:48.774562 | controller | 2026-06-11T20:38:48-04:00 INFO 2026-06-11 20:38:48.774688 | controller | - Config: Waiting ... 2026-06-11 20:38:48.774699 | controller | - Gateway: OK 2026-06-11 20:38:48.774708 | controller | - GitServer: OK 2026-06-11 20:38:48.774716 | controller | - HoundSearch: OK 2026-06-11 20:38:48.774724 | controller | - LogJuicer: OK 2026-06-11 20:38:48.774732 | controller | - Logserver: OK 2026-06-11 20:38:48.774740 | controller | - MariaDB: OK 2026-06-11 20:38:48.774748 | controller | - NodePoolBuilder: OK 2026-06-11 20:38:48.774756 | controller | - NodePoolLauncher: OK 2026-06-11 20:38:48.774764 | controller | - Zookeeper: OK 2026-06-11 20:38:48.774771 | controller | - Zuul: Waiting ... 2026-06-11 20:38:48.774779 | controller | - |_ Config Secrets: OK 2026-06-11 20:38:48.774787 | controller | - |_ Executor: OK 2026-06-11 20:38:48.774795 | controller | - |_ Merger: OK 2026-06-11 20:38:48.774803 | controller | - |_ Scheduler: OK 2026-06-11 20:38:48.774811 | controller | - |_ Web: Waiting ... 2026-06-11 20:38:48.774819 | controller | 2026-06-11 20:38:48.774836 | controller | 2026-06-11T20:38:48-04:00 INFO [attempt #9] Waiting 5s for the next reconcile call ... 2026-06-11 20:38:53.782530 | controller | 2026-06-11T20:38:53-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:38:55.201874 | controller | 2026-06-11T20:38:55-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:38:55.201962 | controller | 2026-06-11T20:38:55-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:38:55.218439 | controller | 2026-06-11T20:38:55-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:38:55.218462 | controller | 2026-06-11T20:38:55-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:38:55.601928 | controller | 2026-06-11T20:38:55-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:38:55.996048 | controller | 2026-06-11T20:38:55-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:38:55.996131 | controller | 2026-06-11T20:38:55-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:38:56.195638 | controller | 2026-06-11T20:38:56-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:38:56.579659 | controller | 2026-06-11T20:38:56-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:38:59.021819 | controller | 2026-06-11T20:38:59-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:38:59.021894 | controller | 2026-06-11T20:38:59-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:38:59.392416 | controller | 2026-06-11T20:38:59-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:38:59.392492 | controller | 2026-06-11T20:38:59-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:39:00.202935 | controller | 2026-06-11T20:39:00-04:00 INFO 2026-06-11 20:39:00.202991 | controller | - Config: Waiting ... 2026-06-11 20:39:00.203002 | controller | - Gateway: OK 2026-06-11 20:39:00.203010 | controller | - GitServer: OK 2026-06-11 20:39:00.203019 | controller | - HoundSearch: OK 2026-06-11 20:39:00.203027 | controller | - LogJuicer: OK 2026-06-11 20:39:00.203035 | controller | - Logserver: OK 2026-06-11 20:39:00.203042 | controller | - MariaDB: OK 2026-06-11 20:39:00.203050 | controller | - NodePoolBuilder: OK 2026-06-11 20:39:00.203058 | controller | - NodePoolLauncher: OK 2026-06-11 20:39:00.203066 | controller | - Zookeeper: OK 2026-06-11 20:39:00.203074 | controller | - Zuul: Waiting ... 2026-06-11 20:39:00.203093 | controller | - |_ Config Secrets: OK 2026-06-11 20:39:00.203101 | controller | - |_ Executor: OK 2026-06-11 20:39:00.203109 | controller | - |_ Merger: OK 2026-06-11 20:39:00.203117 | controller | - |_ Scheduler: OK 2026-06-11 20:39:00.203125 | controller | - |_ Web: Waiting ... 2026-06-11 20:39:00.203133 | controller | 2026-06-11 20:39:00.203142 | controller | 2026-06-11T20:39:00-04:00 INFO [attempt #10] Waiting 5s for the next reconcile call ... 2026-06-11 20:39:05.213854 | controller | 2026-06-11T20:39:05-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:39:06.630966 | controller | 2026-06-11T20:39:06-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:39:06.631049 | controller | 2026-06-11T20:39:06-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:39:06.653013 | controller | 2026-06-11T20:39:06-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:39:06.653092 | controller | 2026-06-11T20:39:06-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:39:07.033345 | controller | 2026-06-11T20:39:07-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:39:07.431761 | controller | 2026-06-11T20:39:07-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:39:07.431845 | controller | 2026-06-11T20:39:07-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:39:07.633292 | controller | 2026-06-11T20:39:07-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:39:08.010623 | controller | 2026-06-11T20:39:08-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:39:10.451480 | controller | 2026-06-11T20:39:10-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:39:10.451540 | controller | 2026-06-11T20:39:10-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:39:10.824500 | controller | 2026-06-11T20:39:10-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:39:10.824602 | controller | 2026-06-11T20:39:10-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:39:11.633914 | controller | 2026-06-11T20:39:11-04:00 INFO 2026-06-11 20:39:11.633982 | controller | - Config: Waiting ... 2026-06-11 20:39:11.633996 | controller | - Gateway: OK 2026-06-11 20:39:11.634008 | controller | - GitServer: OK 2026-06-11 20:39:11.634019 | controller | - HoundSearch: OK 2026-06-11 20:39:11.634030 | controller | - LogJuicer: OK 2026-06-11 20:39:11.634041 | controller | - Logserver: OK 2026-06-11 20:39:11.634052 | controller | - MariaDB: OK 2026-06-11 20:39:11.634063 | controller | - NodePoolBuilder: OK 2026-06-11 20:39:11.634074 | controller | - NodePoolLauncher: OK 2026-06-11 20:39:11.634085 | controller | - Zookeeper: OK 2026-06-11 20:39:11.634096 | controller | - Zuul: Waiting ... 2026-06-11 20:39:11.634107 | controller | - |_ Config Secrets: OK 2026-06-11 20:39:11.634118 | controller | - |_ Executor: OK 2026-06-11 20:39:11.634129 | controller | - |_ Merger: OK 2026-06-11 20:39:11.634140 | controller | - |_ Scheduler: OK 2026-06-11 20:39:11.634151 | controller | - |_ Web: Waiting ... 2026-06-11 20:39:11.634185 | controller | 2026-06-11 20:39:11.634197 | controller | 2026-06-11T20:39:11-04:00 INFO [attempt #11] Waiting 5s for the next reconcile call ... 2026-06-11 20:39:16.646815 | controller | 2026-06-11T20:39:16-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:39:18.063707 | controller | 2026-06-11T20:39:18-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:39:18.063800 | controller | 2026-06-11T20:39:18-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:39:18.095030 | controller | 2026-06-11T20:39:18-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:39:18.095083 | controller | 2026-06-11T20:39:18-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:39:18.464549 | controller | 2026-06-11T20:39:18-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:39:18.863209 | controller | 2026-06-11T20:39:18-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:39:18.863298 | controller | 2026-06-11T20:39:18-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:39:19.064629 | controller | 2026-06-11T20:39:19-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:39:19.440397 | controller | 2026-06-11T20:39:19-04:00 INFO app_key or app_id is not defined, app_key: /var/lib/zuul/githubconnectionsecret/app_key, app_id: 0 2026-06-11 20:39:21.878533 | controller | 2026-06-11T20:39:21-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:39:21.878620 | controller | 2026-06-11T20:39:21-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:39:22.256264 | controller | 2026-06-11T20:39:22-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:39:22.256318 | controller | 2026-06-11T20:39:22-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:39:23.467098 | controller | 2026-06-11T20:39:23-04:00 INFO 2026-06-11 20:39:23.467179 | controller | - Config: OK 2026-06-11 20:39:23.467190 | controller | - Gateway: OK 2026-06-11 20:39:23.467199 | controller | - GitServer: OK 2026-06-11 20:39:23.467207 | controller | - HoundSearch: OK 2026-06-11 20:39:23.467215 | controller | - LogJuicer: OK 2026-06-11 20:39:23.467223 | controller | - Logserver: OK 2026-06-11 20:39:23.467231 | controller | - MariaDB: OK 2026-06-11 20:39:23.467239 | controller | - NodePoolBuilder: OK 2026-06-11 20:39:23.467248 | controller | - NodePoolLauncher: OK 2026-06-11 20:39:23.467256 | controller | - Zookeeper: OK 2026-06-11 20:39:23.467264 | controller | - Zuul: OK 2026-06-11 20:39:23.467273 | controller | 2026-06-11 20:39:23.467329 | controller | 2026-06-11T20:39:23-04:00 INFO Updating controller configmap ... 2026-06-11 20:39:23.854282 | controller | 2026-06-11T20:39:23-04:00 INFO Standalone reconcile done. 2026-06-12 00:39:24.253481 | controller | ok: Runtime: 0:03:14.618793 2026-06-12 00:39:24.272339 | 2026-06-12 00:39:24.272560 | TASK [run-operator-standalone : Copy current spec] 2026-06-12 00:39:24.806289 | controller | skipping: Conditional result was False 2026-06-12 00:39:24.833561 | 2026-06-12 00:39:24.833802 | TASK [health-check/zuul-connections : Wait for the new Zuul connections to appear in the Zuul API] 2026-06-12 00:39:25.404335 | controller | ok: OK (1399 bytes) 2026-06-12 00:39:25.416783 | 2026-06-12 00:39:25.416992 | TASK [health-check/zuul-connections : Ensure the new Zuul connections (non SourceInterface) exist in the scheduler's zuul.conf] 2026-06-11 20:39:25.799578 | controller | Defaulted container "zuul-scheduler" out of: zuul-scheduler, zuul-statsd, zuul-scheduler-nodeexporter, init-scheduler-config (init) 2026-06-11 20:39:25.894365 | controller | [connection dummy-elasticsearch-conn] 2026-06-11 20:39:25.979125 | controller | Defaulted container "zuul-scheduler" out of: zuul-scheduler, zuul-statsd, zuul-scheduler-nodeexporter, init-scheduler-config (init) 2026-06-11 20:39:26.094946 | controller | [connection dummy-smtp-conn] 2026-06-12 00:39:26.468913 | controller | ok: Runtime: 0:00:00.391540 2026-06-12 00:39:26.478597 | 2026-06-12 00:39:26.478825 | TASK [health-check/zuul-connections : Ensure ElasticSearch URI is configured with basic auth] 2026-06-11 20:39:26.830630 | controller | Defaulted container "zuul-scheduler" out of: zuul-scheduler, zuul-statsd, zuul-scheduler-nodeexporter, init-scheduler-config (init) 2026-06-11 20:39:26.942403 | controller | uri = http://es-username:es-password@test:9200 2026-06-12 00:39:27.028215 | controller | ok: Runtime: 0:00:00.173981 2026-06-12 00:39:27.044002 | 2026-06-12 00:39:27.044249 | TASK [health-check/zuul-connections : Ensure SMTP password is present] 2026-06-11 20:39:27.440062 | controller | Defaulted container "zuul-scheduler" out of: zuul-scheduler, zuul-statsd, zuul-scheduler-nodeexporter, init-scheduler-config (init) 2026-06-11 20:39:27.553313 | controller | password = smtp-password 2026-06-12 00:39:27.609231 | controller | ok: Runtime: 0:00:00.212609 2026-06-12 00:39:27.621540 | 2026-06-12 00:39:27.621744 | TASK [health-check/zuul-connections : Ensure the new Zuul dummy gerrit secret exist in the scheduler's zuul.conf] 2026-06-11 20:39:28.107213 | controller | Defaulted container "zuul-scheduler" out of: zuul-scheduler, zuul-statsd, zuul-scheduler-nodeexporter, init-scheduler-config (init) 2026-06-11 20:39:28.237052 | controller | sshkey = /var/lib/zuul-dummygerritsecret/..data/priv 2026-06-11 20:39:28.237123 | controller | sshkey = /var/lib/zuul-dummygerritsecret/..data/priv 2026-06-11 20:39:28.313198 | controller | Defaulted container "zuul-scheduler" out of: zuul-scheduler, zuul-statsd, zuul-scheduler-nodeexporter, init-scheduler-config (init) 2026-06-12 00:39:28.728191 | controller | ok: Runtime: 0:00:00.426742 2026-06-12 00:39:28.735709 | 2026-06-12 00:39:28.735931 | TASK [Delete the dummy Zuul connections] 2026-06-12 00:39:28.761672 | controller | ok 2026-06-12 00:39:28.792231 | 2026-06-12 00:39:28.792397 | TASK [update-custom-resource : read current crd] 2026-06-12 00:39:29.057664 | controller | ok 2026-06-12 00:39:29.064211 | 2026-06-12 00:39:29.064298 | TASK [update-custom-resource : merge the new cr] 2026-06-12 00:39:29.874125 | controller | changed 2026-06-12 00:39:29.883515 | 2026-06-12 00:39:29.883673 | TASK [run the operator in standalone mode] 2026-06-12 00:39:29.918920 | controller | ok 2026-06-12 00:39:29.952009 | 2026-06-12 00:39:29.952188 | TASK [run-operator-standalone : Ensure ~/zuul-output/logs] 2026-06-12 00:39:29.987978 | controller | skipping: Conditional result was False 2026-06-12 00:39:29.998660 | 2026-06-12 00:39:29.998797 | TASK [run-operator-standalone : Clear previous log file] 2026-06-12 00:39:30.025920 | controller | skipping: Conditional result was False 2026-06-12 00:39:30.036605 | 2026-06-12 00:39:30.036746 | TASK [run-operator-standalone : Run the operator in standalone mode] 2026-06-11 20:39:30.671125 | controller | 2026-06-11T20:39:30-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:39:30.671193 | controller | 2026-06-11 20:39:30.682197 | controller | 2026-06-11T20:39:30-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:39:30.682227 | controller | 2026-06-11 20:39:30.696754 | controller | 2026-06-11T20:39:30-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:39:30.717451 | controller | 2026-06-11T20:39:30-04:00 INFO Updating configmap, name: git-server-pi-config-map 2026-06-11 20:39:30.717490 | controller | 2026-06-11T20:39:30-04:00 INFO Updating object, name: git-server-pi-config-map 2026-06-11 20:39:30.723018 | controller | 2026-06-11T20:39:30-04:00 INFO Statefulset "git-server" configuration changed, applying... 2026-06-11 20:39:30.723040 | controller | 2026-06-11T20:39:30-04:00 INFO Updating object, name: git-server 2026-06-11 20:39:31.313836 | controller | 2026-06-11T20:39:31-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:39:31.444851 | controller | 2026-06-11T20:39:31-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:39:31.454323 | controller | 2026-06-11T20:39:31-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:39:31.454439 | controller | 2026-06-11T20:39:31-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:39:31.473770 | controller | 2026-06-11T20:39:31-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:39:31.473855 | controller | 2026-06-11T20:39:31-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:39:31.717457 | controller | 2026-06-11T20:39:31-04:00 INFO Waiting for GitServer and MariaDB services to be ready ... 2026-06-11 20:39:31.717583 | controller | 2026-06-11T20:39:31-04:00 INFO 2026-06-11 20:39:31.717601 | controller | - Config: Waiting ... 2026-06-11 20:39:31.717610 | controller | - Gateway: OK 2026-06-11 20:39:31.717619 | controller | - GitServer: Waiting ... 2026-06-11 20:39:31.717627 | controller | - HoundSearch: OK 2026-06-11 20:39:31.717635 | controller | - LogJuicer: OK 2026-06-11 20:39:31.717644 | controller | - Logserver: OK 2026-06-11 20:39:31.717652 | controller | - MariaDB: OK 2026-06-11 20:39:31.717660 | controller | - Zookeeper: OK 2026-06-11 20:39:31.717668 | controller | 2026-06-11 20:39:31.717677 | controller | 2026-06-11T20:39:31-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-11 20:39:36.728051 | controller | 2026-06-11T20:39:36-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:39:36.758859 | controller | 2026-06-11T20:39:36-04:00 INFO Waiting for statefulset, name: git-server 2026-06-11 20:39:54.913800 | controller | 2026-06-11T20:39:54-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:39:54.913862 | controller | 2026-06-11T20:39:54-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:39:54.933406 | controller | 2026-06-11T20:39:54-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:39:54.933454 | controller | 2026-06-11T20:39:54-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:39:54.956272 | controller | 2026-06-11T20:39:54-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:39:55.261492 | controller | 2026-06-11T20:39:55-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:39:55.261564 | controller | 2026-06-11T20:39:55-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:39:56.243401 | controller | 2026-06-11T20:39:56-04:00 INFO Updating secret, name: zuul-config 2026-06-11 20:39:56.243482 | controller | 2026-06-11T20:39:56-04:00 INFO Updating object, name: zuul-config 2026-06-11 20:39:56.651428 | controller | 2026-06-11T20:39:56-04:00 INFO Statefulset "zuul-scheduler" configuration changed, applying... 2026-06-11 20:39:56.651508 | controller | 2026-06-11T20:39:56-04:00 INFO Updating object, name: zuul-scheduler 2026-06-11 20:39:57.451198 | controller | 2026-06-11T20:39:57-04:00 INFO Statefulset "zuul-executor" configuration changed, applying... 2026-06-11 20:39:57.451260 | controller | 2026-06-11T20:39:57-04:00 INFO Updating object, name: zuul-executor 2026-06-11 20:39:58.251652 | controller | 2026-06-11T20:39:58-04:00 INFO Statefulset "zuul-web" configuration changed, applying... 2026-06-11 20:39:58.251724 | controller | 2026-06-11T20:39:58-04:00 INFO Updating object, name: zuul-web 2026-06-11 20:39:59.053128 | controller | 2026-06-11T20:39:59-04:00 INFO Statefulset "zuul-merger" configuration changed, applying... 2026-06-11 20:39:59.053200 | controller | 2026-06-11T20:39:59-04:00 INFO Updating object, name: zuul-merger 2026-06-11 20:39:59.063266 | controller | 2026-06-11T20:39:59-04:00 INFO 2026-06-11 20:39:59.063298 | controller | - Config: Waiting ... 2026-06-11 20:39:59.063305 | controller | - Gateway: OK 2026-06-11 20:39:59.063311 | controller | - GitServer: OK 2026-06-11 20:39:59.063316 | controller | - HoundSearch: OK 2026-06-11 20:39:59.063321 | controller | - LogJuicer: OK 2026-06-11 20:39:59.063326 | controller | - Logserver: OK 2026-06-11 20:39:59.063331 | controller | - MariaDB: OK 2026-06-11 20:39:59.063336 | controller | - NodePoolBuilder: OK 2026-06-11 20:39:59.063341 | controller | - NodePoolLauncher: OK 2026-06-11 20:39:59.063346 | controller | - Zookeeper: OK 2026-06-11 20:39:59.063351 | controller | - Zuul: Waiting ... 2026-06-11 20:39:59.063356 | controller | - |_ Config Secrets: OK 2026-06-11 20:39:59.063361 | controller | - |_ Executor: Waiting ... 2026-06-11 20:39:59.063371 | controller | - |_ Merger: Waiting ... 2026-06-11 20:39:59.063376 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:39:59.063384 | controller | - |_ Web: Waiting ... 2026-06-11 20:39:59.063415 | controller | 2026-06-11 20:39:59.063426 | controller | 2026-06-11T20:39:59-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-11 20:40:04.073583 | controller | 2026-06-11T20:40:04-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:40:04.686561 | controller | 2026-06-11T20:40:04-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:40:04.686644 | controller | 2026-06-11T20:40:04-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:40:04.701654 | controller | 2026-06-11T20:40:04-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:40:04.701710 | controller | 2026-06-11T20:40:04-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:40:05.092750 | controller | 2026-06-11T20:40:05-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:40:05.486313 | controller | 2026-06-11T20:40:05-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:40:05.486475 | controller | 2026-06-11T20:40:05-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:40:06.497638 | controller | 2026-06-11T20:40:06-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:40:36.615249 | controller | 2026-06-11T20:40:36-04:00 INFO Statefulset "zuul-scheduler" not ready after 30s 2026-06-11 20:40:36.658009 | controller | 2026-06-11T20:40:36-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:40:36.658075 | controller | 2026-06-11T20:40:36-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:40:37.029817 | controller | 2026-06-11T20:40:37-04:00 INFO 2026-06-11 20:40:37.029934 | controller | - Config: Waiting ... 2026-06-11 20:40:37.029950 | controller | - Gateway: OK 2026-06-11 20:40:37.029963 | controller | - GitServer: OK 2026-06-11 20:40:37.029975 | controller | - HoundSearch: OK 2026-06-11 20:40:37.029988 | controller | - LogJuicer: OK 2026-06-11 20:40:37.030000 | controller | - Logserver: OK 2026-06-11 20:40:37.030011 | controller | - MariaDB: OK 2026-06-11 20:40:37.030023 | controller | - NodePoolBuilder: OK 2026-06-11 20:40:37.030034 | controller | - NodePoolLauncher: OK 2026-06-11 20:40:37.030046 | controller | - Zookeeper: OK 2026-06-11 20:40:37.030058 | controller | - Zuul: Waiting ... 2026-06-11 20:40:37.030071 | controller | - |_ Config Secrets: OK 2026-06-11 20:40:37.030083 | controller | - |_ Executor: OK 2026-06-11 20:40:37.030094 | controller | - |_ Merger: OK 2026-06-11 20:40:37.030106 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:40:37.030118 | controller | - |_ Web: Waiting ... 2026-06-11 20:40:37.030130 | controller | 2026-06-11 20:40:37.030152 | controller | 2026-06-11T20:40:37-04:00 INFO [attempt #3] Waiting 5s for the next reconcile call ... 2026-06-11 20:40:42.036936 | controller | 2026-06-11T20:40:42-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:40:42.650286 | controller | 2026-06-11T20:40:42-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:40:42.650330 | controller | 2026-06-11T20:40:42-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:40:42.664832 | controller | 2026-06-11T20:40:42-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:40:42.664871 | controller | 2026-06-11T20:40:42-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:40:43.056275 | controller | 2026-06-11T20:40:43-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:40:43.458053 | controller | 2026-06-11T20:40:43-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:40:43.458124 | controller | 2026-06-11T20:40:43-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:40:44.466552 | controller | 2026-06-11T20:40:44-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:41:00.541508 | controller | 2026-06-11T20:41:00-04:00 INFO Statefulset "zuul-weeder" configuration changed, applying... 2026-06-11 20:41:00.541570 | controller | 2026-06-11T20:41:00-04:00 INFO Updating object, name: zuul-weeder 2026-06-11 20:41:00.615516 | controller | 2026-06-11T20:41:00-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:41:00.615559 | controller | 2026-06-11T20:41:00-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:41:00.968096 | controller | 2026-06-11T20:41:00-04:00 INFO 2026-06-11 20:41:00.968149 | controller | - Config: Waiting ... 2026-06-11 20:41:00.968160 | controller | - Gateway: OK 2026-06-11 20:41:00.968168 | controller | - GitServer: OK 2026-06-11 20:41:00.968177 | controller | - HoundSearch: OK 2026-06-11 20:41:00.968185 | controller | - LogJuicer: OK 2026-06-11 20:41:00.968193 | controller | - Logserver: OK 2026-06-11 20:41:00.968200 | controller | - MariaDB: OK 2026-06-11 20:41:00.968208 | controller | - NodePoolBuilder: OK 2026-06-11 20:41:00.968216 | controller | - NodePoolLauncher: OK 2026-06-11 20:41:00.968224 | controller | - Zookeeper: OK 2026-06-11 20:41:00.968232 | controller | - Zuul: Waiting ... 2026-06-11 20:41:00.968240 | controller | - |_ Config Secrets: OK 2026-06-11 20:41:00.968249 | controller | - |_ Executor: OK 2026-06-11 20:41:00.968260 | controller | - |_ Merger: OK 2026-06-11 20:41:00.968271 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:41:00.968284 | controller | - |_ Web: OK 2026-06-11 20:41:00.968296 | controller | 2026-06-11 20:41:00.968308 | controller | 2026-06-11T20:41:00-04:00 INFO [attempt #4] Waiting 5s for the next reconcile call ... 2026-06-11 20:41:05.976676 | controller | 2026-06-11T20:41:05-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:41:06.594987 | controller | 2026-06-11T20:41:06-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:41:06.595066 | controller | 2026-06-11T20:41:06-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:41:06.618656 | controller | 2026-06-11T20:41:06-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:41:06.618730 | controller | 2026-06-11T20:41:06-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:41:06.993819 | controller | 2026-06-11T20:41:06-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:41:07.397204 | controller | 2026-06-11T20:41:07-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:41:07.397266 | controller | 2026-06-11T20:41:07-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:41:08.412665 | controller | 2026-06-11T20:41:08-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:41:08.412715 | controller | 2026-06-11T20:41:08-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:41:09.982957 | controller | 2026-06-11T20:41:09-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:41:09.983010 | controller | 2026-06-11T20:41:09-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:41:11.194083 | controller | 2026-06-11T20:41:11-04:00 INFO Running tenant-reconfigure for the 'internal' tenant 2026-06-11 20:41:11.377934 | controller | 2026-06-11T20:41:11-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [zuul-scheduler tenant-reconfigure internal] 2026-06-11 20:41:18.245897 | controller | 2026-06-11T20:41:18-04:00 INFO Deleting object, name: zuul-web 2026-06-11 20:41:18.250193 | controller | 2026-06-11T20:41:18-04:00 INFO Updating object, name: zs-internal-tenant-reconfigure 2026-06-11 20:41:18.253987 | controller | 2026-06-11T20:41:18-04:00 INFO 2026-06-11 20:41:18.254003 | controller | - Config: Waiting ... 2026-06-11 20:41:18.254008 | controller | - Gateway: OK 2026-06-11 20:41:18.254012 | controller | - GitServer: OK 2026-06-11 20:41:18.254015 | controller | - HoundSearch: OK 2026-06-11 20:41:18.254019 | controller | - LogJuicer: OK 2026-06-11 20:41:18.254023 | controller | - Logserver: OK 2026-06-11 20:41:18.254026 | controller | - MariaDB: OK 2026-06-11 20:41:18.254030 | controller | - NodePoolBuilder: OK 2026-06-11 20:41:18.254034 | controller | - NodePoolLauncher: OK 2026-06-11 20:41:18.254037 | controller | - Zookeeper: OK 2026-06-11 20:41:18.254041 | controller | - Zuul: OK 2026-06-11 20:41:18.254045 | controller | 2026-06-11 20:41:18.254049 | controller | 2026-06-11T20:41:18-04:00 INFO [attempt #5] Waiting 5s for the next reconcile call ... 2026-06-11 20:41:23.264651 | controller | 2026-06-11T20:41:23-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:41:23.887527 | controller | 2026-06-11T20:41:23-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:41:23.887636 | controller | 2026-06-11T20:41:23-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:41:23.908935 | controller | 2026-06-11T20:41:23-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:41:23.908980 | controller | 2026-06-11T20:41:23-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:41:24.283574 | controller | 2026-06-11T20:41:24-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:41:24.673755 | controller | 2026-06-11T20:41:24-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:41:24.673832 | controller | 2026-06-11T20:41:24-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:41:25.695335 | controller | 2026-06-11T20:41:25-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:41:25.695452 | controller | 2026-06-11T20:41:25-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:41:27.276397 | controller | 2026-06-11T20:41:27-04:00 INFO Creating object, name: zuul-web 2026-06-11 20:41:28.082719 | controller | 2026-06-11T20:41:28-04:00 INFO 2026-06-11 20:41:28.082770 | controller | - Config: Waiting ... 2026-06-11 20:41:28.082780 | controller | - Gateway: OK 2026-06-11 20:41:28.082789 | controller | - GitServer: OK 2026-06-11 20:41:28.082797 | controller | - HoundSearch: OK 2026-06-11 20:41:28.082805 | controller | - LogJuicer: OK 2026-06-11 20:41:28.082813 | controller | - Logserver: OK 2026-06-11 20:41:28.082821 | controller | - MariaDB: OK 2026-06-11 20:41:28.082829 | controller | - NodePoolBuilder: OK 2026-06-11 20:41:28.082837 | controller | - NodePoolLauncher: OK 2026-06-11 20:41:28.082845 | controller | - Zookeeper: OK 2026-06-11 20:41:28.082853 | controller | - Zuul: Waiting ... 2026-06-11 20:41:28.082860 | controller | - |_ Config Secrets: OK 2026-06-11 20:41:28.082868 | controller | - |_ Executor: OK 2026-06-11 20:41:28.082876 | controller | - |_ Merger: OK 2026-06-11 20:41:28.082884 | controller | - |_ Scheduler: OK 2026-06-11 20:41:28.082892 | controller | - |_ Web: Waiting ... 2026-06-11 20:41:28.082900 | controller | 2026-06-11 20:41:28.082969 | controller | 2026-06-11T20:41:28-04:00 INFO [attempt #6] Waiting 5s for the next reconcile call ... 2026-06-11 20:41:33.092232 | controller | 2026-06-11T20:41:33-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:41:33.709523 | controller | 2026-06-11T20:41:33-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:41:33.709591 | controller | 2026-06-11T20:41:33-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:41:33.729587 | controller | 2026-06-11T20:41:33-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:41:33.729654 | controller | 2026-06-11T20:41:33-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:41:34.111306 | controller | 2026-06-11T20:41:34-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:41:34.509109 | controller | 2026-06-11T20:41:34-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:41:34.509188 | controller | 2026-06-11T20:41:34-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:41:35.520589 | controller | 2026-06-11T20:41:35-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:41:35.520661 | controller | 2026-06-11T20:41:35-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:41:37.097943 | controller | 2026-06-11T20:41:37-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:41:37.098021 | controller | 2026-06-11T20:41:37-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:41:37.904481 | controller | 2026-06-11T20:41:37-04:00 INFO 2026-06-11 20:41:37.904535 | controller | - Config: Waiting ... 2026-06-11 20:41:37.904546 | controller | - Gateway: OK 2026-06-11 20:41:37.904555 | controller | - GitServer: OK 2026-06-11 20:41:37.904563 | controller | - HoundSearch: OK 2026-06-11 20:41:37.904572 | controller | - LogJuicer: OK 2026-06-11 20:41:37.904580 | controller | - Logserver: OK 2026-06-11 20:41:37.904588 | controller | - MariaDB: OK 2026-06-11 20:41:37.904596 | controller | - NodePoolBuilder: OK 2026-06-11 20:41:37.904604 | controller | - NodePoolLauncher: OK 2026-06-11 20:41:37.904612 | controller | - Zookeeper: OK 2026-06-11 20:41:37.904621 | controller | - Zuul: Waiting ... 2026-06-11 20:41:37.904630 | controller | - |_ Config Secrets: OK 2026-06-11 20:41:37.904638 | controller | - |_ Executor: OK 2026-06-11 20:41:37.904694 | controller | - |_ Merger: OK 2026-06-11 20:41:37.904703 | controller | - |_ Scheduler: OK 2026-06-11 20:41:37.904712 | controller | - |_ Web: Waiting ... 2026-06-11 20:41:37.904720 | controller | 2026-06-11 20:41:37.904729 | controller | 2026-06-11T20:41:37-04:00 INFO [attempt #7] Waiting 5s for the next reconcile call ... 2026-06-11 20:41:42.913577 | controller | 2026-06-11T20:41:42-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:41:43.535840 | controller | 2026-06-11T20:41:43-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:41:43.536469 | controller | 2026-06-11T20:41:43-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:41:43.559577 | controller | 2026-06-11T20:41:43-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:41:43.559659 | controller | 2026-06-11T20:41:43-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:41:43.931945 | controller | 2026-06-11T20:41:43-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:41:44.326563 | controller | 2026-06-11T20:41:44-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:41:44.326613 | controller | 2026-06-11T20:41:44-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:41:45.338444 | controller | 2026-06-11T20:41:45-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:41:45.338488 | controller | 2026-06-11T20:41:45-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:41:46.919332 | controller | 2026-06-11T20:41:46-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:41:46.919438 | controller | 2026-06-11T20:41:46-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:41:47.726907 | controller | 2026-06-11T20:41:47-04:00 INFO 2026-06-11 20:41:47.726967 | controller | - Config: Waiting ... 2026-06-11 20:41:47.726978 | controller | - Gateway: OK 2026-06-11 20:41:47.726987 | controller | - GitServer: OK 2026-06-11 20:41:47.726996 | controller | - HoundSearch: OK 2026-06-11 20:41:47.727004 | controller | - LogJuicer: OK 2026-06-11 20:41:47.727012 | controller | - Logserver: OK 2026-06-11 20:41:47.727020 | controller | - MariaDB: OK 2026-06-11 20:41:47.727029 | controller | - NodePoolBuilder: OK 2026-06-11 20:41:47.727037 | controller | - NodePoolLauncher: OK 2026-06-11 20:41:47.727045 | controller | - Zookeeper: OK 2026-06-11 20:41:47.727053 | controller | - Zuul: Waiting ... 2026-06-11 20:41:47.727061 | controller | - |_ Config Secrets: OK 2026-06-11 20:41:47.727070 | controller | - |_ Executor: OK 2026-06-11 20:41:47.727077 | controller | - |_ Merger: OK 2026-06-11 20:41:47.727085 | controller | - |_ Scheduler: OK 2026-06-11 20:41:47.727093 | controller | - |_ Web: Waiting ... 2026-06-11 20:41:47.727101 | controller | 2026-06-11 20:41:47.727110 | controller | 2026-06-11T20:41:47-04:00 INFO [attempt #8] Waiting 5s for the next reconcile call ... 2026-06-11 20:41:52.734132 | controller | 2026-06-11T20:41:52-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:41:53.357048 | controller | 2026-06-11T20:41:53-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:41:53.357086 | controller | 2026-06-11T20:41:53-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:41:53.378030 | controller | 2026-06-11T20:41:53-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:41:53.378064 | controller | 2026-06-11T20:41:53-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:41:53.748980 | controller | 2026-06-11T20:41:53-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:41:54.153867 | controller | 2026-06-11T20:41:54-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:41:54.153920 | controller | 2026-06-11T20:41:54-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:41:55.166674 | controller | 2026-06-11T20:41:55-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:41:55.166742 | controller | 2026-06-11T20:41:55-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:41:56.740213 | controller | 2026-06-11T20:41:56-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:41:56.740275 | controller | 2026-06-11T20:41:56-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:41:57.549002 | controller | 2026-06-11T20:41:57-04:00 INFO 2026-06-11 20:41:57.549080 | controller | - Config: Waiting ... 2026-06-11 20:41:57.549097 | controller | - Gateway: OK 2026-06-11 20:41:57.549110 | controller | - GitServer: OK 2026-06-11 20:41:57.549121 | controller | - HoundSearch: OK 2026-06-11 20:41:57.549132 | controller | - LogJuicer: OK 2026-06-11 20:41:57.549152 | controller | - Logserver: OK 2026-06-11 20:41:57.549164 | controller | - MariaDB: OK 2026-06-11 20:41:57.549176 | controller | - NodePoolBuilder: OK 2026-06-11 20:41:57.549188 | controller | - NodePoolLauncher: OK 2026-06-11 20:41:57.549200 | controller | - Zookeeper: OK 2026-06-11 20:41:57.549211 | controller | - Zuul: Waiting ... 2026-06-11 20:41:57.549236 | controller | - |_ Config Secrets: OK 2026-06-11 20:41:57.549248 | controller | - |_ Executor: OK 2026-06-11 20:41:57.549259 | controller | - |_ Merger: OK 2026-06-11 20:41:57.549271 | controller | - |_ Scheduler: OK 2026-06-11 20:41:57.549282 | controller | - |_ Web: Waiting ... 2026-06-11 20:41:57.549294 | controller | 2026-06-11 20:41:57.549341 | controller | 2026-06-11T20:41:57-04:00 INFO [attempt #9] Waiting 5s for the next reconcile call ... 2026-06-11 20:42:02.556060 | controller | 2026-06-11T20:42:02-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:42:03.175358 | controller | 2026-06-11T20:42:03-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:42:03.175472 | controller | 2026-06-11T20:42:03-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:42:03.196656 | controller | 2026-06-11T20:42:03-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:42:03.196702 | controller | 2026-06-11T20:42:03-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:42:03.578167 | controller | 2026-06-11T20:42:03-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:42:03.975415 | controller | 2026-06-11T20:42:03-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:42:03.975540 | controller | 2026-06-11T20:42:03-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:42:04.986328 | controller | 2026-06-11T20:42:04-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:42:04.986426 | controller | 2026-06-11T20:42:04-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:42:06.560139 | controller | 2026-06-11T20:42:06-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:42:06.560199 | controller | 2026-06-11T20:42:06-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:42:07.370104 | controller | 2026-06-11T20:42:07-04:00 INFO 2026-06-11 20:42:07.370178 | controller | - Config: Waiting ... 2026-06-11 20:42:07.370188 | controller | - Gateway: OK 2026-06-11 20:42:07.370197 | controller | - GitServer: OK 2026-06-11 20:42:07.370205 | controller | - HoundSearch: OK 2026-06-11 20:42:07.370212 | controller | - LogJuicer: OK 2026-06-11 20:42:07.370220 | controller | - Logserver: OK 2026-06-11 20:42:07.370227 | controller | - MariaDB: OK 2026-06-11 20:42:07.370235 | controller | - NodePoolBuilder: OK 2026-06-11 20:42:07.370242 | controller | - NodePoolLauncher: OK 2026-06-11 20:42:07.370250 | controller | - Zookeeper: OK 2026-06-11 20:42:07.370257 | controller | - Zuul: Waiting ... 2026-06-11 20:42:07.370265 | controller | - |_ Config Secrets: OK 2026-06-11 20:42:07.370272 | controller | - |_ Executor: OK 2026-06-11 20:42:07.370279 | controller | - |_ Merger: OK 2026-06-11 20:42:07.370287 | controller | - |_ Scheduler: OK 2026-06-11 20:42:07.370294 | controller | - |_ Web: Waiting ... 2026-06-11 20:42:07.370302 | controller | 2026-06-11 20:42:07.370317 | controller | 2026-06-11T20:42:07-04:00 INFO [attempt #10] Waiting 5s for the next reconcile call ... 2026-06-11 20:42:12.380315 | controller | 2026-06-11T20:42:12-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:42:13.001901 | controller | 2026-06-11T20:42:13-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:42:13.001970 | controller | 2026-06-11T20:42:13-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:42:13.027240 | controller | 2026-06-11T20:42:13-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:42:13.027312 | controller | 2026-06-11T20:42:13-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:42:13.399601 | controller | 2026-06-11T20:42:13-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:42:13.796240 | controller | 2026-06-11T20:42:13-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:42:13.796305 | controller | 2026-06-11T20:42:13-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:42:14.815416 | controller | 2026-06-11T20:42:14-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:42:14.815464 | controller | 2026-06-11T20:42:14-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:42:16.385139 | controller | 2026-06-11T20:42:16-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:42:16.385240 | controller | 2026-06-11T20:42:16-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:42:17.193170 | controller | 2026-06-11T20:42:17-04:00 INFO 2026-06-11 20:42:17.193230 | controller | - Config: Waiting ... 2026-06-11 20:42:17.193244 | controller | - Gateway: OK 2026-06-11 20:42:17.193255 | controller | - GitServer: OK 2026-06-11 20:42:17.193263 | controller | - HoundSearch: OK 2026-06-11 20:42:17.193272 | controller | - LogJuicer: OK 2026-06-11 20:42:17.193280 | controller | - Logserver: OK 2026-06-11 20:42:17.193288 | controller | - MariaDB: OK 2026-06-11 20:42:17.193295 | controller | - NodePoolBuilder: OK 2026-06-11 20:42:17.193304 | controller | - NodePoolLauncher: OK 2026-06-11 20:42:17.193312 | controller | - Zookeeper: OK 2026-06-11 20:42:17.193320 | controller | - Zuul: Waiting ... 2026-06-11 20:42:17.193328 | controller | - |_ Config Secrets: OK 2026-06-11 20:42:17.193336 | controller | - |_ Executor: OK 2026-06-11 20:42:17.193343 | controller | - |_ Merger: OK 2026-06-11 20:42:17.193351 | controller | - |_ Scheduler: OK 2026-06-11 20:42:17.193359 | controller | - |_ Web: Waiting ... 2026-06-11 20:42:17.193401 | controller | 2026-06-11 20:42:17.193414 | controller | 2026-06-11T20:42:17-04:00 INFO [attempt #11] Waiting 5s for the next reconcile call ... 2026-06-11 20:42:22.202577 | controller | 2026-06-11T20:42:22-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:42:22.823106 | controller | 2026-06-11T20:42:22-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:42:22.823221 | controller | 2026-06-11T20:42:22-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:42:22.846694 | controller | 2026-06-11T20:42:22-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:42:22.846737 | controller | 2026-06-11T20:42:22-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:42:23.213910 | controller | 2026-06-11T20:42:23-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:42:23.622100 | controller | 2026-06-11T20:42:23-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:42:23.622187 | controller | 2026-06-11T20:42:23-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:42:24.623584 | controller | 2026-06-11T20:42:24-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:42:24.623642 | controller | 2026-06-11T20:42:24-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:42:26.206826 | controller | 2026-06-11T20:42:26-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:42:26.206917 | controller | 2026-06-11T20:42:26-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:42:27.016124 | controller | 2026-06-11T20:42:27-04:00 INFO 2026-06-11 20:42:27.016198 | controller | - Config: Waiting ... 2026-06-11 20:42:27.016208 | controller | - Gateway: OK 2026-06-11 20:42:27.016217 | controller | - GitServer: OK 2026-06-11 20:42:27.016226 | controller | - HoundSearch: OK 2026-06-11 20:42:27.016234 | controller | - LogJuicer: OK 2026-06-11 20:42:27.016242 | controller | - Logserver: OK 2026-06-11 20:42:27.016250 | controller | - MariaDB: OK 2026-06-11 20:42:27.016258 | controller | - NodePoolBuilder: OK 2026-06-11 20:42:27.016266 | controller | - NodePoolLauncher: OK 2026-06-11 20:42:27.016275 | controller | - Zookeeper: OK 2026-06-11 20:42:27.016283 | controller | - Zuul: Waiting ... 2026-06-11 20:42:27.016291 | controller | - |_ Config Secrets: OK 2026-06-11 20:42:27.016299 | controller | - |_ Executor: OK 2026-06-11 20:42:27.016307 | controller | - |_ Merger: OK 2026-06-11 20:42:27.016315 | controller | - |_ Scheduler: OK 2026-06-11 20:42:27.016323 | controller | - |_ Web: Waiting ... 2026-06-11 20:42:27.016331 | controller | 2026-06-11 20:42:27.016340 | controller | 2026-06-11T20:42:27-04:00 INFO [attempt #12] Waiting 5s for the next reconcile call ... 2026-06-11 20:42:32.026134 | controller | 2026-06-11T20:42:32-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:42:32.644720 | controller | 2026-06-11T20:42:32-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:42:32.644810 | controller | 2026-06-11T20:42:32-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:42:32.670010 | controller | 2026-06-11T20:42:32-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:42:32.670072 | controller | 2026-06-11T20:42:32-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:42:33.043290 | controller | 2026-06-11T20:42:33-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:42:33.451655 | controller | 2026-06-11T20:42:33-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:42:33.451734 | controller | 2026-06-11T20:42:33-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:42:34.461413 | controller | 2026-06-11T20:42:34-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:42:34.461463 | controller | 2026-06-11T20:42:34-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:42:36.031597 | controller | 2026-06-11T20:42:36-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:42:36.031683 | controller | 2026-06-11T20:42:36-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:42:37.244396 | controller | 2026-06-11T20:42:37-04:00 INFO 2026-06-11 20:42:37.244467 | controller | - Config: OK 2026-06-11 20:42:37.244477 | controller | - Gateway: OK 2026-06-11 20:42:37.244485 | controller | - GitServer: OK 2026-06-11 20:42:37.244492 | controller | - HoundSearch: OK 2026-06-11 20:42:37.244500 | controller | - LogJuicer: OK 2026-06-11 20:42:37.244507 | controller | - Logserver: OK 2026-06-11 20:42:37.244514 | controller | - MariaDB: OK 2026-06-11 20:42:37.244520 | controller | - NodePoolBuilder: OK 2026-06-11 20:42:37.244527 | controller | - NodePoolLauncher: OK 2026-06-11 20:42:37.244534 | controller | - Zookeeper: OK 2026-06-11 20:42:37.244541 | controller | - Zuul: OK 2026-06-11 20:42:37.244549 | controller | 2026-06-11 20:42:37.244556 | controller | 2026-06-11T20:42:37-04:00 INFO Updating controller configmap ... 2026-06-11 20:42:37.629648 | controller | 2026-06-11T20:42:37-04:00 INFO Standalone reconcile done. 2026-06-12 00:42:37.815388 | controller | ok: Runtime: 0:03:07.297138 2026-06-12 00:42:37.829691 | 2026-06-12 00:42:37.829835 | TASK [run-operator-standalone : Copy current spec] 2026-06-12 00:42:38.368048 | controller | skipping: Conditional result was False 2026-06-12 00:42:38.393601 | 2026-06-12 00:42:38.393756 | TASK [health-check/zuul-connections : Wait for the dummy Zuul connections to be removed from the API] 2026-06-12 00:42:38.948638 | controller | ok: OK (415 bytes) 2026-06-12 00:42:38.959877 | 2026-06-12 00:42:38.960024 | TASK [health-check/zuul-connections : Ensure the new Zuul connections (non SourceInterface) no longer exist in the scheduler's zuul.conf] 2026-06-11 20:42:39.335197 | controller | Defaulted container "zuul-scheduler" out of: zuul-scheduler, zuul-statsd, zuul-scheduler-nodeexporter, init-scheduler-config (init) 2026-06-11 20:42:39.425053 | controller | command terminated with exit code 1 2026-06-11 20:42:39.472481 | controller | Defaulted container "zuul-scheduler" out of: zuul-scheduler, zuul-statsd, zuul-scheduler-nodeexporter, init-scheduler-config (init) 2026-06-11 20:42:39.584057 | controller | command terminated with exit code 1 2026-06-12 00:42:40.009114 | controller | ok: Runtime: 0:00:00.343192 2026-06-12 00:42:40.017276 | 2026-06-12 00:42:40.017380 | TASK [health-check/zuul-connections : Delete GitHub Connection Secret] 2026-06-12 00:42:40.797723 | controller | changed 2026-06-12 00:42:40.807582 | 2026-06-12 00:42:40.807735 | TASK [health-check/zuul-connections : Delete GitLab Connection Secret] 2026-06-12 00:42:41.718776 | controller | changed 2026-06-12 00:42:41.729642 | 2026-06-12 00:42:41.729844 | TASK [health-check/zuul-connections : Delete Pagure Connection Secret] 2026-06-12 00:42:42.610567 | controller | changed 2026-06-12 00:42:42.630131 | 2026-06-12 00:42:42.630308 | TASK [health-check/zuul-authenticators : Initialize new authenticator config] 2026-06-12 00:42:42.666110 | controller | ok 2026-06-12 00:42:42.671701 | 2026-06-12 00:42:42.671788 | TASK [Add the authenticator to spec] 2026-06-12 00:42:42.703696 | controller | ok 2026-06-12 00:42:42.727741 | 2026-06-12 00:42:42.727936 | TASK [update-custom-resource : read current crd] 2026-06-12 00:42:42.933707 | controller | ok 2026-06-12 00:42:42.939887 | 2026-06-12 00:42:42.940023 | TASK [update-custom-resource : merge the new cr] 2026-06-12 00:42:43.782939 | controller | changed 2026-06-12 00:42:43.794088 | 2026-06-12 00:42:43.794260 | TASK [run the operator in standalone mode] 2026-06-12 00:42:43.833244 | controller | ok 2026-06-12 00:42:43.865164 | 2026-06-12 00:42:43.865286 | TASK [run-operator-standalone : Ensure ~/zuul-output/logs] 2026-06-12 00:42:43.892274 | controller | skipping: Conditional result was False 2026-06-12 00:42:43.905762 | 2026-06-12 00:42:43.905974 | TASK [run-operator-standalone : Clear previous log file] 2026-06-12 00:42:43.945352 | controller | skipping: Conditional result was False 2026-06-12 00:42:43.958628 | 2026-06-12 00:42:43.958856 | TASK [run-operator-standalone : Run the operator in standalone mode] 2026-06-11 20:42:44.677695 | controller | 2026-06-11T20:42:44-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:42:44.677837 | controller | 2026-06-11 20:42:44.689734 | controller | 2026-06-11T20:42:44-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:42:44.689780 | controller | 2026-06-11 20:42:44.705563 | controller | 2026-06-11T20:42:44-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:42:45.319833 | controller | 2026-06-11T20:42:45-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:42:45.440150 | controller | 2026-06-11T20:42:45-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:42:45.447474 | controller | 2026-06-11T20:42:45-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:42:45.447549 | controller | 2026-06-11T20:42:45-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:42:45.467321 | controller | 2026-06-11T20:42:45-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:42:45.467423 | controller | 2026-06-11T20:42:45-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:42:45.728254 | controller | 2026-06-11T20:42:45-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:42:46.127509 | controller | 2026-06-11T20:42:46-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:42:46.127601 | controller | 2026-06-11T20:42:46-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:42:47.105930 | controller | 2026-06-11T20:42:47-04:00 INFO Updating secret, name: zuul-config 2026-06-11 20:42:47.106024 | controller | 2026-06-11T20:42:47-04:00 INFO Updating object, name: zuul-config 2026-06-11 20:42:47.330819 | controller | 2026-06-11T20:42:47-04:00 INFO Statefulset "zuul-scheduler" configuration changed, applying... 2026-06-11 20:42:47.330889 | controller | 2026-06-11T20:42:47-04:00 INFO Updating object, name: zuul-scheduler 2026-06-11 20:42:48.905861 | controller | 2026-06-11T20:42:48-04:00 INFO Statefulset "zuul-web" configuration changed, applying... 2026-06-11 20:42:48.905949 | controller | 2026-06-11T20:42:48-04:00 INFO Updating object, name: zuul-web 2026-06-11 20:42:49.713255 | controller | 2026-06-11T20:42:49-04:00 INFO 2026-06-11 20:42:49.713312 | controller | - Config: Waiting ... 2026-06-11 20:42:49.713323 | controller | - Gateway: OK 2026-06-11 20:42:49.713332 | controller | - GitServer: OK 2026-06-11 20:42:49.713340 | controller | - HoundSearch: OK 2026-06-11 20:42:49.713349 | controller | - LogJuicer: OK 2026-06-11 20:42:49.713357 | controller | - Logserver: OK 2026-06-11 20:42:49.713395 | controller | - MariaDB: OK 2026-06-11 20:42:49.713413 | controller | - NodePoolBuilder: OK 2026-06-11 20:42:49.713426 | controller | - NodePoolLauncher: OK 2026-06-11 20:42:49.713436 | controller | - Zookeeper: OK 2026-06-11 20:42:49.713444 | controller | - Zuul: Waiting ... 2026-06-11 20:42:49.713452 | controller | - |_ Config Secrets: OK 2026-06-11 20:42:49.713460 | controller | - |_ Executor: OK 2026-06-11 20:42:49.713468 | controller | - |_ Merger: OK 2026-06-11 20:42:49.713476 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:42:49.713484 | controller | - |_ Web: Waiting ... 2026-06-11 20:42:49.713492 | controller | 2026-06-11 20:42:49.714113 | controller | 2026-06-11T20:42:49-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-11 20:42:54.721897 | controller | 2026-06-11T20:42:54-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:42:55.344335 | controller | 2026-06-11T20:42:55-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:42:55.344459 | controller | 2026-06-11T20:42:55-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:42:55.365959 | controller | 2026-06-11T20:42:55-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:42:55.366032 | controller | 2026-06-11T20:42:55-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:42:55.742258 | controller | 2026-06-11T20:42:55-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:42:56.142115 | controller | 2026-06-11T20:42:56-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:42:56.142188 | controller | 2026-06-11T20:42:56-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:42:57.146529 | controller | 2026-06-11T20:42:57-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:43:27.272300 | controller | 2026-06-11T20:43:27-04:00 INFO Statefulset "zuul-scheduler" not ready after 30s 2026-06-11 20:43:27.304931 | controller | 2026-06-11T20:43:27-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:43:27.305007 | controller | 2026-06-11T20:43:27-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:43:27.686883 | controller | 2026-06-11T20:43:27-04:00 INFO 2026-06-11 20:43:27.686946 | controller | - Config: Waiting ... 2026-06-11 20:43:27.686956 | controller | - Gateway: OK 2026-06-11 20:43:27.686964 | controller | - GitServer: OK 2026-06-11 20:43:27.686971 | controller | - HoundSearch: OK 2026-06-11 20:43:27.686979 | controller | - LogJuicer: OK 2026-06-11 20:43:27.686986 | controller | - Logserver: OK 2026-06-11 20:43:27.686993 | controller | - MariaDB: OK 2026-06-11 20:43:27.687000 | controller | - NodePoolBuilder: OK 2026-06-11 20:43:27.687007 | controller | - NodePoolLauncher: OK 2026-06-11 20:43:27.687013 | controller | - Zookeeper: OK 2026-06-11 20:43:27.687018 | controller | - Zuul: Waiting ... 2026-06-11 20:43:27.687023 | controller | - |_ Config Secrets: OK 2026-06-11 20:43:27.687029 | controller | - |_ Executor: OK 2026-06-11 20:43:27.687033 | controller | - |_ Merger: OK 2026-06-11 20:43:27.687038 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:43:27.687043 | controller | - |_ Web: Waiting ... 2026-06-11 20:43:27.687049 | controller | 2026-06-11 20:43:27.687061 | controller | 2026-06-11T20:43:27-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-11 20:43:32.693202 | controller | 2026-06-11T20:43:32-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:43:33.319928 | controller | 2026-06-11T20:43:33-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:43:33.320056 | controller | 2026-06-11T20:43:33-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:43:33.340926 | controller | 2026-06-11T20:43:33-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:43:33.340977 | controller | 2026-06-11T20:43:33-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:43:33.710442 | controller | 2026-06-11T20:43:33-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:43:34.121035 | controller | 2026-06-11T20:43:34-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:43:34.121317 | controller | 2026-06-11T20:43:34-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:43:35.119898 | controller | 2026-06-11T20:43:35-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:43:51.194968 | controller | 2026-06-11T20:43:51-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:43:51.195054 | controller | 2026-06-11T20:43:51-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:43:51.225940 | controller | 2026-06-11T20:43:51-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:43:51.225983 | controller | 2026-06-11T20:43:51-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:43:52.014053 | controller | 2026-06-11T20:43:52-04:00 INFO 2026-06-11 20:43:52.014107 | controller | - Config: OK 2026-06-11 20:43:52.014117 | controller | - Gateway: OK 2026-06-11 20:43:52.014126 | controller | - GitServer: OK 2026-06-11 20:43:52.014134 | controller | - HoundSearch: OK 2026-06-11 20:43:52.014142 | controller | - LogJuicer: OK 2026-06-11 20:43:52.014150 | controller | - Logserver: OK 2026-06-11 20:43:52.014157 | controller | - MariaDB: OK 2026-06-11 20:43:52.014165 | controller | - NodePoolBuilder: OK 2026-06-11 20:43:52.014173 | controller | - NodePoolLauncher: OK 2026-06-11 20:43:52.014181 | controller | - Zookeeper: OK 2026-06-11 20:43:52.014189 | controller | - Zuul: OK 2026-06-11 20:43:52.014198 | controller | 2026-06-11 20:43:52.014207 | controller | 2026-06-11T20:43:52-04:00 INFO Updating controller configmap ... 2026-06-11 20:43:52.400598 | controller | 2026-06-11T20:43:52-04:00 INFO Standalone reconcile done. 2026-06-12 00:43:52.594492 | controller | ok: Runtime: 0:01:08.155030 2026-06-12 00:43:52.606557 | 2026-06-12 00:43:52.606697 | TASK [run-operator-standalone : Copy current spec] 2026-06-12 00:43:53.147630 | controller | skipping: Conditional result was False 2026-06-12 00:43:53.173215 | 2026-06-12 00:43:53.173400 | TASK [health-check/zuul-authenticators : Wait for the new authenticator to appear in the Zuul API] 2026-06-12 00:43:53.809535 | controller | ok: OK (589 bytes) 2026-06-12 00:43:53.814246 | 2026-06-12 00:43:53.814309 | TASK [Remove the test authenticator from the spec] 2026-06-12 00:43:53.835413 | controller | ok 2026-06-12 00:43:53.861166 | 2026-06-12 00:43:53.861266 | TASK [update-custom-resource : read current crd] 2026-06-12 00:43:54.069136 | controller | ok 2026-06-12 00:43:54.080579 | 2026-06-12 00:43:54.080713 | TASK [update-custom-resource : merge the new cr] 2026-06-12 00:43:54.859928 | controller | changed 2026-06-12 00:43:54.870246 | 2026-06-12 00:43:54.870387 | TASK [run the operator in standalone mode] 2026-06-12 00:43:54.907551 | controller | ok 2026-06-12 00:43:54.940244 | 2026-06-12 00:43:54.940366 | TASK [run-operator-standalone : Ensure ~/zuul-output/logs] 2026-06-12 00:43:54.966533 | controller | skipping: Conditional result was False 2026-06-12 00:43:54.974681 | 2026-06-12 00:43:54.974774 | TASK [run-operator-standalone : Clear previous log file] 2026-06-12 00:43:55.000847 | controller | skipping: Conditional result was False 2026-06-12 00:43:55.011644 | 2026-06-12 00:43:55.011748 | TASK [run-operator-standalone : Run the operator in standalone mode] 2026-06-11 20:43:55.659073 | controller | 2026-06-11T20:43:55-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:43:55.659169 | controller | 2026-06-11 20:43:55.674089 | controller | 2026-06-11T20:43:55-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:43:55.674129 | controller | 2026-06-11 20:43:55.686649 | controller | 2026-06-11T20:43:55-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:43:56.302788 | controller | 2026-06-11T20:43:56-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:43:56.440702 | controller | 2026-06-11T20:43:56-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:43:56.448970 | controller | 2026-06-11T20:43:56-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:43:56.449214 | controller | 2026-06-11T20:43:56-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:43:56.469578 | controller | 2026-06-11T20:43:56-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:43:56.469645 | controller | 2026-06-11T20:43:56-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:43:56.707220 | controller | 2026-06-11T20:43:56-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:43:57.109457 | controller | 2026-06-11T20:43:57-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:43:57.109554 | controller | 2026-06-11T20:43:57-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:43:58.086124 | controller | 2026-06-11T20:43:58-04:00 INFO Updating secret, name: zuul-config 2026-06-11 20:43:58.086201 | controller | 2026-06-11T20:43:58-04:00 INFO Updating object, name: zuul-config 2026-06-11 20:43:58.311900 | controller | 2026-06-11T20:43:58-04:00 INFO Statefulset "zuul-scheduler" configuration changed, applying... 2026-06-11 20:43:58.311991 | controller | 2026-06-11T20:43:58-04:00 INFO Updating object, name: zuul-scheduler 2026-06-11 20:43:59.885244 | controller | 2026-06-11T20:43:59-04:00 INFO Statefulset "zuul-web" configuration changed, applying... 2026-06-11 20:43:59.885313 | controller | 2026-06-11T20:43:59-04:00 INFO Updating object, name: zuul-web 2026-06-11 20:44:00.696044 | controller | 2026-06-11T20:44:00-04:00 INFO 2026-06-11 20:44:00.696122 | controller | - Config: Waiting ... 2026-06-11 20:44:00.696135 | controller | - Gateway: OK 2026-06-11 20:44:00.696146 | controller | - GitServer: OK 2026-06-11 20:44:00.696155 | controller | - HoundSearch: OK 2026-06-11 20:44:00.696164 | controller | - LogJuicer: OK 2026-06-11 20:44:00.696172 | controller | - Logserver: OK 2026-06-11 20:44:00.696181 | controller | - MariaDB: OK 2026-06-11 20:44:00.696190 | controller | - NodePoolBuilder: OK 2026-06-11 20:44:00.696198 | controller | - NodePoolLauncher: OK 2026-06-11 20:44:00.696207 | controller | - Zookeeper: OK 2026-06-11 20:44:00.696216 | controller | - Zuul: Waiting ... 2026-06-11 20:44:00.696224 | controller | - |_ Config Secrets: OK 2026-06-11 20:44:00.696233 | controller | - |_ Executor: OK 2026-06-11 20:44:00.696242 | controller | - |_ Merger: OK 2026-06-11 20:44:00.696251 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:44:00.696259 | controller | - |_ Web: Waiting ... 2026-06-11 20:44:00.696268 | controller | 2026-06-11 20:44:00.696286 | controller | 2026-06-11T20:44:00-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-11 20:44:05.705656 | controller | 2026-06-11T20:44:05-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:44:06.324865 | controller | 2026-06-11T20:44:06-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:44:06.324943 | controller | 2026-06-11T20:44:06-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:44:06.348764 | controller | 2026-06-11T20:44:06-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:44:06.348836 | controller | 2026-06-11T20:44:06-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:44:06.727174 | controller | 2026-06-11T20:44:06-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:44:07.122326 | controller | 2026-06-11T20:44:07-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:44:07.122442 | controller | 2026-06-11T20:44:07-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:44:08.131664 | controller | 2026-06-11T20:44:08-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:44:38.252933 | controller | 2026-06-11T20:44:38-04:00 INFO Statefulset "zuul-scheduler" not ready after 30s 2026-06-11 20:44:38.295535 | controller | 2026-06-11T20:44:38-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:44:38.295623 | controller | 2026-06-11T20:44:38-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 20:44:38.669746 | controller | 2026-06-11T20:44:38-04:00 INFO 2026-06-11 20:44:38.669821 | controller | - Config: Waiting ... 2026-06-11 20:44:38.669832 | controller | - Gateway: OK 2026-06-11 20:44:38.669840 | controller | - GitServer: OK 2026-06-11 20:44:38.669848 | controller | - HoundSearch: OK 2026-06-11 20:44:38.669856 | controller | - LogJuicer: OK 2026-06-11 20:44:38.669864 | controller | - Logserver: OK 2026-06-11 20:44:38.669872 | controller | - MariaDB: OK 2026-06-11 20:44:38.669879 | controller | - NodePoolBuilder: OK 2026-06-11 20:44:38.669887 | controller | - NodePoolLauncher: OK 2026-06-11 20:44:38.669895 | controller | - Zookeeper: OK 2026-06-11 20:44:38.669903 | controller | - Zuul: Waiting ... 2026-06-11 20:44:38.669910 | controller | - |_ Config Secrets: OK 2026-06-11 20:44:38.669918 | controller | - |_ Executor: OK 2026-06-11 20:44:38.669926 | controller | - |_ Merger: OK 2026-06-11 20:44:38.669934 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:44:38.669941 | controller | - |_ Web: Waiting ... 2026-06-11 20:44:38.669950 | controller | 2026-06-11 20:44:38.669966 | controller | 2026-06-11T20:44:38-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-11 20:44:43.679952 | controller | 2026-06-11T20:44:43-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:44:44.299210 | controller | 2026-06-11T20:44:44-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:44:44.299296 | controller | 2026-06-11T20:44:44-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:44:44.332641 | controller | 2026-06-11T20:44:44-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:44:44.332733 | controller | 2026-06-11T20:44:44-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:44:44.697266 | controller | 2026-06-11T20:44:44-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:44:45.094727 | controller | 2026-06-11T20:44:45-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:44:45.094791 | controller | 2026-06-11T20:44:45-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:44:46.111572 | controller | 2026-06-11T20:44:46-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:45:04.196179 | controller | 2026-06-11T20:45:04-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:45:04.196272 | controller | 2026-06-11T20:45:04-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:45:04.233218 | controller | 2026-06-11T20:45:04-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:45:04.233315 | controller | 2026-06-11T20:45:04-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:45:05.017133 | controller | 2026-06-11T20:45:05-04:00 INFO 2026-06-11 20:45:05.017189 | controller | - Config: OK 2026-06-11 20:45:05.017199 | controller | - Gateway: OK 2026-06-11 20:45:05.017208 | controller | - GitServer: OK 2026-06-11 20:45:05.017217 | controller | - HoundSearch: OK 2026-06-11 20:45:05.017225 | controller | - LogJuicer: OK 2026-06-11 20:45:05.017232 | controller | - Logserver: OK 2026-06-11 20:45:05.017240 | controller | - MariaDB: OK 2026-06-11 20:45:05.017248 | controller | - NodePoolBuilder: OK 2026-06-11 20:45:05.017256 | controller | - NodePoolLauncher: OK 2026-06-11 20:45:05.017264 | controller | - Zookeeper: OK 2026-06-11 20:45:05.017272 | controller | - Zuul: OK 2026-06-11 20:45:05.017280 | controller | 2026-06-11 20:45:05.017289 | controller | 2026-06-11T20:45:05-04:00 INFO Updating controller configmap ... 2026-06-11 20:45:05.401874 | controller | 2026-06-11T20:45:05-04:00 INFO Standalone reconcile done. 2026-06-12 00:45:05.630172 | controller | ok: Runtime: 0:01:10.110133 2026-06-12 00:45:05.640901 | 2026-06-12 00:45:05.641037 | TASK [run-operator-standalone : Copy current spec] 2026-06-12 00:45:06.179831 | controller | skipping: Conditional result was False 2026-06-12 00:45:06.197318 | 2026-06-12 00:45:06.197455 | TASK [health-check/zuul-authenticators : Wait for the test authenticator to be delisted] 2026-06-12 00:45:06.728754 | controller | ok: OK (388 bytes) 2026-06-12 00:45:06.747232 | 2026-06-12 00:45:06.747416 | TASK [ansible.builtin.include_role : health-check/check-zuul-tenant] 2026-06-12 00:45:06.782808 | controller | ok 2026-06-12 00:45:06.816965 | 2026-06-12 00:45:06.817080 | TASK [health-check/check-zuul-tenant : Get configuration errors/warnings into the internal tenant] 2026-06-12 00:45:07.367393 | controller | ok: OK (2 bytes) 2026-06-12 00:45:07.378813 | 2026-06-12 00:45:07.378954 | TASK [health-check/check-zuul-tenant : Fail when errors/warnings into the internal tenant] 2026-06-12 00:45:07.416759 | controller | skipping: Conditional result was False 2026-06-12 00:45:07.437646 | 2026-06-12 00:45:07.437903 | TASK [health-check/config-update-zuul : Set random value] 2026-06-12 00:45:07.537728 | controller | ok 2026-06-12 00:45:07.547803 | 2026-06-12 00:45:07.547987 | TASK [health-check/config-update-zuul : Create vars to generate and submit resources addition] 2026-06-12 00:45:07.587116 | controller | ok 2026-06-12 00:45:07.595516 | 2026-06-12 00:45:07.595651 | TASK [ansible.builtin.include_role : create-gerrit-repository] 2026-06-12 00:45:07.623941 | controller | ok 2026-06-12 00:45:07.655778 | 2026-06-12 00:45:07.655949 | TASK [create-gerrit-repository : Create gerrit repository named ichiban-config-Z5F8jidd] 2026-06-11 20:45:09.656531 | controller | 2026-06-12 00:45:09,655 INFO managesf.model.yamlbkd.engine - Resource engine is using /tmp/direct-apply as workdir 2026-06-11 20:45:09.656727 | controller | 2026-06-12 00:45:09,655 INFO managesf.model.yamlbkd.engine - Resources engine: direct apply resources requested 2026-06-11 20:45:09.681403 | controller | 2026-06-12 00:45:09,680 INFO managesf.GerritClient - ichiban-config-Z5F8jidd-core: creating group (Team core for the ichiban-config-Z5F8jidd repo) 2026-06-11 20:45:09.762766 | controller | 2026-06-12 00:45:09,761 INFO managesf.GerritClient - ichiban-config-Z5F8jidd-core: deleting group member admin 2026-06-11 20:45:09.839859 | controller | 2026-06-12 00:45:09,838 INFO managesf.GerritClient - ichiban-config-Z5F8jidd-ptl: creating group (Team lead for the ichiban-config-Z5F8jidd repo) 2026-06-11 20:45:09.968089 | controller | 2026-06-12 00:45:09,967 INFO managesf.GerritClient - ichiban-config-Z5F8jidd-ptl: deleting group member admin 2026-06-11 20:45:10.139588 | controller | 2026-06-12 00:45:10,138 INFO managesf.GerritClient - ichiban-config-Z5F8jidd-ptl: adding group member admin@sfop.me 2026-06-11 20:45:10.236108 | controller | 2026-06-12 00:45:10,235 INFO managesf.GerritClient - ichiban-config-Z5F8jidd: creating project (ichiban-config-Z5F8jidd repository) 2026-06-11 20:45:10.354039 | controller | 2026-06-12 00:45:10,353 INFO managesf.services.gerrit.utils - [gerrit] Clone repository ichiban-config-Z5F8jidd 2026-06-11 20:45:10.582989 | controller | 2026-06-12 00:45:10,581 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'clone', 'ssh://admin@gerrit-sshd:29418/ichiban-config-Z5F8jidd', '/tmp/tmp08x1_vzu/clone-ichiban-config-Z5F8jidd'] output 2026-06-11 20:45:10.583047 | controller | 2026-06-12 00:45:10,581 INFO managesf.services.gerrit.utils - Cloning into '/tmp/tmp08x1_vzu/clone-ichiban-config-Z5F8jidd'... 2026-06-11 20:45:10.583058 | controller | Warning: Permanently added '[gerrit-sshd]:29418' (ED25519) to the list of known hosts. 2026-06-11 20:45:10.583067 | controller | Total 2 (delta 0), reused 0 (delta 0) 2026-06-11 20:45:10.583076 | controller | 2026-06-11 20:45:10.832127 | controller | 2026-06-12 00:45:10,831 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'fetch', '-a'] output 2026-06-11 20:45:10.832208 | controller | 2026-06-12 00:45:10,831 INFO managesf.services.gerrit.utils - 2026-06-11 20:45:10.895746 | controller | 2026-06-12 00:45:10,895 INFO managesf.services.gerrit.utils - [gerrit] Prepare push on config for repository ichiban-config-Z5F8jidd 2026-06-11 20:45:11.092348 | controller | 2026-06-12 00:45:11,091 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'fetch', 'origin', 'refs/meta/config:refs/remotes/origin/meta/config'] output 2026-06-11 20:45:11.092447 | controller | 2026-06-12 00:45:11,091 INFO managesf.services.gerrit.utils - Total 4 (delta 0), reused 0 (delta 0) 2026-06-11 20:45:11.092462 | controller | From ssh://gerrit-sshd:29418/ichiban-config-Z5F8jidd 2026-06-11 20:45:11.092483 | controller | * [new ref] refs/meta/config -> origin/meta/config 2026-06-11 20:45:11.092492 | controller | 2026-06-11 20:45:11.103788 | controller | 2026-06-12 00:45:11,103 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'checkout', 'meta/config'] output 2026-06-11 20:45:11.103837 | controller | 2026-06-12 00:45:11,103 INFO managesf.services.gerrit.utils - Switched to a new branch 'meta/config' 2026-06-11 20:45:11.103850 | controller | branch 'meta/config' set up to track 'origin/meta/config'. 2026-06-11 20:45:11.103861 | controller | 2026-06-11 20:45:11.103872 | controller | 2026-06-12 00:45:11,103 INFO managesf.services.gerrit.utils - [gerrit] Add file project.config to index 2026-06-11 20:45:11.112977 | controller | 2026-06-12 00:45:11,112 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'add', 'project.config'] output 2026-06-11 20:45:11.113019 | controller | 2026-06-12 00:45:11,112 INFO managesf.services.gerrit.utils - 2026-06-11 20:45:11.113031 | controller | 2026-06-12 00:45:11,112 INFO managesf.services.gerrit.utils - [gerrit] Add file groups to index 2026-06-11 20:45:11.121725 | controller | 2026-06-12 00:45:11,120 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'add', 'groups'] output 2026-06-11 20:45:11.121762 | controller | 2026-06-12 00:45:11,121 INFO managesf.services.gerrit.utils - 2026-06-11 20:45:11.140561 | controller | 2026-06-12 00:45:11,139 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'status', '-s'] output 2026-06-11 20:45:11.140671 | controller | 2026-06-12 00:45:11,139 INFO managesf.services.gerrit.utils - M groups 2026-06-11 20:45:11.140682 | controller | M project.config 2026-06-11 20:45:11.140692 | controller | 2026-06-11 20:45:11.154475 | controller | 2026-06-12 00:45:11,153 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'commit', '-a', '--author', 'admin ', '-mProvides ACL and Groups'] output 2026-06-11 20:45:11.154523 | controller | 2026-06-12 00:45:11,153 INFO managesf.services.gerrit.utils - [meta/config 91c3af3] Provides ACL and Groups 2026-06-11 20:45:11.154535 | controller | 2 files changed, 31 insertions(+), 9 deletions(-) 2026-06-11 20:45:11.154544 | controller | 2026-06-11 20:45:11.537262 | controller | 2026-06-12 00:45:11,536 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'push', 'origin', 'meta/config:meta/config'] output 2026-06-11 20:45:11.537336 | controller | 2026-06-12 00:45:11,536 INFO managesf.services.gerrit.utils - remote: remote: Processing changes: refs: 1 remote: Processing changes: refs: 1, done 2026-06-11 20:45:11.537353 | controller | To ssh://gerrit-sshd:29418/ichiban-config-Z5F8jidd 2026-06-11 20:45:11.537401 | controller | b4a09b4..91c3af3 meta/config -> refs/meta/config 2026-06-11 20:45:11.537424 | controller | 2026-06-11 20:45:11.537439 | controller | 2026-06-12 00:45:11,536 INFO managesf.services.gerrit.utils - [gerrit] Push on config for repository ichiban-config-Z5F8jidd 2026-06-11 20:45:11.537451 | controller | 2026-06-12 00:45:11,536 INFO managesf.services.gerrit.utils - [gerrit] Prepare push on master for repository ichiban-config-Z5F8jidd 2026-06-11 20:45:11.546852 | controller | 2026-06-12 00:45:11,545 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'checkout', 'master'] output 2026-06-11 20:45:11.546916 | controller | 2026-06-12 00:45:11,546 INFO managesf.services.gerrit.utils - Switched to branch 'master' 2026-06-11 20:45:11.546932 | controller | Your branch is up to date with 'origin/master'. 2026-06-11 20:45:11.546945 | controller | 2026-06-11 20:45:11.555819 | controller | 2026-06-12 00:45:11,554 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'reset', '--hard', 'origin/master'] output 2026-06-11 20:45:11.556262 | controller | 2026-06-12 00:45:11,555 INFO managesf.services.gerrit.utils - HEAD is now at 016e6ca Initial empty repository 2026-06-11 20:45:11.556286 | controller | 2026-06-11 20:45:11.556300 | controller | 2026-06-12 00:45:11,555 INFO managesf.services.gerrit.utils - [gerrit] Add file .gitreview to index 2026-06-11 20:45:11.564196 | controller | 2026-06-12 00:45:11,563 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'add', '.gitreview'] output 2026-06-11 20:45:11.564250 | controller | 2026-06-12 00:45:11,563 INFO managesf.services.gerrit.utils - 2026-06-11 20:45:11.571611 | controller | 2026-06-12 00:45:11,570 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'status', '-s'] output 2026-06-11 20:45:11.571750 | controller | 2026-06-12 00:45:11,570 INFO managesf.services.gerrit.utils - A .gitreview 2026-06-11 20:45:11.571767 | controller | 2026-06-11 20:45:11.586195 | controller | 2026-06-12 00:45:11,585 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'commit', '-a', '--author', 'admin ', '-mManageSF commit'] output 2026-06-11 20:45:11.586255 | controller | 2026-06-12 00:45:11,585 INFO managesf.services.gerrit.utils - [master 3982ce1] ManageSF commit 2026-06-11 20:45:11.586265 | controller | 1 file changed, 5 insertions(+) 2026-06-11 20:45:11.586275 | controller | create mode 100644 .gitreview 2026-06-11 20:45:11.586284 | controller | 2026-06-11 20:45:11.928799 | controller | 2026-06-12 00:45:11,928 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'push', 'origin', 'master'] output 2026-06-11 20:45:11.928855 | controller | 2026-06-12 00:45:11,928 INFO managesf.services.gerrit.utils - remote: remote: Processing changes: refs: 1 remote: Processing changes: refs: 1, done 2026-06-11 20:45:11.928860 | controller | To ssh://gerrit-sshd:29418/ichiban-config-Z5F8jidd 2026-06-11 20:45:11.928865 | controller | 016e6ca..3982ce1 master -> master 2026-06-11 20:45:11.928870 | controller | 2026-06-11 20:45:11.928874 | controller | 2026-06-12 00:45:11,928 INFO managesf.services.gerrit.utils - [gerrit] Push on master for repository ichiban-config-Z5F8jidd 2026-06-11 20:45:11.928880 | controller | 2026-06-12 00:45:11,928 INFO managesf.services.gerrit.utils - [gerrit] List remote branches 2026-06-11 20:45:11.934505 | controller | 2026-06-12 00:45:11,933 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'branch', '-rv', '--abbrev=40'] output 2026-06-11 20:45:11.934539 | controller | 2026-06-12 00:45:11,933 INFO managesf.services.gerrit.utils - origin/HEAD -> origin/master 2026-06-11 20:45:11.934544 | controller | origin/master 3982ce16193ed11578aaa1881dcaae47fc626443 ManageSF commit 2026-06-11 20:45:11.934548 | controller | origin/meta/config b4a09b420c26ea57fb7395b39d7929113721f135 Created project 2026-06-11 20:45:11.934552 | controller | 2026-06-11 20:45:11.934556 | controller | 2026-06-12 00:45:11,934 INFO managesf.model.yamlbkd.engine - Resource [type: groups, ID: ichiban-config-Z5F8jidd-core] is going to be created. 2026-06-11 20:45:11.934560 | controller | 2026-06-12 00:45:11,934 INFO managesf.model.yamlbkd.engine - Resource [type: groups, ID: ichiban-config-Z5F8jidd-ptl] is going to be created. 2026-06-11 20:45:11.934565 | controller | 2026-06-12 00:45:11,934 INFO managesf.model.yamlbkd.engine - Resource [type: acls, ID: ichiban-config-Z5F8jidd-acl] is going to be created. 2026-06-11 20:45:11.934569 | controller | 2026-06-12 00:45:11,934 INFO managesf.model.yamlbkd.engine - Resource [type: repos, ID: ichiban-config-Z5F8jidd] is going to be created. 2026-06-11 20:45:11.934672 | controller | 2026-06-12 00:45:11,934 INFO managesf.model.yamlbkd.engine - Resource [type: groups, ID: ichiban-config-Z5F8jidd-core] will be created. 2026-06-11 20:45:11.934677 | controller | 2026-06-12 00:45:11,934 INFO managesf.model.yamlbkd.engine - Resource [type: groups, ID: ichiban-config-Z5F8jidd-core] has been created. 2026-06-11 20:45:11.934805 | controller | 2026-06-12 00:45:11,934 INFO managesf.model.yamlbkd.engine - Resource [type: groups, ID: ichiban-config-Z5F8jidd-ptl] will be created. 2026-06-11 20:45:11.934827 | controller | 2026-06-12 00:45:11,934 INFO managesf.model.yamlbkd.engine - Resource [type: groups, ID: ichiban-config-Z5F8jidd-ptl] has been created. 2026-06-11 20:45:11.934867 | controller | 2026-06-12 00:45:11,934 INFO managesf.model.yamlbkd.engine - Resource [type: acls, ID: ichiban-config-Z5F8jidd-acl] will be created. 2026-06-11 20:45:11.934879 | controller | 2026-06-12 00:45:11,934 INFO managesf.model.yamlbkd.engine - Resource [type: acls, ID: ichiban-config-Z5F8jidd-acl] has been created. 2026-06-11 20:45:11.934892 | controller | 2026-06-12 00:45:11,934 INFO managesf.model.yamlbkd.engine - Resource [type: repos, ID: ichiban-config-Z5F8jidd] will be created. 2026-06-11 20:45:11.934897 | controller | 2026-06-12 00:45:11,934 INFO managesf.model.yamlbkd.engine - Resource [type: repos, ID: ichiban-config-Z5F8jidd] has been created. 2026-06-11 20:45:11.935158 | controller | 2026-06-11 20:45:11.935162 | controller | === Resources actions === 2026-06-11 20:45:11.935166 | controller | 2026-06-11 20:45:11.935170 | controller | Resource [type: groups, ID: ichiban-config-Z5F8jidd-core] is going to be created. 2026-06-11 20:45:11.935173 | controller | Resource [type: groups, ID: ichiban-config-Z5F8jidd-ptl] is going to be created. 2026-06-11 20:45:11.935177 | controller | Resource [type: acls, ID: ichiban-config-Z5F8jidd-acl] is going to be created. 2026-06-11 20:45:11.935181 | controller | Resource [type: repos, ID: ichiban-config-Z5F8jidd] is going to be created. 2026-06-11 20:45:11.935184 | controller | Resource [type: groups, ID: ichiban-config-Z5F8jidd-core] will be created. 2026-06-11 20:45:11.935188 | controller | Resource [type: groups, ID: ichiban-config-Z5F8jidd-core] has been created. 2026-06-11 20:45:11.935191 | controller | Resource [type: groups, ID: ichiban-config-Z5F8jidd-ptl] will be created. 2026-06-11 20:45:11.935195 | controller | Resource [type: groups, ID: ichiban-config-Z5F8jidd-ptl] has been created. 2026-06-11 20:45:11.935199 | controller | Resource [type: acls, ID: ichiban-config-Z5F8jidd-acl] will be created. 2026-06-11 20:45:11.935207 | controller | Resource [type: acls, ID: ichiban-config-Z5F8jidd-acl] has been created. 2026-06-11 20:45:11.935211 | controller | Resource [type: repos, ID: ichiban-config-Z5F8jidd] will be created. 2026-06-11 20:45:11.935214 | controller | Resource [type: repos, ID: ichiban-config-Z5F8jidd] has been created. 2026-06-12 00:45:12.210857 | controller | ok: Runtime: 0:00:04.229594 2026-06-12 00:45:12.222477 | 2026-06-12 00:45:12.222710 | TASK [create-gerrit-repository : Ensure repository exists in Gerrit] 2026-06-12 00:45:12.756231 | controller | ok: OK (752 bytes) 2026-06-12 00:45:12.776067 | 2026-06-12 00:45:12.776290 | TASK [health-check/config-update-zuul : Set bad Zuul tenant config] 2026-06-12 00:45:13.277991 | controller | changed: Block inserted 2026-06-12 00:45:13.287226 | 2026-06-12 00:45:13.287369 | LOOP [health-check/config-update-zuul : Commit file in the config repo] 2026-06-12 00:45:13.592885 | controller | ok: Item: git add zuul/main.yaml Runtime: 0:00:00.009724 2026-06-12 00:45:13.593342 | controller | ok: All items complete 2026-06-12 00:45:13.593399 | 2026-06-12 00:45:13.842259 | controller | [master 590acff] Add zuul/main.yaml 2026-06-12 00:45:13.842477 | controller | 1 file changed, 5 insertions(+) 2026-06-12 00:45:13.842567 | controller | ok: Item: git commit -m 'Add zuul/main.yaml' Runtime: 0:00:00.013352 2026-06-12 00:45:13.860948 | 2026-06-12 00:45:13.861092 | TASK [ansible.builtin.include_role : health-check/repo-submit-change] 2026-06-12 00:45:13.896988 | controller | ok 2026-06-12 00:45:13.941397 | 2026-06-12 00:45:13.941569 | TASK [health-check/repo-submit-change : Submit change] 2026-06-12 00:45:13.962142 | controller | ok 2026-06-12 00:45:13.971984 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/submit-change.yaml 2026-06-12 00:45:13.979350 | 2026-06-12 00:45:13.979451 | TASK [health-check/repo-submit-change : Submit change] 2026-06-11 20:45:15.872065 | controller | Your change was committed before the commit hook was installed. 2026-06-11 20:45:15.872154 | controller | Amending the commit to add a gerrit change id. 2026-06-11 20:45:15.872168 | controller | remote: 2026-06-11 20:45:15.872178 | controller | remote: Processing changes: new: 1 (\) 2026-06-11 20:45:15.872189 | controller | remote: Processing changes: new: 1 (|) 2026-06-11 20:45:15.872198 | controller | remote: Processing changes: refs: 1, new: 1 (|) 2026-06-11 20:45:15.872210 | controller | remote: Processing changes: refs: 1, new: 1 (|) 2026-06-11 20:45:15.872218 | controller | remote: Processing changes: refs: 1, new: 1 (|) 2026-06-11 20:45:15.872227 | controller | remote: Processing changes: refs: 1, new: 1, done 2026-06-11 20:45:15.872237 | controller | remote: 2026-06-11 20:45:15.872256 | controller | remote: SUCCESS 2026-06-11 20:45:15.872264 | controller | remote: 2026-06-11 20:45:15.872273 | controller | remote: https://gerrit.sfop.me/c/config/+/1 Add zuul/main.yaml [NEW] 2026-06-11 20:45:15.872281 | controller | remote: 2026-06-11 20:45:15.872289 | controller | To https://gerrit.sfop.me/a/config 2026-06-11 20:45:15.872297 | controller | * [new reference] HEAD -> refs/for/master 2026-06-12 00:45:16.091778 | controller | ok: Runtime: 0:00:01.656545 2026-06-12 00:45:16.096199 | 2026-06-12 00:45:16.096261 | TASK [health-check/repo-submit-change : Get Change-id] 2026-06-11 20:45:16.330588 | controller | I13a91b05589d466b405335a603329c405e77539c 2026-06-12 00:45:16.624583 | controller | ok: Runtime: 0:00:00.009102 2026-06-12 00:45:16.634998 | 2026-06-12 00:45:16.635150 | TASK [health-check/repo-submit-change : Set Code-Review and Workflow label using gerrit API] 2026-06-12 00:45:17.545590 | controller | ok: OK (47 bytes) 2026-06-12 00:45:17.558734 | 2026-06-12 00:45:17.558913 | TASK [health-check/repo-submit-change : Ensure a failure for config-check job] 2026-06-12 00:45:17.598935 | controller | ok 2026-06-12 00:45:17.615112 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/ensure-job-failure.yaml 2026-06-12 00:45:17.630348 | 2026-06-12 00:45:17.630470 | TASK [health-check/repo-submit-change : Get review ID from the changeID using gerrit API] 2026-06-12 00:45:18.221768 | controller | ok: OK (7142 bytes) 2026-06-12 00:45:18.236519 | 2026-06-12 00:45:18.236798 | TASK [health-check/repo-submit-change : ansible.builtin.set_fact] 2026-06-12 00:45:18.298271 | controller | ok 2026-06-12 00:45:18.316687 | 2026-06-12 00:45:18.316844 | TASK [health-check/repo-submit-change : Wait config-check FAILURE result using zuul-web API] 2026-06-12 00:46:33.346090 | controller | ok: OK (1162 bytes) 2026-06-12 00:46:33.353004 | 2026-06-12 00:46:33.353082 | TASK [health-check/repo-submit-change : Verify Zuul Console output] 2026-06-12 00:46:33.388379 | controller | skipping: Conditional result was False 2026-06-12 00:46:33.395014 | 2026-06-12 00:46:33.395126 | TASK [health-check/repo-submit-change : Ensure a success for config-update post job] 2026-06-12 00:46:33.419582 | controller | skipping: Conditional result was False 2026-06-12 00:46:33.427650 | 2026-06-12 00:46:33.427758 | TASK [health-check/repo-submit-change : Ensure a success for config-update job] 2026-06-12 00:46:33.452849 | controller | skipping: Conditional result was False 2026-06-12 00:46:33.465588 | 2026-06-12 00:46:33.465710 | TASK [health-check/config-update-zuul : Set Zuul tenant config] 2026-06-12 00:46:33.733375 | controller | changed: Block inserted 2026-06-12 00:46:33.742500 | 2026-06-12 00:46:33.742675 | LOOP [health-check/config-update-zuul : Commit file in the config repo] 2026-06-12 00:46:34.051539 | controller | ok: Item: git add zuul/main.yaml Runtime: 0:00:00.007305 2026-06-12 00:46:34.353402 | controller | [master 655a40a] Add zuul/main.yaml 2026-06-12 00:46:34.353634 | controller | Date: Thu Jun 11 20:45:13 2026 -0400 2026-06-12 00:46:34.353687 | controller | 1 file changed, 8 insertions(+) 2026-06-12 00:46:34.353743 | controller | ok: Item: git commit --amend --no-edit Runtime: 0:00:00.056093 2026-06-12 00:46:34.372555 | 2026-06-12 00:46:34.372789 | TASK [Submit change and verify Zuul console output] 2026-06-12 00:46:34.409009 | controller | ok 2026-06-12 00:46:34.454738 | 2026-06-12 00:46:34.454926 | TASK [health-check/repo-submit-change : Submit change] 2026-06-12 00:46:34.487367 | controller | ok 2026-06-12 00:46:34.500877 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/submit-change.yaml 2026-06-12 00:46:34.510318 | 2026-06-12 00:46:34.510415 | TASK [health-check/repo-submit-change : Submit change] 2026-06-11 20:46:35.558110 | controller | remote: 2026-06-11 20:46:35.558218 | controller | remote: Processing changes: refs: 1, updated: 1 2026-06-11 20:46:35.558230 | controller | remote: Processing changes: refs: 1, updated: 1 2026-06-11 20:46:35.558239 | controller | remote: Processing changes: refs: 1, updated: 1 2026-06-11 20:46:35.558252 | controller | remote: Processing changes: refs: 1, updated: 1, done 2026-06-11 20:46:35.558263 | controller | remote: 2026-06-11 20:46:35.558271 | controller | remote: SUCCESS 2026-06-11 20:46:35.558280 | controller | remote: 2026-06-11 20:46:35.558289 | controller | remote: https://gerrit.sfop.me/c/config/+/1 Add zuul/main.yaml 2026-06-11 20:46:35.558297 | controller | remote: 2026-06-11 20:46:35.558306 | controller | To https://gerrit.sfop.me/a/config 2026-06-11 20:46:35.558316 | controller | * [new reference] HEAD -> refs/for/master 2026-06-12 00:46:36.048279 | controller | ok: Runtime: 0:00:00.786759 2026-06-12 00:46:36.058327 | 2026-06-12 00:46:36.058501 | TASK [health-check/repo-submit-change : Get Change-id] 2026-06-11 20:46:36.378426 | controller | I13a91b05589d466b405335a603329c405e77539c 2026-06-12 00:46:36.606961 | controller | ok: Runtime: 0:00:00.009596 2026-06-12 00:46:36.616477 | 2026-06-12 00:46:36.616660 | TASK [health-check/repo-submit-change : Set Code-Review and Workflow label using gerrit API] 2026-06-12 00:46:37.261283 | controller | ok: OK (47 bytes) 2026-06-12 00:46:37.275308 | 2026-06-12 00:46:37.275503 | TASK [health-check/repo-submit-change : Ensure a failure for config-check job] 2026-06-12 00:46:37.303000 | controller | skipping: Conditional result was False 2026-06-12 00:46:37.314745 | 2026-06-12 00:46:37.314893 | TASK [health-check/repo-submit-change : Verify Zuul Console output] 2026-06-12 00:46:37.346897 | controller | ok 2026-06-12 00:46:37.353321 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/ensure-zuul-console-success.yaml 2026-06-12 00:46:37.361905 | 2026-06-12 00:46:37.361997 | TASK [health-check/repo-submit-change : Wait for config-update job] 2026-06-11 20:46:37.776986 | controller | jq: error (at :0): Cannot iterate over null (null) 2026-06-12 00:47:49.925727 | controller | ok: Runtime: 0:00:00.070322 2026-06-12 00:47:49.936090 | 2026-06-12 00:47:49.936258 | TASK [health-check/repo-submit-change : Connect and validate console stream] 2026-06-11 20:47:50.341953 | controller | 2026-06-12 00:47:43.358974 | Job console starting 2026-06-11 20:47:50.342050 | controller | 2026-06-12 00:47:43.359548 | Updating git repos 2026-06-11 20:47:50.342063 | controller | 2026-06-12 00:47:43.434473 | Cloning repos into workspace 2026-06-11 20:47:50.342075 | controller | 2026-06-12 00:47:44.282735 | Restoring repo states 2026-06-11 20:47:50.342086 | controller | 2026-06-12 00:47:44.290882 | Merging changes 2026-06-11 20:47:50.342099 | controller | 2026-06-12 00:47:44.290903 | Checking out repos 2026-06-11 20:47:50.342109 | controller | 2026-06-12 00:47:44.357857 | Preparing playbooks 2026-06-11 20:47:50.342119 | controller | 2026-06-12 00:47:44.982676 | Running Ansible setup 2026-06-11 20:47:50.342131 | controller | 2026-06-12 00:47:48.977041 | PRE-RUN START: [trusted : git-server/system-config/playbooks/base/pre.yaml@master] 2026-06-11 20:47:50.342141 | controller | 2026-06-11 20:47:51.342671 | controller | 2026-06-12 00:47:51.059162 | 2026-06-11 20:47:51.342724 | controller | 2026-06-12 00:47:51.059464 | PLAY [localhost] 2026-06-11 20:47:51.342732 | controller | 2026-06-12 00:47:51.075133 | 2026-06-11 20:47:51.342737 | controller | 2026-06-12 00:47:51.075317 | TASK [Gathering Facts] 2026-06-11 20:47:51.342743 | controller | 2026-06-11 20:47:53.344487 | controller | 2026-06-12 00:47:53.261425 | localhost | ok 2026-06-11 20:47:53.344544 | controller | 2026-06-12 00:47:53.277196 | 2026-06-11 20:47:53.344557 | controller | 2026-06-12 00:47:53.277403 | TASK [Setup log path fact] 2026-06-11 20:47:53.344567 | controller | 2026-06-11 20:47:53.844433 | controller | 2026-06-12 00:47:53.352123 | localhost | ok 2026-06-11 20:47:53.844502 | controller | 2026-06-12 00:47:53.374702 | 2026-06-11 20:47:53.844515 | controller | 2026-06-12 00:47:53.374889 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-06-11 20:47:53.844524 | controller | 2026-06-12 00:47:53.458293 | localhost | ok 2026-06-11 20:47:53.844532 | controller | 2026-06-12 00:47:53.470516 | 2026-06-11 20:47:53.844552 | controller | 2026-06-12 00:47:53.470654 | TASK [emit-job-header : Print job information] 2026-06-11 20:47:53.844561 | controller | 2026-06-12 00:47:53.563611 | # Job Information 2026-06-11 20:47:53.844569 | controller | 2026-06-12 00:47:53.563868 | Ansible Version: 2.16.18 2026-06-11 20:47:53.844578 | controller | 2026-06-12 00:47:53.563932 | Job: config-update 2026-06-11 20:47:53.844586 | controller | 2026-06-12 00:47:53.563976 | Pipeline: post 2026-06-11 20:47:53.844594 | controller | 2026-06-12 00:47:53.564015 | Executor: zuul-executor-0.zuul-executor-headless.sf.svc.cluster.local 2026-06-11 20:47:53.844603 | controller | 2026-06-12 00:47:53.564053 | Triggered by: https://gerrit.sfop.me/plugins/gitiles/config/+/655a40a3d7214629ac925bb049792a7ebb7729d5^!/ 2026-06-11 20:47:53.844612 | controller | 2026-06-12 00:47:53.564099 | Log URL (when completed): https://sfop.me/logs/e9b/internal/e9b15d1e12b34adf9a20bd0051f7675e/ 2026-06-11 20:47:53.844620 | controller | 2026-06-12 00:47:53.564138 | Event ID: 02aaeae6ead14beab9c24a9ef1f0da98 2026-06-11 20:47:53.844629 | controller | 2026-06-12 00:47:53.569962 | 2026-06-11 20:47:53.844636 | controller | 2026-06-12 00:47:53.570112 | LOOP [emit-job-header : Print nod 2026-06-11 20:47:53.844654 | controller | e information] 2026-06-11 20:47:53.844663 | controller | 2026-06-12 00:47:53.668927 | 2026-06-11 20:47:53.844671 | controller | 2026-06-12 00:47:53.669295 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-06-11 20:47:53.844680 | controller | 2026-06-12 00:47:55.493101 | controller | ok: Runtime: 0:00:05.026400 2026-06-12 00:47:55.505715 | 2026-06-12 00:47:55.505859 | TASK [health-check/repo-submit-change : Ensure a success for config-update post job] 2026-06-12 00:47:55.550968 | controller | ok 2026-06-12 00:47:55.566579 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/ensure-post-job-success.yaml 2026-06-12 00:47:55.642060 | 2026-06-12 00:47:55.642207 | TASK [health-check/repo-submit-change : Register commit sha] 2026-06-11 20:47:55.896718 | controller | 655a40a3d7214629ac925bb049792a7ebb7729d5 2026-06-12 00:47:56.172142 | controller | ok: Runtime: 0:00:00.008337 2026-06-12 00:47:56.184665 | 2026-06-12 00:47:56.184814 | TASK [health-check/repo-submit-change : Wait config-update SUCCESS result using zuul-web API] 2026-06-12 00:49:42.026790 | controller | ok: OK (1143 bytes) 2026-06-12 00:49:42.039316 | 2026-06-12 00:49:42.039499 | TASK [health-check/repo-submit-change : Ensure a success for config-update job] 2026-06-12 00:49:42.079673 | controller | skipping: Conditional result was False 2026-06-12 00:49:42.098073 | 2026-06-12 00:49:42.098224 | TASK [health-check/config-update-zuul : ansible.builtin.set_fact] 2026-06-12 00:49:42.146946 | controller | ok 2026-06-12 00:49:42.159515 | 2026-06-12 00:49:42.159646 | TASK [Check that Zuul has pushed the job console on the logserver] 2026-06-12 00:49:42.195886 | controller | ok 2026-06-12 00:49:42.237526 | 2026-06-12 00:49:42.237639 | TASK [health-check/ensure-job-result-artifacts : Ensure job console (job-output.txt.gz) exists in Logserver] 2026-06-12 00:49:42.779291 | controller | ok: OK (4518 bytes) 2026-06-12 00:49:42.792588 | 2026-06-12 00:49:42.792734 | TASK [health-check/ensure-job-result-artifacts : Ensure internal logserver rewrite from job-output.txt to job-output.txt.gz] 2026-06-12 00:49:43.357296 | controller | ok: OK (4518 bytes) 2026-06-12 00:49:43.376403 | 2026-06-12 00:49:43.376591 | TASK [health-check/config-update-zuul : Get Zuul projects list] 2026-06-12 00:49:43.951254 | controller | ok: OK (144 bytes) 2026-06-12 00:49:43.960997 | 2026-06-12 00:49:43.961135 | TASK [health-check/config-update-zuul : Ensure project exists in Zuul (fail if not)] 2026-06-12 00:49:44.010508 | controller | skipping: Conditional result was False 2026-06-12 00:49:44.033367 | 2026-06-12 00:49:44.033627 | TASK [health-check/check-logjuicer : Get logjuicer status] 2026-06-12 00:49:44.556805 | controller | ok: OK (2 bytes) 2026-06-12 00:49:44.574691 | 2026-06-12 00:49:44.574963 | TASK [ansible.builtin.include_role : health-check/check-zuul-tenant] 2026-06-12 00:49:44.613643 | controller | ok 2026-06-12 00:49:44.645333 | 2026-06-12 00:49:44.645581 | TASK [health-check/check-zuul-tenant : Get configuration errors/warnings into the demo-tenant tenant] 2026-06-12 00:49:45.132712 | controller | ok: OK (2 bytes) 2026-06-12 00:49:45.145111 | 2026-06-12 00:49:45.145311 | TASK [health-check/check-zuul-tenant : Fail when errors/warnings into the demo-tenant tenant] 2026-06-12 00:49:45.182589 | controller | skipping: Conditional result was False 2026-06-12 00:49:45.210423 | 2026-06-12 00:49:45.210762 | TASK [health-check/zuul-demo-tenant-workflow : Fetch and reset demo-project to latest origin for fast-forward submit] 2026-06-11 20:49:45.574650 | controller | HEAD is now at f82ab53 Automatic secret re-encryption 2026-06-12 00:49:45.784510 | controller | ok: Runtime: 0:00:00.089181 2026-06-12 00:49:45.794876 | 2026-06-12 00:49:45.795031 | TASK [health-check/zuul-demo-tenant-workflow : Update the demo-job to sleep 1 second] 2026-06-12 00:49:46.268321 | controller | changed: 1 replacements made 2026-06-12 00:49:46.278702 | 2026-06-12 00:49:46.278967 | LOOP [health-check/zuul-demo-tenant-workflow : Commit file in the demo-project repo] 2026-06-12 00:49:46.578034 | controller | ok: Item: git add playbooks/run.yaml Runtime: 0:00:00.006829 2026-06-12 00:49:46.578380 | controller | changed: All items complete 2026-06-12 00:49:46.578419 | 2026-06-12 00:49:46.832797 | controller | [master 481da4d] Update demo-job to sleep 1 second 2026-06-12 00:49:46.832970 | controller | 1 file changed, 1 insertion(+), 1 deletion(-) 2026-06-12 00:49:46.833034 | controller | ok: Item: git commit -m 'Update demo-job to sleep 1 second' Runtime: 0:00:00.010706 2026-06-12 00:49:46.846469 | 2026-06-12 00:49:46.846716 | TASK [Submit, merge and verify post-merge job] 2026-06-12 00:49:46.880347 | controller | ok 2026-06-12 00:49:46.904056 | 2026-06-12 00:49:46.904218 | TASK [health-check/repo-submit-change : Submit change] 2026-06-12 00:49:46.937220 | controller | ok 2026-06-12 00:49:46.945485 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/submit-change.yaml 2026-06-12 00:49:46.952645 | 2026-06-12 00:49:46.952725 | TASK [health-check/repo-submit-change : Submit change] 2026-06-11 20:49:48.054192 | controller | Your change was committed before the commit hook was installed. 2026-06-11 20:49:48.054291 | controller | Amending the commit to add a gerrit change id. 2026-06-11 20:49:48.054303 | controller | remote: 2026-06-11 20:49:48.054314 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-11 20:49:48.054327 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-11 20:49:48.054337 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-11 20:49:48.054348 | controller | remote: Processing changes: refs: 1, new: 1, done 2026-06-11 20:49:48.054357 | controller | remote: 2026-06-11 20:49:48.054365 | controller | remote: SUCCESS 2026-06-11 20:49:48.054448 | controller | remote: 2026-06-11 20:49:48.054463 | controller | remote: https://gerrit.sfop.me/c/demo-project/+/2 Update demo-job to sleep 1 second [NEW] 2026-06-11 20:49:48.054475 | controller | remote: 2026-06-11 20:49:48.054486 | controller | To https://gerrit.sfop.me/a/demo-project 2026-06-11 20:49:48.054498 | controller | * [new reference] HEAD -> refs/for/master 2026-06-12 00:49:48.490141 | controller | ok: Runtime: 0:00:00.839292 2026-06-12 00:49:48.500693 | 2026-06-12 00:49:48.500838 | TASK [health-check/repo-submit-change : Get Change-id] 2026-06-11 20:49:48.784916 | controller | Ia0fe660ca8bfa0688d45add14c443b76267834a4 2026-06-12 00:49:49.049952 | controller | ok: Runtime: 0:00:00.010342 2026-06-12 00:49:49.054836 | 2026-06-12 00:49:49.054905 | TASK [health-check/repo-submit-change : Set Code-Review and Workflow label using gerrit API] 2026-06-12 00:49:49.649371 | controller | ok: OK (47 bytes) 2026-06-12 00:49:49.658067 | 2026-06-12 00:49:49.658183 | TASK [health-check/repo-submit-change : Ensure a failure for config-check job] 2026-06-12 00:49:49.684782 | controller | skipping: Conditional result was False 2026-06-12 00:49:49.692813 | 2026-06-12 00:49:49.692910 | TASK [health-check/repo-submit-change : Verify Zuul Console output] 2026-06-12 00:49:49.719951 | controller | skipping: Conditional result was False 2026-06-12 00:49:49.817632 | 2026-06-12 00:49:49.817800 | TASK [health-check/repo-submit-change : Ensure a success for publish-job post job] 2026-06-12 00:49:49.857178 | controller | ok 2026-06-12 00:49:49.863402 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/ensure-post-job-success.yaml 2026-06-12 00:49:49.870029 | 2026-06-12 00:49:49.870097 | TASK [health-check/repo-submit-change : Register commit sha] 2026-06-11 20:49:50.126431 | controller | c5b66007e5ff93cfd4b45a4fc56b6ef19b3ec858 2026-06-12 00:49:50.404848 | controller | ok: Runtime: 0:00:00.008677 2026-06-12 00:49:50.417196 | 2026-06-12 00:49:50.417492 | TASK [health-check/repo-submit-change : Wait publish-job SUCCESS result using zuul-web API] 2026-06-12 00:50:53.848069 | controller | ok: OK (927 bytes) 2026-06-12 00:50:53.860803 | 2026-06-12 00:50:53.860986 | TASK [health-check/repo-submit-change : Ensure a success for publish-job job] 2026-06-12 00:50:53.899417 | controller | skipping: Conditional result was False 2026-06-12 00:50:53.930121 | 2026-06-12 00:50:53.930358 | TASK [health-check/zuul-executor-ensure-graceful-stop : Scale down executor statefulset to ensure 1 replica only] 2026-06-11 20:50:54.319978 | controller | statefulset.apps/zuul-executor scaled 2026-06-12 00:50:54.471127 | controller | ok: Runtime: 0:00:00.117504 2026-06-12 00:50:54.480639 | 2026-06-12 00:50:54.480784 | TASK [health-check/zuul-executor-ensure-graceful-stop : Wait for only 1 executor running] 2026-06-11 20:50:54.809036 | controller | 2 2026-06-12 00:51:05.133773 | controller | ok: Runtime: 0:00:00.050751 2026-06-12 00:51:05.143009 | 2026-06-12 00:51:05.143150 | TASK [health-check/zuul-executor-ensure-graceful-stop : Ensure we are on the default branch] 2026-06-11 20:51:05.428874 | controller | Already on 'master' 2026-06-11 20:51:05.429570 | controller | Your branch is ahead of 'origin/master' by 1 commit. 2026-06-11 20:51:05.429601 | controller | (use "git push" to publish your local commits) 2026-06-12 00:51:05.693238 | controller | ok: Runtime: 0:00:00.008928 2026-06-12 00:51:05.702746 | 2026-06-12 00:51:05.702950 | TASK [health-check/zuul-executor-ensure-graceful-stop : Create a test branch] 2026-06-11 20:51:05.939998 | controller | Switched to a new branch 'test_check_url' 2026-06-12 00:51:06.253275 | controller | ok: Runtime: 0:00:00.008141 2026-06-12 00:51:06.265083 | 2026-06-12 00:51:06.265274 | TASK [health-check/zuul-executor-ensure-graceful-stop : Replace demo-job with demo-job-check-url] 2026-06-12 00:51:06.538909 | controller | changed: 2 replacements made 2026-06-12 00:51:06.550573 | 2026-06-12 00:51:06.550728 | TASK [health-check/zuul-executor-ensure-graceful-stop : create the review] 2026-06-12 00:51:06.589267 | controller | ok 2026-06-12 00:51:06.610189 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/zuul-executor-ensure-graceful-stop/tasks/create-review.yaml 2026-06-12 00:51:06.621348 | 2026-06-12 00:51:06.621465 | LOOP [health-check/zuul-executor-ensure-graceful-stop : Create review] 2026-06-12 00:51:06.908320 | controller | ok: Item: git add --all Runtime: 0:00:00.006864 2026-06-12 00:51:07.232478 | controller | [test_check_url db88e15] test check url 2026-06-12 00:51:07.232669 | controller | 1 file changed, 2 insertions(+), 2 deletions(-) 2026-06-12 00:51:07.232737 | controller | ok: Item: git commit -m 'test check url' Runtime: 0:00:00.064940 2026-06-12 00:51:08.139405 | controller | remote: 2026-06-12 00:51:08.139646 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-12 00:51:08.139718 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-12 00:51:08.139759 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-12 00:51:08.139797 | controller | remote: Processing changes: refs: 1, new: 1, done 2026-06-12 00:51:08.139895 | controller | remote: 2026-06-12 00:51:08.139939 | controller | remote: SUCCESS 2026-06-12 00:51:08.139975 | controller | remote: 2026-06-12 00:51:08.140011 | controller | remote: https://gerrit.sfop.me/c/demo-project/+/3 test check url [NEW] 2026-06-12 00:51:08.140047 | controller | remote: 2026-06-12 00:51:08.140082 | controller | To https://gerrit.sfop.me/a/demo-project 2026-06-12 00:51:08.140118 | controller | * [new reference] HEAD -> refs/for/master 2026-06-12 00:51:08.140171 | controller | ok: Item: git review Runtime: 0:00:00.639000 2026-06-12 00:51:08.160742 | 2026-06-12 00:51:08.160914 | TASK [health-check/zuul-executor-ensure-graceful-stop : Get Change-id] 2026-06-11 20:51:08.481183 | controller | Id515e9844de766e55722370146afcfb83c16c94a 2026-06-12 00:51:08.709088 | controller | ok: Runtime: 0:00:00.011183 2026-06-12 00:51:08.719948 | 2026-06-12 00:51:08.720089 | TASK [health-check/zuul-executor-ensure-graceful-stop : ansible.builtin.debug] 2026-06-12 00:51:08.766053 | controller | ok 2026-06-12 00:51:08.775062 | 2026-06-12 00:51:08.775196 | TASK [health-check/zuul-executor-ensure-graceful-stop : Get review number] 2026-06-11 20:51:09.095576 | controller | 3 2026-06-12 00:51:09.343102 | controller | ok: Runtime: 0:00:00.051085 2026-06-12 00:51:09.353413 | 2026-06-12 00:51:09.353681 | TASK [health-check/zuul-executor-ensure-graceful-stop : ansible.builtin.debug] 2026-06-12 00:51:09.400417 | controller | ok 2026-06-12 00:51:09.409876 | 2026-06-12 00:51:09.410104 | TASK [health-check/zuul-executor-ensure-graceful-stop : ansible.builtin.set_fact] 2026-06-12 00:51:09.443805 | controller | ok 2026-06-12 00:51:09.454703 | 2026-06-12 00:51:09.454844 | TASK [health-check/zuul-executor-ensure-graceful-stop : Wait for job to start] 2026-06-11 20:51:09.781305 | controller | null 2026-06-12 00:51:20.169158 | controller | ok: Runtime: 0:00:00.093508 2026-06-12 00:51:20.239898 | 2026-06-12 00:51:20.240137 | TASK [health-check/zuul-executor-ensure-graceful-stop : Scale down executor statefulset to trigger a graceful stop] 2026-06-11 20:51:20.643245 | controller | statefulset.apps/zuul-executor scaled 2026-06-12 00:51:20.770332 | controller | ok: Runtime: 0:00:00.110253 2026-06-12 00:51:20.791259 | 2026-06-12 00:51:20.791363 | TASK [health-check/zuul-executor-ensure-graceful-stop : Ensure executor component is marked for shutdown in Zuul API] 2026-06-11 20:51:21.120881 | controller | paused 2026-06-12 00:51:21.328161 | controller | ok: Runtime: 0:00:00.047361 2026-06-12 00:51:21.339660 | 2026-06-12 00:51:21.339813 | TASK [health-check/zuul-executor-ensure-graceful-stop : show executor state] 2026-06-12 00:51:21.385589 | controller | ok: paused 2026-06-12 00:51:21.394066 | 2026-06-12 00:51:21.394203 | TASK [health-check/zuul-executor-ensure-graceful-stop : Get back on default branch] 2026-06-11 20:51:21.679220 | controller | Switched to branch 'master' 2026-06-11 20:51:21.680214 | controller | Your branch is ahead of 'origin/master' by 1 commit. 2026-06-11 20:51:21.680243 | controller | (use "git push" to publish your local commits) 2026-06-12 00:51:21.943047 | controller | ok: Runtime: 0:00:00.008843 2026-06-12 00:51:21.952345 | 2026-06-12 00:51:21.952516 | TASK [health-check/zuul-executor-ensure-graceful-stop : Create a test branch] 2026-06-11 20:51:22.255011 | controller | Switched to a new branch 'test_short_job' 2026-06-12 00:51:22.501246 | controller | ok: Runtime: 0:00:00.008050 2026-06-12 00:51:22.510943 | 2026-06-12 00:51:22.511090 | TASK [health-check/zuul-executor-ensure-graceful-stop : Update the demo-job to sleep 2 seconds] 2026-06-12 00:51:22.797621 | controller | changed: 1 replacements made 2026-06-12 00:51:22.803747 | 2026-06-12 00:51:22.803835 | TASK [health-check/zuul-executor-ensure-graceful-stop : create the review] 2026-06-12 00:51:22.828754 | controller | ok 2026-06-12 00:51:22.837943 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/zuul-executor-ensure-graceful-stop/tasks/create-review.yaml 2026-06-12 00:51:22.848932 | 2026-06-12 00:51:22.849017 | LOOP [health-check/zuul-executor-ensure-graceful-stop : Create review] 2026-06-12 00:51:23.145011 | controller | ok: Item: git add --all Runtime: 0:00:00.005947 2026-06-12 00:51:23.145664 | controller | changed: All items complete 2026-06-12 00:51:23.145728 | 2026-06-12 00:51:23.452635 | controller | [test_short_job 4eeeb12] test short job 2026-06-12 00:51:23.452804 | controller | 1 file changed, 1 insertion(+), 1 deletion(-) 2026-06-12 00:51:23.452869 | controller | ok: Item: git commit -m 'test short job' Runtime: 0:00:00.061948 2026-06-12 00:51:24.234041 | controller | remote: 2026-06-12 00:51:24.234184 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-12 00:51:24.234208 | controller | remote: Processing changes: refs: 1, new: 1, done 2026-06-12 00:51:24.234226 | controller | remote: 2026-06-12 00:51:24.234243 | controller | remote: SUCCESS 2026-06-12 00:51:24.234259 | controller | remote: 2026-06-12 00:51:24.234276 | controller | remote: https://gerrit.sfop.me/c/demo-project/+/4 test short job [NEW] 2026-06-12 00:51:24.234292 | controller | remote: 2026-06-12 00:51:24.234308 | controller | To https://gerrit.sfop.me/a/demo-project 2026-06-12 00:51:24.234325 | controller | * [new reference] HEAD -> refs/for/master 2026-06-12 00:51:24.234350 | controller | ok: Item: git review Runtime: 0:00:00.535327 2026-06-12 00:51:24.250082 | 2026-06-12 00:51:24.250291 | TASK [health-check/zuul-executor-ensure-graceful-stop : Get Change-id] 2026-06-11 20:51:24.545438 | controller | Icf916088632f56a6cb9a417488815c9ba431af71 2026-06-12 00:51:24.788773 | controller | ok: Runtime: 0:00:00.009217 2026-06-12 00:51:24.799862 | 2026-06-12 00:51:24.800051 | TASK [health-check/zuul-executor-ensure-graceful-stop : ansible.builtin.debug] 2026-06-12 00:51:24.845945 | controller | ok 2026-06-12 00:51:24.855414 | 2026-06-12 00:51:24.855582 | TASK [health-check/zuul-executor-ensure-graceful-stop : Get review number] 2026-06-11 20:51:25.223431 | controller | 4 2026-06-12 00:51:25.401082 | controller | ok: Runtime: 0:00:00.042292 2026-06-12 00:51:25.411051 | 2026-06-12 00:51:25.411198 | TASK [health-check/zuul-executor-ensure-graceful-stop : ansible.builtin.debug] 2026-06-12 00:51:25.457648 | controller | ok 2026-06-12 00:51:25.468045 | 2026-06-12 00:51:25.468182 | TASK [health-check/zuul-executor-ensure-graceful-stop : ansible.builtin.set_fact] 2026-06-12 00:51:25.514904 | controller | ok 2026-06-12 00:51:25.523944 | 2026-06-12 00:51:25.524100 | TASK [health-check/zuul-executor-ensure-graceful-stop : Ensure new review is queued] 2026-06-12 00:51:36.270106 | controller | ok: Runtime: 0:00:00.079037 2026-06-12 00:51:36.279141 | 2026-06-12 00:51:36.279272 | TASK [Create switch file on logserver so that first job can complete] 2026-06-12 00:51:36.314276 | controller | ok 2026-06-12 00:51:36.354957 | 2026-06-12 00:51:36.355168 | TASK [create-file-on-logserver : copy file on log server] 2026-06-11 20:51:36.796883 | controller | Defaulted container "logserver" out of: logserver, logserver-sshd, purgelogs, logserver-nodeexporter 2026-06-12 00:51:36.952406 | controller | ok: Runtime: 0:00:00.208867 2026-06-12 00:51:36.970275 | 2026-06-12 00:51:36.970457 | TASK [health-check/zuul-executor-ensure-graceful-stop : Wait for executor pod to terminate] 2026-06-11 20:51:37.353628 | controller | NAME READY STATUS RESTARTS AGE 2026-06-11 20:51:37.353751 | controller | config-base-secret-1-2691-ns-kptqw 0/1 Completed 0 29m 2026-06-11 20:51:37.353773 | controller | config-base-secret-1-857-ns-2dgfx 0/1 Completed 0 34m 2026-06-11 20:51:37.353790 | controller | config-base-secret-1-857-ns-7qpqr 0/1 Completed 0 38m 2026-06-11 20:51:37.353822 | controller | gateway-6bbbd758d9-x9nlh 1/1 Running 0 27m 2026-06-11 20:51:37.353837 | controller | gerrit-0 2/2 Running 0 45m 2026-06-11 20:51:37.353852 | controller | git-server-0 2/2 Running 0 12m 2026-06-11 20:51:37.353866 | controller | hound-search-0 1/1 Running 0 43m 2026-06-11 20:51:37.353879 | controller | logjuicer-6ff84764b7-m82j9 1/1 Running 0 43m 2026-06-11 20:51:37.353892 | controller | logserver-0 4/4 Running 0 22m 2026-06-11 20:51:37.353919 | controller | mariadb-0 3/3 Running 0 20m 2026-06-11 20:51:37.353933 | controller | nodepool-builder-0 5/5 Running 0 20m 2026-06-11 20:51:37.353946 | controller | nodepool-launcher-5f9b8fdb58-wdggv 3/3 Running 0 20m 2026-06-11 20:51:37.353958 | controller | post-init-fl4dd 0/1 Completed 0 44m 2026-06-11 20:51:37.353977 | controller | test-fluentbit 1/1 Running 0 37m 2026-06-11 20:51:37.353990 | controller | test-loki-8cd4fd56-8v78l 1/1 Running 0 37m 2026-06-11 20:51:37.354002 | controller | zookeeper-0 3/3 Running 0 20m 2026-06-11 20:51:37.354014 | controller | zuul-db-provision-26r62 0/1 Completed 0 31m 2026-06-11 20:51:37.354026 | controller | zuul-db-provision-74d9p 0/1 Completed 0 43m 2026-06-11 20:51:37.354038 | controller | zuul-executor-0 2/2 Terminating 0 11m 2026-06-11 20:51:37.354050 | controller | zuul-merger-0 2/2 Running 0 11m 2026-06-11 20:51:37.354069 | controller | zuul-merger-1 2/2 Running 0 11m 2026-06-11 20:51:37.354082 | controller | zuul-scheduler-0 3/3 Running 0 7m36s 2026-06-11 20:51:37.354094 | controller | zuul-web-86dddfc859-skp85 1/1 Running 0 7m38s 2026-06-11 20:51:37.354106 | controller | zuul-weeder-5fb87885d-j2lp7 1/1 Running 0 10m 2026-06-12 00:51:58.166360 | controller | ok: Runtime: 0:00:00.132809 2026-06-12 00:51:58.177075 | 2026-06-12 00:51:58.177213 | TASK [health-check/zuul-executor-ensure-graceful-stop : Ensure first job completed] 2026-06-12 00:51:58.728404 | controller | ok: Runtime: 0:00:00.061546 2026-06-12 00:51:58.739384 | 2026-06-12 00:51:58.739558 | TASK [health-check/zuul-executor-ensure-graceful-stop : Ensure second job hasn't completed] 2026-06-12 00:51:59.281555 | controller | ok: Runtime: 0:00:00.048024 2026-06-12 00:51:59.291206 | 2026-06-12 00:51:59.291341 | TASK [health-check/zuul-executor-ensure-graceful-stop : Scale up executor statefulset] 2026-06-11 20:51:59.668539 | controller | statefulset.apps/zuul-executor scaled 2026-06-12 00:51:59.836473 | controller | ok: Runtime: 0:00:00.100747 2026-06-12 00:51:59.845669 | 2026-06-12 00:51:59.845800 | TASK [health-check/zuul-executor-ensure-graceful-stop : Wait until executor pod is up] 2026-06-11 20:52:00.216995 | controller | NAME READY STATUS RESTARTS AGE 2026-06-11 20:52:00.217078 | controller | zuul-executor-0 0/2 ContainerCreating 0 1s 2026-06-12 00:52:10.562230 | controller | ok: Runtime: 0:00:00.057513 2026-06-12 00:52:10.573312 | 2026-06-12 00:52:10.573500 | TASK [health-check/zuul-executor-ensure-graceful-stop : Ensure executor component is running] 2026-06-11 20:52:10.870152 | controller | stopped 2026-06-12 00:52:21.226091 | controller | ok: Runtime: 0:00:00.068374 2026-06-12 00:52:21.235129 | 2026-06-12 00:52:21.235263 | TASK [health-check/zuul-executor-ensure-graceful-stop : Ensure second review's job completed] 2026-06-12 00:52:52.493326 | controller | ok: Runtime: 0:00:00.047534 2026-06-12 00:52:52.510143 | 2026-06-12 00:52:52.510281 | TASK [health-check/test-nodepool-providers-secrets : Ensure an empty /tmp/kube.config] 2026-06-12 00:52:52.771546 | controller | changed 2026-06-12 00:52:52.781317 | 2026-06-12 00:52:52.781486 | TASK [health-check/test-nodepool-providers-secrets : Get existing kube.config from the secret] 2026-06-12 00:52:53.329416 | controller | ok: Runtime: 0:00:00.066842 2026-06-12 00:52:53.338660 | 2026-06-12 00:52:53.338791 | TASK [health-check/test-nodepool-providers-secrets : Create a fake clouds.yaml] 2026-06-12 00:52:53.988850 | controller | changed 2026-06-12 00:52:53.999208 | 2026-06-12 00:52:53.999567 | TASK [health-check/test-nodepool-providers-secrets : Update the secret clouds.yaml key] 2026-06-11 20:52:54.435067 | controller | Warning: resource secrets/nodepool-providers-secrets is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. 2026-06-11 20:52:54.562744 | controller | secret/nodepool-providers-secrets configured 2026-06-12 00:52:55.049198 | controller | ok: Runtime: 0:00:00.294824 2026-06-12 00:52:55.060565 | 2026-06-12 00:52:55.060709 | TASK [Wait for secrets to be updated] 2026-06-12 00:52:55.100487 | controller | ok 2026-06-12 00:52:55.126134 | 2026-06-12 00:52:55.126265 | TASK [run the operator in standalone mode] 2026-06-12 00:52:55.157969 | controller | ok 2026-06-12 00:52:55.179063 | 2026-06-12 00:52:55.179150 | TASK [run-operator-standalone : Ensure ~/zuul-output/logs] 2026-06-12 00:52:55.210055 | controller | skipping: Conditional result was False 2026-06-12 00:52:55.217326 | 2026-06-12 00:52:55.217405 | TASK [run-operator-standalone : Clear previous log file] 2026-06-12 00:52:55.254068 | controller | skipping: Conditional result was False 2026-06-12 00:52:55.260333 | 2026-06-12 00:52:55.260409 | TASK [run-operator-standalone : Run the operator in standalone mode] 2026-06-11 20:52:55.903773 | controller | 2026-06-11T20:52:55-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:52:55.903870 | controller | 2026-06-11 20:52:55.914041 | controller | 2026-06-11T20:52:55-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:52:55.914076 | controller | 2026-06-11 20:52:55.925911 | controller | 2026-06-11T20:52:55-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:52:56.539941 | controller | 2026-06-11T20:52:56-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:52:56.661663 | controller | 2026-06-11T20:52:56-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:52:56.669110 | controller | 2026-06-11T20:52:56-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:52:56.669129 | controller | 2026-06-11T20:52:56-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:52:56.688973 | controller | 2026-06-11T20:52:56-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:52:56.688995 | controller | 2026-06-11T20:52:56-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:52:56.948399 | controller | 2026-06-11T20:52:56-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:52:57.330427 | controller | 2026-06-11T20:52:57-04:00 INFO Updating configmap, name: np-statsd-config-map 2026-06-11 20:52:57.330499 | controller | 2026-06-11T20:52:57-04:00 INFO Updating object, name: np-statsd-config-map 2026-06-11 20:52:57.347861 | controller | 2026-06-11T20:52:57-04:00 INFO Statefulset "nodepool-launcher" configuration changed, applying... 2026-06-11 20:52:57.347918 | controller | 2026-06-11T20:52:57-04:00 INFO Updating object, name: nodepool-launcher 2026-06-11 20:52:57.933556 | controller | 2026-06-11T20:52:57-04:00 INFO Statefulset "nodepool-builder" configuration changed, applying... 2026-06-11 20:52:57.933628 | controller | 2026-06-11T20:52:57-04:00 INFO Updating object, name: nodepool-builder 2026-06-11 20:52:58.738921 | controller | 2026-06-11T20:52:58-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:52:58.738992 | controller | 2026-06-11T20:52:58-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:53:00.327499 | controller | 2026-06-11T20:53:00-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:53:00.327591 | controller | 2026-06-11T20:53:00-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:53:01.537405 | controller | 2026-06-11T20:53:01-04:00 INFO 2026-06-11 20:53:01.537484 | controller | - Config: OK 2026-06-11 20:53:01.537497 | controller | - Gateway: OK 2026-06-11 20:53:01.537506 | controller | - GitServer: OK 2026-06-11 20:53:01.537514 | controller | - HoundSearch: OK 2026-06-11 20:53:01.537524 | controller | - LogJuicer: OK 2026-06-11 20:53:01.537532 | controller | - Logserver: OK 2026-06-11 20:53:01.537540 | controller | - MariaDB: OK 2026-06-11 20:53:01.537548 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:53:01.537556 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:53:01.537564 | controller | - Zookeeper: OK 2026-06-11 20:53:01.537572 | controller | - Zuul: OK 2026-06-11 20:53:01.537580 | controller | 2026-06-11 20:53:01.537597 | controller | 2026-06-11T20:53:01-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-11 20:53:06.544868 | controller | 2026-06-11T20:53:06-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:53:07.164819 | controller | 2026-06-11T20:53:07-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:53:07.164894 | controller | 2026-06-11T20:53:07-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:53:07.187183 | controller | 2026-06-11T20:53:07-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:53:07.187254 | controller | 2026-06-11T20:53:07-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:53:07.565646 | controller | 2026-06-11T20:53:07-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:53:07.966179 | controller | 2026-06-11T20:53:07-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:53:07.966263 | controller | 2026-06-11T20:53:07-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:53:08.978029 | controller | 2026-06-11T20:53:08-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:53:08.978116 | controller | 2026-06-11T20:53:08-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:53:10.549621 | controller | 2026-06-11T20:53:10-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:53:10.549727 | controller | 2026-06-11T20:53:10-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:53:11.758274 | controller | 2026-06-11T20:53:11-04:00 INFO 2026-06-11 20:53:11.758341 | controller | - Config: OK 2026-06-11 20:53:11.758352 | controller | - Gateway: OK 2026-06-11 20:53:11.758361 | controller | - GitServer: OK 2026-06-11 20:53:11.758395 | controller | - HoundSearch: OK 2026-06-11 20:53:11.758407 | controller | - LogJuicer: OK 2026-06-11 20:53:11.758415 | controller | - Logserver: OK 2026-06-11 20:53:11.758423 | controller | - MariaDB: OK 2026-06-11 20:53:11.758431 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:53:11.758440 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:53:11.758448 | controller | - Zookeeper: OK 2026-06-11 20:53:11.758456 | controller | - Zuul: OK 2026-06-11 20:53:11.758464 | controller | 2026-06-11 20:53:11.758480 | controller | 2026-06-11T20:53:11-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-11 20:53:16.769051 | controller | 2026-06-11T20:53:16-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:53:17.388697 | controller | 2026-06-11T20:53:17-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:53:17.388753 | controller | 2026-06-11T20:53:17-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:53:17.410163 | controller | 2026-06-11T20:53:17-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:53:17.410203 | controller | 2026-06-11T20:53:17-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:53:17.787891 | controller | 2026-06-11T20:53:17-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:53:18.192185 | controller | 2026-06-11T20:53:18-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:53:18.192271 | controller | 2026-06-11T20:53:18-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:53:19.200211 | controller | 2026-06-11T20:53:19-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:53:19.200296 | controller | 2026-06-11T20:53:19-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:53:20.772801 | controller | 2026-06-11T20:53:20-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:53:20.772861 | controller | 2026-06-11T20:53:20-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:53:21.982477 | controller | 2026-06-11T20:53:21-04:00 INFO 2026-06-11 20:53:21.982545 | controller | - Config: OK 2026-06-11 20:53:21.982556 | controller | - Gateway: OK 2026-06-11 20:53:21.982565 | controller | - GitServer: OK 2026-06-11 20:53:21.982573 | controller | - HoundSearch: OK 2026-06-11 20:53:21.982581 | controller | - LogJuicer: OK 2026-06-11 20:53:21.982589 | controller | - Logserver: OK 2026-06-11 20:53:21.982597 | controller | - MariaDB: OK 2026-06-11 20:53:21.982605 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:53:21.982614 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:53:21.982622 | controller | - Zookeeper: OK 2026-06-11 20:53:21.982632 | controller | - Zuul: OK 2026-06-11 20:53:21.982640 | controller | 2026-06-11 20:53:21.982656 | controller | 2026-06-11T20:53:21-04:00 INFO [attempt #3] Waiting 5s for the next reconcile call ... 2026-06-11 20:53:26.992606 | controller | 2026-06-11T20:53:26-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:53:27.610660 | controller | 2026-06-11T20:53:27-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:53:27.610712 | controller | 2026-06-11T20:53:27-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:53:27.632072 | controller | 2026-06-11T20:53:27-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:53:27.632123 | controller | 2026-06-11T20:53:27-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:53:28.009251 | controller | 2026-06-11T20:53:28-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:53:28.409850 | controller | 2026-06-11T20:53:28-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:53:28.409938 | controller | 2026-06-11T20:53:28-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:53:29.425894 | controller | 2026-06-11T20:53:29-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:53:29.425948 | controller | 2026-06-11T20:53:29-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:53:30.996999 | controller | 2026-06-11T20:53:30-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:53:30.997051 | controller | 2026-06-11T20:53:30-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:53:32.203438 | controller | 2026-06-11T20:53:32-04:00 INFO 2026-06-11 20:53:32.203518 | controller | - Config: OK 2026-06-11 20:53:32.203533 | controller | - Gateway: OK 2026-06-11 20:53:32.203546 | controller | - GitServer: OK 2026-06-11 20:53:32.203556 | controller | - HoundSearch: OK 2026-06-11 20:53:32.203565 | controller | - LogJuicer: OK 2026-06-11 20:53:32.203573 | controller | - Logserver: OK 2026-06-11 20:53:32.203581 | controller | - MariaDB: OK 2026-06-11 20:53:32.203589 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:53:32.203597 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:53:32.203607 | controller | - Zookeeper: OK 2026-06-11 20:53:32.203615 | controller | - Zuul: OK 2026-06-11 20:53:32.203624 | controller | 2026-06-11 20:53:32.203640 | controller | 2026-06-11T20:53:32-04:00 INFO [attempt #4] Waiting 5s for the next reconcile call ... 2026-06-11 20:53:37.216502 | controller | 2026-06-11T20:53:37-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:53:37.833388 | controller | 2026-06-11T20:53:37-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:53:37.833480 | controller | 2026-06-11T20:53:37-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:53:37.853237 | controller | 2026-06-11T20:53:37-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:53:37.853286 | controller | 2026-06-11T20:53:37-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:53:38.230050 | controller | 2026-06-11T20:53:38-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:53:38.636619 | controller | 2026-06-11T20:53:38-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:53:38.636716 | controller | 2026-06-11T20:53:38-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:53:39.654463 | controller | 2026-06-11T20:53:39-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:53:39.654561 | controller | 2026-06-11T20:53:39-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:53:41.220344 | controller | 2026-06-11T20:53:41-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:53:41.220462 | controller | 2026-06-11T20:53:41-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:53:42.432164 | controller | 2026-06-11T20:53:42-04:00 INFO 2026-06-11 20:53:42.432224 | controller | - Config: OK 2026-06-11 20:53:42.432239 | controller | - Gateway: OK 2026-06-11 20:53:42.432251 | controller | - GitServer: OK 2026-06-11 20:53:42.432263 | controller | - HoundSearch: OK 2026-06-11 20:53:42.432275 | controller | - LogJuicer: OK 2026-06-11 20:53:42.432286 | controller | - Logserver: OK 2026-06-11 20:53:42.432297 | controller | - MariaDB: OK 2026-06-11 20:53:42.432308 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:53:42.432320 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:53:42.432331 | controller | - Zookeeper: OK 2026-06-11 20:53:42.432342 | controller | - Zuul: OK 2026-06-11 20:53:42.432354 | controller | 2026-06-11 20:53:42.432413 | controller | 2026-06-11T20:53:42-04:00 INFO [attempt #5] Waiting 5s for the next reconcile call ... 2026-06-11 20:53:47.439000 | controller | 2026-06-11T20:53:47-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:53:48.056444 | controller | 2026-06-11T20:53:48-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:53:48.056514 | controller | 2026-06-11T20:53:48-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:53:48.080414 | controller | 2026-06-11T20:53:48-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:53:48.080481 | controller | 2026-06-11T20:53:48-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:53:48.459944 | controller | 2026-06-11T20:53:48-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:53:48.859294 | controller | 2026-06-11T20:53:48-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:53:48.859418 | controller | 2026-06-11T20:53:48-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 20:53:49.868929 | controller | 2026-06-11T20:53:49-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 20:53:49.869006 | controller | 2026-06-11T20:53:49-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 20:53:51.441667 | controller | 2026-06-11T20:53:51-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:53:51.441710 | controller | 2026-06-11T20:53:51-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 20:53:52.653763 | controller | 2026-06-11T20:53:52-04:00 INFO 2026-06-11 20:53:52.653843 | controller | - Config: OK 2026-06-11 20:53:52.653867 | controller | - Gateway: OK 2026-06-11 20:53:52.653876 | controller | - GitServer: OK 2026-06-11 20:53:52.653884 | controller | - HoundSearch: OK 2026-06-11 20:53:52.653892 | controller | - LogJuicer: OK 2026-06-11 20:53:52.653900 | controller | - Logserver: OK 2026-06-11 20:53:52.653908 | controller | - MariaDB: OK 2026-06-11 20:53:52.653916 | controller | - NodePoolBuilder: OK 2026-06-11 20:53:52.653923 | controller | - NodePoolLauncher: OK 2026-06-11 20:53:52.653931 | controller | - Zookeeper: OK 2026-06-11 20:53:52.653940 | controller | - Zuul: OK 2026-06-11 20:53:52.653948 | controller | 2026-06-11 20:53:52.654007 | controller | 2026-06-11T20:53:52-04:00 INFO Updating controller configmap ... 2026-06-11 20:53:53.042257 | controller | 2026-06-11T20:53:53-04:00 INFO Standalone reconcile done. 2026-06-12 00:53:53.470160 | controller | ok: Runtime: 0:00:57.419930 2026-06-12 00:53:53.481614 | 2026-06-12 00:53:53.481743 | TASK [run-operator-standalone : Copy current spec] 2026-06-12 00:53:54.020875 | controller | skipping: Conditional result was False 2026-06-12 00:53:54.048275 | 2026-06-12 00:53:54.048526 | TASK [health-check/test-nodepool-providers-secrets : Check that clouds.yaml available in nodepool-builder] 2026-06-11 20:53:54.423469 | controller | Defaulted container "nodepool-builder" out of: nodepool-builder, fluentbit, np-statsd, nodepool-builder-nodeexporter, build-logs-httpd, nodepool-builder-init (init) 2026-06-11 20:53:54.565536 | controller | /var/lib/nodepool/.config/openstack/clouds.yaml 2026-06-12 00:53:54.618175 | controller | ok: Runtime: 0:00:00.246256 2026-06-12 00:53:54.627929 | 2026-06-12 00:53:54.628127 | TASK [health-check/test-nodepool-providers-secrets : Check that clouds.yaml available in nodepool-launcher containers] 2026-06-11 20:53:55.123778 | controller | Defaulted container "launcher" out of: launcher, np-statsd, zuul-capacity, nodepool-launcher-init (init) 2026-06-11 20:53:55.261197 | controller | /var/lib/nodepool/.config/openstack/clouds.yaml 2026-06-12 00:53:55.675389 | controller | ok: Runtime: 0:00:00.359198 2026-06-12 00:53:55.692082 | 2026-06-12 00:53:55.692222 | TASK [health-check/config-update-nodepool-launcher : Set random value] 2026-06-12 00:53:55.801708 | controller | ok 2026-06-12 00:53:55.816573 | 2026-06-12 00:53:55.816799 | TASK [health-check/config-update-nodepool-launcher : Ensure nodepool directory exists] 2026-06-12 00:53:56.094207 | controller | changed 2026-06-12 00:53:56.103260 | 2026-06-12 00:53:56.103386 | TASK [health-check/config-update-nodepool-launcher : Set bad Nodepool config] 2026-06-12 00:53:56.399789 | controller | changed: File created 2026-06-12 00:53:56.405934 | 2026-06-12 00:53:56.406038 | LOOP [health-check/config-update-nodepool-launcher : Commit file in the config repo] 2026-06-12 00:53:56.671885 | controller | ok: Item: git add nodepool/nodepool.yaml Runtime: 0:00:00.007825 2026-06-12 00:53:57.008837 | controller | [master 27e57f2] Add nodepool/nodepool.yaml 2026-06-12 00:53:57.009036 | controller | 1 file changed, 3 insertions(+) 2026-06-12 00:53:57.009089 | controller | create mode 100644 nodepool/nodepool.yaml 2026-06-12 00:53:57.009146 | controller | ok: Item: git commit -m 'Add nodepool/nodepool.yaml' Runtime: 0:00:00.072184 2026-06-12 00:53:57.022549 | 2026-06-12 00:53:57.022780 | TASK [ansible.builtin.include_role : health-check/repo-submit-change] 2026-06-12 00:53:57.059496 | controller | ok 2026-06-12 00:53:57.096497 | 2026-06-12 00:53:57.096590 | TASK [health-check/repo-submit-change : Submit change] 2026-06-12 00:53:57.130649 | controller | ok 2026-06-12 00:53:57.138282 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/submit-change.yaml 2026-06-12 00:53:57.145307 | 2026-06-12 00:53:57.145395 | TASK [health-check/repo-submit-change : Submit change] 2026-06-11 20:53:58.084150 | controller | remote: 2026-06-11 20:53:58.084233 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-11 20:53:58.084245 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-11 20:53:58.084254 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-11 20:53:58.084267 | controller | remote: Processing changes: refs: 1, new: 1, done 2026-06-11 20:53:58.084275 | controller | remote: 2026-06-11 20:53:58.084284 | controller | remote: SUCCESS 2026-06-11 20:53:58.084292 | controller | remote: 2026-06-11 20:53:58.084320 | controller | remote: https://gerrit.sfop.me/c/config/+/5 Add nodepool/nodepool.yaml [NEW] 2026-06-11 20:53:58.084328 | controller | remote: 2026-06-11 20:53:58.084336 | controller | To https://gerrit.sfop.me/a/config 2026-06-11 20:53:58.084347 | controller | * [new reference] HEAD -> refs/for/master 2026-06-12 00:53:58.193128 | controller | ok: Runtime: 0:00:00.593113 2026-06-12 00:53:58.204722 | 2026-06-12 00:53:58.204973 | TASK [health-check/repo-submit-change : Get Change-id] 2026-06-11 20:53:58.523358 | controller | I3129b55ed390a8063c53815ff060b6df8b6af87a 2026-06-12 00:53:58.752557 | controller | ok: Runtime: 0:00:00.012346 2026-06-12 00:53:58.762673 | 2026-06-12 00:53:58.762812 | TASK [health-check/repo-submit-change : Set Code-Review and Workflow label using gerrit API] 2026-06-12 00:53:59.318928 | controller | ok: OK (47 bytes) 2026-06-12 00:53:59.332010 | 2026-06-12 00:53:59.332152 | TASK [health-check/repo-submit-change : Ensure a failure for config-check job] 2026-06-12 00:53:59.380874 | controller | ok 2026-06-12 00:53:59.397598 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/ensure-job-failure.yaml 2026-06-12 00:53:59.410273 | 2026-06-12 00:53:59.410496 | TASK [health-check/repo-submit-change : Get review ID from the changeID using gerrit API] 2026-06-12 00:53:59.973111 | controller | ok: OK (7150 bytes) 2026-06-12 00:53:59.986792 | 2026-06-12 00:53:59.986930 | TASK [health-check/repo-submit-change : ansible.builtin.set_fact] 2026-06-12 00:54:00.035478 | controller | ok 2026-06-12 00:54:00.051282 | 2026-06-12 00:54:00.051482 | TASK [health-check/repo-submit-change : Wait config-check FAILURE result using zuul-web API] 2026-06-12 00:55:03.668575 | controller | ok: OK (1163 bytes) 2026-06-12 00:55:03.680215 | 2026-06-12 00:55:03.680352 | TASK [health-check/repo-submit-change : Verify Zuul Console output] 2026-06-12 00:55:03.710062 | controller | skipping: Conditional result was False 2026-06-12 00:55:03.725505 | 2026-06-12 00:55:03.725661 | TASK [health-check/repo-submit-change : Ensure a success for config-update post job] 2026-06-12 00:55:03.753917 | controller | skipping: Conditional result was False 2026-06-12 00:55:03.768340 | 2026-06-12 00:55:03.768529 | TASK [health-check/repo-submit-change : Ensure a success for config-update job] 2026-06-12 00:55:03.797087 | controller | skipping: Conditional result was False 2026-06-12 00:55:03.816245 | 2026-06-12 00:55:03.816395 | TASK [health-check/config-update-nodepool-launcher : Reset the config repo] 2026-06-11 20:55:04.134931 | controller | HEAD is now at 655a40a Add zuul/main.yaml 2026-06-12 00:55:04.362966 | controller | ok: Runtime: 0:00:00.008177 2026-06-12 00:55:04.372181 | 2026-06-12 00:55:04.372317 | TASK [health-check/config-update-nodepool-launcher : Ensure nodepool directory exists] 2026-06-12 00:55:04.651668 | controller | changed 2026-06-12 00:55:04.663020 | 2026-06-12 00:55:04.663152 | TASK [health-check/config-update-nodepool-launcher : Check nodepool.yaml exists] 2026-06-12 00:55:04.923261 | controller | ok 2026-06-12 00:55:04.934658 | 2026-06-12 00:55:04.934824 | TASK [health-check/config-update-nodepool-launcher : Ensure nodepool.yaml default content] 2026-06-12 00:55:05.728985 | controller | changed 2026-06-12 00:55:05.739028 | 2026-06-12 00:55:05.739187 | TASK [health-check/config-update-nodepool-launcher : Load current nodepool launcher config] 2026-06-11 20:55:06.130049 | controller | labels: [] 2026-06-11 20:55:06.130137 | controller | providers: [] 2026-06-12 00:55:06.386723 | controller | ok: Runtime: 0:00:00.004943 2026-06-12 00:55:06.396330 | 2026-06-12 00:55:06.396511 | TASK [health-check/config-update-nodepool-launcher : ansible.builtin.set_fact] 2026-06-12 00:55:06.453941 | controller | ok 2026-06-12 00:55:06.463742 | 2026-06-12 00:55:06.463889 | TASK [health-check/config-update-nodepool-launcher : ansible.builtin.set_fact] 2026-06-12 00:55:06.513550 | controller | ok 2026-06-12 00:55:06.522415 | 2026-06-12 00:55:06.522613 | TASK [health-check/config-update-nodepool-launcher : ansible.builtin.set_fact] 2026-06-12 00:55:06.550189 | controller | skipping: Conditional result was False 2026-06-12 00:55:06.560984 | 2026-06-12 00:55:06.561124 | TASK [health-check/config-update-nodepool-launcher : ansible.builtin.set_fact] 2026-06-12 00:55:06.618797 | controller | ok 2026-06-12 00:55:06.627803 | 2026-06-12 00:55:06.627947 | TASK [health-check/config-update-nodepool-launcher : ansible.builtin.set_fact] 2026-06-12 00:55:06.656567 | controller | skipping: Conditional result was False 2026-06-12 00:55:06.667805 | 2026-06-12 00:55:06.667958 | TASK [health-check/config-update-nodepool-launcher : ansible.builtin.set_fact] 2026-06-12 00:55:06.716332 | controller | ok 2026-06-12 00:55:06.725572 | 2026-06-12 00:55:06.725712 | TASK [health-check/config-update-nodepool-launcher : ansible.builtin.set_fact] 2026-06-12 00:55:06.777830 | controller | ok 2026-06-12 00:55:06.786811 | 2026-06-12 00:55:06.786950 | TASK [health-check/config-update-nodepool-launcher : Set dummy Nodepool config] 2026-06-12 00:55:07.633529 | controller | changed 2026-06-12 00:55:07.639889 | 2026-06-12 00:55:07.639982 | LOOP [health-check/config-update-nodepool-launcher : Commit file in the config repo] 2026-06-12 00:55:07.945728 | controller | ok: Item: git add nodepool/nodepool.yaml Runtime: 0:00:00.007159 2026-06-12 00:55:07.946285 | controller | changed: All items complete 2026-06-12 00:55:07.946351 | 2026-06-12 00:55:08.258034 | controller | [master 10fc0df] Add nodepool/nodepool.yaml 2026-06-12 00:55:08.258210 | controller | 1 file changed, 12 insertions(+) 2026-06-12 00:55:08.258263 | controller | create mode 100644 nodepool/nodepool.yaml 2026-06-12 00:55:08.258318 | controller | ok: Item: git commit -m 'Add nodepool/nodepool.yaml' Runtime: 0:00:00.056452 2026-06-12 00:55:08.277256 | 2026-06-12 00:55:08.277536 | TASK [Update config repo change] 2026-06-12 00:55:08.313161 | controller | ok 2026-06-12 00:55:08.354853 | 2026-06-12 00:55:08.354946 | TASK [health-check/repo-submit-change : Submit change] 2026-06-12 00:55:08.385048 | controller | ok 2026-06-12 00:55:08.395096 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/submit-change.yaml 2026-06-12 00:55:08.402113 | 2026-06-12 00:55:08.402194 | TASK [health-check/repo-submit-change : Submit change] 2026-06-11 20:55:09.284574 | controller | remote: 2026-06-11 20:55:09.284669 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-11 20:55:09.284687 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-11 20:55:09.284699 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-11 20:55:09.284716 | controller | remote: Processing changes: refs: 1, new: 1, done 2026-06-11 20:55:09.284729 | controller | remote: 2026-06-11 20:55:09.284740 | controller | remote: SUCCESS 2026-06-11 20:55:09.284751 | controller | remote: 2026-06-11 20:55:09.284762 | controller | remote: https://gerrit.sfop.me/c/config/+/6 Add nodepool/nodepool.yaml [NEW] 2026-06-11 20:55:09.284772 | controller | remote: 2026-06-11 20:55:09.284782 | controller | To https://gerrit.sfop.me/a/config 2026-06-11 20:55:09.284795 | controller | * [new reference] HEAD -> refs/for/master 2026-06-12 00:55:09.435330 | controller | ok: Runtime: 0:00:00.641959 2026-06-12 00:55:09.444671 | 2026-06-12 00:55:09.444807 | TASK [health-check/repo-submit-change : Get Change-id] 2026-06-11 20:55:09.744945 | controller | Ic766fc108494e971999bcc4bfc9952b2590b27a3 2026-06-12 00:55:09.990968 | controller | ok: Runtime: 0:00:00.010792 2026-06-12 00:55:10.000337 | 2026-06-12 00:55:10.000499 | TASK [health-check/repo-submit-change : Set Code-Review and Workflow label using gerrit API] 2026-06-12 00:55:10.614788 | controller | ok: OK (47 bytes) 2026-06-12 00:55:10.627090 | 2026-06-12 00:55:10.627238 | TASK [health-check/repo-submit-change : Ensure a failure for config-check job] 2026-06-12 00:55:10.655561 | controller | skipping: Conditional result was False 2026-06-12 00:55:10.668184 | 2026-06-12 00:55:10.668327 | TASK [health-check/repo-submit-change : Verify Zuul Console output] 2026-06-12 00:55:10.696516 | controller | skipping: Conditional result was False 2026-06-12 00:55:10.711308 | 2026-06-12 00:55:10.711531 | TASK [health-check/repo-submit-change : Ensure a success for config-update post job] 2026-06-12 00:55:10.762547 | controller | ok 2026-06-12 00:55:10.774150 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/ensure-post-job-success.yaml 2026-06-12 00:55:10.787464 | 2026-06-12 00:55:10.787551 | TASK [health-check/repo-submit-change : Register commit sha] 2026-06-11 20:55:11.040259 | controller | 10fc0dfa2fc1acd0736c9aa548c0d95dccbeaa98 2026-06-12 00:55:11.323050 | controller | ok: Runtime: 0:00:00.005290 2026-06-12 00:55:11.334329 | 2026-06-12 00:55:11.334507 | TASK [health-check/repo-submit-change : Wait config-update SUCCESS result using zuul-web API] 2026-06-12 00:58:10.667633 | controller | ok: OK (1144 bytes) 2026-06-12 00:58:10.680377 | 2026-06-12 00:58:10.680553 | TASK [health-check/repo-submit-change : Ensure a success for config-update job] 2026-06-12 00:58:10.718857 | controller | skipping: Conditional result was False 2026-06-12 00:58:10.739880 | 2026-06-12 00:58:10.740025 | TASK [health-check/config-update-nodepool-launcher : Get nodepool-launcher pod name] 2026-06-11 20:58:11.125938 | controller | nodepool-launcher-6c67f95fc4-jkpt4 2026-06-12 00:58:11.279788 | controller | ok: Runtime: 0:00:00.108590 2026-06-12 00:58:11.292044 | 2026-06-12 00:58:11.292205 | LOOP [health-check/config-update-nodepool-launcher : Check that new zuul-worker-sf-operator-ci-uhwg3ogw label exists in the destination file] 2026-06-12 00:58:11.778101 | controller | - name: zuul-worker-sf-operator-ci-uhwg3ogw 2026-06-12 00:58:11.778650 | controller | name: zuul-worker-sf-operator-ci-uhwg3ogw 2026-06-12 00:58:11.778750 | controller | ok: Item: zuul-worker-sf-operator-ci-uhwg3ogw Runtime: 0:00:00.184922 2026-06-12 00:58:12.282843 | controller | name: microshiftLocal 2026-06-12 00:58:12.283403 | controller | ok: Item: microshiftLocal Runtime: 0:00:00.259743 2026-06-12 00:58:12.305237 | 2026-06-12 00:58:12.305525 | TASK [health-check/config-update-nodepool-launcher : Ensure the new label listed in the Nodepool API] 2026-06-12 00:58:12.854555 | controller | ok: OK (199 bytes) 2026-06-12 00:58:12.867910 | 2026-06-12 00:58:12.868054 | TASK [health-check/config-update-nodepool-launcher : Ensure the new label listed in the Zuul API] 2026-06-12 00:58:13.416136 | controller | ok: OK (49 bytes) 2026-06-12 00:58:13.434171 | 2026-06-12 00:58:13.434310 | TASK [health-check/test-deploy-zero-replica : Set executor replica set to 0] 2026-06-11 20:58:13.766428 | controller | statefulset.apps/zuul-executor scaled 2026-06-12 00:58:13.979686 | controller | ok: Runtime: 0:00:00.104725 2026-06-12 00:58:13.989336 | 2026-06-12 00:58:13.989507 | TASK [health-check/test-deploy-zero-replica : Ensure executor pod is down] 2026-06-11 20:58:14.540447 | controller | NAME READY STATUS RESTARTS AGE 2026-06-11 20:58:14.540604 | controller | config-base-secret-1-2691-ns-kptqw 0/1 Completed 0 36m 2026-06-11 20:58:14.540633 | controller | config-base-secret-1-857-ns-2dgfx 0/1 Completed 0 40m 2026-06-11 20:58:14.540669 | controller | config-base-secret-1-857-ns-7qpqr 0/1 Completed 0 45m 2026-06-11 20:58:14.540684 | controller | gateway-6bbbd758d9-x9nlh 1/1 Running 0 34m 2026-06-11 20:58:14.540693 | controller | gerrit-0 2/2 Running 0 52m 2026-06-11 20:58:14.540705 | controller | git-server-0 2/2 Running 0 18m 2026-06-11 20:58:14.540714 | controller | hound-search-0 1/1 Running 0 50m 2026-06-11 20:58:14.540722 | controller | logjuicer-6ff84764b7-m82j9 1/1 Running 0 50m 2026-06-11 20:58:14.540731 | controller | logserver-0 4/4 Running 0 29m 2026-06-11 20:58:14.540739 | controller | mariadb-0 3/3 Running 0 27m 2026-06-11 20:58:14.540747 | controller | nodepool-builder-0 5/5 Running 0 5m15s 2026-06-11 20:58:14.540755 | controller | nodepool-launcher-6c67f95fc4-jkpt4 3/3 Running 0 5m17s 2026-06-11 20:58:14.540764 | controller | post-init-fl4dd 0/1 Completed 0 51m 2026-06-11 20:58:14.540776 | controller | test-fluentbit 1/1 Running 0 43m 2026-06-11 20:58:14.540785 | controller | test-loki-8cd4fd56-8v78l 1/1 Running 0 43m 2026-06-11 20:58:14.540793 | controller | zookeeper-0 3/3 Running 0 27m 2026-06-11 20:58:14.540800 | controller | zuul-db-provision-26r62 0/1 Completed 0 37m 2026-06-11 20:58:14.540808 | controller | zuul-db-provision-74d9p 0/1 Completed 0 49m 2026-06-11 20:58:14.540816 | controller | zuul-executor-0 2/2 Terminating 0 6m15s 2026-06-11 20:58:14.540824 | controller | zuul-merger-0 2/2 Running 0 17m 2026-06-11 20:58:14.540838 | controller | zuul-merger-1 2/2 Running 0 18m 2026-06-11 20:58:14.540922 | controller | zuul-scheduler-0 3/3 Running 0 14m 2026-06-11 20:58:14.540934 | controller | zuul-web-86dddfc859-skp85 1/1 Running 0 14m 2026-06-11 20:58:14.540942 | controller | zuul-weeder-5fb87885d-j2lp7 1/1 Running 0 17m 2026-06-12 00:58:24.992640 | controller | ok: Runtime: 0:00:00.151257 2026-06-12 00:58:25.002217 | 2026-06-12 00:58:25.002354 | TASK [health-check/test-deploy-zero-replica : Set zuul-web replica set to 0] 2026-06-11 20:58:25.441495 | controller | deployment.apps/zuul-web scaled 2026-06-12 00:58:25.547825 | controller | ok: Runtime: 0:00:00.110231 2026-06-12 00:58:25.556994 | 2026-06-12 00:58:25.557144 | TASK [health-check/test-deploy-zero-replica : Ensure zuul-web pod is down] 2026-06-11 20:58:25.966665 | controller | NAME READY STATUS RESTARTS AGE 2026-06-11 20:58:25.966771 | controller | config-base-secret-1-2691-ns-kptqw 0/1 Completed 0 36m 2026-06-11 20:58:25.966791 | controller | config-base-secret-1-857-ns-2dgfx 0/1 Completed 0 40m 2026-06-11 20:58:25.966803 | controller | config-base-secret-1-857-ns-7qpqr 0/1 Completed 0 45m 2026-06-11 20:58:25.966816 | controller | gateway-6bbbd758d9-x9nlh 1/1 Running 0 34m 2026-06-11 20:58:25.966824 | controller | gerrit-0 2/2 Running 0 52m 2026-06-11 20:58:25.966836 | controller | git-server-0 2/2 Running 0 18m 2026-06-11 20:58:25.966855 | controller | hound-search-0 1/1 Running 0 50m 2026-06-11 20:58:25.966864 | controller | logjuicer-6ff84764b7-m82j9 1/1 Running 0 50m 2026-06-11 20:58:25.966872 | controller | logserver-0 4/4 Running 0 29m 2026-06-11 20:58:25.966880 | controller | mariadb-0 3/3 Running 0 27m 2026-06-11 20:58:25.966888 | controller | nodepool-builder-0 5/5 Running 0 5m26s 2026-06-11 20:58:25.966896 | controller | nodepool-launcher-6c67f95fc4-jkpt4 3/3 Running 0 5m28s 2026-06-11 20:58:25.966904 | controller | post-init-fl4dd 0/1 Completed 0 51m 2026-06-11 20:58:25.966916 | controller | test-fluentbit 1/1 Running 0 43m 2026-06-11 20:58:25.966924 | controller | test-loki-8cd4fd56-8v78l 1/1 Running 0 44m 2026-06-11 20:58:25.966932 | controller | zookeeper-0 3/3 Running 0 27m 2026-06-11 20:58:25.966940 | controller | zuul-db-provision-26r62 0/1 Completed 0 37m 2026-06-11 20:58:25.966947 | controller | zuul-db-provision-74d9p 0/1 Completed 0 49m 2026-06-11 20:58:25.966959 | controller | zuul-merger-0 2/2 Running 0 18m 2026-06-11 20:58:25.966967 | controller | zuul-merger-1 2/2 Running 0 18m 2026-06-11 20:58:25.966975 | controller | zuul-scheduler-0 3/3 Running 0 14m 2026-06-11 20:58:25.966983 | controller | zuul-web-86dddfc859-skp85 1/1 Terminating 0 14m 2026-06-11 20:58:25.966991 | controller | zuul-weeder-5fb87885d-j2lp7 1/1 Running 0 17m 2026-06-12 00:58:36.393104 | controller | ok: Runtime: 0:00:00.130063 2026-06-12 00:58:36.403755 | 2026-06-12 00:58:36.403901 | TASK [health-check/test-deploy-zero-replica : Run sf-operator and expect reconciliation] 2026-06-11 20:58:37.088293 | controller | 2026-06-11T20:58:37-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 20:58:37.088420 | controller | 2026-06-11 20:58:37.105692 | controller | 2026-06-11T20:58:37-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 20:58:37.105729 | controller | 2026-06-11 20:58:37.119462 | controller | 2026-06-11T20:58:37-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:58:37.159179 | controller | 2026-06-11T20:58:37-04:00 INFO Statefulset "mariadb" configuration changed, applying... 2026-06-11 20:58:37.159241 | controller | 2026-06-11T20:58:37-04:00 INFO Updating object, name: mariadb 2026-06-11 20:58:37.534543 | controller | 2026-06-11T20:58:37-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 20:58:37.662781 | controller | 2026-06-11T20:58:37-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 20:58:37.670771 | controller | 2026-06-11T20:58:37-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:58:37.670819 | controller | 2026-06-11T20:58:37-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:58:37.689905 | controller | 2026-06-11T20:58:37-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:58:37.689959 | controller | 2026-06-11T20:58:37-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:58:37.930570 | controller | 2026-06-11T20:58:37-04:00 INFO Statefulset "zookeeper" configuration changed, applying... 2026-06-11 20:58:37.930680 | controller | 2026-06-11T20:58:37-04:00 INFO Updating object, name: zookeeper 2026-06-11 20:58:37.938756 | controller | 2026-06-11T20:58:37-04:00 INFO Waiting for Zookeeper service to be ready ... 2026-06-11 20:58:37.938832 | controller | 2026-06-11T20:58:37-04:00 INFO 2026-06-11 20:58:37.938849 | controller | - Config: Waiting ... 2026-06-11 20:58:37.938858 | controller | - Gateway: OK 2026-06-11 20:58:37.938866 | controller | - GitServer: OK 2026-06-11 20:58:37.938875 | controller | - HoundSearch: OK 2026-06-11 20:58:37.938898 | controller | - LogJuicer: OK 2026-06-11 20:58:37.938906 | controller | - Logserver: OK 2026-06-11 20:58:37.938915 | controller | - MariaDB: Waiting ... 2026-06-11 20:58:37.938922 | controller | - Zookeeper: Waiting ... 2026-06-11 20:58:37.938931 | controller | 2026-06-11 20:58:37.938939 | controller | 2026-06-11T20:58:37-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-11 20:58:42.949283 | controller | 2026-06-11T20:58:42-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:58:43.007115 | controller | 2026-06-11T20:58:43-04:00 INFO Waiting for statefulset, name: mariadb 2026-06-11 20:58:53.098043 | controller | 2026-06-11T20:58:53-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:58:53.098132 | controller | 2026-06-11T20:58:53-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:58:53.117314 | controller | 2026-06-11T20:58:53-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:58:53.117355 | controller | 2026-06-11T20:58:53-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:58:53.141955 | controller | 2026-06-11T20:58:53-04:00 INFO Waiting for statefulset, name: zookeeper 2026-06-11 20:58:57.161103 | controller | 2026-06-11T20:58:57-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:58:57.175837 | controller | 2026-06-11T20:58:57-04:00 INFO Updating configmap, name: nodepool-launcher-extra-config-config-map 2026-06-11 20:58:57.176055 | controller | 2026-06-11T20:58:57-04:00 INFO Updating object, name: nodepool-launcher-extra-config-config-map 2026-06-11 20:58:57.189476 | controller | 2026-06-11T20:58:57-04:00 INFO Statefulset "nodepool-launcher" configuration changed, applying... 2026-06-11 20:58:57.189510 | controller | 2026-06-11T20:58:57-04:00 INFO Updating object, name: nodepool-launcher 2026-06-11 20:58:57.211090 | controller | 2026-06-11T20:58:57-04:00 INFO Updating configmap, name: nodepool-builder-extra-config-config-map 2026-06-11 20:58:57.211139 | controller | 2026-06-11T20:58:57-04:00 INFO Updating object, name: nodepool-builder-extra-config-config-map 2026-06-11 20:58:57.225140 | controller | 2026-06-11T20:58:57-04:00 INFO Statefulset "nodepool-builder" configuration changed, applying... 2026-06-11 20:58:57.225189 | controller | 2026-06-11T20:58:57-04:00 INFO Updating object, name: nodepool-builder 2026-06-11 20:58:57.260822 | controller | 2026-06-11T20:58:57-04:00 INFO Updating secret, name: zuul-config 2026-06-11 20:58:57.260882 | controller | 2026-06-11T20:58:57-04:00 INFO Updating object, name: zuul-config 2026-06-11 20:58:57.772617 | controller | 2026-06-11T20:58:57-04:00 INFO Updating configmap, name: zuul-logging-config-map 2026-06-11 20:58:57.772704 | controller | 2026-06-11T20:58:57-04:00 INFO Updating object, name: zuul-logging-config-map 2026-06-11 20:58:57.976909 | controller | 2026-06-11T20:58:57-04:00 INFO Statefulset "zuul-scheduler" configuration changed, applying... 2026-06-11 20:58:57.977002 | controller | 2026-06-11T20:58:57-04:00 INFO Updating object, name: zuul-scheduler 2026-06-11 20:58:58.775997 | controller | 2026-06-11T20:58:58-04:00 INFO Statefulset "zuul-executor" configuration changed, applying... 2026-06-11 20:58:58.776048 | controller | 2026-06-11T20:58:58-04:00 INFO Updating object, name: zuul-executor 2026-06-11 20:58:59.574505 | controller | 2026-06-11T20:58:59-04:00 INFO Statefulset "zuul-web" configuration changed, applying... 2026-06-11 20:58:59.574599 | controller | 2026-06-11T20:58:59-04:00 INFO Updating object, name: zuul-web 2026-06-11 20:59:00.375894 | controller | 2026-06-11T20:59:00-04:00 INFO Statefulset "zuul-merger" configuration changed, applying... 2026-06-11 20:59:00.376013 | controller | 2026-06-11T20:59:00-04:00 INFO Updating object, name: zuul-merger 2026-06-11 20:59:00.387789 | controller | 2026-06-11T20:59:00-04:00 INFO 2026-06-11 20:59:00.387866 | controller | - Config: Waiting ... 2026-06-11 20:59:00.387876 | controller | - Gateway: OK 2026-06-11 20:59:00.387884 | controller | - GitServer: OK 2026-06-11 20:59:00.387892 | controller | - HoundSearch: OK 2026-06-11 20:59:00.387901 | controller | - LogJuicer: OK 2026-06-11 20:59:00.387909 | controller | - Logserver: OK 2026-06-11 20:59:00.387917 | controller | - MariaDB: OK 2026-06-11 20:59:00.387925 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 20:59:00.387932 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 20:59:00.387940 | controller | - Zookeeper: OK 2026-06-11 20:59:00.387948 | controller | - Zuul: Waiting ... 2026-06-11 20:59:00.387955 | controller | - |_ Config Secrets: OK 2026-06-11 20:59:00.387963 | controller | - |_ Executor: Waiting ... 2026-06-11 20:59:00.387971 | controller | - |_ Merger: Waiting ... 2026-06-11 20:59:00.387978 | controller | - |_ Scheduler: Waiting ... 2026-06-11 20:59:00.387986 | controller | - |_ Web: Waiting ... 2026-06-11 20:59:00.387993 | controller | 2026-06-11 20:59:00.388001 | controller | 2026-06-11T20:59:00-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-11 20:59:05.397222 | controller | 2026-06-11T20:59:05-04:00 INFO Deleting object, name: ca-cert 2026-06-11 20:59:06.019551 | controller | 2026-06-11T20:59:06-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 20:59:06.019820 | controller | 2026-06-11T20:59:06-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 20:59:06.045007 | controller | 2026-06-11T20:59:06-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 20:59:06.045073 | controller | 2026-06-11T20:59:06-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 20:59:06.415092 | controller | 2026-06-11T20:59:06-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 20:59:06.813760 | controller | 2026-06-11T20:59:06-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 20:59:06.813841 | controller | 2026-06-11T20:59:06-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 20:59:07.818699 | controller | 2026-06-11T20:59:07-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 20:59:37.948106 | controller | 2026-06-11T20:59:37-04:00 INFO Statefulset "zuul-scheduler" not ready after 30s 2026-06-11 20:59:37.985227 | controller | 2026-06-11T20:59:37-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 20:59:38.363094 | controller | 2026-06-11T20:59:38-04:00 INFO Waiting for statefulset, name: zuul-merger 2026-06-11 21:00:00.459915 | controller | 2026-06-11T21:00:00-04:00 INFO 2026-06-11 21:00:00.460010 | controller | - Config: Waiting ... 2026-06-11 21:00:00.460025 | controller | - Gateway: OK 2026-06-11 21:00:00.460037 | controller | - GitServer: OK 2026-06-11 21:00:00.460047 | controller | - HoundSearch: OK 2026-06-11 21:00:00.460055 | controller | - LogJuicer: OK 2026-06-11 21:00:00.460063 | controller | - Logserver: OK 2026-06-11 21:00:00.460071 | controller | - MariaDB: OK 2026-06-11 21:00:00.460079 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 21:00:00.460087 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 21:00:00.460095 | controller | - Zookeeper: OK 2026-06-11 21:00:00.460102 | controller | - Zuul: Waiting ... 2026-06-11 21:00:00.460110 | controller | - |_ Config Secrets: OK 2026-06-11 21:00:00.460118 | controller | - |_ Executor: OK 2026-06-11 21:00:00.460142 | controller | - |_ Merger: OK 2026-06-11 21:00:00.460150 | controller | - |_ Scheduler: Waiting ... 2026-06-11 21:00:00.460158 | controller | - |_ Web: OK 2026-06-11 21:00:00.460166 | controller | 2026-06-11 21:00:00.460175 | controller | 2026-06-11T21:00:00-04:00 INFO [attempt #3] Waiting 5s for the next reconcile call ... 2026-06-11 21:00:05.468885 | controller | 2026-06-11T21:00:05-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:00:06.087305 | controller | 2026-06-11T21:00:06-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:00:06.087425 | controller | 2026-06-11T21:00:06-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:00:06.113218 | controller | 2026-06-11T21:00:06-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:00:06.113260 | controller | 2026-06-11T21:00:06-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:00:06.486129 | controller | 2026-06-11T21:00:06-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:00:06.891975 | controller | 2026-06-11T21:00:06-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:00:06.892055 | controller | 2026-06-11T21:00:06-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:00:07.897135 | controller | 2026-06-11T21:00:07-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 21:00:32.003742 | controller | 2026-06-11T21:00:32-04:00 INFO Statefulset "zuul-weeder" configuration changed, applying... 2026-06-11 21:00:32.003841 | controller | 2026-06-11T21:00:32-04:00 INFO Updating object, name: zuul-weeder 2026-06-11 21:00:32.050769 | controller | 2026-06-11T21:00:32-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:00:32.428709 | controller | 2026-06-11T21:00:32-04:00 INFO 2026-06-11 21:00:32.428785 | controller | - Config: Waiting ... 2026-06-11 21:00:32.428796 | controller | - Gateway: OK 2026-06-11 21:00:32.428805 | controller | - GitServer: OK 2026-06-11 21:00:32.428813 | controller | - HoundSearch: OK 2026-06-11 21:00:32.428821 | controller | - LogJuicer: OK 2026-06-11 21:00:32.428829 | controller | - Logserver: OK 2026-06-11 21:00:32.428837 | controller | - MariaDB: OK 2026-06-11 21:00:32.428845 | controller | - NodePoolBuilder: OK 2026-06-11 21:00:32.428853 | controller | - NodePoolLauncher: OK 2026-06-11 21:00:32.428861 | controller | - Zookeeper: OK 2026-06-11 21:00:32.428868 | controller | - Zuul: Waiting ... 2026-06-11 21:00:32.428876 | controller | - |_ Config Secrets: OK 2026-06-11 21:00:32.428884 | controller | - |_ Executor: OK 2026-06-11 21:00:32.428892 | controller | - |_ Merger: OK 2026-06-11 21:00:32.428900 | controller | - |_ Scheduler: Waiting ... 2026-06-11 21:00:32.428908 | controller | - |_ Web: OK 2026-06-11 21:00:32.428916 | controller | 2026-06-11 21:00:32.428931 | controller | 2026-06-11T21:00:32-04:00 INFO [attempt #4] Waiting 5s for the next reconcile call ... 2026-06-11 21:00:37.439091 | controller | 2026-06-11T21:00:37-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:00:38.053340 | controller | 2026-06-11T21:00:38-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:00:38.053444 | controller | 2026-06-11T21:00:38-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:00:38.072481 | controller | 2026-06-11T21:00:38-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:00:38.072538 | controller | 2026-06-11T21:00:38-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:00:38.452812 | controller | 2026-06-11T21:00:38-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:00:38.859424 | controller | 2026-06-11T21:00:38-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:00:38.859509 | controller | 2026-06-11T21:00:38-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:00:39.871601 | controller | 2026-06-11T21:00:39-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:00:39.871680 | controller | 2026-06-11T21:00:39-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:00:40.842545 | controller | 2026-06-11T21:00:40-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:00:42.057026 | controller | 2026-06-11T21:00:42-04:00 INFO 2026-06-11 21:00:42.057105 | controller | - Config: OK 2026-06-11 21:00:42.057116 | controller | - Gateway: OK 2026-06-11 21:00:42.057125 | controller | - GitServer: OK 2026-06-11 21:00:42.057133 | controller | - HoundSearch: OK 2026-06-11 21:00:42.057141 | controller | - LogJuicer: OK 2026-06-11 21:00:42.057149 | controller | - Logserver: OK 2026-06-11 21:00:42.057157 | controller | - MariaDB: OK 2026-06-11 21:00:42.057180 | controller | - NodePoolBuilder: OK 2026-06-11 21:00:42.057188 | controller | - NodePoolLauncher: OK 2026-06-11 21:00:42.057196 | controller | - Zookeeper: OK 2026-06-11 21:00:42.057204 | controller | - Zuul: OK 2026-06-11 21:00:42.057212 | controller | 2026-06-11 21:00:42.057228 | controller | 2026-06-11T21:00:42-04:00 INFO Updating controller configmap ... 2026-06-11 21:00:42.441740 | controller | 2026-06-11T21:00:42-04:00 INFO Standalone reconcile done. 2026-06-12 01:00:42.603906 | controller | ok: Runtime: 0:02:05.769617 2026-06-12 01:00:42.615609 | 2026-06-12 01:00:42.615744 | TASK [health-check/test-deploy-zero-replica : Set executor replica set to 1] 2026-06-11 21:00:42.982199 | controller | statefulset.apps/zuul-executor scaled 2026-06-12 01:00:43.166817 | controller | ok: Runtime: 0:00:00.095831 2026-06-12 01:00:43.176318 | 2026-06-12 01:00:43.176493 | TASK [health-check/test-deploy-zero-replica : Set web replica set to 1] 2026-06-11 21:00:43.543918 | controller | deployment.apps/zuul-web scaled 2026-06-12 01:00:43.723541 | controller | ok: Runtime: 0:00:00.099229 2026-06-12 01:00:43.730375 | 2026-06-12 01:00:43.730502 | TASK [health-check/test-deploy-zero-replica : Ensure executor pod is up] 2026-06-11 21:00:44.048423 | controller | NAME READY STATUS RESTARTS AGE 2026-06-11 21:00:44.048517 | controller | zuul-executor-0 0/2 ContainerCreating 0 2s 2026-06-12 01:01:04.793102 | controller | ok: Runtime: 0:00:00.101144 2026-06-12 01:01:04.802325 | 2026-06-12 01:01:04.802518 | TASK [health-check/test-deploy-zero-replica : Ensure web pod is up] 2026-06-11 21:01:05.193468 | controller | NAME READY STATUS RESTARTS AGE 2026-06-11 21:01:05.193593 | controller | gateway-6bbbd758d9-x9nlh 1/1 Running 0 37m 2026-06-11 21:01:05.193613 | controller | gerrit-0 2/2 Running 0 55m 2026-06-11 21:01:05.193627 | controller | git-server-0 2/2 Running 0 21m 2026-06-11 21:01:05.193642 | controller | hound-search-0 1/1 Running 0 53m 2026-06-11 21:01:05.193653 | controller | logjuicer-6ff84764b7-m82j9 1/1 Running 0 53m 2026-06-11 21:01:05.193677 | controller | logserver-0 4/4 Running 0 32m 2026-06-11 21:01:05.193693 | controller | mariadb-0 2/2 Running 0 2m28s 2026-06-11 21:01:05.193704 | controller | nodepool-builder-0 4/4 Running 0 2m7s 2026-06-11 21:01:05.193712 | controller | nodepool-launcher-b79c8ffb-srkqh 3/3 Running 0 2m8s 2026-06-11 21:01:05.193720 | controller | test-fluentbit 1/1 Running 0 46m 2026-06-11 21:01:05.193728 | controller | test-loki-8cd4fd56-8v78l 1/1 Running 0 46m 2026-06-11 21:01:05.193736 | controller | zookeeper-0 2/2 Running 0 2m27s 2026-06-11 21:01:05.193744 | controller | zuul-executor-0 2/2 Running 0 23s 2026-06-11 21:01:05.193854 | controller | zuul-merger-0 2/2 Running 0 78s 2026-06-11 21:01:05.193868 | controller | zuul-merger-1 2/2 Running 0 2m2s 2026-06-11 21:01:05.193877 | controller | zuul-scheduler-0 3/3 Running 0 96s 2026-06-11 21:01:05.193885 | controller | zuul-web-5d5f9b866d-2bm9m 0/1 Running 0 22s 2026-06-11 21:01:05.193892 | controller | zuul-weeder-57c6567f5f-4x8rm 1/1 Running 0 33s 2026-06-12 01:01:05.348370 | controller | ok: Runtime: 0:00:00.114727 2026-06-12 01:01:05.359682 | 2026-06-12 01:01:05.359818 | TASK [Run dry-run update detection test] 2026-06-12 01:01:05.396832 | controller | ok 2026-06-12 01:01:05.433529 | 2026-06-12 01:01:05.433681 | TASK [test-dry-run-update-detection : Fetch current serial for zuul-executor] 2026-06-12 01:01:05.969301 | controller | ok: Runtime: 0:00:00.108069 2026-06-12 01:01:05.979463 | 2026-06-12 01:01:05.979819 | TASK [test-dry-run-update-detection : Fetch current serial for zuul-web] 2026-06-12 01:01:06.528985 | controller | ok: Runtime: 0:00:00.099807 2026-06-12 01:01:06.538622 | 2026-06-12 01:01:06.538762 | TASK [test-dry-run-update-detection : Patch zuul-executor statefulset template to trigger reconciliation] 2026-06-11 21:01:06.939897 | controller | statefulset.apps/zuul-executor patched 2026-06-12 01:01:07.092230 | controller | ok: Runtime: 0:00:00.113014 2026-06-12 01:01:07.103106 | 2026-06-12 01:01:07.103391 | TASK [test-dry-run-update-detection : Patch zuul-web deployment template to trigger reconciliation] 2026-06-11 21:01:07.491466 | controller | deployment.apps/zuul-web patched 2026-06-12 01:01:07.649086 | controller | ok: Runtime: 0:00:00.082685 2026-06-12 01:01:07.658623 | 2026-06-12 01:01:07.658755 | TASK [Run deploy with --dry-run to check for update detection] 2026-06-12 01:01:07.694356 | controller | ok 2026-06-12 01:01:07.730465 | 2026-06-12 01:01:07.730655 | TASK [run-operator-standalone : Ensure ~/zuul-output/logs] 2026-06-12 01:01:08.020662 | controller | ok 2026-06-12 01:01:08.030189 | 2026-06-12 01:01:08.030322 | TASK [run-operator-standalone : Clear previous log file] 2026-06-12 01:01:08.310137 | controller | ok 2026-06-12 01:01:08.321755 | 2026-06-12 01:01:08.321928 | TASK [run-operator-standalone : Run the operator in standalone mode] 2026-06-11 21:01:09.051058 | controller | 2026-06-11T21:01:09-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 21:01:09.051131 | controller | 2026-06-11 21:01:09.062964 | controller | 2026-06-11T21:01:09-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 21:01:09.062981 | controller | 2026-06-11 21:01:09.077445 | controller | 2026-06-11T21:01:09-04:00 INFO Deleting object, name: ca-cert (server dry run) 2026-06-11 21:01:09.688105 | controller | 2026-06-11T21:01:09-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 21:01:09.808921 | controller | 2026-06-11T21:01:09-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 21:01:10.091620 | controller | 2026-06-11T21:01:10-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:01:11.877579 | controller | 2026-06-11T21:01:11-04:00 INFO [Dry Run] Statefulset "zuul-executor" configuration changed, applying... 2026-06-11 21:01:11.877655 | controller | 2026-06-11T21:01:11-04:00 INFO [Dry Run] Reason: annotation 'serial' changed from '11' to '0' 2026-06-11 21:01:11.877666 | controller | 2026-06-11T21:01:11-04:00 INFO Updating object, name: zuul-executor (server dry run) 2026-06-11 21:01:12.678256 | controller | 2026-06-11T21:01:12-04:00 INFO [Dry Run] Statefulset "zuul-web" configuration changed, applying... 2026-06-11 21:01:12.678751 | controller | 2026-06-11T21:01:12-04:00 INFO [Dry Run] Reason: annotation 'serial' changed from '9' to '0' 2026-06-11 21:01:12.678777 | controller | 2026-06-11T21:01:12-04:00 INFO Updating object, name: zuul-web (server dry run) 2026-06-11 21:01:13.485434 | controller | 2026-06-11T21:01:13-04:00 INFO 2026-06-11 21:01:13.485523 | controller | - Config: Waiting ... 2026-06-11 21:01:13.485539 | controller | - Gateway: OK 2026-06-11 21:01:13.485552 | controller | - GitServer: OK 2026-06-11 21:01:13.485564 | controller | - HoundSearch: OK 2026-06-11 21:01:13.485576 | controller | - LogJuicer: OK 2026-06-11 21:01:13.485588 | controller | - Logserver: OK 2026-06-11 21:01:13.485599 | controller | - MariaDB: OK 2026-06-11 21:01:13.485611 | controller | - NodePoolBuilder: OK 2026-06-11 21:01:13.485622 | controller | - NodePoolLauncher: OK 2026-06-11 21:01:13.485633 | controller | - Zookeeper: OK 2026-06-11 21:01:13.485644 | controller | - Zuul: Waiting ... 2026-06-11 21:01:13.485656 | controller | - |_ Config Secrets: OK 2026-06-11 21:01:13.485667 | controller | - |_ Executor: Waiting ... 2026-06-11 21:01:13.485679 | controller | - |_ Merger: OK 2026-06-11 21:01:13.485690 | controller | - |_ Scheduler: OK 2026-06-11 21:01:13.485701 | controller | - |_ Web: Waiting ... 2026-06-11 21:01:13.485713 | controller | 2026-06-11 21:01:13.485726 | controller | 2026-06-11T21:01:13-04:00 INFO [Dry Run] Standalone reconcile done 2026-06-12 01:01:13.947093 | controller | ok: Runtime: 0:00:04.814824 2026-06-12 01:01:13.957019 | 2026-06-12 01:01:13.957158 | TASK [run-operator-standalone : Copy current spec] 2026-06-12 01:01:14.504479 | controller | ok: Runtime: 0:00:00.009450 2026-06-12 01:01:14.521155 | 2026-06-12 01:01:14.521284 | TASK [test-dry-run-update-detection : Check for 'update' dry-run message in the log for zuul-executor] 2026-06-11 21:01:14.809847 | controller | 2026-06-11T21:01:11-04:00 INFO [Dry Run] Reason: annotation 'serial' changed from '11' to '0' 2026-06-12 01:01:15.066730 | controller | ok: Runtime: 0:00:00.007058 2026-06-12 01:01:15.076701 | 2026-06-12 01:01:15.076844 | TASK [test-dry-run-update-detection : Check for 'update' dry-run message in the log for zuul-web] 2026-06-11 21:01:15.381263 | controller | 2026-06-11T21:01:12-04:00 INFO [Dry Run] Reason: annotation 'serial' changed from '9' to '0' 2026-06-12 01:01:15.625505 | controller | ok: Runtime: 0:00:00.008536 2026-06-12 01:01:15.635906 | 2026-06-12 01:01:15.636049 | TASK [test-dry-run-update-detection : Restore original serial for zuul-executor] 2026-06-11 21:01:16.028401 | controller | statefulset.apps/zuul-executor patched 2026-06-12 01:01:16.185894 | controller | ok: Runtime: 0:00:00.118696 2026-06-12 01:01:16.196066 | 2026-06-12 01:01:16.196241 | TASK [test-dry-run-update-detection : Restore original serial for zuul-web] 2026-06-11 21:01:16.618925 | controller | deployment.apps/zuul-web patched 2026-06-12 01:01:16.739762 | controller | ok: Runtime: 0:00:00.106516 2026-06-12 01:01:16.755234 | 2026-06-12 01:01:16.755339 | TASK [health-check/test-dry-run-lifecycle : Create a temporary directory for generated CRs] 2026-06-12 01:01:17.032547 | controller | changed 2026-06-12 01:01:17.041313 | 2026-06-12 01:01:17.041474 | TASK [health-check/test-dry-run-lifecycle : Generate CR with zuul-executor disabled] 2026-06-12 01:01:17.836913 | controller | changed 2026-06-12 01:01:17.851771 | 2026-06-12 01:01:17.851947 | TASK [Deploy SF without zuul-executor to ensure its removal] 2026-06-12 01:01:17.887358 | controller | ok 2026-06-12 01:01:17.918550 | 2026-06-12 01:01:17.918641 | TASK [run-operator-standalone : Ensure ~/zuul-output/logs] 2026-06-12 01:01:18.216101 | controller | ok 2026-06-12 01:01:18.225696 | 2026-06-12 01:01:18.225828 | TASK [run-operator-standalone : Clear previous log file] 2026-06-12 01:01:18.505403 | controller | changed 2026-06-12 01:01:18.517645 | 2026-06-12 01:01:18.517777 | TASK [run-operator-standalone : Run the operator in standalone mode] 2026-06-11 21:01:19.159789 | controller | 2026-06-11T21:01:19-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 21:01:19.159849 | controller | 2026-06-11 21:01:19.169743 | controller | 2026-06-11T21:01:19-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 21:01:19.169762 | controller | 2026-06-11 21:01:19.183447 | controller | 2026-06-11T21:01:19-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:01:19.801312 | controller | 2026-06-11T21:01:19-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 21:01:19.939226 | controller | 2026-06-11T21:01:19-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 21:01:19.949044 | controller | 2026-06-11T21:01:19-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:01:19.949089 | controller | 2026-06-11T21:01:19-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:01:19.970579 | controller | 2026-06-11T21:01:19-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:01:19.970626 | controller | 2026-06-11T21:01:19-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:01:20.205840 | controller | 2026-06-11T21:01:20-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:01:20.610734 | controller | 2026-06-11T21:01:20-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:01:20.610910 | controller | 2026-06-11T21:01:20-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:01:20.808697 | controller | 2026-06-11T21:01:20-04:00 INFO zuul-executor is disabled but running. Deleting the executor ... 2026-06-11 21:01:20.808847 | controller | 2026-06-11T21:01:20-04:00 INFO Deleting object, name: zuul-executor 2026-06-11 21:01:21.616018 | controller | 2026-06-11T21:01:21-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:01:21.616192 | controller | 2026-06-11T21:01:21-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:01:21.982798 | controller | 2026-06-11T21:01:21-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:01:21.982929 | controller | 2026-06-11T21:01:21-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 21:01:22.793319 | controller | 2026-06-11T21:01:22-04:00 INFO 2026-06-11 21:01:22.793457 | controller | - Config: Waiting ... 2026-06-11 21:01:22.793470 | controller | - Gateway: OK 2026-06-11 21:01:22.793479 | controller | - GitServer: OK 2026-06-11 21:01:22.793487 | controller | - HoundSearch: OK 2026-06-11 21:01:22.793495 | controller | - LogJuicer: OK 2026-06-11 21:01:22.793503 | controller | - Logserver: OK 2026-06-11 21:01:22.793523 | controller | - MariaDB: OK 2026-06-11 21:01:22.793531 | controller | - NodePoolBuilder: OK 2026-06-11 21:01:22.793538 | controller | - NodePoolLauncher: OK 2026-06-11 21:01:22.793547 | controller | - Zookeeper: OK 2026-06-11 21:01:22.793554 | controller | - Zuul: Waiting ... 2026-06-11 21:01:22.793562 | controller | - |_ Config Secrets: OK 2026-06-11 21:01:22.793570 | controller | - |_ Merger: OK 2026-06-11 21:01:22.793578 | controller | - |_ Scheduler: OK 2026-06-11 21:01:22.793586 | controller | - |_ Web: Waiting ... 2026-06-11 21:01:22.793594 | controller | 2026-06-11 21:01:22.793614 | controller | 2026-06-11T21:01:22-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-11 21:01:27.806406 | controller | 2026-06-11T21:01:27-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:01:28.423973 | controller | 2026-06-11T21:01:28-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:01:28.424051 | controller | 2026-06-11T21:01:28-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:01:28.445010 | controller | 2026-06-11T21:01:28-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:01:28.445064 | controller | 2026-06-11T21:01:28-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:01:28.818931 | controller | 2026-06-11T21:01:28-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:01:29.226780 | controller | 2026-06-11T21:01:29-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:01:29.226871 | controller | 2026-06-11T21:01:29-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:01:30.233387 | controller | 2026-06-11T21:01:30-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:01:30.233474 | controller | 2026-06-11T21:01:30-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:01:30.409194 | controller | 2026-06-11T21:01:30-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:01:30.409310 | controller | 2026-06-11T21:01:30-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 21:01:31.217699 | controller | 2026-06-11T21:01:31-04:00 INFO 2026-06-11 21:01:31.217769 | controller | - Config: Waiting ... 2026-06-11 21:01:31.217780 | controller | - Gateway: OK 2026-06-11 21:01:31.217789 | controller | - GitServer: OK 2026-06-11 21:01:31.217799 | controller | - HoundSearch: OK 2026-06-11 21:01:31.217807 | controller | - LogJuicer: OK 2026-06-11 21:01:31.217815 | controller | - Logserver: OK 2026-06-11 21:01:31.217822 | controller | - MariaDB: OK 2026-06-11 21:01:31.217830 | controller | - NodePoolBuilder: OK 2026-06-11 21:01:31.217838 | controller | - NodePoolLauncher: OK 2026-06-11 21:01:31.217846 | controller | - Zookeeper: OK 2026-06-11 21:01:31.217853 | controller | - Zuul: Waiting ... 2026-06-11 21:01:31.217861 | controller | - |_ Config Secrets: OK 2026-06-11 21:01:31.217869 | controller | - |_ Merger: OK 2026-06-11 21:01:31.217877 | controller | - |_ Scheduler: OK 2026-06-11 21:01:31.217884 | controller | - |_ Web: Waiting ... 2026-06-11 21:01:31.217892 | controller | 2026-06-11 21:01:31.217901 | controller | 2026-06-11T21:01:31-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-11 21:01:36.227570 | controller | 2026-06-11T21:01:36-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:01:36.849047 | controller | 2026-06-11T21:01:36-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:01:36.849135 | controller | 2026-06-11T21:01:36-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:01:36.870696 | controller | 2026-06-11T21:01:36-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:01:36.870783 | controller | 2026-06-11T21:01:36-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:01:37.244595 | controller | 2026-06-11T21:01:37-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:01:37.644662 | controller | 2026-06-11T21:01:37-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:01:37.644752 | controller | 2026-06-11T21:01:37-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:01:38.658609 | controller | 2026-06-11T21:01:38-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:01:38.658696 | controller | 2026-06-11T21:01:38-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:01:38.831321 | controller | 2026-06-11T21:01:38-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:01:38.831447 | controller | 2026-06-11T21:01:38-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 21:01:39.640771 | controller | 2026-06-11T21:01:39-04:00 INFO 2026-06-11 21:01:39.640857 | controller | - Config: Waiting ... 2026-06-11 21:01:39.640868 | controller | - Gateway: OK 2026-06-11 21:01:39.640878 | controller | - GitServer: OK 2026-06-11 21:01:39.640887 | controller | - HoundSearch: OK 2026-06-11 21:01:39.640895 | controller | - LogJuicer: OK 2026-06-11 21:01:39.640903 | controller | - Logserver: OK 2026-06-11 21:01:39.640910 | controller | - MariaDB: OK 2026-06-11 21:01:39.640918 | controller | - NodePoolBuilder: OK 2026-06-11 21:01:39.640926 | controller | - NodePoolLauncher: OK 2026-06-11 21:01:39.640934 | controller | - Zookeeper: OK 2026-06-11 21:01:39.640942 | controller | - Zuul: Waiting ... 2026-06-11 21:01:39.640950 | controller | - |_ Config Secrets: OK 2026-06-11 21:01:39.640958 | controller | - |_ Merger: OK 2026-06-11 21:01:39.640966 | controller | - |_ Scheduler: OK 2026-06-11 21:01:39.640973 | controller | - |_ Web: Waiting ... 2026-06-11 21:01:39.640982 | controller | 2026-06-11 21:01:39.640999 | controller | 2026-06-11T21:01:39-04:00 INFO [attempt #3] Waiting 5s for the next reconcile call ... 2026-06-11 21:01:44.651409 | controller | 2026-06-11T21:01:44-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:01:45.270861 | controller | 2026-06-11T21:01:45-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:01:45.270934 | controller | 2026-06-11T21:01:45-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:01:45.297191 | controller | 2026-06-11T21:01:45-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:01:45.297271 | controller | 2026-06-11T21:01:45-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:01:45.668112 | controller | 2026-06-11T21:01:45-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:01:46.070772 | controller | 2026-06-11T21:01:46-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:01:46.070871 | controller | 2026-06-11T21:01:46-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:01:47.083896 | controller | 2026-06-11T21:01:47-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:01:47.083989 | controller | 2026-06-11T21:01:47-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:01:47.255214 | controller | 2026-06-11T21:01:47-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:01:47.255295 | controller | 2026-06-11T21:01:47-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 21:01:48.466175 | controller | 2026-06-11T21:01:48-04:00 INFO 2026-06-11 21:01:48.466238 | controller | - Config: OK 2026-06-11 21:01:48.466249 | controller | - Gateway: OK 2026-06-11 21:01:48.466257 | controller | - GitServer: OK 2026-06-11 21:01:48.466266 | controller | - HoundSearch: OK 2026-06-11 21:01:48.466274 | controller | - LogJuicer: OK 2026-06-11 21:01:48.466282 | controller | - Logserver: OK 2026-06-11 21:01:48.466290 | controller | - MariaDB: OK 2026-06-11 21:01:48.466298 | controller | - NodePoolBuilder: OK 2026-06-11 21:01:48.466306 | controller | - NodePoolLauncher: OK 2026-06-11 21:01:48.466314 | controller | - Zookeeper: OK 2026-06-11 21:01:48.466321 | controller | - Zuul: OK 2026-06-11 21:01:48.466330 | controller | 2026-06-11 21:01:48.466345 | controller | 2026-06-11T21:01:48-04:00 INFO Updating controller configmap ... 2026-06-11 21:01:48.854311 | controller | 2026-06-11T21:01:48-04:00 INFO Standalone reconcile done. 2026-06-12 01:01:49.103050 | controller | ok: Runtime: 0:00:30.091380 2026-06-12 01:01:49.116955 | 2026-06-12 01:01:49.117100 | TASK [run-operator-standalone : Copy current spec] 2026-06-12 01:01:49.660368 | controller | ok: Runtime: 0:00:00.007419 2026-06-12 01:01:49.676740 | 2026-06-12 01:01:49.676869 | TASK [health-check/test-dry-run-lifecycle : Ensure zuul-executor StatefulSet is not present] 2026-06-11 21:01:50.049833 | controller | Error from server (NotFound): statefulsets.apps "zuul-executor" not found 2026-06-12 01:01:50.221179 | controller | ok: Runtime: 0:00:00.101711 2026-06-12 01:01:50.230505 | 2026-06-12 01:01:50.230635 | TASK [Run update detection test on zuul-web only] 2026-06-12 01:01:50.265572 | controller | ok 2026-06-12 01:01:50.305863 | 2026-06-12 01:01:50.305950 | TASK [test-dry-run-update-detection : Fetch current serial for zuul-executor] 2026-06-12 01:01:50.834476 | controller | skipping: Conditional result was False 2026-06-12 01:01:50.845205 | 2026-06-12 01:01:50.845344 | TASK [test-dry-run-update-detection : Fetch current serial for zuul-web] 2026-06-12 01:01:51.390830 | controller | ok: Runtime: 0:00:00.079061 2026-06-12 01:01:51.400763 | 2026-06-12 01:01:51.400898 | TASK [test-dry-run-update-detection : Patch zuul-executor statefulset template to trigger reconciliation] 2026-06-12 01:01:52.009905 | controller | skipping: Conditional result was False 2026-06-12 01:01:52.021601 | 2026-06-12 01:01:52.021759 | TASK [test-dry-run-update-detection : Patch zuul-web deployment template to trigger reconciliation] 2026-06-11 21:01:52.433184 | controller | deployment.apps/zuul-web patched 2026-06-12 01:01:52.568862 | controller | ok: Runtime: 0:00:00.108107 2026-06-12 01:01:52.578121 | 2026-06-12 01:01:52.578286 | TASK [Run deploy with --dry-run to check for update detection] 2026-06-12 01:01:52.615005 | controller | ok 2026-06-12 01:01:52.652043 | 2026-06-12 01:01:52.652149 | TASK [run-operator-standalone : Ensure ~/zuul-output/logs] 2026-06-12 01:01:52.954530 | controller | ok 2026-06-12 01:01:52.964751 | 2026-06-12 01:01:52.964883 | TASK [run-operator-standalone : Clear previous log file] 2026-06-12 01:01:53.225012 | controller | changed 2026-06-12 01:01:53.235360 | 2026-06-12 01:01:53.235542 | TASK [run-operator-standalone : Run the operator in standalone mode] 2026-06-11 21:01:53.889819 | controller | 2026-06-11T21:01:53-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 21:01:53.889902 | controller | 2026-06-11 21:01:53.906261 | controller | 2026-06-11T21:01:53-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 21:01:53.906297 | controller | 2026-06-11 21:01:53.921255 | controller | 2026-06-11T21:01:53-04:00 INFO Deleting object, name: ca-cert (server dry run) 2026-06-11 21:01:54.535307 | controller | 2026-06-11T21:01:54-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 21:01:54.680019 | controller | 2026-06-11T21:01:54-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 21:01:54.934837 | controller | 2026-06-11T21:01:54-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:01:56.721267 | controller | 2026-06-11T21:01:56-04:00 INFO [Dry Run] Statefulset "zuul-web" configuration changed, applying... 2026-06-11 21:01:56.721316 | controller | 2026-06-11T21:01:56-04:00 INFO [Dry Run] Reason: annotation 'serial' changed from '9' to '0' 2026-06-11 21:01:56.721327 | controller | 2026-06-11T21:01:56-04:00 INFO Updating object, name: zuul-web (server dry run) 2026-06-11 21:01:57.528525 | controller | 2026-06-11T21:01:57-04:00 INFO 2026-06-11 21:01:57.528589 | controller | - Config: Waiting ... 2026-06-11 21:01:57.528604 | controller | - Gateway: OK 2026-06-11 21:01:57.528616 | controller | - GitServer: OK 2026-06-11 21:01:57.528629 | controller | - HoundSearch: OK 2026-06-11 21:01:57.528641 | controller | - LogJuicer: OK 2026-06-11 21:01:57.528652 | controller | - Logserver: OK 2026-06-11 21:01:57.528663 | controller | - MariaDB: OK 2026-06-11 21:01:57.528674 | controller | - NodePoolBuilder: OK 2026-06-11 21:01:57.528685 | controller | - NodePoolLauncher: OK 2026-06-11 21:01:57.528711 | controller | - Zookeeper: OK 2026-06-11 21:01:57.528723 | controller | - Zuul: Waiting ... 2026-06-11 21:01:57.528734 | controller | - |_ Config Secrets: OK 2026-06-11 21:01:57.528746 | controller | - |_ Merger: OK 2026-06-11 21:01:57.528756 | controller | - |_ Scheduler: OK 2026-06-11 21:01:57.528768 | controller | - |_ Web: Waiting ... 2026-06-11 21:01:57.528779 | controller | 2026-06-11 21:01:57.528791 | controller | 2026-06-11T21:01:57-04:00 INFO [Dry Run] Standalone reconcile done 2026-06-12 01:01:57.792525 | controller | ok: Runtime: 0:00:04.009871 2026-06-12 01:01:57.803393 | 2026-06-12 01:01:57.803622 | TASK [run-operator-standalone : Copy current spec] 2026-06-12 01:01:58.355327 | controller | ok: Runtime: 0:00:00.006106 2026-06-12 01:01:58.372608 | 2026-06-12 01:01:58.372745 | TASK [test-dry-run-update-detection : Check for 'update' dry-run message in the log for zuul-executor] 2026-06-12 01:01:58.912288 | controller | skipping: Conditional result was False 2026-06-12 01:01:58.922163 | 2026-06-12 01:01:58.922300 | TASK [test-dry-run-update-detection : Check for 'update' dry-run message in the log for zuul-web] 2026-06-11 21:01:59.196300 | controller | 2026-06-11T21:01:56-04:00 INFO [Dry Run] Reason: annotation 'serial' changed from '9' to '0' 2026-06-12 01:01:59.457008 | controller | ok: Runtime: 0:00:00.005454 2026-06-12 01:01:59.466396 | 2026-06-12 01:01:59.466567 | TASK [test-dry-run-update-detection : Restore original serial for zuul-executor] 2026-06-12 01:02:00.007825 | controller | skipping: Conditional result was False 2026-06-12 01:02:00.019544 | 2026-06-12 01:02:00.019700 | TASK [test-dry-run-update-detection : Restore original serial for zuul-web] 2026-06-11 21:02:00.431570 | controller | deployment.apps/zuul-web patched 2026-06-12 01:02:00.566541 | controller | ok: Runtime: 0:00:00.111908 2026-06-12 01:02:00.582746 | 2026-06-12 01:02:00.582876 | TASK [health-check/test-dry-run-lifecycle : Generate CR with zuul-executor enabled] 2026-06-12 01:02:01.399348 | controller | changed 2026-06-12 01:02:01.409113 | 2026-06-12 01:02:01.409273 | TASK [Run deploy with --dry-run to test from-scratch creation] 2026-06-12 01:02:01.448804 | controller | ok 2026-06-12 01:02:01.487110 | 2026-06-12 01:02:01.487218 | TASK [run-operator-standalone : Ensure ~/zuul-output/logs] 2026-06-12 01:02:01.765303 | controller | ok 2026-06-12 01:02:01.774887 | 2026-06-12 01:02:01.775019 | TASK [run-operator-standalone : Clear previous log file] 2026-06-12 01:02:02.096150 | controller | ok 2026-06-12 01:02:02.107491 | 2026-06-12 01:02:02.107631 | TASK [run-operator-standalone : Run the operator in standalone mode] 2026-06-11 21:02:02.736005 | controller | 2026-06-11T21:02:02-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 21:02:02.736143 | controller | 2026-06-11 21:02:02.748102 | controller | 2026-06-11T21:02:02-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 21:02:02.748147 | controller | 2026-06-11 21:02:02.763177 | controller | 2026-06-11T21:02:02-04:00 INFO Deleting object, name: ca-cert (server dry run) 2026-06-11 21:02:03.378268 | controller | 2026-06-11T21:02:03-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 21:02:03.506080 | controller | 2026-06-11T21:02:03-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 21:02:03.778661 | controller | 2026-06-11T21:02:03-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:02:05.562620 | controller | 2026-06-11T21:02:05-04:00 INFO Creating object, name: zuul-executor (server dry run) 2026-06-11 21:02:07.169315 | controller | 2026-06-11T21:02:07-04:00 INFO 2026-06-11 21:02:07.169415 | controller | - Config: Waiting ... 2026-06-11 21:02:07.169429 | controller | - Gateway: OK 2026-06-11 21:02:07.169438 | controller | - GitServer: OK 2026-06-11 21:02:07.169446 | controller | - HoundSearch: OK 2026-06-11 21:02:07.169454 | controller | - LogJuicer: OK 2026-06-11 21:02:07.169462 | controller | - Logserver: OK 2026-06-11 21:02:07.169470 | controller | - MariaDB: OK 2026-06-11 21:02:07.169477 | controller | - NodePoolBuilder: OK 2026-06-11 21:02:07.169485 | controller | - NodePoolLauncher: OK 2026-06-11 21:02:07.169493 | controller | - Zookeeper: OK 2026-06-11 21:02:07.169501 | controller | - Zuul: Waiting ... 2026-06-11 21:02:07.169509 | controller | - |_ Config Secrets: OK 2026-06-11 21:02:07.169517 | controller | - |_ Executor: Waiting ... 2026-06-11 21:02:07.169525 | controller | - |_ Merger: OK 2026-06-11 21:02:07.169533 | controller | - |_ Scheduler: OK 2026-06-11 21:02:07.169541 | controller | - |_ Web: OK 2026-06-11 21:02:07.169549 | controller | 2026-06-11 21:02:07.169565 | controller | 2026-06-11T21:02:07-04:00 INFO [Dry Run] Standalone reconcile done 2026-06-12 01:02:07.661860 | controller | ok: Runtime: 0:00:04.805355 2026-06-12 01:02:07.672841 | 2026-06-12 01:02:07.672990 | TASK [run-operator-standalone : Copy current spec] 2026-06-12 01:02:08.222477 | controller | ok: Runtime: 0:00:00.008093 2026-06-12 01:02:08.240646 | 2026-06-12 01:02:08.240824 | TASK [health-check/test-dry-run-lifecycle : Check for 'create' dry-run messages for zuul-executor resources] 2026-06-11 21:02:08.531538 | controller | 2026-06-11T21:02:05-04:00 INFO Creating object, name: zuul-executor (server dry run) 2026-06-12 01:02:08.785012 | controller | ok: Runtime: 0:00:00.007554 2026-06-12 01:02:08.794095 | 2026-06-12 01:02:08.794225 | TASK [Restore original state by deploying with zuul-executor enabled] 2026-06-12 01:02:08.840731 | controller | ok 2026-06-12 01:02:08.886232 | 2026-06-12 01:02:08.886448 | TASK [run-operator-standalone : Ensure ~/zuul-output/logs] 2026-06-12 01:02:09.180618 | controller | ok 2026-06-12 01:02:09.274895 | 2026-06-12 01:02:09.275048 | TASK [run-operator-standalone : Clear previous log file] 2026-06-12 01:02:09.552694 | controller | changed 2026-06-12 01:02:09.562601 | 2026-06-12 01:02:09.562740 | TASK [run-operator-standalone : Run the operator in standalone mode] 2026-06-11 21:02:10.189451 | controller | 2026-06-11T21:02:10-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 21:02:10.189577 | controller | 2026-06-11 21:02:10.197779 | controller | 2026-06-11T21:02:10-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 21:02:10.197817 | controller | 2026-06-11 21:02:10.210951 | controller | 2026-06-11T21:02:10-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:02:10.826924 | controller | 2026-06-11T21:02:10-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 21:02:10.954306 | controller | 2026-06-11T21:02:10-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 21:02:10.962627 | controller | 2026-06-11T21:02:10-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:02:10.962670 | controller | 2026-06-11T21:02:10-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:02:10.984398 | controller | 2026-06-11T21:02:10-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:02:10.984451 | controller | 2026-06-11T21:02:10-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:02:11.226557 | controller | 2026-06-11T21:02:11-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:02:11.630173 | controller | 2026-06-11T21:02:11-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:02:11.630263 | controller | 2026-06-11T21:02:11-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:02:12.648223 | controller | 2026-06-11T21:02:12-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:02:12.648311 | controller | 2026-06-11T21:02:12-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:02:13.012870 | controller | 2026-06-11T21:02:13-04:00 INFO Creating object, name: zuul-executor 2026-06-11 21:02:13.811342 | controller | 2026-06-11T21:02:13-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:02:13.811456 | controller | 2026-06-11T21:02:13-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 21:02:14.622758 | controller | 2026-06-11T21:02:14-04:00 INFO 2026-06-11 21:02:14.622846 | controller | - Config: Waiting ... 2026-06-11 21:02:14.622859 | controller | - Gateway: OK 2026-06-11 21:02:14.622871 | controller | - GitServer: OK 2026-06-11 21:02:14.622882 | controller | - HoundSearch: OK 2026-06-11 21:02:14.622893 | controller | - LogJuicer: OK 2026-06-11 21:02:14.622903 | controller | - Logserver: OK 2026-06-11 21:02:14.622914 | controller | - MariaDB: OK 2026-06-11 21:02:14.622926 | controller | - NodePoolBuilder: OK 2026-06-11 21:02:14.622937 | controller | - NodePoolLauncher: OK 2026-06-11 21:02:14.622947 | controller | - Zookeeper: OK 2026-06-11 21:02:14.622954 | controller | - Zuul: Waiting ... 2026-06-11 21:02:14.622962 | controller | - |_ Config Secrets: OK 2026-06-11 21:02:14.622970 | controller | - |_ Executor: Waiting ... 2026-06-11 21:02:14.622978 | controller | - |_ Merger: OK 2026-06-11 21:02:14.622985 | controller | - |_ Scheduler: OK 2026-06-11 21:02:14.622993 | controller | - |_ Web: OK 2026-06-11 21:02:14.623001 | controller | 2026-06-11 21:02:14.623010 | controller | 2026-06-11T21:02:14-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-11 21:02:19.633323 | controller | 2026-06-11T21:02:19-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:02:20.258340 | controller | 2026-06-11T21:02:20-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:02:20.258453 | controller | 2026-06-11T21:02:20-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:02:20.274918 | controller | 2026-06-11T21:02:20-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:02:20.274955 | controller | 2026-06-11T21:02:20-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:02:20.656274 | controller | 2026-06-11T21:02:20-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:02:21.072502 | controller | 2026-06-11T21:02:21-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:02:21.072591 | controller | 2026-06-11T21:02:21-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:02:22.070775 | controller | 2026-06-11T21:02:22-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:02:22.070842 | controller | 2026-06-11T21:02:22-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:02:22.248745 | controller | 2026-06-11T21:02:22-04:00 INFO Waiting for statefulset, name: zuul-executor 2026-06-11 21:02:26.279798 | controller | 2026-06-11T21:02:26-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:02:26.279898 | controller | 2026-06-11T21:02:26-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 21:02:26.324697 | controller | 2026-06-11T21:02:26-04:00 INFO 2026-06-11 21:02:26.324755 | controller | - Config: OK 2026-06-11 21:02:26.324770 | controller | - Gateway: OK 2026-06-11 21:02:26.324781 | controller | - GitServer: OK 2026-06-11 21:02:26.324792 | controller | - HoundSearch: OK 2026-06-11 21:02:26.324803 | controller | - LogJuicer: OK 2026-06-11 21:02:26.324814 | controller | - Logserver: OK 2026-06-11 21:02:26.324825 | controller | - MariaDB: OK 2026-06-11 21:02:26.324837 | controller | - NodePoolBuilder: OK 2026-06-11 21:02:26.324848 | controller | - NodePoolLauncher: OK 2026-06-11 21:02:26.324859 | controller | - Zookeeper: OK 2026-06-11 21:02:26.324871 | controller | - Zuul: OK 2026-06-11 21:02:26.324883 | controller | 2026-06-11 21:02:26.324961 | controller | 2026-06-11T21:02:26-04:00 INFO Updating controller configmap ... 2026-06-11 21:02:26.670588 | controller | 2026-06-11T21:02:26-04:00 INFO Standalone reconcile done. 2026-06-12 01:02:27.132240 | controller | ok: Runtime: 0:00:16.843038 2026-06-12 01:02:27.138999 | 2026-06-12 01:02:27.139079 | TASK [run-operator-standalone : Copy current spec] 2026-06-12 01:02:27.669331 | controller | ok: Runtime: 0:00:00.007369 2026-06-12 01:02:27.688282 | 2026-06-12 01:02:27.688534 | TASK [health-check/test-dry-run-lifecycle : Remove temporary directory] 2026-06-12 01:02:27.964721 | controller | changed 2026-06-12 01:02:27.983637 | 2026-06-12 01:02:27.983773 | TASK [health-check/test-backup-restore : Backup the Software Factory deployment] 2026-06-11 21:02:28.627877 | controller | 2026-06-11T21:02:28-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 21:02:28.628072 | controller | 2026-06-11 21:02:28.636686 | controller | 2026-06-11T21:02:28-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 21:02:28.636707 | controller | 2026-06-11 21:02:28.640911 | controller | 2026-06-11T21:02:28-04:00 INFO Starting backup process for services in namespace: sf 2026-06-11 21:02:28.640939 | controller | 2026-06-11T21:02:28-04:00 INFO Creating secrets backup... 2026-06-11 21:02:28.668659 | controller | 2026-06-11T21:02:28-04:00 INFO Finished doing secret backup! 2026-06-11 21:02:28.668722 | controller | 2026-06-11T21:02:28-04:00 INFO Doing Zuul keys backup... 2026-06-11 21:02:28.671688 | controller | 2026-06-11T21:02:28-04:00 INFO Creating object, name: zuul-kazoo 2026-06-11 21:02:30.687605 | controller | 2026-06-11T21:02:30-04:00 INFO Running pod execution pod: zuul-kazoo, command: [zuul-admin export-keys /tmp/zuul-backup] 2026-06-11 21:02:32.354676 | controller | INFO:kazoo.client:Connecting to zookeeper-0.zookeeper-headless.sf(10.244.0.98):2281, use_ssl: True 2026-06-11 21:02:32.438562 | controller | INFO:kazoo.client:Zookeeper connection established, state: CONNECTED 2026-06-11 21:02:32.557350 | controller | INFO:zuul.KeyStorage:Exported: /keystorage/opendev.org/zuul/zuul%2Fzuul-jobs/ssh 2026-06-11 21:02:32.557456 | controller | INFO:zuul.KeyStorage:Exported: /keystorage/opendev.org/zuul/zuul%2Fzuul-jobs/secrets 2026-06-11 21:02:32.557468 | controller | INFO:zuul.KeyStorage:Exported: /keystorage/gerrit/demo-tenant-config/demo-tenant-config/ssh 2026-06-11 21:02:32.557477 | controller | INFO:zuul.KeyStorage:Exported: /keystorage/gerrit/demo-tenant-config/demo-tenant-config/secrets 2026-06-11 21:02:32.557492 | controller | INFO:zuul.KeyStorage:Exported: /keystorage/gerrit/demo-project/demo-project/ssh 2026-06-11 21:02:32.557501 | controller | INFO:zuul.KeyStorage:Exported: /keystorage/gerrit/demo-project/demo-project/secrets 2026-06-11 21:02:32.557933 | controller | INFO:zuul.KeyStorage:Exported: /keystorage/gerrit/ichiban-config-Z5F8jidd/ichiban-config-Z5F8jidd/ssh 2026-06-11 21:02:32.557946 | controller | INFO:zuul.KeyStorage:Exported: /keystorage/gerrit/ichiban-config-Z5F8jidd/ichiban-config-Z5F8jidd/secrets 2026-06-11 21:02:32.557955 | controller | INFO:zuul.KeyStorage:Exported: /keystorage/gerrit/config/config/ssh 2026-06-11 21:02:32.557963 | controller | INFO:zuul.KeyStorage:Exported: /keystorage/gerrit/config/config/secrets 2026-06-11 21:02:32.557974 | controller | INFO:zuul.KeyStorage:Exported: /keystorage/git-server/system-config/system-config/ssh 2026-06-11 21:02:32.558446 | controller | INFO:zuul.KeyStorage:Exported: /keystorage/git-server/system-config/system-config/secrets 2026-06-11 21:02:32.558464 | controller | INFO:zuul.KeyStorage:Exported: /keystorage2/tenant/internal/ssh 2026-06-11 21:02:32.558473 | controller | INFO:zuul.KeyStorage:Exported: /keystorage2/tenant/demo-tenant/ssh 2026-06-11 21:02:32.558906 | controller | INFO:zuul.KeyStorage:Exported: /keystorage2/tenant/ichiban-tenant-Z5F8jidd/ssh 2026-06-11 21:02:33.557222 | controller | 2026-06-11T21:02:33-04:00 INFO Running pod execution pod: zuul-kazoo, command: [cat /tmp/zuul-backup] 2026-06-11 21:02:33.679256 | controller | 2026-06-11T21:02:33-04:00 INFO Running pod execution pod: zuul-kazoo, command: [rm /tmp/zuul-backup] 2026-06-11 21:02:33.820641 | controller | 2026-06-11T21:02:33-04:00 INFO Finished doing Zuul private keys backup! 2026-06-11 21:02:33.824711 | controller | 2026-06-11T21:02:33-04:00 INFO Deleting object, name: zuul-kazoo 2026-06-11 21:02:33.830313 | controller | 2026-06-11T21:02:33-04:00 INFO Doing DB backup... 2026-06-11 21:02:33.833869 | controller | 2026-06-11T21:02:33-04:00 INFO Running pod execution pod: mariadb-0, command: [mysqldump --databases zuul --single-transaction] 2026-06-11 21:02:33.978139 | controller | mysqldump: Deprecated program name. It will be removed in a future release, use '/usr/bin/mariadb-dump' instead 2026-06-11 21:02:33.978218 | controller | Warning: World-writable config file '/etc/my.cnf.d/docker.cnf' is ignored 2026-06-11 21:02:34.182255 | controller | 2026-06-11T21:02:34-04:00 INFO Finished doing DBs backup! 2026-06-12 01:02:34.539607 | controller | ok: Runtime: 0:00:05.912457 2026-06-12 01:02:34.550911 | 2026-06-12 01:02:34.551077 | TASK [health-check/test-backup-restore : Fetch the last build ID reported by Zuul web] 2026-06-12 01:02:35.114719 | controller | ok: OK (698 bytes) 2026-06-12 01:02:35.125900 | 2026-06-12 01:02:35.126050 | TASK [health-check/test-backup-restore : Wipe Software Factory deployment] 2026-06-11 21:02:35.750718 | controller | 2026-06-11T21:02:35-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 21:02:35.750789 | controller | 2026-06-11 21:02:35.765779 | controller | 2026-06-11T21:02:35-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 21:02:35.765812 | controller | 2026-06-11 21:02:35.793581 | controller | 2026-06-11T21:02:35-04:00 INFO Warning: Killing ZooKeeper client: nodepool-builder-0 nodepool-builder 2026-06-11 21:02:35.793627 | controller | 2026-06-11T21:02:35-04:00 INFO Running pod execution pod: nodepool-builder-0, command: [kill -9 1] 2026-06-11 21:02:35.906715 | controller | 2026-06-11T21:02:35-04:00 INFO Deleting object, name: nodepool-builder 2026-06-11 21:02:35.913802 | controller | 2026-06-11T21:02:35-04:00 INFO Warning: Killing ZooKeeper client: nodepool-launcher-b79c8ffb-srkqh launcher 2026-06-11 21:02:35.913855 | controller | 2026-06-11T21:02:35-04:00 INFO Running pod execution pod: nodepool-launcher-b79c8ffb-srkqh, command: [kill -9 1] 2026-06-11 21:02:36.048906 | controller | 2026-06-11T21:02:36-04:00 INFO Deleting object, name: launcher 2026-06-11 21:02:36.051491 | controller | 2026-06-11T21:02:36-04:00 INFO Warning: Killing ZooKeeper client: zuul-db-provision-26r62 mariadb-client 2026-06-11 21:02:36.051514 | controller | 2026-06-11T21:02:36-04:00 INFO Running pod execution pod: zuul-db-provision-26r62, command: [kill -9 1] 2026-06-11 21:02:36.073391 | controller | 2026-06-11T21:02:36-04:00 INFO Deleting object, name: mariadb-client 2026-06-11 21:02:36.075944 | controller | 2026-06-11T21:02:36-04:00 INFO Warning: Killing ZooKeeper client: zuul-db-provision-74d9p mariadb-client 2026-06-11 21:02:36.075971 | controller | 2026-06-11T21:02:36-04:00 INFO Running pod execution pod: zuul-db-provision-74d9p, command: [kill -9 1] 2026-06-11 21:02:36.096801 | controller | 2026-06-11T21:02:36-04:00 INFO Deleting object, name: mariadb-client 2026-06-11 21:02:36.099166 | controller | 2026-06-11T21:02:36-04:00 INFO Warning: Killing ZooKeeper client: zuul-executor-0 zuul-executor 2026-06-11 21:02:36.099189 | controller | 2026-06-11T21:02:36-04:00 INFO Running pod execution pod: zuul-executor-0, command: [kill -9 1] 2026-06-11 21:02:36.168089 | controller | 2026-06-11T21:02:36-04:00 INFO Deleting object, name: zuul-executor 2026-06-11 21:02:36.173150 | controller | 2026-06-11T21:02:36-04:00 INFO Warning: Killing ZooKeeper client: zuul-kazoo zuul-kazoo 2026-06-11 21:02:36.173179 | controller | 2026-06-11T21:02:36-04:00 INFO Running pod execution pod: zuul-kazoo, command: [kill -9 1] 2026-06-11 21:03:04.019592 | controller | 2026-06-11T21:03:04-04:00 INFO Deleting object, name: zuul-kazoo 2026-06-11 21:03:04.023299 | controller | 2026-06-11T21:03:04-04:00 INFO Warning: Killing ZooKeeper client: zuul-merger-0 zuul-merger 2026-06-11 21:03:04.023342 | controller | 2026-06-11T21:03:04-04:00 INFO Running pod execution pod: zuul-merger-0, command: [kill -9 1] 2026-06-11 21:03:04.167095 | controller | 2026-06-11T21:03:04-04:00 INFO Deleting object, name: zuul-merger 2026-06-11 21:03:04.173314 | controller | 2026-06-11T21:03:04-04:00 INFO Warning: Killing ZooKeeper client: zuul-merger-1 zuul-merger 2026-06-11 21:03:04.173355 | controller | 2026-06-11T21:03:04-04:00 INFO Running pod execution pod: zuul-merger-1, command: [kill -9 1] 2026-06-11 21:03:05.492747 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: zuul-merger 2026-06-11 21:03:05.498134 | controller | 2026-06-11T21:03:05-04:00 INFO Warning: Killing ZooKeeper client: zuul-scheduler-0 zuul-scheduler 2026-06-11 21:03:05.498170 | controller | 2026-06-11T21:03:05-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [kill -9 1] 2026-06-11 21:03:05.617989 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: zuul-scheduler 2026-06-11 21:03:05.622507 | controller | 2026-06-11T21:03:05-04:00 INFO Warning: Killing ZooKeeper client: zuul-web-5d5f9b866d-2bm9m zuul-web 2026-06-11 21:03:05.622535 | controller | 2026-06-11T21:03:05-04:00 INFO Running pod execution pod: zuul-web-5d5f9b866d-2bm9m, command: [kill -9 1] 2026-06-11 21:03:05.749995 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: zuul-web 2026-06-11 21:03:05.756474 | controller | 2026-06-11T21:03:05-04:00 INFO Warning: Killing ZooKeeper client: zuul-weeder-57c6567f5f-4x8rm zuul-weeder 2026-06-11 21:03:05.756534 | controller | 2026-06-11T21:03:05-04:00 INFO Running pod execution pod: zuul-weeder-57c6567f5f-4x8rm, command: [kill -9 1] 2026-06-11 21:03:05.883927 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: zuul-weeder 2026-06-11 21:03:05.888720 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: zookeeper 2026-06-11 21:03:05.902192 | controller | 2026-06-11T21:03:05-04:00 INFO Standalone mode detected. Deleting owner ConfigMap with foreground propagation. 2026-06-11 21:03:05.902256 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: sf-standalone-owner 2026-06-11 21:03:05.906321 | controller | 2026-06-11T21:03:05-04:00 INFO Cleaning resources... 2026-06-11 21:03:05.911486 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: gateway 2026-06-11 21:03:05.930338 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: hound-search 2026-06-11 21:03:05.939554 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: logjuicer 2026-06-11 21:03:05.948897 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: nodepool-launcher 2026-06-11 21:03:05.961377 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: zookeeper 2026-06-11 21:03:05.969260 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: zookeeper-headless 2026-06-11 21:03:05.974444 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: zuul-capacity 2026-06-11 21:03:05.982142 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: zuul-executor-headless 2026-06-11 21:03:05.987075 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: zuul-web 2026-06-11 21:03:05.995401 | controller | 2026-06-11T21:03:05-04:00 INFO Deleting object, name: zuul-weeder 2026-06-11 21:03:06.007408 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: gateway 2026-06-11 21:03:06.010902 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: logjuicer 2026-06-11 21:03:06.013471 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: nodepool-launcher 2026-06-11 21:03:06.020776 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: git-server 2026-06-11 21:03:06.024244 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: hound-search 2026-06-11 21:03:06.030266 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: logserver 2026-06-11 21:03:06.033216 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: mariadb 2026-06-11 21:03:06.064956 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-x9nlh", "status": "Running"} 2026-06-11 21:03:06.065019 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: gateway-6bbbd758d9-x9nlh 2026-06-11 21:03:06.073392 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting pod {"name": "git-server-0", "status": "Running"} 2026-06-11 21:03:06.073449 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: git-server-0 2026-06-11 21:03:06.082264 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting pod {"name": "hound-search-0", "status": "Running"} 2026-06-11 21:03:06.082305 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: hound-search-0 2026-06-11 21:03:06.093222 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-m82j9", "status": "Running"} 2026-06-11 21:03:06.093259 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-m82j9 2026-06-11 21:03:06.099753 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting pod {"name": "logserver-0", "status": "Running"} 2026-06-11 21:03:06.099789 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: logserver-0 2026-06-11 21:03:06.108690 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting pod {"name": "mariadb-0", "status": "Running"} 2026-06-11 21:03:06.108736 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: mariadb-0 2026-06-11 21:03:06.114902 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-srkqh", "status": "Running"} 2026-06-11 21:03:06.114932 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-srkqh 2026-06-11 21:03:06.119142 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting pod {"name": "zookeeper-0", "status": "Running"} 2026-06-11 21:03:06.119171 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: zookeeper-0 2026-06-11 21:03:06.121344 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting pod {"name": "zuul-merger-0", "status": "Failed"} 2026-06-11 21:03:06.121387 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: zuul-merger-0 2026-06-11 21:03:06.124031 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting pod {"name": "zuul-merger-1", "status": "Failed"} 2026-06-11 21:03:06.124052 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: zuul-merger-1 2026-06-11 21:03:06.126551 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting pod {"name": "zuul-scheduler-0", "status": "Running"} 2026-06-11 21:03:06.126568 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 21:03:06.268394 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Running"} 2026-06-11 21:03:06.268447 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:06.468982 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting pod {"name": "zuul-weeder-57c6567f5f-4x8rm", "status": "Running"} 2026-06-11 21:03:06.469037 | controller | 2026-06-11T21:03:06-04:00 INFO Deleting object, name: zuul-weeder-57c6567f5f-4x8rm 2026-06-11 21:03:08.677522 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Running"} 2026-06-11 21:03:08.677626 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:08.683345 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-m82j9", "status": "Running"} 2026-06-11 21:03:08.683407 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-m82j9 2026-06-11 21:03:08.688417 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:08.688477 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:08.693313 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting pod {"name": "logserver-0", "status": "Running"} 2026-06-11 21:03:08.693353 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting object, name: logserver-0 2026-06-11 21:03:08.697796 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-bt78j", "status": "Pending"} 2026-06-11 21:03:08.697883 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-bt78j 2026-06-11 21:03:08.705880 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-srkqh", "status": "Running"} 2026-06-11 21:03:08.705940 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-srkqh 2026-06-11 21:03:08.709862 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting pod {"name": "zuul-merger-0", "status": "Failed"} 2026-06-11 21:03:08.709900 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting object, name: zuul-merger-0 2026-06-11 21:03:08.713139 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting pod {"name": "zuul-scheduler-0", "status": "Running"} 2026-06-11 21:03:08.713177 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 21:03:08.718428 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Running"} 2026-06-11 21:03:08.718464 | controller | 2026-06-11T21:03:08-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:10.734038 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-tjlnl", "status": "Pending"} 2026-06-11 21:03:10.734115 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting object, name: gateway-6bbbd758d9-tjlnl 2026-06-11 21:03:10.736948 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Running"} 2026-06-11 21:03:10.736987 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:10.743259 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-m82j9", "status": "Running"} 2026-06-11 21:03:10.743319 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-m82j9 2026-06-11 21:03:10.746590 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:10.746626 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:10.749230 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting pod {"name": "logserver-0", "status": "Running"} 2026-06-11 21:03:10.749277 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting object, name: logserver-0 2026-06-11 21:03:10.752521 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-bt78j", "status": "Pending"} 2026-06-11 21:03:10.752580 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-bt78j 2026-06-11 21:03:10.755585 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-ngpwx", "status": "Pending"} 2026-06-11 21:03:10.755642 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-ngpwx 2026-06-11 21:03:10.758738 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-srkqh", "status": "Running"} 2026-06-11 21:03:10.758796 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-srkqh 2026-06-11 21:03:10.762476 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting pod {"name": "zuul-merger-0", "status": "Failed"} 2026-06-11 21:03:10.762561 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting object, name: zuul-merger-0 2026-06-11 21:03:10.765284 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting pod {"name": "zuul-scheduler-0", "status": "Running"} 2026-06-11 21:03:10.765329 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 21:03:10.768049 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Running"} 2026-06-11 21:03:10.768093 | controller | 2026-06-11T21:03:10-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:12.948225 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Running"} 2026-06-11 21:03:12.948304 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:12.951732 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-m82j9", "status": "Running"} 2026-06-11 21:03:12.951773 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-m82j9 2026-06-11 21:03:12.955161 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:12.955214 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:12.958407 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting pod {"name": "logserver-0", "status": "Running"} 2026-06-11 21:03:12.958464 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting object, name: logserver-0 2026-06-11 21:03:12.961029 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-bt78j", "status": "Pending"} 2026-06-11 21:03:12.961109 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-bt78j 2026-06-11 21:03:12.963813 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-srkqh", "status": "Running"} 2026-06-11 21:03:12.963858 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-srkqh 2026-06-11 21:03:12.966582 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting pod {"name": "zuul-merger-0", "status": "Failed"} 2026-06-11 21:03:12.966619 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting object, name: zuul-merger-0 2026-06-11 21:03:12.969577 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting pod {"name": "zuul-scheduler-0", "status": "Running"} 2026-06-11 21:03:12.969634 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 21:03:12.986121 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Running"} 2026-06-11 21:03:12.986209 | controller | 2026-06-11T21:03:12-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:15.000446 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Running"} 2026-06-11 21:03:15.000536 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:15.003495 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-m82j9", "status": "Running"} 2026-06-11 21:03:15.003550 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-m82j9 2026-06-11 21:03:15.006152 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:15.006187 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:15.008800 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting pod {"name": "logserver-0", "status": "Running"} 2026-06-11 21:03:15.008861 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting object, name: logserver-0 2026-06-11 21:03:15.011546 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-bt78j", "status": "Pending"} 2026-06-11 21:03:15.011608 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-bt78j 2026-06-11 21:03:15.015623 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-srkqh", "status": "Running"} 2026-06-11 21:03:15.015667 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-srkqh 2026-06-11 21:03:15.019293 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting pod {"name": "zuul-merger-0", "status": "Failed"} 2026-06-11 21:03:15.019355 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting object, name: zuul-merger-0 2026-06-11 21:03:15.022082 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting pod {"name": "zuul-scheduler-0", "status": "Running"} 2026-06-11 21:03:15.022144 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 21:03:15.025244 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Running"} 2026-06-11 21:03:15.025279 | controller | 2026-06-11T21:03:15-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:17.036276 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Running"} 2026-06-11 21:03:17.036360 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:17.039415 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-m82j9", "status": "Running"} 2026-06-11 21:03:17.039449 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-m82j9 2026-06-11 21:03:17.042001 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:17.042034 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:17.044873 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting pod {"name": "logserver-0", "status": "Running"} 2026-06-11 21:03:17.044902 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting object, name: logserver-0 2026-06-11 21:03:17.048035 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-bt78j", "status": "Pending"} 2026-06-11 21:03:17.048066 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-bt78j 2026-06-11 21:03:17.050821 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-srkqh", "status": "Running"} 2026-06-11 21:03:17.050861 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-srkqh 2026-06-11 21:03:17.055336 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting pod {"name": "zuul-merger-0", "status": "Failed"} 2026-06-11 21:03:17.055435 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting object, name: zuul-merger-0 2026-06-11 21:03:17.058548 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting pod {"name": "zuul-scheduler-0", "status": "Running"} 2026-06-11 21:03:17.058589 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 21:03:17.061996 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Running"} 2026-06-11 21:03:17.062029 | controller | 2026-06-11T21:03:17-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:19.072148 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Running"} 2026-06-11 21:03:19.072225 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:19.075130 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-m82j9", "status": "Running"} 2026-06-11 21:03:19.075525 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-m82j9 2026-06-11 21:03:19.078729 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:19.078819 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:19.081685 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting pod {"name": "logserver-0", "status": "Running"} 2026-06-11 21:03:19.081746 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting object, name: logserver-0 2026-06-11 21:03:19.084189 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-bt78j", "status": "Pending"} 2026-06-11 21:03:19.084224 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-bt78j 2026-06-11 21:03:19.087024 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-srkqh", "status": "Running"} 2026-06-11 21:03:19.087165 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-srkqh 2026-06-11 21:03:19.090039 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting pod {"name": "zuul-merger-0", "status": "Failed"} 2026-06-11 21:03:19.090126 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting object, name: zuul-merger-0 2026-06-11 21:03:19.094438 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting pod {"name": "zuul-scheduler-0", "status": "Running"} 2026-06-11 21:03:19.094484 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 21:03:19.097037 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Running"} 2026-06-11 21:03:19.097076 | controller | 2026-06-11T21:03:19-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:21.106459 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Running"} 2026-06-11 21:03:21.106535 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:21.109196 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-m82j9", "status": "Running"} 2026-06-11 21:03:21.109228 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-m82j9 2026-06-11 21:03:21.112196 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:21.112228 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:21.114823 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting pod {"name": "logserver-0", "status": "Running"} 2026-06-11 21:03:21.114853 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting object, name: logserver-0 2026-06-11 21:03:21.117985 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-bt78j", "status": "Pending"} 2026-06-11 21:03:21.118019 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-bt78j 2026-06-11 21:03:21.121169 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-srkqh", "status": "Running"} 2026-06-11 21:03:21.121202 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-srkqh 2026-06-11 21:03:21.124256 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting pod {"name": "zuul-merger-0", "status": "Failed"} 2026-06-11 21:03:21.124299 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting object, name: zuul-merger-0 2026-06-11 21:03:21.128121 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting pod {"name": "zuul-scheduler-0", "status": "Running"} 2026-06-11 21:03:21.128157 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 21:03:21.131049 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Running"} 2026-06-11 21:03:21.131113 | controller | 2026-06-11T21:03:21-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:23.141282 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Running"} 2026-06-11 21:03:23.141428 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:23.145679 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-m82j9", "status": "Running"} 2026-06-11 21:03:23.145717 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-m82j9 2026-06-11 21:03:23.149587 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:23.149670 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:23.152776 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting pod {"name": "logserver-0", "status": "Running"} 2026-06-11 21:03:23.152857 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting object, name: logserver-0 2026-06-11 21:03:23.156007 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-bt78j", "status": "Pending"} 2026-06-11 21:03:23.156089 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-bt78j 2026-06-11 21:03:23.158561 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-srkqh", "status": "Running"} 2026-06-11 21:03:23.158622 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-srkqh 2026-06-11 21:03:23.161314 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting pod {"name": "zuul-merger-0", "status": "Failed"} 2026-06-11 21:03:23.161347 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting object, name: zuul-merger-0 2026-06-11 21:03:23.164042 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting pod {"name": "zuul-scheduler-0", "status": "Running"} 2026-06-11 21:03:23.164078 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 21:03:23.167177 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Running"} 2026-06-11 21:03:23.167213 | controller | 2026-06-11T21:03:23-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:25.179289 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Running"} 2026-06-11 21:03:25.179411 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:25.182543 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-m82j9", "status": "Running"} 2026-06-11 21:03:25.182610 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-m82j9 2026-06-11 21:03:25.185564 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:25.185611 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:25.188091 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting pod {"name": "logserver-0", "status": "Running"} 2026-06-11 21:03:25.188135 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting object, name: logserver-0 2026-06-11 21:03:25.191260 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-bt78j", "status": "Pending"} 2026-06-11 21:03:25.191307 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-bt78j 2026-06-11 21:03:25.194473 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-srkqh", "status": "Running"} 2026-06-11 21:03:25.194515 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-srkqh 2026-06-11 21:03:25.197670 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting pod {"name": "zuul-merger-0", "status": "Failed"} 2026-06-11 21:03:25.197706 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting object, name: zuul-merger-0 2026-06-11 21:03:25.201228 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting pod {"name": "zuul-scheduler-0", "status": "Running"} 2026-06-11 21:03:25.201290 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 21:03:25.204566 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Running"} 2026-06-11 21:03:25.204643 | controller | 2026-06-11T21:03:25-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:27.217753 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Running"} 2026-06-11 21:03:27.217843 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:27.221875 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-m82j9", "status": "Running"} 2026-06-11 21:03:27.221912 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-m82j9 2026-06-11 21:03:27.224769 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:27.224807 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:27.227210 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting pod {"name": "logserver-0", "status": "Running"} 2026-06-11 21:03:27.227237 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting object, name: logserver-0 2026-06-11 21:03:27.229939 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-bt78j", "status": "Pending"} 2026-06-11 21:03:27.229970 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-bt78j 2026-06-11 21:03:27.232818 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-srkqh", "status": "Running"} 2026-06-11 21:03:27.232880 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-srkqh 2026-06-11 21:03:27.235928 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting pod {"name": "zuul-merger-0", "status": "Failed"} 2026-06-11 21:03:27.235969 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting object, name: zuul-merger-0 2026-06-11 21:03:27.239496 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting pod {"name": "zuul-scheduler-0", "status": "Running"} 2026-06-11 21:03:27.239567 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 21:03:27.242750 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Running"} 2026-06-11 21:03:27.242815 | controller | 2026-06-11T21:03:27-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:29.251141 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Running"} 2026-06-11 21:03:29.251294 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:29.254339 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-m82j9", "status": "Running"} 2026-06-11 21:03:29.254426 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-m82j9 2026-06-11 21:03:29.257730 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:29.257791 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:29.261215 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting pod {"name": "logserver-0", "status": "Running"} 2026-06-11 21:03:29.261278 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting object, name: logserver-0 2026-06-11 21:03:29.264146 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-bt78j", "status": "Pending"} 2026-06-11 21:03:29.264224 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-bt78j 2026-06-11 21:03:29.266778 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-srkqh", "status": "Running"} 2026-06-11 21:03:29.266811 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-srkqh 2026-06-11 21:03:29.269441 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting pod {"name": "zuul-merger-0", "status": "Failed"} 2026-06-11 21:03:29.269496 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting object, name: zuul-merger-0 2026-06-11 21:03:29.272093 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting pod {"name": "zuul-scheduler-0", "status": "Running"} 2026-06-11 21:03:29.272173 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 21:03:29.274982 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Running"} 2026-06-11 21:03:29.275013 | controller | 2026-06-11T21:03:29-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:31.287427 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Running"} 2026-06-11 21:03:31.287516 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:31.291016 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-m82j9", "status": "Running"} 2026-06-11 21:03:31.291060 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-m82j9 2026-06-11 21:03:31.294200 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:31.294266 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:31.297082 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting pod {"name": "logserver-0", "status": "Running"} 2026-06-11 21:03:31.297126 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting object, name: logserver-0 2026-06-11 21:03:31.300758 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-srkqh", "status": "Running"} 2026-06-11 21:03:31.300801 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-srkqh 2026-06-11 21:03:31.303708 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting pod {"name": "zuul-merger-0", "status": "Failed"} 2026-06-11 21:03:31.303773 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting object, name: zuul-merger-0 2026-06-11 21:03:31.307497 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting pod {"name": "zuul-scheduler-0", "status": "Running"} 2026-06-11 21:03:31.307564 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 21:03:31.310964 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Running"} 2026-06-11 21:03:31.311026 | controller | 2026-06-11T21:03:31-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:33.319949 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Running"} 2026-06-11 21:03:33.320023 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:33.322744 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-m82j9", "status": "Running"} 2026-06-11 21:03:33.322803 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-m82j9 2026-06-11 21:03:33.325651 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:33.325698 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:33.328581 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting pod {"name": "logserver-0", "status": "Running"} 2026-06-11 21:03:33.328637 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting object, name: logserver-0 2026-06-11 21:03:33.331183 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-srkqh", "status": "Running"} 2026-06-11 21:03:33.331244 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-srkqh 2026-06-11 21:03:33.333764 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting pod {"name": "zuul-merger-0", "status": "Failed"} 2026-06-11 21:03:33.333825 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting object, name: zuul-merger-0 2026-06-11 21:03:33.336458 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting pod {"name": "zuul-scheduler-0", "status": "Running"} 2026-06-11 21:03:33.336517 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 21:03:33.339410 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Running"} 2026-06-11 21:03:33.339451 | controller | 2026-06-11T21:03:33-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:35.350221 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Running"} 2026-06-11 21:03:35.350401 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:35.353205 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-m82j9", "status": "Running"} 2026-06-11 21:03:35.353275 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-m82j9 2026-06-11 21:03:35.356280 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:35.356342 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:35.359252 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting pod {"name": "logserver-0", "status": "Running"} 2026-06-11 21:03:35.359313 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting object, name: logserver-0 2026-06-11 21:03:35.361860 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting pod {"name": "nodepool-launcher-b79c8ffb-srkqh", "status": "Running"} 2026-06-11 21:03:35.361921 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting object, name: nodepool-launcher-b79c8ffb-srkqh 2026-06-11 21:03:35.365415 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting pod {"name": "zuul-merger-0", "status": "Failed"} 2026-06-11 21:03:35.365476 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting object, name: zuul-merger-0 2026-06-11 21:03:35.368205 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting pod {"name": "zuul-scheduler-0", "status": "Running"} 2026-06-11 21:03:35.368278 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting object, name: zuul-scheduler-0 2026-06-11 21:03:35.371594 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Running"} 2026-06-11 21:03:35.371654 | controller | 2026-06-11T21:03:35-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:37.380585 | controller | 2026-06-11T21:03:37-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Running"} 2026-06-11 21:03:37.380665 | controller | 2026-06-11T21:03:37-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:37.383126 | controller | 2026-06-11T21:03:37-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:37.383185 | controller | 2026-06-11T21:03:37-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:37.386290 | controller | 2026-06-11T21:03:37-04:00 INFO Deleting pod {"name": "zuul-web-5d5f9b866d-2bm9m", "status": "Failed"} 2026-06-11 21:03:37.386345 | controller | 2026-06-11T21:03:37-04:00 INFO Deleting object, name: zuul-web-5d5f9b866d-2bm9m 2026-06-11 21:03:39.394728 | controller | 2026-06-11T21:03:39-04:00 INFO Deleting pod {"name": "gateway-6bbbd758d9-vscph", "status": "Failed"} 2026-06-11 21:03:39.394815 | controller | 2026-06-11T21:03:39-04:00 INFO Deleting object, name: gateway-6bbbd758d9-vscph 2026-06-11 21:03:39.397710 | controller | 2026-06-11T21:03:39-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Running"} 2026-06-11 21:03:39.397801 | controller | 2026-06-11T21:03:39-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:41.406230 | controller | 2026-06-11T21:03:41-04:00 INFO Deleting pod {"name": "logjuicer-6ff84764b7-nzd48", "status": "Failed"} 2026-06-11 21:03:41.406309 | controller | 2026-06-11T21:03:41-04:00 INFO Deleting object, name: logjuicer-6ff84764b7-nzd48 2026-06-11 21:03:43.416987 | controller | 2026-06-11T21:03:43-04:00 INFO Removing dangling persistent volume claims if any... 2026-06-11 21:03:43.420865 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting pvc {"name": "git-server-git-server-0", "status": "Bound"} 2026-06-11 21:03:43.420903 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting object, name: git-server-git-server-0 2026-06-11 21:03:43.425030 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting pvc {"name": "hound-search-data-hound-search-0", "status": "Bound"} 2026-06-11 21:03:43.425074 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting object, name: hound-search-data-hound-search-0 2026-06-11 21:03:43.429241 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting pvc {"name": "logserver-logserver-0", "status": "Bound"} 2026-06-11 21:03:43.429285 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting object, name: logserver-logserver-0 2026-06-11 21:03:43.435154 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting pvc {"name": "mariadb-logs-mariadb-0", "status": "Bound"} 2026-06-11 21:03:43.435216 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting object, name: mariadb-logs-mariadb-0 2026-06-11 21:03:43.439066 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting pvc {"name": "mariadb-mariadb-0", "status": "Bound"} 2026-06-11 21:03:43.439109 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting object, name: mariadb-mariadb-0 2026-06-11 21:03:43.443284 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting pvc {"name": "nodepool-builder-nodepool-builder-0", "status": "Bound"} 2026-06-11 21:03:43.443327 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting object, name: nodepool-builder-nodepool-builder-0 2026-06-11 21:03:43.447687 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting pvc {"name": "zookeeper-data-zookeeper-0", "status": "Bound"} 2026-06-11 21:03:43.447732 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting object, name: zookeeper-data-zookeeper-0 2026-06-11 21:03:43.452012 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting pvc {"name": "zookeeper-logs-zookeeper-0", "status": "Bound"} 2026-06-11 21:03:43.452058 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting object, name: zookeeper-logs-zookeeper-0 2026-06-11 21:03:43.455629 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting pvc {"name": "zuul-executor-zuul-executor-0", "status": "Bound"} 2026-06-11 21:03:43.455670 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting object, name: zuul-executor-zuul-executor-0 2026-06-11 21:03:43.459747 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting pvc {"name": "zuul-executor-zuul-executor-1", "status": "Bound"} 2026-06-11 21:03:43.459788 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting object, name: zuul-executor-zuul-executor-1 2026-06-11 21:03:43.463559 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting pvc {"name": "zuul-merger-zuul-merger-0", "status": "Bound"} 2026-06-11 21:03:43.463630 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting object, name: zuul-merger-zuul-merger-0 2026-06-11 21:03:43.625941 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting pvc {"name": "zuul-merger-zuul-merger-1", "status": "Bound"} 2026-06-11 21:03:43.626015 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting object, name: zuul-merger-zuul-merger-1 2026-06-11 21:03:43.826312 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting pvc {"name": "zuul-scheduler-zuul-scheduler-0", "status": "Bound"} 2026-06-11 21:03:43.826400 | controller | 2026-06-11T21:03:43-04:00 INFO Deleting object, name: zuul-scheduler-zuul-scheduler-0 2026-06-12 01:03:46.253330 | controller | ok: Runtime: 0:01:10.655816 2026-06-12 01:03:46.271080 | 2026-06-12 01:03:46.271275 | TASK [health-check/test-backup-restore : Restore backup of the Software Factory previous deployment] 2026-06-11 21:03:46.960063 | controller | 2026-06-11T21:03:46-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-11 21:03:46.960159 | controller | 2026-06-11 21:03:46.974296 | controller | 2026-06-11T21:03:46-04:00 INFO Kubernetes Distribution found: Kubernetes 2026-06-11 21:03:46.974351 | controller | 2026-06-11 21:03:46.986881 | controller | 2026-06-11T21:03:46-04:00 INFO Restoring secrets... 2026-06-11 21:03:46.988329 | controller | 2026-06-11T21:03:46-04:00 INFO Creating object, name: zookeeper-client-tls 2026-06-11 21:03:46.992693 | controller | 2026-06-11T21:03:46-04:00 INFO Creating object, name: zookeeper-server-tls 2026-06-11 21:03:46.998513 | controller | 2026-06-11T21:03:46-04:00 INFO Creating object, name: nodepool-builder-ssh-key 2026-06-11 21:03:47.002669 | controller | 2026-06-11T21:03:47-04:00 INFO Creating object, name: zuul-ssh-key 2026-06-11 21:03:47.007195 | controller | 2026-06-11T21:03:47-04:00 INFO Creating object, name: zuul-spare-ssh-key 2026-06-11 21:03:47.010324 | controller | 2026-06-11T21:03:47-04:00 INFO Creating object, name: zuul-keystore-password 2026-06-11 21:03:47.013526 | controller | 2026-06-11T21:03:47-04:00 INFO Creating object, name: zuul-auth-secret 2026-06-11 21:03:47.017394 | controller | 2026-06-11T21:03:47-04:00 INFO Creating object, name: logserver-keys 2026-06-11 21:03:47.021286 | controller | 2026-06-11T21:03:47-04:00 INFO Creating object, name: logserver-uploader-keys 2026-06-11 21:03:47.024504 | controller | 2026-06-11T21:03:47-04:00 INFO Creating object, name: logserver-uploader-spare-keys 2026-06-11 21:03:47.028683 | controller | 2026-06-11T21:03:47-04:00 INFO Spawning backend services... 2026-06-11 21:03:47.192418 | controller | 2026-06-11T21:03:47-04:00 INFO Creating secret, name: mariadb-root-password 2026-06-11 21:03:47.192564 | controller | 2026-06-11T21:03:47-04:00 INFO Creating object, name: mariadb-root-password 2026-06-11 21:03:47.592323 | controller | 2026-06-11T21:03:47-04:00 INFO Creating secret, name: mariadb-config-secrets 2026-06-11 21:03:47.592496 | controller | 2026-06-11T21:03:47-04:00 INFO Creating object, name: mariadb-config-secrets 2026-06-11 21:03:47.991900 | controller | 2026-06-11T21:03:47-04:00 INFO Creating secret, name: mariadb-initdb-secrets 2026-06-11 21:03:47.991992 | controller | 2026-06-11T21:03:47-04:00 INFO Creating object, name: mariadb-initdb-secrets 2026-06-11 21:03:48.199296 | controller | 2026-06-11T21:03:48-04:00 INFO Creating object, name: mariadb 2026-06-11 21:03:48.595181 | controller | 2026-06-11T21:03:48-04:00 INFO Creating config map name: zookeeper-pi-config-map 2026-06-11 21:03:48.595306 | controller | 2026-06-11T21:03:48-04:00 INFO Creating object, name: zookeeper-pi-config-map 2026-06-11 21:03:48.601729 | controller | 2026-06-11T21:03:48-04:00 INFO Creating service, name: zookeeper-headless 2026-06-11 21:03:48.601832 | controller | 2026-06-11T21:03:48-04:00 INFO Creating object, name: zookeeper-headless 2026-06-11 21:03:48.608337 | controller | 2026-06-11T21:03:48-04:00 INFO Creating service, name: zookeeper 2026-06-11 21:03:48.608453 | controller | 2026-06-11T21:03:48-04:00 INFO Creating object, name: zookeeper 2026-06-11 21:03:48.620673 | controller | 2026-06-11T21:03:48-04:00 INFO Creating object, name: zookeeper 2026-06-11 21:03:48.625907 | controller | 2026-06-11T21:03:48-04:00 INFO Waiting for backend services... 2026-06-11 21:03:49.215806 | controller | 2026-06-11T21:03:49-04:00 INFO Creating service, name: mariadb 2026-06-11 21:03:49.215944 | controller | 2026-06-11T21:03:49-04:00 INFO Creating object, name: mariadb 2026-06-11 21:03:49.243805 | controller | 2026-06-11T21:03:49-04:00 INFO Waiting for statefulset, name: mariadb 2026-06-11 21:04:17.361009 | controller | 2026-06-11T21:04:17-04:00 INFO Creating object, name: zuul-db-connection 2026-06-11 21:04:17.368553 | controller | 2026-06-11T21:04:17-04:00 INFO Creating object, name: zuul-db-provision 2026-06-11 21:04:24.110356 | controller | 2026-06-11T21:04:24-04:00 INFO Creating secret, name: zuul-config 2026-06-11 21:04:24.110481 | controller | 2026-06-11T21:04:24-04:00 INFO Creating object, name: zuul-config 2026-06-11 21:04:24.315074 | controller | 2026-06-11T21:04:24-04:00 INFO Creating config map name: zuul-scheduler-tooling-config-map 2026-06-11 21:04:24.315201 | controller | 2026-06-11T21:04:24-04:00 INFO Creating object, name: zuul-scheduler-tooling-config-map 2026-06-11 21:04:24.324025 | controller | 2026-06-11T21:04:24-04:00 INFO Creating object, name: zuul-kazoo 2026-06-11 21:04:26.339644 | controller | 2026-06-11T21:04:26-04:00 INFO Restoring Zuul... 2026-06-11 21:04:26.339767 | controller | 2026-06-11T21:04:26-04:00 INFO Running pod execution pod: zuul-kazoo, command: [bash -c rm -rf /tmp/zuul-import && mkdir -p /tmp/zuul-import] 2026-06-11 21:04:26.473130 | controller | 2026-06-11T21:04:26-04:00 INFO Running pod execution pod: zuul-kazoo, command: [bash -c cat > /tmp/zuul.keys && zuul-admin import-keys --force /tmp/zuul.keys] 2026-06-11 21:04:28.092851 | controller | INFO:kazoo.client:Connecting to zookeeper-0.zookeeper-headless.sf(10.244.0.116):2281, use_ssl: True 2026-06-11 21:04:28.252908 | controller | INFO:kazoo.client:Zookeeper connection established, state: CONNECTED 2026-06-11 21:04:28.752994 | controller | INFO:zuul.KeyStorage:Created key at /keystorage/opendev.org/zuul/zuul%2Fzuul-jobs/ssh 2026-06-11 21:04:28.758359 | controller | INFO:zuul.KeyStorage:Created key at /keystorage/opendev.org/zuul/zuul%2Fzuul-jobs/secrets 2026-06-11 21:04:28.847824 | controller | INFO:zuul.KeyStorage:Created key at /keystorage/gerrit/demo-tenant-config/demo-tenant-config/ssh 2026-06-11 21:04:28.852585 | controller | INFO:zuul.KeyStorage:Created key at /keystorage/gerrit/demo-tenant-config/demo-tenant-config/secrets 2026-06-11 21:04:28.938050 | controller | INFO:zuul.KeyStorage:Created key at /keystorage/gerrit/demo-project/demo-project/ssh 2026-06-11 21:04:28.944251 | controller | INFO:zuul.KeyStorage:Created key at /keystorage/gerrit/demo-project/demo-project/secrets 2026-06-11 21:04:29.045154 | controller | INFO:zuul.KeyStorage:Created key at /keystorage/gerrit/ichiban-config-Z5F8jidd/ichiban-config-Z5F8jidd/ssh 2026-06-11 21:04:29.051607 | controller | INFO:zuul.KeyStorage:Created key at /keystorage/gerrit/ichiban-config-Z5F8jidd/ichiban-config-Z5F8jidd/secrets 2026-06-11 21:04:29.137008 | controller | INFO:zuul.KeyStorage:Created key at /keystorage/gerrit/config/config/ssh 2026-06-11 21:04:29.142123 | controller | INFO:zuul.KeyStorage:Created key at /keystorage/gerrit/config/config/secrets 2026-06-11 21:04:29.171052 | controller | INFO:zuul.KeyStorage:Created key at /keystorage/git-server/system-config/system-config/ssh 2026-06-11 21:04:29.237895 | controller | INFO:zuul.KeyStorage:Created key at /keystorage/git-server/system-config/system-config/secrets 2026-06-11 21:04:29.337801 | controller | INFO:zuul.KeyStorage:Created key at /keystorage2/tenant/internal/ssh 2026-06-11 21:04:29.355274 | controller | INFO:zuul.KeyStorage:Created key at /keystorage2/tenant/demo-tenant/ssh 2026-06-11 21:04:29.371274 | controller | INFO:zuul.KeyStorage:Created key at /keystorage2/tenant/ichiban-tenant-Z5F8jidd/ssh 2026-06-11 21:04:29.901950 | controller | 2026-06-11T21:04:29-04:00 INFO Finished doing Zuul private keys restore! 2026-06-11 21:04:29.902059 | controller | 2026-06-11T21:04:29-04:00 INFO Restoring DB... 2026-06-11 21:04:29.906265 | controller | 2026-06-11T21:04:29-04:00 INFO Running pod execution pod: mariadb-0, command: [mysql -e DROP DATABASE zuul;] 2026-06-11 21:04:30.141679 | controller | mysql: Deprecated program name. It will be removed in a future release, use '/usr/bin/mariadb' instead 2026-06-11 21:04:30.141770 | controller | Warning: World-writable config file '/etc/my.cnf.d/docker.cnf' is ignored 2026-06-11 21:04:30.276852 | controller | 2026-06-11T21:04:30-04:00 INFO Running pod execution pod: mariadb-0, command: [mysql -h0] 2026-06-11 21:04:30.440872 | controller | mysql: Deprecated program name. It will be removed in a future release, use '/usr/bin/mariadb' instead 2026-06-11 21:04:30.440939 | controller | Warning: World-writable config file '/etc/my.cnf.d/docker.cnf' is ignored 2026-06-11 21:04:30.808867 | controller | 2026-06-11T21:04:30-04:00 INFO Finished restoring DB from backup! 2026-06-11 21:04:30.812066 | controller | 2026-06-11T21:04:30-04:00 INFO Deleting object, name: zuul-kazoo 2026-06-11 21:04:30.831800 | controller | 2026-06-11T21:04:30-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:04:30.844807 | controller | 2026-06-11T21:04:30-04:00 INFO Creating config map name: git-server-pi-config-map 2026-06-11 21:04:30.844850 | controller | 2026-06-11T21:04:30-04:00 INFO Creating object, name: git-server-pi-config-map 2026-06-11 21:04:30.852359 | controller | 2026-06-11T21:04:30-04:00 INFO Creating object, name: git-server 2026-06-11 21:04:31.232849 | controller | 2026-06-11T21:04:31-04:00 INFO Creating config map name: logserver-config-map 2026-06-11 21:04:31.232938 | controller | 2026-06-11T21:04:31-04:00 INFO Creating object, name: logserver-config-map 2026-06-11 21:04:31.238222 | controller | 2026-06-11T21:04:31-04:00 INFO Creating service, name: logserver 2026-06-11 21:04:31.238288 | controller | 2026-06-11T21:04:31-04:00 INFO Creating object, name: logserver 2026-06-11 21:04:31.434226 | controller | 2026-06-11T21:04:31-04:00 INFO Creating object, name: logserver 2026-06-11 21:04:31.441680 | controller | 2026-06-11T21:04:31-04:00 INFO Creating object, name: gateway 2026-06-11 21:04:31.456132 | controller | 2026-06-11T21:04:31-04:00 INFO Creating config map name: gateway-config-map 2026-06-11 21:04:31.456220 | controller | 2026-06-11T21:04:31-04:00 INFO Creating object, name: gateway-config-map 2026-06-11 21:04:31.462224 | controller | 2026-06-11T21:04:31-04:00 INFO Creating object, name: gateway 2026-06-11 21:04:31.471695 | controller | 2026-06-11T21:04:31-04:00 INFO Creating service, name: hound-search 2026-06-11 21:04:31.471814 | controller | 2026-06-11T21:04:31-04:00 INFO Creating object, name: hound-search 2026-06-11 21:04:31.488063 | controller | 2026-06-11T21:04:31-04:00 INFO Creating object, name: hound-search 2026-06-11 21:04:31.500972 | controller | 2026-06-11T21:04:31-04:00 INFO Creating object, name: logjuicer-pvc 2026-06-11 21:04:31.518196 | controller | 2026-06-11T21:04:31-04:00 INFO Creating object, name: logjuicer 2026-06-11 21:04:31.541647 | controller | 2026-06-11T21:04:31-04:00 INFO Creating object, name: logjuicer 2026-06-11 21:04:31.851389 | controller | 2026-06-11T21:04:31-04:00 INFO Waiting for GitServer and MariaDB services to be ready ... 2026-06-11 21:04:31.851466 | controller | 2026-06-11T21:04:31-04:00 INFO 2026-06-11 21:04:31.851478 | controller | - Config: Waiting ... 2026-06-11 21:04:31.851487 | controller | - Gateway: Waiting ... 2026-06-11 21:04:31.851496 | controller | - GitServer: Waiting ... 2026-06-11 21:04:31.851504 | controller | - HoundSearch: Waiting ... 2026-06-11 21:04:31.851512 | controller | - LogJuicer: Waiting ... 2026-06-11 21:04:31.851520 | controller | - Logserver: Waiting ... 2026-06-11 21:04:31.851528 | controller | - MariaDB: OK 2026-06-11 21:04:31.851536 | controller | - Zookeeper: OK 2026-06-11 21:04:31.851545 | controller | 2026-06-11 21:04:31.851553 | controller | 2026-06-11T21:04:31-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-11 21:04:36.861716 | controller | 2026-06-11T21:04:36-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:04:36.883881 | controller | 2026-06-11T21:04:36-04:00 INFO Creating service, name: git-server 2026-06-11 21:04:36.883962 | controller | 2026-06-11T21:04:36-04:00 INFO Creating object, name: git-server 2026-06-11 21:04:36.895005 | controller | 2026-06-11T21:04:36-04:00 INFO Creating service, name: git-server-rw 2026-06-11 21:04:36.895047 | controller | 2026-06-11T21:04:36-04:00 INFO Creating object, name: git-server-rw 2026-06-11 21:04:36.909366 | controller | 2026-06-11T21:04:36-04:00 INFO Waiting for statefulset, name: git-server 2026-06-11 21:04:55.042753 | controller | 2026-06-11T21:04:55-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-11 21:04:55.183259 | controller | 2026-06-11T21:04:55-04:00 INFO Logserver authorized_keys is up to date 2026-06-11 21:04:55.192871 | controller | 2026-06-11T21:04:55-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:04:55.192925 | controller | 2026-06-11T21:04:55-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:04:55.215021 | controller | 2026-06-11T21:04:55-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:04:55.215108 | controller | 2026-06-11T21:04:55-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:04:55.237720 | controller | 2026-06-11T21:04:55-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:04:55.394349 | controller | 2026-06-11T21:04:55-04:00 INFO Creating config map name: np-statsd-config-map 2026-06-11 21:04:55.394440 | controller | 2026-06-11T21:04:55-04:00 INFO Creating object, name: np-statsd-config-map 2026-06-11 21:04:55.401235 | controller | 2026-06-11T21:04:55-04:00 INFO Creating config map name: nodepool-tooling-config-map 2026-06-11 21:04:55.401295 | controller | 2026-06-11T21:04:55-04:00 INFO Creating object, name: nodepool-tooling-config-map 2026-06-11 21:04:55.407208 | controller | 2026-06-11T21:04:55-04:00 INFO Creating config map name: nodepool-launcher-extra-config-config-map 2026-06-11 21:04:55.407248 | controller | 2026-06-11T21:04:55-04:00 INFO Creating object, name: nodepool-launcher-extra-config-config-map 2026-06-11 21:04:55.427896 | controller | 2026-06-11T21:04:55-04:00 INFO Creating object, name: zuul-capacity 2026-06-11 21:04:55.444424 | controller | 2026-06-11T21:04:55-04:00 INFO Creating object, name: nodepool-launcher 2026-06-11 21:04:55.825135 | controller | 2026-06-11T21:04:55-04:00 INFO Creating config map name: nodepool-builder-extra-config-config-map 2026-06-11 21:04:55.825203 | controller | 2026-06-11T21:04:55-04:00 INFO Creating object, name: nodepool-builder-extra-config-config-map 2026-06-11 21:04:56.229966 | controller | 2026-06-11T21:04:56-04:00 INFO Creating service, name: nodepool-builder 2026-06-11 21:04:56.230108 | controller | 2026-06-11T21:04:56-04:00 INFO Creating object, name: nodepool-builder 2026-06-11 21:04:56.241783 | controller | 2026-06-11T21:04:56-04:00 INFO Creating object, name: nodepool-builder 2026-06-11 21:04:56.392154 | controller | 2026-06-11T21:04:56-04:00 INFO Creating object, name: zuul-web 2026-06-11 21:04:56.401661 | controller | 2026-06-11T21:04:56-04:00 INFO Creating object, name: zuul-executor-headless 2026-06-11 21:04:56.623582 | controller | 2026-06-11T21:04:56-04:00 INFO Creating config map name: zuul-extra-config-map 2026-06-11 21:04:56.623675 | controller | 2026-06-11T21:04:56-04:00 INFO Creating object, name: zuul-extra-config-map 2026-06-11 21:04:57.023539 | controller | 2026-06-11T21:04:57-04:00 INFO Creating config map name: zuul-statsd-config-map 2026-06-11 21:04:57.023636 | controller | 2026-06-11T21:04:57-04:00 INFO Creating object, name: zuul-statsd-config-map 2026-06-11 21:04:57.423543 | controller | 2026-06-11T21:04:57-04:00 INFO Creating config map name: zuul-logging-config-map 2026-06-11 21:04:57.423622 | controller | 2026-06-11T21:04:57-04:00 INFO Creating object, name: zuul-logging-config-map 2026-06-11 21:04:57.627286 | controller | 2026-06-11T21:04:57-04:00 INFO Creating object, name: zuul-scheduler 2026-06-11 21:04:58.428912 | controller | 2026-06-11T21:04:58-04:00 INFO Creating object, name: zuul-executor 2026-06-11 21:04:59.225468 | controller | 2026-06-11T21:04:59-04:00 INFO Creating object, name: zuul-web 2026-06-11 21:05:00.026609 | controller | 2026-06-11T21:05:00-04:00 INFO Creating object, name: zuul-merger 2026-06-11 21:05:00.033016 | controller | 2026-06-11T21:05:00-04:00 INFO 2026-06-11 21:05:00.033052 | controller | - Config: Waiting ... 2026-06-11 21:05:00.033065 | controller | - Gateway: OK 2026-06-11 21:05:00.033071 | controller | - GitServer: OK 2026-06-11 21:05:00.033077 | controller | - HoundSearch: OK 2026-06-11 21:05:00.033082 | controller | - LogJuicer: OK 2026-06-11 21:05:00.033087 | controller | - Logserver: OK 2026-06-11 21:05:00.033092 | controller | - MariaDB: OK 2026-06-11 21:05:00.033097 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 21:05:00.033102 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 21:05:00.033107 | controller | - Zookeeper: OK 2026-06-11 21:05:00.033112 | controller | - Zuul: Waiting ... 2026-06-11 21:05:00.033118 | controller | - |_ Config Secrets: OK 2026-06-11 21:05:00.033123 | controller | - |_ Executor: Waiting ... 2026-06-11 21:05:00.033128 | controller | - |_ Merger: Waiting ... 2026-06-11 21:05:00.033132 | controller | - |_ Scheduler: Waiting ... 2026-06-11 21:05:00.033137 | controller | - |_ Web: Waiting ... 2026-06-11 21:05:00.033143 | controller | 2026-06-11 21:05:00.033148 | controller | 2026-06-11T21:05:00-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-11 21:05:05.039691 | controller | 2026-06-11T21:05:05-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:05:05.666771 | controller | 2026-06-11T21:05:05-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:05:05.666843 | controller | 2026-06-11T21:05:05-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:05:05.689601 | controller | 2026-06-11T21:05:05-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:05:05.689670 | controller | 2026-06-11T21:05:05-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:05:06.069908 | controller | 2026-06-11T21:05:06-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:05:06.466718 | controller | 2026-06-11T21:05:06-04:00 INFO Creating object, name: nodepool-launcher 2026-06-11 21:05:06.479154 | controller | 2026-06-11T21:05:06-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:05:06.479238 | controller | 2026-06-11T21:05:06-04:00 INFO deployment rollout not ok, name: nodepool-launcher 2026-06-11 21:05:07.475734 | controller | 2026-06-11T21:05:07-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 21:05:37.596911 | controller | 2026-06-11T21:05:37-04:00 INFO Statefulset "zuul-scheduler" not ready after 30s 2026-06-11 21:05:37.632311 | controller | 2026-06-11T21:05:37-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:05:37.632430 | controller | 2026-06-11T21:05:37-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 21:05:38.014652 | controller | 2026-06-11T21:05:38-04:00 INFO 2026-06-11 21:05:38.014735 | controller | - Config: Waiting ... 2026-06-11 21:05:38.014746 | controller | - Gateway: OK 2026-06-11 21:05:38.014754 | controller | - GitServer: OK 2026-06-11 21:05:38.014763 | controller | - HoundSearch: OK 2026-06-11 21:05:38.014771 | controller | - LogJuicer: OK 2026-06-11 21:05:38.014779 | controller | - Logserver: OK 2026-06-11 21:05:38.014787 | controller | - MariaDB: OK 2026-06-11 21:05:38.014795 | controller | - NodePoolBuilder: Waiting ... 2026-06-11 21:05:38.014803 | controller | - NodePoolLauncher: Waiting ... 2026-06-11 21:05:38.014811 | controller | - Zookeeper: OK 2026-06-11 21:05:38.014819 | controller | - Zuul: Waiting ... 2026-06-11 21:05:38.014827 | controller | - |_ Config Secrets: OK 2026-06-11 21:05:38.014835 | controller | - |_ Executor: OK 2026-06-11 21:05:38.014843 | controller | - |_ Merger: OK 2026-06-11 21:05:38.014851 | controller | - |_ Scheduler: Waiting ... 2026-06-11 21:05:38.014859 | controller | - |_ Web: Waiting ... 2026-06-11 21:05:38.014867 | controller | 2026-06-11 21:05:38.014917 | controller | 2026-06-11T21:05:38-04:00 INFO [attempt #3] Waiting 5s for the next reconcile call ... 2026-06-11 21:05:43.026501 | controller | 2026-06-11T21:05:43-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:05:43.642563 | controller | 2026-06-11T21:05:43-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:05:43.642636 | controller | 2026-06-11T21:05:43-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:05:43.658712 | controller | 2026-06-11T21:05:43-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:05:43.658769 | controller | 2026-06-11T21:05:43-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:05:44.045469 | controller | 2026-06-11T21:05:44-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:05:44.451021 | controller | 2026-06-11T21:05:44-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:05:44.451109 | controller | 2026-06-11T21:05:44-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:05:45.456426 | controller | 2026-06-11T21:05:45-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-11 21:06:01.536204 | controller | 2026-06-11T21:06:01-04:00 INFO Creating object, name: zuul-weeder 2026-06-11 21:06:01.551404 | controller | 2026-06-11T21:06:01-04:00 INFO Creating object, name: zuul-weeder 2026-06-11 21:06:01.619980 | controller | 2026-06-11T21:06:01-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:06:01.620046 | controller | 2026-06-11T21:06:01-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 21:06:01.978250 | controller | 2026-06-11T21:06:01-04:00 INFO 2026-06-11 21:06:01.978330 | controller | - Config: Waiting ... 2026-06-11 21:06:01.978341 | controller | - Gateway: OK 2026-06-11 21:06:01.978350 | controller | - GitServer: OK 2026-06-11 21:06:01.978358 | controller | - HoundSearch: OK 2026-06-11 21:06:01.978385 | controller | - LogJuicer: OK 2026-06-11 21:06:01.978397 | controller | - Logserver: OK 2026-06-11 21:06:01.978405 | controller | - MariaDB: OK 2026-06-11 21:06:01.978412 | controller | - NodePoolBuilder: OK 2026-06-11 21:06:01.978420 | controller | - NodePoolLauncher: OK 2026-06-11 21:06:01.978428 | controller | - Zookeeper: OK 2026-06-11 21:06:01.978436 | controller | - Zuul: Waiting ... 2026-06-11 21:06:01.978444 | controller | - |_ Config Secrets: OK 2026-06-11 21:06:01.978453 | controller | - |_ Executor: OK 2026-06-11 21:06:01.978460 | controller | - |_ Merger: OK 2026-06-11 21:06:01.978468 | controller | - |_ Scheduler: Waiting ... 2026-06-11 21:06:01.978477 | controller | - |_ Web: OK 2026-06-11 21:06:01.978485 | controller | 2026-06-11 21:06:01.978494 | controller | 2026-06-11T21:06:01-04:00 INFO [attempt #4] Waiting 5s for the next reconcile call ... 2026-06-11 21:06:06.990234 | controller | 2026-06-11T21:06:06-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:06:07.607244 | controller | 2026-06-11T21:06:07-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:06:07.607360 | controller | 2026-06-11T21:06:07-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:06:07.630078 | controller | 2026-06-11T21:06:07-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:06:07.630172 | controller | 2026-06-11T21:06:07-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:06:08.002137 | controller | 2026-06-11T21:06:08-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:06:08.405879 | controller | 2026-06-11T21:06:08-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:06:08.405961 | controller | 2026-06-11T21:06:08-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:06:09.420582 | controller | 2026-06-11T21:06:09-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:06:09.420665 | controller | 2026-06-11T21:06:09-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:06:10.393719 | controller | 2026-06-11T21:06:10-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:06:10.393798 | controller | 2026-06-11T21:06:10-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 21:06:11.390562 | controller | 2026-06-11T21:06:11-04:00 INFO Creating config map name: pymod-sf-operator-config-map 2026-06-11 21:06:11.390649 | controller | 2026-06-11T21:06:11-04:00 INFO Creating object, name: pymod-sf-operator-config-map 2026-06-11 21:06:11.792611 | controller | 2026-06-11T21:06:11-04:00 INFO Creating object, name: config-updater 2026-06-11 21:06:11.800050 | controller | 2026-06-11T21:06:11-04:00 INFO Creating object, name: config-updater-role 2026-06-11 21:06:11.805452 | controller | 2026-06-11T21:06:11-04:00 INFO Creating object, name: config-updater 2026-06-11 21:06:11.810598 | controller | 2026-06-11T21:06:11-04:00 INFO Creating the config-update service account secret 2026-06-11 21:06:11.810649 | controller | 2026-06-11T21:06:11-04:00 INFO Creating object, name: config-update-secrets 2026-06-11 21:06:11.815531 | controller | 2026-06-11T21:06:11-04:00 INFO Creating base secret job 2026-06-11 21:06:11.816023 | controller | 2026-06-11T21:06:11-04:00 INFO Creating object, name: config-base-secret-1-8679-ns 2026-06-11 21:06:11.820860 | controller | 2026-06-11T21:06:11-04:00 INFO 2026-06-11 21:06:11.820908 | controller | - Config: Waiting ... 2026-06-11 21:06:11.820922 | controller | - Gateway: OK 2026-06-11 21:06:11.820934 | controller | - GitServer: OK 2026-06-11 21:06:11.820946 | controller | - HoundSearch: OK 2026-06-11 21:06:11.820957 | controller | - LogJuicer: OK 2026-06-11 21:06:11.820968 | controller | - Logserver: OK 2026-06-11 21:06:11.820979 | controller | - MariaDB: OK 2026-06-11 21:06:11.820990 | controller | - NodePoolBuilder: OK 2026-06-11 21:06:11.821000 | controller | - NodePoolLauncher: OK 2026-06-11 21:06:11.821011 | controller | - Zookeeper: OK 2026-06-11 21:06:11.821022 | controller | - Zuul: OK 2026-06-11 21:06:11.821034 | controller | 2026-06-11 21:06:11.821114 | controller | 2026-06-11T21:06:11-04:00 INFO [attempt #5] Waiting 5s for the next reconcile call ... 2026-06-11 21:06:16.827114 | controller | 2026-06-11T21:06:16-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:06:17.444271 | controller | 2026-06-11T21:06:17-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:06:17.444352 | controller | 2026-06-11T21:06:17-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:06:17.463313 | controller | 2026-06-11T21:06:17-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:06:17.463417 | controller | 2026-06-11T21:06:17-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:06:17.844162 | controller | 2026-06-11T21:06:17-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:06:18.251721 | controller | 2026-06-11T21:06:18-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:06:18.251797 | controller | 2026-06-11T21:06:18-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:06:19.263418 | controller | 2026-06-11T21:06:19-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:06:19.263505 | controller | 2026-06-11T21:06:19-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:06:20.231035 | controller | 2026-06-11T21:06:20-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:06:20.231142 | controller | 2026-06-11T21:06:20-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 21:06:21.441952 | controller | 2026-06-11T21:06:21-04:00 INFO Running tenant-reconfigure for the 'internal' tenant 2026-06-11 21:06:21.628433 | controller | 2026-06-11T21:06:21-04:00 INFO Running pod execution pod: zuul-scheduler-0, command: [zuul-scheduler tenant-reconfigure internal] 2026-06-11 21:06:28.051288 | controller | 2026-06-11T21:06:28-04:00 INFO Deleting object, name: zuul-web 2026-06-11 21:06:28.057178 | controller | 2026-06-11T21:06:28-04:00 INFO Creating object, name: zs-internal-tenant-reconfigure 2026-06-11 21:06:28.062169 | controller | 2026-06-11T21:06:28-04:00 INFO 2026-06-11 21:06:28.062269 | controller | - Config: Waiting ... 2026-06-11 21:06:28.062299 | controller | - Gateway: OK 2026-06-11 21:06:28.062314 | controller | - GitServer: OK 2026-06-11 21:06:28.062326 | controller | - HoundSearch: OK 2026-06-11 21:06:28.062339 | controller | - LogJuicer: OK 2026-06-11 21:06:28.062351 | controller | - Logserver: OK 2026-06-11 21:06:28.062363 | controller | - MariaDB: OK 2026-06-11 21:06:28.062418 | controller | - NodePoolBuilder: OK 2026-06-11 21:06:28.062434 | controller | - NodePoolLauncher: OK 2026-06-11 21:06:28.062446 | controller | - Zookeeper: OK 2026-06-11 21:06:28.062459 | controller | - Zuul: OK 2026-06-11 21:06:28.062472 | controller | 2026-06-11 21:06:28.062485 | controller | 2026-06-11T21:06:28-04:00 INFO [attempt #6] Waiting 5s for the next reconcile call ... 2026-06-11 21:06:33.070673 | controller | 2026-06-11T21:06:33-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:06:33.695321 | controller | 2026-06-11T21:06:33-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:06:33.695434 | controller | 2026-06-11T21:06:33-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:06:33.717410 | controller | 2026-06-11T21:06:33-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:06:33.717437 | controller | 2026-06-11T21:06:33-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:06:34.091130 | controller | 2026-06-11T21:06:34-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:06:34.491626 | controller | 2026-06-11T21:06:34-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:06:34.491706 | controller | 2026-06-11T21:06:34-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:06:35.501025 | controller | 2026-06-11T21:06:35-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:06:35.501108 | controller | 2026-06-11T21:06:35-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:06:36.475223 | controller | 2026-06-11T21:06:36-04:00 INFO Creating object, name: zuul-web 2026-06-11 21:06:37.286183 | controller | 2026-06-11T21:06:37-04:00 INFO 2026-06-11 21:06:37.286255 | controller | - Config: Waiting ... 2026-06-11 21:06:37.286264 | controller | - Gateway: OK 2026-06-11 21:06:37.286272 | controller | - GitServer: OK 2026-06-11 21:06:37.286279 | controller | - HoundSearch: OK 2026-06-11 21:06:37.286286 | controller | - LogJuicer: OK 2026-06-11 21:06:37.286293 | controller | - Logserver: OK 2026-06-11 21:06:37.286300 | controller | - MariaDB: OK 2026-06-11 21:06:37.286307 | controller | - NodePoolBuilder: OK 2026-06-11 21:06:37.286314 | controller | - NodePoolLauncher: OK 2026-06-11 21:06:37.286321 | controller | - Zookeeper: OK 2026-06-11 21:06:37.286328 | controller | - Zuul: Waiting ... 2026-06-11 21:06:37.286335 | controller | - |_ Config Secrets: OK 2026-06-11 21:06:37.286342 | controller | - |_ Executor: OK 2026-06-11 21:06:37.286347 | controller | - |_ Merger: OK 2026-06-11 21:06:37.286352 | controller | - |_ Scheduler: OK 2026-06-11 21:06:37.286357 | controller | - |_ Web: Waiting ... 2026-06-11 21:06:37.286362 | controller | 2026-06-11 21:06:37.286398 | controller | 2026-06-11T21:06:37-04:00 INFO [attempt #7] Waiting 5s for the next reconcile call ... 2026-06-11 21:06:42.292020 | controller | 2026-06-11T21:06:42-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:06:42.912756 | controller | 2026-06-11T21:06:42-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:06:42.912847 | controller | 2026-06-11T21:06:42-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:06:42.939993 | controller | 2026-06-11T21:06:42-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:06:42.940133 | controller | 2026-06-11T21:06:42-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:06:43.308810 | controller | 2026-06-11T21:06:43-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:06:43.722211 | controller | 2026-06-11T21:06:43-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:06:43.722285 | controller | 2026-06-11T21:06:43-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:06:44.726161 | controller | 2026-06-11T21:06:44-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:06:44.726241 | controller | 2026-06-11T21:06:44-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:06:45.696838 | controller | 2026-06-11T21:06:45-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:06:45.696912 | controller | 2026-06-11T21:06:45-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 21:06:46.506622 | controller | 2026-06-11T21:06:46-04:00 INFO 2026-06-11 21:06:46.506697 | controller | - Config: Waiting ... 2026-06-11 21:06:46.506709 | controller | - Gateway: OK 2026-06-11 21:06:46.506718 | controller | - GitServer: OK 2026-06-11 21:06:46.506727 | controller | - HoundSearch: OK 2026-06-11 21:06:46.506736 | controller | - LogJuicer: OK 2026-06-11 21:06:46.506744 | controller | - Logserver: OK 2026-06-11 21:06:46.506753 | controller | - MariaDB: OK 2026-06-11 21:06:46.506761 | controller | - NodePoolBuilder: OK 2026-06-11 21:06:46.506770 | controller | - NodePoolLauncher: OK 2026-06-11 21:06:46.506779 | controller | - Zookeeper: OK 2026-06-11 21:06:46.506787 | controller | - Zuul: Waiting ... 2026-06-11 21:06:46.506796 | controller | - |_ Config Secrets: OK 2026-06-11 21:06:46.506805 | controller | - |_ Executor: OK 2026-06-11 21:06:46.506813 | controller | - |_ Merger: OK 2026-06-11 21:06:46.506822 | controller | - |_ Scheduler: OK 2026-06-11 21:06:46.506831 | controller | - |_ Web: Waiting ... 2026-06-11 21:06:46.506840 | controller | 2026-06-11 21:06:46.506899 | controller | 2026-06-11T21:06:46-04:00 INFO [attempt #8] Waiting 5s for the next reconcile call ... 2026-06-11 21:06:51.519012 | controller | 2026-06-11T21:06:51-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:06:52.140462 | controller | 2026-06-11T21:06:52-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:06:52.140628 | controller | 2026-06-11T21:06:52-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:06:52.167715 | controller | 2026-06-11T21:06:52-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:06:52.167827 | controller | 2026-06-11T21:06:52-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:06:52.535746 | controller | 2026-06-11T21:06:52-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:06:52.937109 | controller | 2026-06-11T21:06:52-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:06:52.937234 | controller | 2026-06-11T21:06:52-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:06:53.948655 | controller | 2026-06-11T21:06:53-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:06:53.948730 | controller | 2026-06-11T21:06:53-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:06:54.922535 | controller | 2026-06-11T21:06:54-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:06:54.922640 | controller | 2026-06-11T21:06:54-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 21:06:55.732408 | controller | 2026-06-11T21:06:55-04:00 INFO 2026-06-11 21:06:55.732508 | controller | - Config: Waiting ... 2026-06-11 21:06:55.732525 | controller | - Gateway: OK 2026-06-11 21:06:55.732537 | controller | - GitServer: OK 2026-06-11 21:06:55.732549 | controller | - HoundSearch: OK 2026-06-11 21:06:55.732561 | controller | - LogJuicer: OK 2026-06-11 21:06:55.732573 | controller | - Logserver: OK 2026-06-11 21:06:55.732584 | controller | - MariaDB: OK 2026-06-11 21:06:55.732596 | controller | - NodePoolBuilder: OK 2026-06-11 21:06:55.732607 | controller | - NodePoolLauncher: OK 2026-06-11 21:06:55.732619 | controller | - Zookeeper: OK 2026-06-11 21:06:55.732631 | controller | - Zuul: Waiting ... 2026-06-11 21:06:55.732642 | controller | - |_ Config Secrets: OK 2026-06-11 21:06:55.732654 | controller | - |_ Executor: OK 2026-06-11 21:06:55.732666 | controller | - |_ Merger: OK 2026-06-11 21:06:55.732677 | controller | - |_ Scheduler: OK 2026-06-11 21:06:55.732689 | controller | - |_ Web: Waiting ... 2026-06-11 21:06:55.732701 | controller | 2026-06-11 21:06:55.732721 | controller | 2026-06-11T21:06:55-04:00 INFO [attempt #9] Waiting 5s for the next reconcile call ... 2026-06-11 21:07:00.745304 | controller | 2026-06-11T21:07:00-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:07:01.363173 | controller | 2026-06-11T21:07:01-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:07:01.363283 | controller | 2026-06-11T21:07:01-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:07:01.384863 | controller | 2026-06-11T21:07:01-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:07:01.384905 | controller | 2026-06-11T21:07:01-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:07:01.758146 | controller | 2026-06-11T21:07:01-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:07:02.161363 | controller | 2026-06-11T21:07:02-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:07:02.161462 | controller | 2026-06-11T21:07:02-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:07:03.170872 | controller | 2026-06-11T21:07:03-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:07:03.170958 | controller | 2026-06-11T21:07:03-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:07:04.150874 | controller | 2026-06-11T21:07:04-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:07:04.150949 | controller | 2026-06-11T21:07:04-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 21:07:04.959404 | controller | 2026-06-11T21:07:04-04:00 INFO 2026-06-11 21:07:04.959483 | controller | - Config: Waiting ... 2026-06-11 21:07:04.959494 | controller | - Gateway: OK 2026-06-11 21:07:04.959503 | controller | - GitServer: OK 2026-06-11 21:07:04.959511 | controller | - HoundSearch: OK 2026-06-11 21:07:04.959519 | controller | - LogJuicer: OK 2026-06-11 21:07:04.959527 | controller | - Logserver: OK 2026-06-11 21:07:04.959535 | controller | - MariaDB: OK 2026-06-11 21:07:04.959543 | controller | - NodePoolBuilder: OK 2026-06-11 21:07:04.959552 | controller | - NodePoolLauncher: OK 2026-06-11 21:07:04.959560 | controller | - Zookeeper: OK 2026-06-11 21:07:04.959568 | controller | - Zuul: Waiting ... 2026-06-11 21:07:04.959576 | controller | - |_ Config Secrets: OK 2026-06-11 21:07:04.959584 | controller | - |_ Executor: OK 2026-06-11 21:07:04.959592 | controller | - |_ Merger: OK 2026-06-11 21:07:04.959600 | controller | - |_ Scheduler: OK 2026-06-11 21:07:04.959608 | controller | - |_ Web: Waiting ... 2026-06-11 21:07:04.959616 | controller | 2026-06-11 21:07:04.959625 | controller | 2026-06-11T21:07:04-04:00 INFO [attempt #10] Waiting 5s for the next reconcile call ... 2026-06-11 21:07:09.969478 | controller | 2026-06-11T21:07:09-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:07:10.587710 | controller | 2026-06-11T21:07:10-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:07:10.587823 | controller | 2026-06-11T21:07:10-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:07:10.607124 | controller | 2026-06-11T21:07:10-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:07:10.607194 | controller | 2026-06-11T21:07:10-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:07:10.983426 | controller | 2026-06-11T21:07:10-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:07:11.392008 | controller | 2026-06-11T21:07:11-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:07:11.392142 | controller | 2026-06-11T21:07:11-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:07:12.399727 | controller | 2026-06-11T21:07:12-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:07:12.399823 | controller | 2026-06-11T21:07:12-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:07:13.373962 | controller | 2026-06-11T21:07:13-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:07:13.374039 | controller | 2026-06-11T21:07:13-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 21:07:14.181152 | controller | 2026-06-11T21:07:14-04:00 INFO 2026-06-11 21:07:14.181238 | controller | - Config: Waiting ... 2026-06-11 21:07:14.181255 | controller | - Gateway: OK 2026-06-11 21:07:14.181268 | controller | - GitServer: OK 2026-06-11 21:07:14.181281 | controller | - HoundSearch: OK 2026-06-11 21:07:14.181293 | controller | - LogJuicer: OK 2026-06-11 21:07:14.181305 | controller | - Logserver: OK 2026-06-11 21:07:14.181317 | controller | - MariaDB: OK 2026-06-11 21:07:14.181330 | controller | - NodePoolBuilder: OK 2026-06-11 21:07:14.181341 | controller | - NodePoolLauncher: OK 2026-06-11 21:07:14.181353 | controller | - Zookeeper: OK 2026-06-11 21:07:14.181365 | controller | - Zuul: Waiting ... 2026-06-11 21:07:14.181417 | controller | - |_ Config Secrets: OK 2026-06-11 21:07:14.181431 | controller | - |_ Executor: OK 2026-06-11 21:07:14.181444 | controller | - |_ Merger: OK 2026-06-11 21:07:14.181456 | controller | - |_ Scheduler: OK 2026-06-11 21:07:14.181468 | controller | - |_ Web: Waiting ... 2026-06-11 21:07:14.181480 | controller | 2026-06-11 21:07:14.181492 | controller | 2026-06-11T21:07:14-04:00 INFO [attempt #11] Waiting 5s for the next reconcile call ... 2026-06-11 21:07:19.186184 | controller | 2026-06-11T21:07:19-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:07:19.806277 | controller | 2026-06-11T21:07:19-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:07:19.806412 | controller | 2026-06-11T21:07:19-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:07:19.826743 | controller | 2026-06-11T21:07:19-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:07:19.826789 | controller | 2026-06-11T21:07:19-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:07:20.202060 | controller | 2026-06-11T21:07:20-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:07:20.605329 | controller | 2026-06-11T21:07:20-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:07:20.605430 | controller | 2026-06-11T21:07:20-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:07:21.621405 | controller | 2026-06-11T21:07:21-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:07:21.621489 | controller | 2026-06-11T21:07:21-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:07:22.590732 | controller | 2026-06-11T21:07:22-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:07:22.590822 | controller | 2026-06-11T21:07:22-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 21:07:23.402601 | controller | 2026-06-11T21:07:23-04:00 INFO 2026-06-11 21:07:23.402682 | controller | - Config: Waiting ... 2026-06-11 21:07:23.402695 | controller | - Gateway: OK 2026-06-11 21:07:23.402704 | controller | - GitServer: OK 2026-06-11 21:07:23.402712 | controller | - HoundSearch: OK 2026-06-11 21:07:23.402720 | controller | - LogJuicer: OK 2026-06-11 21:07:23.402727 | controller | - Logserver: OK 2026-06-11 21:07:23.402735 | controller | - MariaDB: OK 2026-06-11 21:07:23.402743 | controller | - NodePoolBuilder: OK 2026-06-11 21:07:23.402751 | controller | - NodePoolLauncher: OK 2026-06-11 21:07:23.402758 | controller | - Zookeeper: OK 2026-06-11 21:07:23.402766 | controller | - Zuul: Waiting ... 2026-06-11 21:07:23.402793 | controller | - |_ Config Secrets: OK 2026-06-11 21:07:23.402801 | controller | - |_ Executor: OK 2026-06-11 21:07:23.402809 | controller | - |_ Merger: OK 2026-06-11 21:07:23.402817 | controller | - |_ Scheduler: OK 2026-06-11 21:07:23.402825 | controller | - |_ Web: Waiting ... 2026-06-11 21:07:23.402833 | controller | 2026-06-11 21:07:23.402841 | controller | 2026-06-11T21:07:23-04:00 INFO [attempt #12] Waiting 5s for the next reconcile call ... 2026-06-11 21:07:28.409661 | controller | 2026-06-11T21:07:28-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:07:29.024876 | controller | 2026-06-11T21:07:29-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:07:29.024951 | controller | 2026-06-11T21:07:29-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:07:29.045262 | controller | 2026-06-11T21:07:29-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:07:29.045323 | controller | 2026-06-11T21:07:29-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:07:29.423341 | controller | 2026-06-11T21:07:29-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:07:29.830237 | controller | 2026-06-11T21:07:29-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:07:29.830304 | controller | 2026-06-11T21:07:29-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:07:30.845027 | controller | 2026-06-11T21:07:30-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:07:30.845121 | controller | 2026-06-11T21:07:30-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:07:31.814612 | controller | 2026-06-11T21:07:31-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:07:31.814692 | controller | 2026-06-11T21:07:31-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-11 21:07:32.629160 | controller | 2026-06-11T21:07:32-04:00 INFO 2026-06-11 21:07:32.629250 | controller | - Config: Waiting ... 2026-06-11 21:07:32.629266 | controller | - Gateway: OK 2026-06-11 21:07:32.629279 | controller | - GitServer: OK 2026-06-11 21:07:32.629291 | controller | - HoundSearch: OK 2026-06-11 21:07:32.629303 | controller | - LogJuicer: OK 2026-06-11 21:07:32.629315 | controller | - Logserver: OK 2026-06-11 21:07:32.629327 | controller | - MariaDB: OK 2026-06-11 21:07:32.629338 | controller | - NodePoolBuilder: OK 2026-06-11 21:07:32.629350 | controller | - NodePoolLauncher: OK 2026-06-11 21:07:32.629361 | controller | - Zookeeper: OK 2026-06-11 21:07:32.629414 | controller | - Zuul: Waiting ... 2026-06-11 21:07:32.629428 | controller | - |_ Config Secrets: OK 2026-06-11 21:07:32.629440 | controller | - |_ Executor: OK 2026-06-11 21:07:32.629451 | controller | - |_ Merger: OK 2026-06-11 21:07:32.629462 | controller | - |_ Scheduler: OK 2026-06-11 21:07:32.629473 | controller | - |_ Web: Waiting ... 2026-06-11 21:07:32.629484 | controller | 2026-06-11 21:07:32.629495 | controller | 2026-06-11T21:07:32-04:00 INFO [attempt #13] Waiting 5s for the next reconcile call ... 2026-06-11 21:07:37.638784 | controller | 2026-06-11T21:07:37-04:00 INFO Deleting object, name: ca-cert 2026-06-11 21:07:38.264156 | controller | 2026-06-11T21:07:38-04:00 INFO Waiting for deployment, name: gateway 2026-06-11 21:07:38.264237 | controller | 2026-06-11T21:07:38-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-11 21:07:38.285278 | controller | 2026-06-11T21:07:38-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-11 21:07:38.285325 | controller | 2026-06-11T21:07:38-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-11 21:07:38.654346 | controller | 2026-06-11T21:07:38-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-11 21:07:39.059901 | controller | 2026-06-11T21:07:39-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-11 21:07:39.059983 | controller | 2026-06-11T21:07:39-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-11 21:07:40.080426 | controller | 2026-06-11T21:07:40-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-11 21:07:40.080511 | controller | 2026-06-11T21:07:40-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-11 21:07:41.044193 | controller | 2026-06-11T21:07:41-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-11 21:07:41.044271 | controller | 2026-06-11T21:07:41-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-11 21:07:42.252420 | controller | 2026-06-11T21:07:42-04:00 INFO 2026-06-11 21:07:42.252503 | controller | - Config: OK 2026-06-11 21:07:42.252519 | controller | - Gateway: OK 2026-06-11 21:07:42.252530 | controller | - GitServer: OK 2026-06-11 21:07:42.252542 | controller | - HoundSearch: OK 2026-06-11 21:07:42.252552 | controller | - LogJuicer: OK 2026-06-11 21:07:42.252560 | controller | - Logserver: OK 2026-06-11 21:07:42.252568 | controller | - MariaDB: OK 2026-06-11 21:07:42.252576 | controller | - NodePoolBuilder: OK 2026-06-11 21:07:42.252584 | controller | - NodePoolLauncher: OK 2026-06-11 21:07:42.252592 | controller | - Zookeeper: OK 2026-06-11 21:07:42.252600 | controller | - Zuul: OK 2026-06-11 21:07:42.252608 | controller | 2026-06-11 21:07:42.252617 | controller | 2026-06-11T21:07:42-04:00 INFO Updating controller configmap ... 2026-06-11 21:07:42.641625 | controller | 2026-06-11T21:07:42-04:00 INFO Standalone reconcile done. 2026-06-12 01:07:43.142513 | controller | ok: Runtime: 0:03:56.074706 2026-06-12 01:07:43.159293 | 2026-06-12 01:07:43.159471 | TASK [health-check/test-backup-restore : Fetch the last build ID reported by Zuul web (after restore)] 2026-06-12 01:07:43.743770 | controller | ok: OK (698 bytes) 2026-06-12 01:07:43.757279 | 2026-06-12 01:07:43.757507 | TASK [health-check/test-backup-restore : Ensure Zuul SQL DB well restored by checking last build ID] 2026-06-12 01:07:43.817219 | controller | ok: All assertions passed 2026-06-12 01:07:43.826108 | 2026-06-12 01:07:43.826233 | TASK [Run a Zuul job workflow in order to validate the restored system] 2026-06-12 01:07:43.862594 | controller | ok 2026-06-12 01:07:43.897308 | 2026-06-12 01:07:43.897396 | TASK [ansible.builtin.include_role : health-check/check-zuul-tenant] 2026-06-12 01:07:43.930738 | controller | ok 2026-06-12 01:07:43.963181 | 2026-06-12 01:07:43.963374 | TASK [health-check/check-zuul-tenant : Get configuration errors/warnings into the internal tenant] 2026-06-12 01:07:44.516942 | controller | ok: OK (2 bytes) 2026-06-12 01:07:44.529122 | 2026-06-12 01:07:44.529261 | TASK [health-check/check-zuul-tenant : Fail when errors/warnings into the internal tenant] 2026-06-12 01:07:44.568023 | controller | skipping: Conditional result was False 2026-06-12 01:07:44.590066 | 2026-06-12 01:07:44.590251 | TASK [health-check/config-update-zuul : Set random value] 2026-06-12 01:07:44.784168 | controller | ok 2026-06-12 01:07:44.792985 | 2026-06-12 01:07:44.793123 | TASK [health-check/config-update-zuul : Create vars to generate and submit resources addition] 2026-06-12 01:07:44.830882 | controller | ok 2026-06-12 01:07:44.839770 | 2026-06-12 01:07:44.839910 | TASK [ansible.builtin.include_role : create-gerrit-repository] 2026-06-12 01:07:44.868140 | controller | ok 2026-06-12 01:07:44.904008 | 2026-06-12 01:07:44.904129 | TASK [create-gerrit-repository : Create gerrit repository named ichiban-config-byJqXcrC] 2026-06-11 21:07:46.661292 | controller | 2026-06-12 01:07:46,659 INFO managesf.model.yamlbkd.engine - Resource engine is using /tmp/direct-apply as workdir 2026-06-11 21:07:46.661444 | controller | 2026-06-12 01:07:46,660 INFO managesf.model.yamlbkd.engine - Resources engine: direct apply resources requested 2026-06-11 21:07:46.688028 | controller | 2026-06-12 01:07:46,687 INFO managesf.GerritClient - ichiban-config-byJqXcrC-core: creating group (Team core for the ichiban-config-byJqXcrC repo) 2026-06-11 21:07:46.740070 | controller | 2026-06-12 01:07:46,739 INFO managesf.GerritClient - ichiban-config-byJqXcrC-core: deleting group member admin 2026-06-11 21:07:46.771864 | controller | 2026-06-12 01:07:46,771 INFO managesf.GerritClient - ichiban-config-byJqXcrC-ptl: creating group (Team lead for the ichiban-config-byJqXcrC repo) 2026-06-11 21:07:46.856065 | controller | 2026-06-12 01:07:46,855 INFO managesf.GerritClient - ichiban-config-byJqXcrC-ptl: deleting group member admin 2026-06-11 21:07:46.937983 | controller | 2026-06-12 01:07:46,936 INFO managesf.GerritClient - ichiban-config-byJqXcrC-ptl: adding group member admin@sfop.me 2026-06-11 21:07:46.963698 | controller | 2026-06-12 01:07:46,962 INFO managesf.GerritClient - ichiban-config-byJqXcrC: creating project (ichiban-config-byJqXcrC repository) 2026-06-11 21:07:47.064615 | controller | 2026-06-12 01:07:47,063 INFO managesf.services.gerrit.utils - [gerrit] Clone repository ichiban-config-byJqXcrC 2026-06-11 21:07:47.353668 | controller | 2026-06-12 01:07:47,352 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'clone', 'ssh://admin@gerrit-sshd:29418/ichiban-config-byJqXcrC', '/tmp/tmpe07ldcs9/clone-ichiban-config-byJqXcrC'] output 2026-06-11 21:07:47.353729 | controller | 2026-06-12 01:07:47,352 INFO managesf.services.gerrit.utils - Cloning into '/tmp/tmpe07ldcs9/clone-ichiban-config-byJqXcrC'... 2026-06-11 21:07:47.353741 | controller | Total 2 (delta 0), reused 0 (delta 0) 2026-06-11 21:07:47.353750 | controller | 2026-06-11 21:07:47.623533 | controller | 2026-06-12 01:07:47,622 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'fetch', '-a'] output 2026-06-11 21:07:47.623594 | controller | 2026-06-12 01:07:47,622 INFO managesf.services.gerrit.utils - 2026-06-11 21:07:47.688001 | controller | 2026-06-12 01:07:47,687 INFO managesf.services.gerrit.utils - [gerrit] Prepare push on config for repository ichiban-config-byJqXcrC 2026-06-11 21:07:47.913581 | controller | 2026-06-12 01:07:47,912 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'fetch', 'origin', 'refs/meta/config:refs/remotes/origin/meta/config'] output 2026-06-11 21:07:47.913644 | controller | 2026-06-12 01:07:47,912 INFO managesf.services.gerrit.utils - Total 4 (delta 0), reused 0 (delta 0) 2026-06-11 21:07:47.913656 | controller | From ssh://gerrit-sshd:29418/ichiban-config-byJqXcrC 2026-06-11 21:07:47.913665 | controller | * [new ref] refs/meta/config -> origin/meta/config 2026-06-11 21:07:47.913673 | controller | 2026-06-11 21:07:47.924654 | controller | 2026-06-12 01:07:47,923 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'checkout', 'meta/config'] output 2026-06-11 21:07:47.924705 | controller | 2026-06-12 01:07:47,924 INFO managesf.services.gerrit.utils - Switched to a new branch 'meta/config' 2026-06-11 21:07:47.924720 | controller | branch 'meta/config' set up to track 'origin/meta/config'. 2026-06-11 21:07:47.924729 | controller | 2026-06-11 21:07:47.924744 | controller | 2026-06-12 01:07:47,924 INFO managesf.services.gerrit.utils - [gerrit] Add file project.config to index 2026-06-11 21:07:47.933143 | controller | 2026-06-12 01:07:47,932 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'add', 'project.config'] output 2026-06-11 21:07:47.933194 | controller | 2026-06-12 01:07:47,932 INFO managesf.services.gerrit.utils - 2026-06-11 21:07:47.933208 | controller | 2026-06-12 01:07:47,932 INFO managesf.services.gerrit.utils - [gerrit] Add file groups to index 2026-06-11 21:07:47.941447 | controller | 2026-06-12 01:07:47,940 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'add', 'groups'] output 2026-06-11 21:07:47.941486 | controller | 2026-06-12 01:07:47,940 INFO managesf.services.gerrit.utils - 2026-06-11 21:07:47.949823 | controller | 2026-06-12 01:07:47,948 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'status', '-s'] output 2026-06-11 21:07:47.949867 | controller | 2026-06-12 01:07:47,949 INFO managesf.services.gerrit.utils - M groups 2026-06-11 21:07:47.949893 | controller | M project.config 2026-06-11 21:07:47.949902 | controller | 2026-06-11 21:07:47.963550 | controller | 2026-06-12 01:07:47,962 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'commit', '-a', '--author', 'admin ', '-mProvides ACL and Groups'] output 2026-06-11 21:07:47.963590 | controller | 2026-06-12 01:07:47,962 INFO managesf.services.gerrit.utils - [meta/config 931fb62] Provides ACL and Groups 2026-06-11 21:07:47.963602 | controller | 2 files changed, 31 insertions(+), 9 deletions(-) 2026-06-11 21:07:47.963611 | controller | 2026-06-11 21:07:48.322657 | controller | 2026-06-12 01:07:48,321 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'push', 'origin', 'meta/config:meta/config'] output 2026-06-11 21:07:48.322912 | controller | 2026-06-12 01:07:48,321 INFO managesf.services.gerrit.utils - remote: remote: Processing changes: refs: 1 remote: Processing changes: refs: 1 remote: Processing changes: refs: 1, done 2026-06-11 21:07:48.322947 | controller | To ssh://gerrit-sshd:29418/ichiban-config-byJqXcrC 2026-06-11 21:07:48.322962 | controller | 9ee45a8..931fb62 meta/config -> refs/meta/config 2026-06-11 21:07:48.322973 | controller | 2026-06-11 21:07:48.323068 | controller | 2026-06-12 01:07:48,322 INFO managesf.services.gerrit.utils - [gerrit] Push on config for repository ichiban-config-byJqXcrC 2026-06-11 21:07:48.323182 | controller | 2026-06-12 01:07:48,322 INFO managesf.services.gerrit.utils - [gerrit] Prepare push on master for repository ichiban-config-byJqXcrC 2026-06-11 21:07:48.329752 | controller | 2026-06-12 01:07:48,329 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'checkout', 'master'] output 2026-06-11 21:07:48.329952 | controller | 2026-06-12 01:07:48,329 INFO managesf.services.gerrit.utils - Switched to branch 'master' 2026-06-11 21:07:48.329979 | controller | Your branch is up to date with 'origin/master'. 2026-06-11 21:07:48.329992 | controller | 2026-06-11 21:07:48.338998 | controller | 2026-06-12 01:07:48,338 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'reset', '--hard', 'origin/master'] output 2026-06-11 21:07:48.339198 | controller | 2026-06-12 01:07:48,338 INFO managesf.services.gerrit.utils - HEAD is now at a8e0fc0 Initial empty repository 2026-06-11 21:07:48.339221 | controller | 2026-06-11 21:07:48.339401 | controller | 2026-06-12 01:07:48,338 INFO managesf.services.gerrit.utils - [gerrit] Add file .gitreview to index 2026-06-11 21:07:48.347602 | controller | 2026-06-12 01:07:48,346 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'add', '.gitreview'] output 2026-06-11 21:07:48.347804 | controller | 2026-06-12 01:07:48,347 INFO managesf.services.gerrit.utils - 2026-06-11 21:07:48.354812 | controller | 2026-06-12 01:07:48,354 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'status', '-s'] output 2026-06-11 21:07:48.354842 | controller | 2026-06-12 01:07:48,354 INFO managesf.services.gerrit.utils - A .gitreview 2026-06-11 21:07:48.354851 | controller | 2026-06-11 21:07:48.368154 | controller | 2026-06-12 01:07:48,367 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'commit', '-a', '--author', 'admin ', '-mManageSF commit'] output 2026-06-11 21:07:48.368189 | controller | 2026-06-12 01:07:48,367 INFO managesf.services.gerrit.utils - [master 3be9310] ManageSF commit 2026-06-11 21:07:48.368199 | controller | 1 file changed, 5 insertions(+) 2026-06-11 21:07:48.368208 | controller | create mode 100644 .gitreview 2026-06-11 21:07:48.368216 | controller | 2026-06-11 21:07:48.722190 | controller | 2026-06-12 01:07:48,721 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'push', 'origin', 'master'] output 2026-06-11 21:07:48.722263 | controller | 2026-06-12 01:07:48,721 INFO managesf.services.gerrit.utils - remote: remote: Processing changes: refs: 1 remote: Processing changes: refs: 1, done 2026-06-11 21:07:48.722275 | controller | To ssh://gerrit-sshd:29418/ichiban-config-byJqXcrC 2026-06-11 21:07:48.722283 | controller | a8e0fc0..3be9310 master -> master 2026-06-11 21:07:48.722293 | controller | 2026-06-11 21:07:48.722302 | controller | 2026-06-12 01:07:48,721 INFO managesf.services.gerrit.utils - [gerrit] Push on master for repository ichiban-config-byJqXcrC 2026-06-11 21:07:48.722311 | controller | 2026-06-12 01:07:48,721 INFO managesf.services.gerrit.utils - [gerrit] List remote branches 2026-06-11 21:07:48.730675 | controller | 2026-06-12 01:07:48,729 INFO managesf.services.gerrit.utils - [gerrit] cmd ['git', 'branch', '-rv', '--abbrev=40'] output 2026-06-11 21:07:48.730720 | controller | 2026-06-12 01:07:48,729 INFO managesf.services.gerrit.utils - origin/HEAD -> origin/master 2026-06-11 21:07:48.730729 | controller | origin/master 3be931031ae510582387b3ff9830654535d1a840 ManageSF commit 2026-06-11 21:07:48.730737 | controller | origin/meta/config 9ee45a85333695cda6f1be229654afad4f25b608 Created project 2026-06-11 21:07:48.730745 | controller | 2026-06-11 21:07:48.730754 | controller | 2026-06-12 01:07:48,729 INFO managesf.model.yamlbkd.engine - Resource [type: acls, ID: ichiban-config-byJqXcrC-acl] is going to be created. 2026-06-11 21:07:48.730839 | controller | 2026-06-12 01:07:48,729 INFO managesf.model.yamlbkd.engine - Resource [type: groups, ID: ichiban-config-byJqXcrC-core] is going to be created. 2026-06-11 21:07:48.731257 | controller | 2026-06-12 01:07:48,729 INFO managesf.model.yamlbkd.engine - Resource [type: groups, ID: ichiban-config-byJqXcrC-ptl] is going to be created. 2026-06-11 21:07:48.731473 | controller | 2026-06-12 01:07:48,729 INFO managesf.model.yamlbkd.engine - Resource [type: repos, ID: ichiban-config-byJqXcrC] is going to be created. 2026-06-11 21:07:48.731518 | controller | 2026-06-12 01:07:48,729 INFO managesf.model.yamlbkd.engine - Resource [type: groups, ID: ichiban-config-byJqXcrC-core] will be created. 2026-06-11 21:07:48.731528 | controller | 2026-06-12 01:07:48,730 INFO managesf.model.yamlbkd.engine - Resource [type: groups, ID: ichiban-config-byJqXcrC-core] has been created. 2026-06-11 21:07:48.731704 | controller | 2026-06-12 01:07:48,730 INFO managesf.model.yamlbkd.engine - Resource [type: groups, ID: ichiban-config-byJqXcrC-ptl] will be created. 2026-06-11 21:07:48.731714 | controller | 2026-06-12 01:07:48,730 INFO managesf.model.yamlbkd.engine - Resource [type: groups, ID: ichiban-config-byJqXcrC-ptl] has been created. 2026-06-11 21:07:48.731725 | controller | 2026-06-12 01:07:48,730 INFO managesf.model.yamlbkd.engine - Resource [type: acls, ID: ichiban-config-byJqXcrC-acl] will be created. 2026-06-11 21:07:48.731733 | controller | 2026-06-12 01:07:48,730 INFO managesf.model.yamlbkd.engine - Resource [type: acls, ID: ichiban-config-byJqXcrC-acl] has been created. 2026-06-11 21:07:48.731741 | controller | 2026-06-12 01:07:48,730 INFO managesf.model.yamlbkd.engine - Resource [type: repos, ID: ichiban-config-byJqXcrC] will be created. 2026-06-11 21:07:48.731749 | controller | 2026-06-12 01:07:48,730 INFO managesf.model.yamlbkd.engine - Resource [type: repos, ID: ichiban-config-byJqXcrC] has been created. 2026-06-11 21:07:48.731920 | controller | 2026-06-11 21:07:48.731930 | controller | === Resources actions === 2026-06-11 21:07:48.731938 | controller | 2026-06-11 21:07:48.731946 | controller | Resource [type: acls, ID: ichiban-config-byJqXcrC-acl] is going to be created. 2026-06-11 21:07:48.731954 | controller | Resource [type: groups, ID: ichiban-config-byJqXcrC-core] is going to be created. 2026-06-11 21:07:48.731963 | controller | Resource [type: groups, ID: ichiban-config-byJqXcrC-ptl] is going to be created. 2026-06-11 21:07:48.731970 | controller | Resource [type: repos, ID: ichiban-config-byJqXcrC] is going to be created. 2026-06-11 21:07:48.731978 | controller | Resource [type: groups, ID: ichiban-config-byJqXcrC-core] will be created. 2026-06-11 21:07:48.731997 | controller | Resource [type: groups, ID: ichiban-config-byJqXcrC-core] has been created. 2026-06-11 21:07:48.732005 | controller | Resource [type: groups, ID: ichiban-config-byJqXcrC-ptl] will be created. 2026-06-11 21:07:48.732013 | controller | Resource [type: groups, ID: ichiban-config-byJqXcrC-ptl] has been created. 2026-06-11 21:07:48.732021 | controller | Resource [type: acls, ID: ichiban-config-byJqXcrC-acl] will be created. 2026-06-11 21:07:48.732029 | controller | Resource [type: acls, ID: ichiban-config-byJqXcrC-acl] has been created. 2026-06-11 21:07:48.732036 | controller | Resource [type: repos, ID: ichiban-config-byJqXcrC] will be created. 2026-06-11 21:07:48.732044 | controller | Resource [type: repos, ID: ichiban-config-byJqXcrC] has been created. 2026-06-12 01:07:49.446015 | controller | ok: Runtime: 0:00:03.770889 2026-06-12 01:07:49.457125 | 2026-06-12 01:07:49.457257 | TASK [create-gerrit-repository : Ensure repository exists in Gerrit] 2026-06-12 01:07:50.035029 | controller | ok: OK (752 bytes) 2026-06-12 01:07:50.052808 | 2026-06-12 01:07:50.052945 | TASK [health-check/config-update-zuul : Set bad Zuul tenant config] 2026-06-12 01:07:50.364154 | controller | changed: Block inserted 2026-06-12 01:07:50.373577 | 2026-06-12 01:07:50.373716 | LOOP [health-check/config-update-zuul : Commit file in the config repo] 2026-06-12 01:07:50.676990 | controller | ok: Item: git add zuul/main.yaml Runtime: 0:00:00.007277 2026-06-12 01:07:50.677473 | controller | changed: All items complete 2026-06-12 01:07:50.677538 | 2026-06-12 01:07:50.937167 | controller | [master 898ecd3] Add zuul/main.yaml 2026-06-12 01:07:50.937271 | controller | 1 file changed, 2 insertions(+), 5 deletions(-) 2026-06-12 01:07:50.937336 | controller | ok: Item: git commit -m 'Add zuul/main.yaml' Runtime: 0:00:00.044420 2026-06-12 01:07:50.955313 | 2026-06-12 01:07:50.955482 | TASK [ansible.builtin.include_role : health-check/repo-submit-change] 2026-06-12 01:07:50.993073 | controller | ok 2026-06-12 01:07:51.042898 | 2026-06-12 01:07:51.043007 | TASK [health-check/repo-submit-change : Submit change] 2026-06-12 01:07:51.160781 | controller | ok 2026-06-12 01:07:51.166759 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/submit-change.yaml 2026-06-12 01:07:51.172323 | 2026-06-12 01:07:51.172386 | TASK [health-check/repo-submit-change : Submit change] 2026-06-11 21:07:51.982975 | controller | remote: 2026-06-11 21:07:51.983089 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-11 21:07:51.983104 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-11 21:07:51.983113 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-11 21:07:51.983125 | controller | remote: Processing changes: refs: 1, new: 1, done 2026-06-11 21:07:51.983134 | controller | remote: 2026-06-11 21:07:51.983142 | controller | remote: SUCCESS 2026-06-11 21:07:51.983151 | controller | remote: 2026-06-11 21:07:51.983161 | controller | remote: https://gerrit.sfop.me/c/config/+/7 Add zuul/main.yaml [NEW] 2026-06-11 21:07:51.983170 | controller | remote: 2026-06-11 21:07:51.983179 | controller | To https://gerrit.sfop.me/a/config 2026-06-11 21:07:51.983207 | controller | * [new reference] HEAD -> refs/for/master 2026-06-12 01:07:52.203527 | controller | ok: Runtime: 0:00:00.566120 2026-06-12 01:07:52.213918 | 2026-06-12 01:07:52.214074 | TASK [health-check/repo-submit-change : Get Change-id] 2026-06-11 21:07:52.498995 | controller | I4fbdac59195523e5ce0f962bf4066652a07ecd4f 2026-06-12 01:07:52.763197 | controller | ok: Runtime: 0:00:00.010496 2026-06-12 01:07:52.775694 | 2026-06-12 01:07:52.775884 | TASK [health-check/repo-submit-change : Set Code-Review and Workflow label using gerrit API] 2026-06-12 01:07:53.342402 | controller | ok: OK (47 bytes) 2026-06-12 01:07:53.355667 | 2026-06-12 01:07:53.355810 | TASK [health-check/repo-submit-change : Ensure a failure for config-check job] 2026-06-12 01:07:53.403659 | controller | ok 2026-06-12 01:07:53.420595 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/ensure-job-failure.yaml 2026-06-12 01:07:53.436916 | 2026-06-12 01:07:53.437003 | TASK [health-check/repo-submit-change : Get review ID from the changeID using gerrit API] 2026-06-12 01:07:53.948616 | controller | ok: OK (7142 bytes) 2026-06-12 01:07:53.959569 | 2026-06-12 01:07:53.959719 | TASK [health-check/repo-submit-change : ansible.builtin.set_fact] 2026-06-12 01:07:54.019387 | controller | ok 2026-06-12 01:07:54.035557 | 2026-06-12 01:07:54.035729 | TASK [health-check/repo-submit-change : Wait config-check FAILURE result using zuul-web API] 2026-06-12 01:09:08.254033 | controller | ok: OK (1163 bytes) 2026-06-12 01:09:08.265136 | 2026-06-12 01:09:08.265271 | TASK [health-check/repo-submit-change : Verify Zuul Console output] 2026-06-12 01:09:08.292724 | controller | skipping: Conditional result was False 2026-06-12 01:09:08.307319 | 2026-06-12 01:09:08.307500 | TASK [health-check/repo-submit-change : Ensure a success for config-update post job] 2026-06-12 01:09:08.336114 | controller | skipping: Conditional result was False 2026-06-12 01:09:08.349789 | 2026-06-12 01:09:08.349909 | TASK [health-check/repo-submit-change : Ensure a success for config-update job] 2026-06-12 01:09:08.377588 | controller | skipping: Conditional result was False 2026-06-12 01:09:08.398992 | 2026-06-12 01:09:08.399156 | TASK [health-check/config-update-zuul : Set Zuul tenant config] 2026-06-12 01:09:08.692055 | controller | changed: Block inserted 2026-06-12 01:09:08.700960 | 2026-06-12 01:09:08.701093 | LOOP [health-check/config-update-zuul : Commit file in the config repo] 2026-06-12 01:09:09.012084 | controller | ok: Item: git add zuul/main.yaml Runtime: 0:00:00.008068 2026-06-12 01:09:09.313294 | controller | [master 81c6465] Add zuul/main.yaml 2026-06-12 01:09:09.313512 | controller | Date: Thu Jun 11 21:07:50 2026 -0400 2026-06-12 01:09:09.313599 | controller | 1 file changed, 2 insertions(+), 2 deletions(-) 2026-06-12 01:09:09.313687 | controller | ok: Item: git commit --amend --no-edit Runtime: 0:00:00.053138 2026-06-12 01:09:09.331273 | 2026-06-12 01:09:09.331406 | TASK [Submit change and verify Zuul console output] 2026-06-12 01:09:09.366280 | controller | ok 2026-06-12 01:09:09.421169 | 2026-06-12 01:09:09.421299 | TASK [health-check/repo-submit-change : Submit change] 2026-06-12 01:09:09.451156 | controller | ok 2026-06-12 01:09:09.459181 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/submit-change.yaml 2026-06-12 01:09:09.467265 | 2026-06-12 01:09:09.467531 | TASK [health-check/repo-submit-change : Submit change] 2026-06-11 21:09:10.274277 | controller | remote: 2026-06-11 21:09:10.274339 | controller | remote: Processing changes: refs: 1, updated: 1 2026-06-11 21:09:10.274347 | controller | remote: Processing changes: refs: 1, updated: 1 2026-06-11 21:09:10.274354 | controller | remote: Processing changes: refs: 1, updated: 1, done 2026-06-11 21:09:10.274361 | controller | remote: 2026-06-11 21:09:10.274394 | controller | remote: SUCCESS 2026-06-11 21:09:10.274403 | controller | remote: 2026-06-11 21:09:10.274413 | controller | remote: https://gerrit.sfop.me/c/config/+/7 Add zuul/main.yaml 2026-06-11 21:09:10.274419 | controller | remote: 2026-06-11 21:09:10.274424 | controller | To https://gerrit.sfop.me/a/config 2026-06-11 21:09:10.274430 | controller | * [new reference] HEAD -> refs/for/master 2026-06-12 01:09:10.502817 | controller | ok: Runtime: 0:00:00.562573 2026-06-12 01:09:10.509285 | 2026-06-12 01:09:10.509373 | TASK [health-check/repo-submit-change : Get Change-id] 2026-06-11 21:09:10.848311 | controller | I4fbdac59195523e5ce0f962bf4066652a07ecd4f 2026-06-12 01:09:11.044341 | controller | ok: Runtime: 0:00:00.009167 2026-06-12 01:09:11.053886 | 2026-06-12 01:09:11.054062 | TASK [health-check/repo-submit-change : Set Code-Review and Workflow label using gerrit API] 2026-06-12 01:09:11.658832 | controller | ok: OK (47 bytes) 2026-06-12 01:09:11.670504 | 2026-06-12 01:09:11.670720 | TASK [health-check/repo-submit-change : Ensure a failure for config-check job] 2026-06-12 01:09:11.688357 | controller | skipping: Conditional result was False 2026-06-12 01:09:11.700340 | 2026-06-12 01:09:11.700514 | TASK [health-check/repo-submit-change : Verify Zuul Console output] 2026-06-12 01:09:11.745819 | controller | ok 2026-06-12 01:09:11.757931 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/ensure-zuul-console-success.yaml 2026-06-12 01:09:11.774881 | 2026-06-12 01:09:11.774968 | TASK [health-check/repo-submit-change : Wait for config-update job] 2026-06-12 01:10:24.282386 | controller | ok: Runtime: 0:00:00.066321 2026-06-12 01:10:24.292507 | 2026-06-12 01:10:24.292652 | TASK [health-check/repo-submit-change : Connect and validate console stream] 2026-06-11 21:10:24.646380 | controller | 2026-06-12 01:10:16.061439 | Job console starting 2026-06-11 21:10:24.646437 | controller | 2026-06-12 01:10:16.062179 | Updating git repos 2026-06-11 21:10:24.646443 | controller | 2026-06-12 01:10:16.348233 | Cloning repos into workspace 2026-06-11 21:10:24.646448 | controller | 2026-06-12 01:10:17.473593 | Restoring repo states 2026-06-11 21:10:24.646453 | controller | 2026-06-12 01:10:17.482957 | Merging changes 2026-06-11 21:10:24.646458 | controller | 2026-06-12 01:10:17.482980 | Checking out repos 2026-06-11 21:10:24.646463 | controller | 2026-06-12 01:10:17.553061 | Preparing playbooks 2026-06-11 21:10:24.646467 | controller | 2026-06-12 01:10:18.282893 | Running Ansible setup 2026-06-11 21:10:24.646473 | controller | 2026-06-12 01:10:21.750063 | PRE-RUN START: [trusted : git-server/system-config/playbooks/base/pre.yaml@master] 2026-06-11 21:10:24.646478 | controller | 2026-06-12 01:10:23.683227 | 2026-06-11 21:10:24.646481 | controller | 2026-06-12 01:10:23.683391 | PLAY [localhost] 2026-06-11 21:10:24.646485 | controller | 2026-06-12 01:10:23.745984 | 2026-06-11 21:10:24.646488 | controller | 2026-06-12 01:10:23.746167 | TASK [Gathering Facts] 2026-06-11 21:10:24.646492 | controller | 2026-06-11 21:10:26.148801 | controller | 2026-06-12 01:10:25.860634 | localhost | ok 2026-06-11 21:10:26.148863 | controller | 2026-06-12 01:10:25.874193 | 2026-06-11 21:10:26.148877 | controller | 2026-06-12 01:10:25.874336 | TASK [Setup log path fact] 2026-06-11 21:10:26.148889 | controller | 2026-06-12 01:10:25.945603 | localhost | ok 2026-06-11 21:10:26.148901 | controller | 2026-06-12 01:10:26.036128 | 2026-06-11 21:10:26.148913 | controller | 2026-06-12 01:10:26.036362 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-06-11 21:10:26.148925 | controller | 2026-06-12 01:10:26.068179 | localhost | ok 2026-06-11 21:10:26.148936 | controller | 2026-06-12 01:10:26.145074 | 2026-06-11 21:10:26.148972 | controller | 2026-06-12 01:10:26.145237 | TASK [emit-job-header : Print job information] 2026-06-11 21:10:26.148986 | controller | 2026-06-11 21:10:26.649290 | controller | 2026-06-12 01:10:26.237197 | # Job Information 2026-06-11 21:10:26.649360 | controller | 2026-06-12 01:10:26.237460 | Ansible Version: 2.16.18 2026-06-11 21:10:26.649402 | controller | 2026-06-12 01:10:26.237569 | Job: config-update 2026-06-11 21:10:26.649414 | controller | 2026-06-12 01:10:26.237614 | Pipeline: post 2026-06-11 21:10:26.649423 | controller | 2026-06-12 01:10:26.237651 | Executor: zuul-executor-0.zuul-executor-headless.sf.svc.cluster.local 2026-06-11 21:10:26.649432 | controller | 2026-06-12 01:10:26.237690 | Triggered by: https://gerrit.sfop.me/plugins/gitiles/config/+/81c6465de59b8289936d520ecd2d84a72719e7c6^!/ 2026-06-11 21:10:26.649441 | controller | 2026-06-12 01:10:26.237732 | Log URL (when completed): https://sfop.me/logs/2aa/internal/2aa13bf0949f4f32bbc59a0b284fc4bc/ 2026-06-11 21:10:26.649449 | controller | 2026-06-12 01:10:26.237770 | Event ID: 1bd5526ed6044c10b9a22b04075b87cd 2026-06-11 21:10:26.649457 | controller | 2026-06-12 01:10:26.245054 | 2026-06-11 21:10:26.649465 | controller | 2026-06-12 01:10:26.245259 | LOOP [emit-job-header : Print node information] 2026-06-11 21:10:26.649473 | controller | 2026-06-12 01:10:26.284047 | 2026-06-11 21:10:26.649482 | controller | 2026-06-12 01:10:26.284285 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-06-11 21:10:26.649490 | controller | 2026-06-11 21:10:27.649719 | controller | 2026-06-12 01:10:27.575033 | localhost -> localhost | changed 2026-06-11 21:10:27.649778 | controller | 2026-06-12 01:10:27.638625 | 2026-06-11 21:10:27.649788 | controller | 2026-06-12 01:10:27.638813 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-06-11 21:10:27.649798 | controller | 2026-06-12 01:10:29.844183 | controller | ok: Runtime: 0:00:05.023090 2026-06-12 01:10:29.856790 | 2026-06-12 01:10:29.856936 | TASK [health-check/repo-submit-change : Ensure a success for config-update post job] 2026-06-12 01:10:29.897754 | controller | ok 2026-06-12 01:10:29.914242 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/ensure-post-job-success.yaml 2026-06-12 01:10:29.930055 | 2026-06-12 01:10:29.930139 | TASK [health-check/repo-submit-change : Register commit sha] 2026-06-11 21:10:30.199257 | controller | 81c6465de59b8289936d520ecd2d84a72719e7c6 2026-06-12 01:10:30.465934 | controller | ok: Runtime: 0:00:00.007023 2026-06-12 01:10:30.475548 | 2026-06-12 01:10:30.475663 | TASK [health-check/repo-submit-change : Wait config-update SUCCESS result using zuul-web API] 2026-06-12 01:12:05.872465 | controller | ok: OK (1144 bytes) 2026-06-12 01:12:05.885622 | 2026-06-12 01:12:05.885773 | TASK [health-check/repo-submit-change : Ensure a success for config-update job] 2026-06-12 01:12:05.922046 | controller | skipping: Conditional result was False 2026-06-12 01:12:06.032249 | 2026-06-12 01:12:06.032418 | TASK [health-check/config-update-zuul : ansible.builtin.set_fact] 2026-06-12 01:12:06.076909 | controller | ok 2026-06-12 01:12:06.086655 | 2026-06-12 01:12:06.086818 | TASK [Check that Zuul has pushed the job console on the logserver] 2026-06-12 01:12:06.117230 | controller | ok 2026-06-12 01:12:06.160805 | 2026-06-12 01:12:06.160900 | TASK [health-check/ensure-job-result-artifacts : Ensure job console (job-output.txt.gz) exists in Logserver] 2026-06-12 01:12:06.724658 | controller | ok: OK (4739 bytes) 2026-06-12 01:12:06.735018 | 2026-06-12 01:12:06.735150 | TASK [health-check/ensure-job-result-artifacts : Ensure internal logserver rewrite from job-output.txt to job-output.txt.gz] 2026-06-12 01:12:07.308723 | controller | ok: OK (4739 bytes) 2026-06-12 01:12:07.328864 | 2026-06-12 01:12:07.329021 | TASK [health-check/config-update-zuul : Get Zuul projects list] 2026-06-12 01:12:07.873653 | controller | ok: OK (144 bytes) 2026-06-12 01:12:07.883986 | 2026-06-12 01:12:07.884123 | TASK [health-check/config-update-zuul : Ensure project exists in Zuul (fail if not)] 2026-06-12 01:12:07.944218 | controller | skipping: Conditional result was False 2026-06-12 01:12:07.974621 | 2026-06-12 01:12:07.974785 | LOOP [health-check/test-nodepool-launcher-pod : Reset config dir to HEAD] 2026-06-12 01:12:08.421585 | controller | Fetching origin 2026-06-12 01:12:08.422053 | controller | From https://gerrit.sfop.me/a/demo-project 2026-06-12 01:12:08.422118 | controller | f82ab53..c5b6600 master -> origin/master 2026-06-12 01:12:08.422162 | controller | Fetching gerrit 2026-06-12 01:12:08.422235 | controller | ok: Item: git remote update Runtime: 0:00:00.143329 2026-06-12 01:12:08.422311 | controller | changed: All items complete 2026-06-12 01:12:08.422369 | 2026-06-12 01:12:08.665731 | controller | HEAD is now at c5b6600 Update demo-job to sleep 1 second 2026-06-12 01:12:08.665929 | controller | ok: Item: git reset --hard origin/master Runtime: 0:00:00.010924 2026-06-12 01:12:08.678888 | 2026-06-12 01:12:08.679094 | LOOP [health-check/test-nodepool-launcher-pod : Ensure playbooks and zuul.d dir exists] 2026-06-12 01:12:08.976490 | controller | ok: "playbooks" 2026-06-12 01:12:09.167091 | controller | changed: "zuul.d" 2026-06-12 01:12:09.185720 | 2026-06-12 01:12:09.185952 | TASK [health-check/test-nodepool-launcher-pod : Create new zuul config] 2026-06-12 01:12:10.013933 | controller | changed 2026-06-12 01:12:10.020567 | 2026-06-12 01:12:10.020653 | TASK [health-check/test-nodepool-launcher-pod : Create simple playbook] 2026-06-12 01:12:10.868370 | controller | changed 2026-06-12 01:12:10.878039 | 2026-06-12 01:12:10.878173 | LOOP [health-check/test-nodepool-launcher-pod : Create git commit message] 2026-06-12 01:12:11.197173 | controller | ok: Item: git add . Runtime: 0:00:00.009815 2026-06-12 01:12:11.197664 | controller | changed: All items complete 2026-06-12 01:12:11.197733 | 2026-06-12 01:12:11.472843 | controller | [test_short_job 88f5650] Provide a demo job for testing the local pod spawning 2026-06-12 01:12:11.473027 | controller | 2 files changed, 18 insertions(+) 2026-06-12 01:12:11.473100 | controller | create mode 100644 playbooks/microshift-pod.yml 2026-06-12 01:12:11.473154 | controller | create mode 100644 zuul.d/config.yaml 2026-06-12 01:12:11.473218 | controller | ok: Item: git commit -m 'Provide a demo job for testing the local pod spawning' Runtime: 0:00:00.067107 2026-06-12 01:12:11.485798 | 2026-06-12 01:12:11.486016 | TASK [Submit change and validate job success] 2026-06-12 01:12:11.523211 | controller | ok 2026-06-12 01:12:11.560790 | 2026-06-12 01:12:11.561094 | TASK [health-check/repo-submit-change : Submit change] 2026-06-12 01:12:11.596804 | controller | ok 2026-06-12 01:12:11.606764 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/submit-change.yaml 2026-06-12 01:12:11.614756 | 2026-06-12 01:12:11.614854 | TASK [health-check/repo-submit-change : Submit change] 2026-06-11 21:12:12.485905 | controller | remote: 2026-06-11 21:12:12.485994 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-11 21:12:12.486008 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-11 21:12:12.486018 | controller | remote: Processing changes: refs: 1, new: 1 2026-06-11 21:12:12.486030 | controller | remote: Processing changes: refs: 1, new: 1, done 2026-06-11 21:12:12.486041 | controller | remote: commit 88f5650: warning: subject >50 characters; use shorter first paragraph 2026-06-11 21:12:12.486051 | controller | remote: 2026-06-11 21:12:12.486060 | controller | remote: SUCCESS 2026-06-11 21:12:12.486069 | controller | remote: 2026-06-11 21:12:12.486079 | controller | remote: https://gerrit.sfop.me/c/demo-project/+/8 Provide a demo job for testing the local pod spawning [NEW] 2026-06-11 21:12:12.486089 | controller | remote: 2026-06-11 21:12:12.486097 | controller | To https://gerrit.sfop.me/a/demo-project 2026-06-11 21:12:12.486107 | controller | * [new reference] HEAD -> refs/for/master 2026-06-12 01:12:12.656335 | controller | ok: Runtime: 0:00:00.618241 2026-06-12 01:12:12.666344 | 2026-06-12 01:12:12.666516 | TASK [health-check/repo-submit-change : Get Change-id] 2026-06-11 21:12:12.970900 | controller | Ic17cdbea48de15db06aa703c64859f3248202947 2026-06-12 01:12:13.214722 | controller | ok: Runtime: 0:00:00.012351 2026-06-12 01:12:13.224932 | 2026-06-12 01:12:13.225089 | TASK [health-check/repo-submit-change : Set Code-Review and Workflow label using gerrit API] 2026-06-12 01:12:13.264263 | controller | skipping: Conditional result was False 2026-06-12 01:12:13.278246 | 2026-06-12 01:12:13.278400 | TASK [health-check/repo-submit-change : Ensure a failure for config-check job] 2026-06-12 01:12:13.316339 | controller | skipping: Conditional result was False 2026-06-12 01:12:13.327959 | 2026-06-12 01:12:13.328166 | TASK [health-check/repo-submit-change : Verify Zuul Console output] 2026-06-12 01:12:13.366975 | controller | skipping: Conditional result was False 2026-06-12 01:12:13.383161 | 2026-06-12 01:12:13.383308 | TASK [health-check/repo-submit-change : Ensure a success for microshift-pod post job] 2026-06-12 01:12:13.421042 | controller | skipping: Conditional result was False 2026-06-12 01:12:13.434363 | 2026-06-12 01:12:13.434559 | TASK [health-check/repo-submit-change : Ensure a success for microshift-pod job] 2026-06-12 01:12:13.481546 | controller | ok 2026-06-12 01:12:13.495742 | controller | included: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/untrusted/project_0/softwarefactory-project.io/software-factory/sf-operator/roles/health-check/repo-submit-change/tasks/ensure-job-success.yaml 2026-06-12 01:12:13.509650 | 2026-06-12 01:12:13.509781 | TASK [health-check/repo-submit-change : Get review ID from the changeID using gerrit API] 2026-06-12 01:12:14.084036 | controller | ok: OK (2986 bytes) 2026-06-12 01:12:14.094411 | 2026-06-12 01:12:14.094579 | TASK [health-check/repo-submit-change : ansible.builtin.set_fact] 2026-06-12 01:12:14.156006 | controller | ok 2026-06-12 01:12:14.168674 | 2026-06-12 01:12:14.168814 | TASK [health-check/repo-submit-change : Wait microshift-pod SUCCESS result using zuul-web API] 2026-06-12 01:14:10.419278 | controller | ok: OK (799 bytes) 2026-06-12 01:14:10.456476 | 2026-06-12 01:14:10.456847 | TASK [health-check/test-volumestats-sidecar : ensure logserver deployment is ready] 2026-06-12 01:14:10.993973 | controller | ok: Runtime: 0:00:00.098482 2026-06-12 01:14:11.004019 | 2026-06-12 01:14:11.004153 | TASK [health-check/test-volumestats-sidecar : Start port forwarding to logserver sidecar] 2026-06-12 01:14:11.860605 | controller | ok: ERROR (ignored) 2026-06-12 01:14:11.861038 | controller | { 2026-06-12 01:14:11.861104 | controller | "ansible_job_id": "j273195487081.189686", 2026-06-12 01:14:11.861148 | controller | "finished": 0, 2026-06-12 01:14:11.861190 | controller | "results_file": "/home/zuul-worker/.ansible_async/j273195487081.189686", 2026-06-12 01:14:11.861230 | controller | "started": 1 2026-06-12 01:14:11.861269 | controller | } 2026-06-12 01:14:11.870196 | 2026-06-12 01:14:11.870327 | TASK [health-check/test-volumestats-sidecar : Pause to ensure the port forwarding is up] 2026-06-12 01:14:31.918666 | controller | ok 2026-06-12 01:14:31.929689 | 2026-06-12 01:14:31.929885 | TASK [health-check/test-volumestats-sidecar : Ensure volume info is exposed by metrics] 2026-06-12 01:14:32.545888 | controller | ok: OK (unknown bytes) 2026-06-12 01:14:32.567121 | 2026-06-12 01:14:32.567332 | TASK [Register CLI version] 2026-06-11 21:14:33.223484 | controller | v0.0.68 2026-06-12 01:14:33.614537 | controller | ok: Runtime: 0:00:00.378023 2026-06-12 01:14:33.623232 | 2026-06-12 01:14:33.623367 | TASK [ensure annotations are present on sf-standalone-owner] 2026-06-12 01:14:34.172563 | controller | ok: Runtime: 0:00:00.095469 2026-06-12 01:14:34.175652 | 2026-06-12 01:14:34.175712 | PLAY RECAP 2026-06-12 01:14:34.175776 | controller | ok: 367 changed: 219 unreachable: 0 failed: 0 skipped: 57 rescued: 0 ignored: 0 2026-06-12 01:14:34.175805 | 2026-06-12 01:14:34.502560 | RUN END RESULT_NORMAL: [untrusted : softwarefactory-project.io/software-factory/sf-operator/playbooks/run-tests.yaml@master] 2026-06-12 01:14:34.503858 | POST-RUN START: [untrusted : softwarefactory-project.io/software-factory/sf-operator/playbooks/get-minikube-logs.yaml@master] 2026-06-12 01:14:35.119182 | 2026-06-12 01:14:35.119305 | PLAY [controller] 2026-06-12 01:14:35.128562 | 2026-06-12 01:14:35.128631 | TASK [Grab minikube logs] 2026-06-12 01:14:38.159322 | controller | ok: Runtime: 0:00:02.333046 2026-06-12 01:14:38.168940 | 2026-06-12 01:14:38.169118 | TASK [ansible.builtin.include_role : post/get-kubectl-logs] 2026-06-12 01:14:38.196649 | controller | ok 2026-06-12 01:14:38.228888 | 2026-06-12 01:14:38.228984 | TASK [post/get-kubectl-logs : Set proper facts] 2026-06-12 01:14:38.258909 | controller | ok 2026-06-12 01:14:38.263862 | 2026-06-12 01:14:38.263953 | TASK [post/get-kubectl-logs : Get pod logs] 2026-06-12 01:14:48.810240 | controller | ok: Runtime: 0:00:09.784551 2026-06-12 01:14:48.819207 | 2026-06-12 01:14:48.819355 | LOOP [post/get-kubectl-logs : Describe namespace resources] 2026-06-12 01:14:53.645426 | controller | ok: Item: pods Runtime: 0:00:04.534771 2026-06-12 01:14:55.335863 | controller | ok: Item: deployments Runtime: 0:00:01.467275 2026-06-12 01:14:57.715236 | controller | ok: Item: statefulsets Runtime: 0:00:02.123870 2026-06-12 01:15:01.368559 | controller | ok: Item: services Runtime: 0:00:03.405387 2026-06-12 01:15:04.837788 | controller | ok: Item: secrets Runtime: 0:00:03.218159 2026-06-12 01:15:09.659737 | controller | ok: Item: configmaps Runtime: 0:00:04.577100 2026-06-12 01:15:11.173948 | controller | ok: Item: jobs Runtime: 0:00:01.256870 2026-06-12 01:15:13.860875 | controller | ok: Item: pvc Runtime: 0:00:02.451465 2026-06-12 01:15:15.072575 | controller | ok: Item: ingress Runtime: 0:00:00.988333 2026-06-12 01:15:15.091484 | 2026-06-12 01:15:15.091635 | TASK [post/get-kubectl-logs : Get events] 2026-06-12 01:15:17.124042 | controller | ok: Runtime: 0:00:01.369704 2026-06-12 01:15:17.132780 | 2026-06-12 01:15:17.133088 | TASK [post/get-kubectl-logs : Fetch decoded secrets] 2026-06-12 01:15:20.680755 | controller | ok: Runtime: 0:00:02.950947 2026-06-12 01:15:20.695184 | 2026-06-12 01:15:20.695332 | TASK [ansible.builtin.include_role : post/get-logserver-content] 2026-06-12 01:15:20.720189 | controller | ok 2026-06-12 01:15:20.754748 | 2026-06-12 01:15:20.754894 | TASK [post/get-logserver-content : Ensure removal of ~/zuul-output/logs/logserver-content] 2026-06-12 01:15:21.094002 | controller | ok 2026-06-12 01:15:21.101972 | 2026-06-12 01:15:21.102115 | TASK [post/get-logserver-content : Get logserver pod name] 2026-06-11 21:15:21.474600 | controller | logserver-0 2026-06-12 01:15:21.646548 | controller | ok: Runtime: 0:00:00.104808 2026-06-12 01:15:21.658863 | 2026-06-12 01:15:21.659036 | TASK [post/get-logserver-content : Fetch logserver content on locally in ~/zuul-output/logs/logserver-content] 2026-06-11 21:15:22.168949 | controller | tar: Removing leading `/' from member names 2026-06-12 01:15:22.215839 | controller | ok: Runtime: 0:00:00.240030 2026-06-12 01:15:22.230125 | 2026-06-12 01:15:22.230258 | TASK [ansible.builtin.include_role : post/get-repos] 2026-06-12 01:15:22.264037 | controller | ok 2026-06-12 01:15:22.294781 | 2026-06-12 01:15:22.294911 | TASK [post/get-repos : Set proper facts] 2026-06-12 01:15:22.325478 | controller | ok 2026-06-12 01:15:22.331310 | 2026-06-12 01:15:22.331396 | TASK [post/get-repos : Ensure ~/zuul-output/logs/repos/] 2026-06-12 01:15:22.545689 | controller | changed 2026-06-12 01:15:22.554975 | 2026-06-12 01:15:22.555106 | TASK [post/get-repos : Copy repositories] 2026-06-12 01:15:23.242932 | controller | changed 2026-06-12 01:15:23.259519 | 2026-06-12 01:15:23.259686 | TASK [ansible.builtin.include_role : post/get-loki-logs] 2026-06-12 01:15:23.293783 | controller | ok 2026-06-12 01:15:23.334453 | 2026-06-12 01:15:23.334648 | TASK [post/get-loki-logs : Ensure output dir exists for loki logs] 2026-06-12 01:15:23.632047 | controller | changed 2026-06-12 01:15:23.640333 | 2026-06-12 01:15:23.640496 | TASK [post/get-loki-logs : Set realpath for the log directory] 2026-06-11 21:15:23.910911 | controller | /home/zuul-worker/zuul-output/logs/loki-logs 2026-06-12 01:15:24.187329 | controller | ok: Runtime: 0:00:00.003805 2026-06-12 01:15:24.195265 | 2026-06-12 01:15:24.195394 | TASK [post/get-loki-logs : Start port forwarding to loki-http if needed] 2026-06-12 01:15:24.936524 | controller | ok: ERROR (ignored) 2026-06-12 01:15:24.937089 | controller | { 2026-06-12 01:15:24.937187 | controller | "ansible_job_id": "j964836978347.196201", 2026-06-12 01:15:24.937251 | controller | "finished": 0, 2026-06-12 01:15:24.937309 | controller | "results_file": "/home/zuul-worker/.ansible_async/j964836978347.196201", 2026-06-12 01:15:24.937370 | controller | "started": 1 2026-06-12 01:15:24.937411 | controller | } 2026-06-12 01:15:24.945691 | 2026-06-12 01:15:24.945819 | TASK [post/get-loki-logs : Ensure loki is reachable] 2026-06-12 01:15:25.700336 | controller | ok: OK (141 bytes) 2026-06-12 01:15:25.709176 | 2026-06-12 01:15:25.709305 | TASK [post/get-loki-logs : Get aggregated logs prefixed by service] 2026-06-12 01:15:27.759859 | controller | ok: Runtime: 0:00:01.529793 2026-06-12 01:15:27.767836 | 2026-06-12 01:15:27.767984 | TASK [post/get-loki-logs : Change owner and group for the log dir] 2026-06-12 01:15:28.312326 | controller | ok: Runtime: 0:00:00.007916 2026-06-12 01:15:28.321607 | 2026-06-12 01:15:28.321998 | PLAY RECAP 2026-06-12 01:15:28.322081 | controller | ok: 18 changed: 14 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-06-12 01:15:28.322123 | 2026-06-12 01:15:28.471414 | POST-RUN END RESULT_NORMAL: [untrusted : softwarefactory-project.io/software-factory/sf-operator/playbooks/get-minikube-logs.yaml@master] 2026-06-12 01:15:28.473749 | POST-RUN START: [trusted : gitlab.com/softwarefactory-project/centosinfra-prod/sf-config/playbooks/base/post.yaml@main] 2026-06-12 01:15:29.100070 | 2026-06-12 01:15:29.100188 | PLAY [all] 2026-06-12 01:15:29.109550 | 2026-06-12 01:15:29.109626 | TASK [include_role : fetch-output] 2026-06-12 01:15:29.148421 | controller | ok 2026-06-12 01:15:29.160005 | 2026-06-12 01:15:29.160077 | TASK [fetch-output : Set log path for multiple nodes] 2026-06-12 01:15:29.214607 | controller | skipping: Conditional result was False 2026-06-12 01:15:29.220208 | 2026-06-12 01:15:29.220299 | TASK [fetch-output : Set log path for single node] 2026-06-12 01:15:29.263548 | controller | ok 2026-06-12 01:15:29.270752 | 2026-06-12 01:15:29.270885 | LOOP [fetch-output : Ensure local output dirs] 2026-06-12 01:15:29.766581 | controller -> localhost | changed: "/var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/work/logs" 2026-06-12 01:15:30.039368 | controller -> localhost | changed: "/var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/work/artifacts" 2026-06-12 01:15:30.297684 | controller -> localhost | changed: "/var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/work/docs" 2026-06-12 01:15:30.312070 | 2026-06-12 01:15:30.312257 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-06-12 01:15:31.229658 | controller | changed: 2026-06-12 01:15:31.230044 | controller | .d..t...... ./ 2026-06-12 01:15:31.230113 | controller | >f+++++++++ dmesg.txt 2026-06-12 01:15:31.230158 | controller | >f+++++++++ minikube.logs 2026-06-12 01:15:31.230199 | controller | >f+++++++++ sf-operator-dry-run-lifecycle.log 2026-06-12 01:15:31.230239 | controller | >f+++++++++ sf-operator-dry-run-update.log 2026-06-12 01:15:31.230279 | controller | >f+++++++++ sf-operator.log 2026-06-12 01:15:31.230317 | controller | cd+++++++++ decoded-secrets/ 2026-06-12 01:15:31.230372 | controller | >f+++++++++ decoded-secrets/ingress-nginx--ingress-nginx-admission 2026-06-12 01:15:31.230413 | controller | >f+++++++++ decoded-secrets/kube-system--bootstrap-token-jusm9o 2026-06-12 01:15:31.230511 | controller | >f+++++++++ decoded-secrets/nodepool--nodepool-token 2026-06-12 01:15:31.230561 | controller | >f+++++++++ decoded-secrets/sf--admin-ssh-key 2026-06-12 01:15:31.230600 | controller | >f+++++++++ decoded-secrets/sf--config-update-secrets 2026-06-12 01:15:31.230639 | controller | >f+++++++++ decoded-secrets/sf--dummygerritsecret 2026-06-12 01:15:31.230675 | controller | >f+++++++++ decoded-secrets/sf--es-basicauth 2026-06-12 01:15:31.230713 | controller | >f+++++++++ decoded-secrets/sf--gerrit-admin-api-key 2026-06-12 01:15:31.230754 | controller | >f+++++++++ decoded-secrets/sf--logserver-keys 2026-06-12 01:15:31.230792 | controller | >f+++++++++ decoded-secrets/sf--logserver-uploader-keys 2026-06-12 01:15:31.230905 | controller | >f+++++++++ decoded-secrets/sf--logserver-uploader-spare-keys 2026-06-12 01:15:31.230945 | controller | >f+++++++++ decoded-secrets/sf--mariadb-config-secrets 2026-06-12 01:15:31.230982 | controller | >f+++++++++ decoded-secrets/sf--mariadb-initdb-secrets 2026-06-12 01:15:31.231018 | controller | >f+++++++++ decoded-secrets/sf--mariadb-root-password 2026-06-12 01:15:31.231054 | controller | >f+++++++++ decoded-secrets/sf--nodepool-builder-ssh-key 2026-06-12 01:15:31.231090 | controller | >f+++++++++ decoded-secrets/sf--nodepool-providers-secrets 2026-06-12 01:15:31.231126 | controller | >f+++++++++ decoded-secrets/sf--self-signed-cert 2026-06-12 01:15:31.231163 | controller | >f+++++++++ decoded-secrets/sf--smtp-secret 2026-06-12 01:15:31.231201 | controller | >f+++++++++ decoded-secrets/sf--zookeeper-client-tls 2026-06-12 01:15:31.231237 | controller | >f+++++++++ decoded-secrets/sf--zookeeper-server-tls 2026-06-12 01:15:31.231273 | controller | >f+++++++++ decoded-secrets/sf--zuul-auth-secret 2026-06-12 01:15:31.231309 | controller | >f+++++++++ decoded-secrets/sf--zuul-config 2026-06-12 01:15:31.231345 | controller | >f+++++++++ decoded-secrets/sf--zuul-db-connection 2026-06-12 01:15:31.231381 | controller | >f+++++++++ decoded-secrets/sf--zuul-gerrit-api-key 2026-06-12 01:15:31.231417 | controller | >f+++++++++ decoded-secrets/sf--zuul-keystore-password 2026-06-12 01:15:31.231493 | controller | >f+++++++++ decoded-secrets/sf--zuul-spare-ssh-key 2026-06-12 01:15:31.231533 | controller | >f+++++++++ decoded-secrets/sf--zuul-ssh-key 2026-06-12 01:15:31.231569 | controller | cd+++++++++ events/ 2026-06-12 01:15:31.231605 | controller | >f+++++++++ events/default.txt 2026-06-12 01:15:31.231641 | controller | >f+++++++++ events/ingress-nginx.txt 2026-06-12 01:15:31.231676 | controller | >f+++++++++ events/kube-node-lease.txt 2026-06-12 01:15:31.231722 | controller | >f+++++++++ events/kube-public.txt 2026-06-12 01:15:31.231760 | controller | >f+++++++++ events/kube-system.txt 2026-06-12 01:15:31.231796 | controller | >f+++++++++ events/nodepool.txt 2026-06-12 01:15:31.231833 | controller | >f+++++++++ events/sf.txt 2026-06-12 01:15:31.231870 | controller | cd+++++++++ items-describe/ 2026-06-12 01:15:31.231907 | controller | >f+++++++++ items-describe/default--configmaps--kube-root-ca.crt.txt 2026-06-12 01:15:31.231943 | controller | >f+++++++++ items-describe/default--services--kubernetes.txt 2026-06-12 01:15:31.231980 | controller | >f+++++++++ items-describe/ingress-nginx--configmaps--ingress-nginx-controller.txt 2026-06-12 01:15:31.232019 | controller | >f+++++++++ items-describe/ingress-nginx--configmaps--kube-root-ca.crt.txt 2026-06-12 01:15:31.232057 | controller | >f+++++++++ items-describe/ingress-nginx--configmaps--tcp-services.txt 2026-06-12 01:15:31.232095 | controller | >f+++++++++ items-describe/ingress-nginx--configmaps--udp-services.txt 2026-06-12 01:15:31.232132 | controller | >f+++++++++ items-describe/ingress-nginx--deployments--ingress-nginx-controller.txt 2026-06-12 01:15:31.232169 | controller | >f+++++++++ items-describe/ingress-nginx--jobs--ingress-nginx-admission-create.txt 2026-06-12 01:15:31.232214 | controller | >f+++++++++ items-describe/ingress-nginx--jobs--ingress-nginx-admission-patch.txt 2026-06-12 01:15:31.232251 | controller | >f+++++++++ items-describe/ingress-nginx--pods--ingress-nginx-admission-create-rdqwd.txt 2026-06-12 01:15:31.232288 | controller | >f+++++++++ items-describe/ingress-nginx--pods--ingress-nginx-admission-patch-9b2v2.txt 2026-06-12 01:15:31.232325 | controller | >f+++++++++ items-describe/ingress-nginx--pods--ingress-nginx-controller-86649c845b-s9hqf.txt 2026-06-12 01:15:31.232361 | controller | >f+++++++++ items-describe/ingress-nginx--secrets--ingress-nginx-admission.txt 2026-06-12 01:15:31.232397 | controller | >f+++++++++ items-describe/ingress-nginx--services--ingress-nginx-controller-admission.txt 2026-06-12 01:15:31.232463 | controller | >f+++++++++ items-describe/ingress-nginx--services--ingress-nginx-controller.txt 2026-06-12 01:15:31.232511 | controller | >f+++++++++ items-describe/kube-node-lease--configmaps--kube-root-ca.crt.txt 2026-06-12 01:15:31.232549 | controller | >f+++++++++ items-describe/kube-public--configmaps--cluster-info.txt 2026-06-12 01:15:31.232585 | controller | >f+++++++++ items-describe/kube-public--configmaps--kube-root-ca.crt.txt 2026-06-12 01:15:31.232621 | controller | >f+++++++++ items-describe/kube-system--configmaps--coredns.txt 2026-06-12 01:15:31.232657 | controller | >f+++++++++ items-describe/kube-system--configmaps--extension-apiserver-authentication.txt 2026-06-12 01:15:31.232693 | controller | >f+++++++++ items-describe/kube-system--configmaps--kube-apiserver-legacy-service-account-token-tracking.txt 2026-06-12 01:15:31.232729 | controller | >f+++++++++ items-describe/kube-system--configmaps--kube-proxy.txt 2026-06-12 01:15:31.232764 | controller | >f+++++++++ items-describe/kube-system--configmaps--kube-root-ca.crt.txt 2026-06-12 01:15:31.232800 | controller | >f+++++++++ items-describe/kube-system--configmaps--kubeadm-config.txt 2026-06-12 01:15:31.232835 | controller | >f+++++++++ items-describe/kube-system--configmaps--kubelet-config.txt 2026-06-12 01:15:31.232870 | controller | >f+++++++++ items-describe/kube-system--deployments--coredns.txt 2026-06-12 01:15:31.233004 | controller | >f+++++++++ items-describe/kube-system--pods--coredns-668d6bf9bc-5j4w8.txt 2026-06-12 01:15:31.233049 | controller | >f+++++++++ items-describe/kube-system--pods--etcd-minikube.txt 2026-06-12 01:15:31.233086 | controller | >f+++++++++ items-describe/kube-system--pods--kindnet-8ghkz.txt 2026-06-12 01:15:31.233122 | controller | >f+++++++++ items-describe/kube-system--pods--kube-apiserver-minikube.txt 2026-06-12 01:15:31.233159 | controller | >f+++++++++ items-describe/kube-system--pods--kube-controller-manager-minikube.txt 2026-06-12 01:15:31.233196 | controller | >f+++++++++ items-describe/kube-system--pods--kube-ingress-dns-minikube.txt 2026-06-12 01:15:31.233232 | controller | >f+++++++++ items-describe/kube-system--pods--kube-proxy-z4h4c.txt 2026-06-12 01:15:31.233268 | controller | >f+++++++++ items-describe/kube-system--pods--kube-scheduler-minikube.txt 2026-06-12 01:15:31.233304 | controller | >f+++++++++ items-describe/kube-system--pods--storage-provisioner.txt 2026-06-12 01:15:31.233339 | controller | >f+++++++++ items-describe/kube-system--secrets--bootstrap-token-jusm9o.txt 2026-06-12 01:15:31.233374 | controller | >f+++++++++ items-describe/kube-system--services--kube-dns.txt 2026-06-12 01:15:31.233409 | controller | >f+++++++++ items-describe/nodepool--configmaps--kube-root-ca.crt.txt 2026-06-12 01:15:31.233492 | controller | >f+++++++++ items-describe/nodepool--secrets--nodepool-token.txt 2026-06-12 01:15:31.233534 | controller | >f+++++++++ items-describe/sf--configmaps--gateway-config-map.txt 2026-06-12 01:15:31.233571 | controller | >f+++++++++ items-describe/sf--configmaps--git-server-pi-config-map.txt 2026-06-12 01:15:31.233608 | controller | >f+++++++++ items-describe/sf--configmaps--kube-root-ca.crt.txt 2026-06-12 01:15:31.233644 | controller | >f+++++++++ items-describe/sf--configmaps--logserver-config-map.txt 2026-06-12 01:15:31.233689 | controller | >f+++++++++ items-describe/sf--configmaps--loki-config.txt 2026-06-12 01:15:31.233726 | controller | >f+++++++++ items-describe/sf--configmaps--managesf-resources-config-map.txt 2026-06-12 01:15:31.233761 | controller | >f+++++++++ items-describe/sf--configmaps--managesf-resources-tooling-config-map.txt 2026-06-12 01:15:31.233797 | controller | >f+++++++++ items-describe/sf--configmaps--nodepool-builder-extra-config-config-map.txt 2026-06-12 01:15:31.233833 | controller | >f+++++++++ items-describe/sf--configmaps--nodepool-launcher-extra-config-config-map.txt 2026-06-12 01:15:31.233868 | controller | >f+++++++++ items-describe/sf--configmaps--nodepool-tooling-config-map.txt 2026-06-12 01:15:31.233903 | controller | >f+++++++++ items-describe/sf--configmaps--np-statsd-config-map.txt 2026-06-12 01:15:31.233938 | controller | >f+++++++++ items-describe/sf--configmaps--pymod-sf-operator-config-map.txt 2026-06-12 01:15:31.233974 | controller | >f+++++++++ items-describe/sf--configmaps--sf-standalone-owner.txt 2026-06-12 01:15:31.234163 | controller | >f+++++++++ items-describe/sf--configmaps--test-fluentbit-config.txt 2026-06-12 01:15:31.234208 | controller | >f+++++++++ items-describe/sf--configmaps--zookeeper-pi-config-map.txt 2026-06-12 01:15:31.234246 | controller | >f+++++++++ items-describe/sf--configmaps--zs-internal-tenant-reconfigure.txt 2026-06-12 01:15:31.234283 | controller | >f+++++++++ items-describe/sf--configmaps--zuul-extra-config-map.txt 2026-06-12 01:15:31.234320 | controller | >f+++++++++ items-describe/sf--configmaps--zuul-logging-config-map.txt 2026-06-12 01:15:31.234356 | controller | >f+++++++++ items-describe/sf--configmaps--zuul-scheduler-tooling-config-map.txt 2026-06-12 01:15:31.234391 | controller | >f+++++++++ items-describe/sf--configmaps--zuul-statsd-config-map.txt 2026-06-12 01:15:31.234455 | controller | >f+++++++++ items-describe/sf--deployments--gateway.txt 2026-06-12 01:15:31.234529 | controller | >f+++++++++ items-describe/sf--deployments--logjuicer.txt 2026-06-12 01:15:31.234571 | controller | >f+++++++++ items-describe/sf--deployments--nodepool-launcher.txt 2026-06-12 01:15:31.234607 | controller | >f+++++++++ items-describe/sf--deployments--test-loki.txt 2026-06-12 01:15:31.234644 | controller | >f+++++++++ items-describe/sf--deployments--zuul-web.txt 2026-06-12 01:15:31.234681 | controller | >f+++++++++ items-describe/sf--deployments--zuul-weeder.txt 2026-06-12 01:15:31.234719 | controller | >f+++++++++ items-describe/sf--ingress--gerrit-ingress.txt 2026-06-12 01:15:31.234759 | controller | >f+++++++++ items-describe/sf--ingress--sf-ingress.txt 2026-06-12 01:15:31.234798 | controller | >f+++++++++ items-describe/sf--jobs--config-base-secret-1-8679-ns.txt 2026-06-12 01:15:31.234835 | controller | >f+++++++++ items-describe/sf--jobs--post-init.txt 2026-06-12 01:15:31.234872 | controller | >f+++++++++ items-describe/sf--jobs--zuul-db-provision.txt 2026-06-12 01:15:31.234909 | controller | >f+++++++++ items-describe/sf--pods--config-base-secret-1-857-ns-7qpqr.txt 2026-06-12 01:15:31.234946 | controller | >f+++++++++ items-describe/sf--pods--config-base-secret-1-8679-ns-q9g5k.txt 2026-06-12 01:15:31.234983 | controller | >f+++++++++ items-describe/sf--pods--gateway-6bbbd758d9-drvjg.txt 2026-06-12 01:15:31.235019 | controller | >f+++++++++ items-describe/sf--pods--gerrit-0.txt 2026-06-12 01:15:31.235056 | controller | >f+++++++++ items-describe/sf--pods--git-server-0.txt 2026-06-12 01:15:31.235151 | controller | >f+++++++++ items-describe/sf--pods--hound-search-0.txt 2026-06-12 01:15:31.235196 | controller | >f+++++++++ items-describe/sf--pods--logjuicer-6ff84764b7-g7v2t.txt 2026-06-12 01:15:31.235233 | controller | >f+++++++++ items-describe/sf--pods--logserver-0.txt 2026-06-12 01:15:31.235269 | controller | >f+++++++++ items-describe/sf--pods--mariadb-0.txt 2026-06-12 01:15:31.235306 | controller | >f+++++++++ items-describe/sf--pods--nodepool-builder-0.txt 2026-06-12 01:15:31.235343 | controller | >f+++++++++ items-describe/sf--pods--nodepool-launcher-b79c8ffb-strq5.txt 2026-06-12 01:15:31.235394 | controller | >f+++++++++ items-describe/sf--pods--post-init-fl4dd.txt 2026-06-12 01:15:31.235460 | controller | >f+++++++++ items-describe/sf--pods--test-fluentbit.txt 2026-06-12 01:15:31.235508 | controller | >f+++++++++ items-describe/sf--pods--test-loki-8cd4fd56-8v78l.txt 2026-06-12 01:15:31.235546 | controller | >f+++++++++ items-describe/sf--pods--zookeeper-0.txt 2026-06-12 01:15:31.235583 | controller | >f+++++++++ items-describe/sf--pods--zuul-db-provision-74d9p.txt 2026-06-12 01:15:31.235620 | controller | >f+++++++++ items-describe/sf--pods--zuul-db-provision-mtng6.txt 2026-06-12 01:15:31.235656 | controller | >f+++++++++ items-describe/sf--pods--zuul-executor-0.txt 2026-06-12 01:15:31.235692 | controller | >f+++++++++ items-describe/sf--pods--zuul-merger-0.txt 2026-06-12 01:15:31.235728 | controller | >f+++++++++ items-describe/sf--pods--zuul-scheduler-0.txt 2026-06-12 01:15:31.235763 | controller | >f+++++++++ items-describe/sf--pods--zuul-web-74c88ff8b-l76wt.txt 2026-06-12 01:15:31.235799 | controller | >f+++++++++ items-describe/sf--pods--zuul-weeder-57c6567f5f-tf7f4.txt 2026-06-12 01:15:31.235835 | controller | >f+++++++++ items-describe/sf--pvc--gerrit-gerrit-0.txt 2026-06-12 01:15:31.235871 | controller | >f+++++++++ items-describe/sf--pvc--git-server-git-server-0.txt 2026-06-12 01:15:31.235907 | controller | >f+++++++++ items-describe/sf--pvc--hound-search-data-hound-search-0.txt 2026-06-12 01:15:31.235943 | controller | >f+++++++++ items-describe/sf--pvc--logjuicer-pvc.txt 2026-06-12 01:15:31.235978 | controller | >f+++++++++ items-describe/sf--pvc--logserver-logserver-0.txt 2026-06-12 01:15:31.236013 | controller | >f+++++++++ items-describe/sf--pvc--mariadb-logs-mariadb-0.txt 2026-06-12 01:15:31.236048 | controller | >f+++++++++ items-describe/sf--pvc--mariadb-mariadb-0.txt 2026-06-12 01:15:31.236084 | controller | >f+++++++++ items-describe/sf--pvc--nodepool-builder-nodepool-builder-0.txt 2026-06-12 01:15:31.236120 | controller | >f+++++++++ items-describe/sf--pvc--zookeeper-data-zookeeper-0.txt 2026-06-12 01:15:31.236155 | controller | >f+++++++++ items-describe/sf--pvc--zookeeper-logs-zookeeper-0.txt 2026-06-12 01:15:31.236258 | controller | >f+++++++++ items-describe/sf--pvc--zuul-executor-zuul-executor-0.txt 2026-06-12 01:15:31.236300 | controller | >f+++++++++ items-describe/sf--pvc--zuul-merger-zuul-merger-0.txt 2026-06-12 01:15:31.236337 | controller | >f+++++++++ items-describe/sf--pvc--zuul-scheduler-zuul-scheduler-0.txt 2026-06-12 01:15:31.236373 | controller | >f+++++++++ items-describe/sf--secrets--admin-ssh-key.txt 2026-06-12 01:15:31.236408 | controller | >f+++++++++ items-describe/sf--secrets--config-update-secrets.txt 2026-06-12 01:15:31.236483 | controller | >f+++++++++ items-describe/sf--secrets--dummygerritsecret.txt 2026-06-12 01:15:31.236536 | controller | >f+++++++++ items-describe/sf--secrets--es-basicauth.txt 2026-06-12 01:15:31.236581 | controller | >f+++++++++ items-describe/sf--secrets--gerrit-admin-api-key.txt 2026-06-12 01:15:31.236622 | controller | >f+++++++++ items-describe/sf--secrets--logserver-keys.txt 2026-06-12 01:15:31.236669 | controller | >f+++++++++ items-describe/sf--secrets--logserver-uploader-keys.txt 2026-06-12 01:15:31.236714 | controller | >f+++++++++ items-describe/sf--secrets--logserver-uploader-spare-keys.txt 2026-06-12 01:15:31.236754 | controller | >f+++++++++ items-describe/sf--secrets--mariadb-config-secrets.txt 2026-06-12 01:15:31.236802 | controller | >f+++++++++ items-describe/sf--secrets--mariadb-initdb-secrets.txt 2026-06-12 01:15:31.236847 | controller | >f+++++++++ items-describe/sf--secrets--mariadb-root-password.txt 2026-06-12 01:15:31.236892 | controller | >f+++++++++ items-describe/sf--secrets--nodepool-builder-ssh-key.txt 2026-06-12 01:15:31.236937 | controller | >f+++++++++ items-describe/sf--secrets--nodepool-providers-secrets.txt 2026-06-12 01:15:31.236983 | controller | >f+++++++++ items-describe/sf--secrets--self-signed-cert.txt 2026-06-12 01:15:31.237037 | controller | >f+++++++++ items-describe/sf--secrets--smtp-secret.txt 2026-06-12 01:15:31.237083 | controller | >f+++++++++ items-describe/sf--secrets--zookeeper-client-tls.txt 2026-06-12 01:15:31.237128 | controller | >f+++++++++ items-describe/sf--secrets--zookeeper-server-tls.txt 2026-06-12 01:15:31.237172 | controller | >f+++++++++ items-describe/sf--secrets--zuul-auth-secret.txt 2026-06-12 01:15:31.237216 | controller | >f+++++++++ items-describe/sf--secrets--zuul-config.txt 2026-06-12 01:15:31.237309 | controller | >f+++++++++ items-describe/sf--secrets--zuul-db-connection.txt 2026-06-12 01:15:31.237376 | controller | >f+++++++++ items-describe/sf--secrets--zuul-gerrit-api-key.txt 2026-06-12 01:15:31.237423 | controller | >f+++++++++ items-describe/sf--secrets--zuul-keystore-password.txt 2026-06-12 01:15:31.237502 | controller | >f+++++++++ items-describe/sf--secrets--zuul-spare-ssh-key.txt 2026-06-12 01:15:31.237550 | controller | >f+++++++++ items-describe/sf--secrets--zuul-ssh-key.txt 2026-06-12 01:15:31.237594 | controller | >f+++++++++ items-describe/sf--services--fluent-bit-forward-input.txt 2026-06-12 01:15:31.237638 | controller | >f+++++++++ items-describe/sf--services--gateway.txt 2026-06-12 01:15:31.237682 | controller | >f+++++++++ items-describe/sf--services--gerrit-httpd.txt 2026-06-12 01:15:31.237729 | controller | >f+++++++++ items-describe/sf--services--gerrit-sshd.txt 2026-06-12 01:15:31.237775 | controller | >f+++++++++ items-describe/sf--services--git-server-rw.txt 2026-06-12 01:15:31.237820 | controller | >f+++++++++ items-describe/sf--services--git-server.txt 2026-06-12 01:15:31.237866 | controller | >f+++++++++ items-describe/sf--services--hound-search.txt 2026-06-12 01:15:31.237911 | controller | >f+++++++++ items-describe/sf--services--logjuicer.txt 2026-06-12 01:15:31.237955 | controller | >f+++++++++ items-describe/sf--services--logserver.txt 2026-06-12 01:15:31.238001 | controller | >f+++++++++ items-describe/sf--services--loki-http.txt 2026-06-12 01:15:31.238046 | controller | >f+++++++++ items-describe/sf--services--mariadb.txt 2026-06-12 01:15:31.238091 | controller | >f+++++++++ items-describe/sf--services--nodepool-builder.txt 2026-06-12 01:15:31.238135 | controller | >f+++++++++ items-describe/sf--services--nodepool-launcher.txt 2026-06-12 01:15:31.238180 | controller | >f+++++++++ items-describe/sf--services--zookeeper-headless.txt 2026-06-12 01:15:31.238224 | controller | >f+++++++++ items-describe/sf--services--zookeeper.txt 2026-06-12 01:15:31.238269 | controller | >f+++++++++ items-describe/sf--services--zuul-capacity.txt 2026-06-12 01:15:31.238314 | controller | >f+++++++++ items-describe/sf--services--zuul-executor-headless.txt 2026-06-12 01:15:31.238535 | controller | >f+++++++++ items-describe/sf--services--zuul-web.txt 2026-06-12 01:15:31.238604 | controller | >f+++++++++ items-describe/sf--services--zuul-weeder.txt 2026-06-12 01:15:31.238647 | controller | >f+++++++++ items-describe/sf--statefulsets--gerrit.txt 2026-06-12 01:15:31.238685 | controller | >f+++++++++ items-describe/sf--statefulsets--git-server.txt 2026-06-12 01:15:31.238723 | controller | >f+++++++++ items-describe/sf--statefulsets--hound-search.txt 2026-06-12 01:15:31.238759 | controller | >f+++++++++ items-describe/sf--statefulsets--logserver.txt 2026-06-12 01:15:31.238795 | controller | >f+++++++++ items-describe/sf--statefulsets--mariadb.txt 2026-06-12 01:15:31.238831 | controller | >f+++++++++ items-describe/sf--statefulsets--nodepool-builder.txt 2026-06-12 01:15:31.238867 | controller | >f+++++++++ items-describe/sf--statefulsets--zookeeper.txt 2026-06-12 01:15:31.238903 | controller | >f+++++++++ items-describe/sf--statefulsets--zuul-executor.txt 2026-06-12 01:15:31.238938 | controller | >f+++++++++ items-describe/sf--statefulsets--zuul-merger.txt 2026-06-12 01:15:31.238973 | controller | >f+++++++++ items-describe/sf--statefulsets--zuul-scheduler.txt 2026-06-12 01:15:31.239009 | controller | cd+++++++++ k8s-resources/ 2026-06-12 01:15:31.239044 | controller | cd+++++++++ k8s-resources/sf/ 2026-06-12 01:15:31.239089 | controller | cd+++++++++ k8s-resources/sf/pod/ 2026-06-12 01:15:31.239126 | controller | >f+++++++++ k8s-resources/sf/pod/zuul-executor-0-zuul-executor-logs0.txt 2026-06-12 01:15:31.239163 | controller | >f+++++++++ k8s-resources/sf/pod/zuul-merger-0-zuul-merger-logs0.txt 2026-06-12 01:15:31.239199 | controller | >f+++++++++ k8s-resources/sf/pod/zuul-scheduler-0-zuul-scheduler-logs0.txt 2026-06-12 01:15:31.239234 | controller | >f+++++++++ k8s-resources/sf/pod/zuul-web-0-zuul-web-logs0.txt 2026-06-12 01:15:31.239270 | controller | cd+++++++++ logserver-content/ 2026-06-12 01:15:31.239306 | controller | cd+++++++++ logserver-content/2aa/ 2026-06-12 01:15:31.239342 | controller | cd+++++++++ logserver-content/2aa/internal/ 2026-06-12 01:15:31.239377 | controller | cd+++++++++ logserver-content/2aa/internal/2aa13bf0949f4f32bbc59a0b284fc4bc/ 2026-06-12 01:15:31.239414 | controller | >f+++++++++ logserver-content/2aa/internal/2aa13bf0949f4f32bbc59a0b284fc4bc/job-output.json.gz 2026-06-12 01:15:31.239494 | controller | >f+++++++++ logserver-content/2aa/internal/2aa13bf0949f4f32bbc59a0b284fc4bc/job-output.txt.gz 2026-06-12 01:15:31.239534 | controller | >f+++++++++ logserver-content/2aa/internal/2aa13bf0949f4f32bbc59a0b284fc4bc/workspace-repos.json 2026-06-12 01:15:31.239570 | controller | >f+++++++++ logserver-content/2aa/internal/2aa13bf0949f4f32bbc59a0b284fc4bc/zuul-manifest.json 2026-06-12 01:15:31.239678 | controller | cd+++++++++ logserver-content/2aa/internal/2aa13bf0949f4f32bbc59a0b284fc4bc/zuul-info/ 2026-06-12 01:15:31.239716 | controller | >f+++++++++ logserver-content/2aa/internal/2aa13bf0949f4f32bbc59a0b284fc4bc/zuul-info/inventory.yaml 2026-06-12 01:15:31.239751 | controller | cd+++++++++ logserver-content/8c4/ 2026-06-12 01:15:31.239787 | controller | cd+++++++++ logserver-content/8c4/internal/ 2026-06-12 01:15:31.239823 | controller | cd+++++++++ logserver-content/8c4/internal/8c4b5d4050784909bfaa74ce4a9107ba/ 2026-06-12 01:15:31.239859 | controller | >f+++++++++ logserver-content/8c4/internal/8c4b5d4050784909bfaa74ce4a9107ba/job-output.json.gz 2026-06-12 01:15:31.239895 | controller | >f+++++++++ logserver-content/8c4/internal/8c4b5d4050784909bfaa74ce4a9107ba/job-output.txt.gz 2026-06-12 01:15:31.239931 | controller | >f+++++++++ logserver-content/8c4/internal/8c4b5d4050784909bfaa74ce4a9107ba/workspace-repos.json 2026-06-12 01:15:31.239967 | controller | >f+++++++++ logserver-content/8c4/internal/8c4b5d4050784909bfaa74ce4a9107ba/zuul-manifest.json 2026-06-12 01:15:31.240003 | controller | cd+++++++++ logserver-content/8c4/internal/8c4b5d4050784909bfaa74ce4a9107ba/zuul-info/ 2026-06-12 01:15:31.240038 | controller | >f+++++++++ logserver-content/8c4/internal/8c4b5d4050784909bfaa74ce4a9107ba/zuul-info/inventory.yaml 2026-06-12 01:15:31.240073 | controller | cd+++++++++ logserver-content/db0/ 2026-06-12 01:15:31.240108 | controller | cd+++++++++ logserver-content/db0/internal/ 2026-06-12 01:15:31.240144 | controller | cd+++++++++ logserver-content/db0/internal/db08fd0b4d8c4ef18aa765cc8ce06b59/ 2026-06-12 01:15:31.240179 | controller | >f+++++++++ logserver-content/db0/internal/db08fd0b4d8c4ef18aa765cc8ce06b59/job-output.json.gz 2026-06-12 01:15:31.240214 | controller | >f+++++++++ logserver-content/db0/internal/db08fd0b4d8c4ef18aa765cc8ce06b59/job-output.txt.gz 2026-06-12 01:15:31.240249 | controller | >f+++++++++ logserver-content/db0/internal/db08fd0b4d8c4ef18aa765cc8ce06b59/workspace-repos.json 2026-06-12 01:15:31.240284 | controller | >f+++++++++ logserver-content/db0/internal/db08fd0b4d8c4ef18aa765cc8ce06b59/zuul-manifest.json 2026-06-12 01:15:31.240319 | controller | cd+++++++++ logserver-content/db0/internal/db08fd0b4d8c4ef18aa765cc8ce06b59/zuul-info/ 2026-06-12 01:15:31.240354 | controller | >f+++++++++ logserver-content/db0/internal/db08fd0b4d8c4ef18aa765cc8ce06b59/zuul-info/inventory.yaml 2026-06-12 01:15:31.240393 | controller | cd+++++++++ loki-logs/ 2026-06-12 01:15:31.240460 | controller | >f+++++++++ loki-logs/all.log 2026-06-12 01:15:31.240507 | controller | cd+++++++++ pods-logs/ 2026-06-12 01:15:31.240554 | controller | >f+++++++++ pods-logs/ingress-nginx--ingress-nginx-admission-create-rdqwd--create.txt 2026-06-12 01:15:31.240591 | controller | >f+++++++++ pods-logs/ingress-nginx--ingress-nginx-admission-patch-9b2v2--patch.txt 2026-06-12 01:15:31.240628 | controller | >f+++++++++ pods-logs/ingress-nginx--ingress-nginx-controller-86649c845b-s9hqf--controller.txt 2026-06-12 01:15:31.240664 | controller | >f+++++++++ pods-logs/kube-system--coredns-668d6bf9bc-5j4w8--coredns.txt 2026-06-12 01:15:31.240701 | controller | >f+++++++++ pods-logs/kube-system--etcd-minikube--etcd.txt 2026-06-12 01:15:31.240737 | controller | >f+++++++++ pods-logs/kube-system--kindnet-8ghkz--kindnet-cni.txt 2026-06-12 01:15:31.240907 | controller | >f+++++++++ pods-logs/kube-system--kube-apiserver-minikube--kube-apiserver.txt 2026-06-12 01:15:31.240950 | controller | >f+++++++++ pods-logs/kube-system--kube-controller-manager-minikube--kube-controller-manager.txt 2026-06-12 01:15:31.240989 | controller | >f+++++++++ pods-logs/kube-system--kube-ingress-dns-minikube--minikube-ingress-dns.txt 2026-06-12 01:15:31.241027 | controller | >f+++++++++ pods-logs/kube-system--kube-proxy-z4h4c--kube-proxy.txt 2026-06-12 01:15:31.241064 | controller | >f+++++++++ pods-logs/kube-system--kube-scheduler-minikube--kube-scheduler.txt 2026-06-12 01:15:31.241100 | controller | >f+++++++++ pods-logs/kube-system--storage-provisioner--storage-provisioner.txt 2026-06-12 01:15:31.241137 | controller | >f+++++++++ pods-logs/sf--config-base-secret-1-857-ns-7qpqr--sf-operator.txt 2026-06-12 01:15:31.241173 | controller | >f+++++++++ pods-logs/sf--config-base-secret-1-8679-ns-q9g5k--sf-operator.txt 2026-06-12 01:15:31.241208 | controller | >f+++++++++ pods-logs/sf--gateway-6bbbd758d9-drvjg--gateway.txt 2026-06-12 01:15:31.241244 | controller | >f+++++++++ pods-logs/sf--gerrit-0--gerrit.txt 2026-06-12 01:15:31.241280 | controller | >f+++++++++ pods-logs/sf--gerrit-0--managesf-resources.txt 2026-06-12 01:15:31.241315 | controller | >f+++++++++ pods-logs/sf--git-server-0--git-server-rw.txt 2026-06-12 01:15:31.241351 | controller | >f+++++++++ pods-logs/sf--git-server-0--git-server.txt 2026-06-12 01:15:31.241387 | controller | >f+++++++++ pods-logs/sf--hound-search-0--hound-search.txt 2026-06-12 01:15:31.241424 | controller | >f+++++++++ pods-logs/sf--logjuicer-6ff84764b7-g7v2t--logjuicer.txt 2026-06-12 01:15:31.241502 | controller | >f+++++++++ pods-logs/sf--logserver-0--logserver-nodeexporter.txt 2026-06-12 01:15:31.241542 | controller | >f+++++++++ pods-logs/sf--logserver-0--logserver-sshd.txt 2026-06-12 01:15:31.241579 | controller | >f+++++++++ pods-logs/sf--logserver-0--logserver.txt 2026-06-12 01:15:31.241616 | controller | >f+++++++++ pods-logs/sf--logserver-0--purgelogs.txt 2026-06-12 01:15:31.241653 | controller | >f+++++++++ pods-logs/sf--mariadb-0--mariadb-nodeexporter.txt 2026-06-12 01:15:31.241690 | controller | >f+++++++++ pods-logs/sf--mariadb-0--mariadb.txt 2026-06-12 01:15:31.241726 | controller | >f+++++++++ pods-logs/sf--nodepool-builder-0--build-logs-httpd.txt 2026-06-12 01:15:31.241762 | controller | >f+++++++++ pods-logs/sf--nodepool-builder-0--nodepool-builder-nodeexporter.txt 2026-06-12 01:15:31.241799 | controller | >f+++++++++ pods-logs/sf--nodepool-builder-0--nodepool-builder.txt 2026-06-12 01:15:31.241836 | controller | >f+++++++++ pods-logs/sf--nodepool-builder-0--np-statsd.txt 2026-06-12 01:15:31.241872 | controller | >f+++++++++ pods-logs/sf--nodepool-launcher-b79c8ffb-strq5--launcher.txt 2026-06-12 01:15:31.241908 | controller | >f+++++++++ pods-logs/sf--nodepool-launcher-b79c8ffb-strq5--np-statsd.txt 2026-06-12 01:15:31.241943 | controller | >f+++++++++ pods-logs/sf--nodepool-launcher-b79c8ffb-strq5--zuul-capacity.txt 2026-06-12 01:15:31.241979 | controller | >f+++++++++ pods-logs/sf--post-init-fl4dd--post-init-container.txt 2026-06-12 01:15:31.242118 | controller | >f+++++++++ pods-logs/sf--test-fluentbit--test-fluentbit.txt 2026-06-12 01:15:31.242165 | controller | >f+++++++++ pods-logs/sf--test-loki-8cd4fd56-8v78l--loki.txt 2026-06-12 01:15:31.242211 | controller | >f+++++++++ pods-logs/sf--zookeeper-0--zookeeper-nodeexporter.txt 2026-06-12 01:15:31.242248 | controller | >f+++++++++ pods-logs/sf--zookeeper-0--zookeeper.txt 2026-06-12 01:15:31.242284 | controller | >f+++++++++ pods-logs/sf--zuul-db-provision-74d9p--mariadb-client.txt 2026-06-12 01:15:31.242319 | controller | >f+++++++++ pods-logs/sf--zuul-db-provision-mtng6--mariadb-client.txt 2026-06-12 01:15:31.242355 | controller | >f+++++++++ pods-logs/sf--zuul-executor-0--zuul-executor-nodeexporter.txt 2026-06-12 01:15:31.242391 | controller | >f+++++++++ pods-logs/sf--zuul-executor-0--zuul-executor.txt 2026-06-12 01:15:31.242457 | controller | >f+++++++++ pods-logs/sf--zuul-merger-0--zuul-merger-nodeexporter.txt 2026-06-12 01:15:31.242536 | controller | >f+++++++++ pods-logs/sf--zuul-merger-0--zuul-merger.txt 2026-06-12 01:15:31.242582 | controller | >f+++++++++ pods-logs/sf--zuul-scheduler-0--zuul-scheduler-nodeexporter.txt 2026-06-12 01:15:31.242619 | controller | >f+++++++++ pods-logs/sf--zuul-scheduler-0--zuul-scheduler.txt 2026-06-12 01:15:31.242655 | controller | >f+++++++++ pods-logs/sf--zuul-scheduler-0--zuul-statsd.txt 2026-06-12 01:15:31.242691 | controller | >f+++++++++ pods-logs/sf--zuul-web-74c88ff8b-l76wt--zuul-web.txt 2026-06-12 01:15:31.242726 | controller | >f+++++++++ pods-logs/sf--zuul-weeder-57c6567f5f-tf7f4--zuul-weeder.txt 2026-06-12 01:15:31.242761 | controller | cd+++++++++ repos/ 2026-06-12 01:15:31.242797 | controller | >f+++++++++ repos/test-ssh-key 2026-06-12 01:15:31.242833 | controller | >f+++++++++ repos/test-ssh-key.pub 2026-06-12 01:15:31.242869 | controller | >f+++++++++ repos/zuul-ssh-key 2026-06-12 01:15:31.242904 | controller | cd+++++++++ repos/config/ 2026-06-12 01:15:31.242940 | controller | >f+++++++++ repos/config/.gitreview 2026-06-12 01:15:31.242975 | controller | cd+++++++++ repos/config/.git/ 2026-06-12 01:15:31.243010 | controller | >f+++++++++ repos/config/.git/COMMIT_EDITMSG 2026-06-12 01:15:31.243046 | controller | >f+++++++++ repos/config/.git/FETCH_HEAD 2026-06-12 01:15:31.243081 | controller | >f+++++++++ repos/config/.git/HEAD 2026-06-12 01:15:31.243116 | controller | >f+++++++++ repos/config/.git/ORIG_HEAD 2026-06-12 01:15:31.243232 | controller | >f+++++++++ repos/config/.git/config 2026-06-12 01:15:31.243283 | controller | >f+++++++++ repos/config/.git/description 2026-06-12 01:15:31.243321 | controller | >f+++++++++ repos/config/.git/index 2026-06-12 01:15:31.243357 | controller | >f+++++++++ repos/config/.git/packed-refs 2026-06-12 01:15:31.243478 | controller | cd+++++++++ repos/config/.git/hooks/ 2026-06-12 01:15:31.243526 | controller | >f+++++++++ repos/config/.git/hooks/applypatch-msg.sample 2026-06-12 01:15:31.243562 | controller | >f+++++++++ repos/config/.git/hooks/commit-msg 2026-06-12 01:15:31.243598 | controller | >f+++++++++ repos/config/.git/hooks/commit-msg.sample 2026-06-12 01:15:31.243634 | controller | >f+++++++++ repos/config/.git/hooks/fsmonitor-watchman.sample 2026-06-12 01:15:31.243670 | controller | >f+++++++++ repos/config/.git/hooks/post-update.sample 2026-06-12 01:15:31.243705 | controller | >f+++++++++ repos/config/.git/hooks/pre-applypatch.sample 2026-06-12 01:15:31.243741 | controller | >f+++++++++ repos/config/.git/hooks/pre-commit.sample 2026-06-12 01:15:31.243777 | controller | >f+++++++++ repos/config/.git/hooks/pre-merge-commit.sample 2026-06-12 01:15:31.243814 | controller | >f+++++++++ repos/config/.git/hooks/pre-push.sample 2026-06-12 01:15:31.243850 | controller | >f+++++++++ repos/config/.git/hooks/pre-rebase.sample 2026-06-12 01:15:31.243886 | controller | >f+++++++++ repos/config/.git/hooks/pre-receive.sample 2026-06-12 01:15:31.243921 | controller | >f+++++++++ repos/config/.git/hooks/prepare-commit-msg.sample 2026-06-12 01:15:31.243957 | controller | >f+++++++++ repos/config/.git/hooks/push-to-checkout.sample 2026-06-12 01:15:31.243993 | controller | >f+++++++++ repos/config/.git/hooks/sendemail-validate.sample 2026-06-12 01:15:31.244029 | controller | >f+++++++++ repos/config/.git/hooks/update.sample 2026-06-12 01:15:31.244074 | controller | cd+++++++++ repos/config/.git/info/ 2026-06-12 01:15:31.244110 | controller | >f+++++++++ repos/config/.git/info/exclude 2026-06-12 01:15:31.244147 | controller | cd+++++++++ repos/config/.git/logs/ 2026-06-12 01:15:31.244183 | controller | >f+++++++++ repos/config/.git/logs/HEAD 2026-06-12 01:15:31.244219 | controller | cd+++++++++ repos/config/.git/logs/refs/ 2026-06-12 01:15:31.244255 | controller | cd+++++++++ repos/config/.git/logs/refs/heads/ 2026-06-12 01:15:31.244291 | controller | >f+++++++++ repos/config/.git/logs/refs/heads/master 2026-06-12 01:15:31.244328 | controller | cd+++++++++ repos/config/.git/logs/refs/remotes/ 2026-06-12 01:15:31.244365 | controller | cd+++++++++ repos/config/.git/logs/refs/remotes/gerrit/ 2026-06-12 01:15:31.244401 | controller | >f+++++++++ repos/config/.git/logs/refs/remotes/gerrit/HEAD 2026-06-12 01:15:31.244566 | controller | >f+++++++++ repos/config/.git/logs/refs/remotes/gerrit/master 2026-06-12 01:15:31.244620 | controller | cd+++++++++ repos/config/.git/logs/refs/remotes/origin/ 2026-06-12 01:15:31.244657 | controller | >f+++++++++ repos/config/.git/logs/refs/remotes/origin/HEAD 2026-06-12 01:15:31.244694 | controller | >f+++++++++ repos/config/.git/logs/refs/remotes/origin/master 2026-06-12 01:15:31.244729 | controller | cd+++++++++ repos/config/.git/objects/ 2026-06-12 01:15:31.244765 | controller | cd+++++++++ repos/config/.git/objects/06/ 2026-06-12 01:15:31.244800 | controller | >f+++++++++ repos/config/.git/objects/06/5460e3e4fba2934d333152681c02f5bafe09c9 2026-06-12 01:15:31.244836 | controller | cd+++++++++ repos/config/.git/objects/10/ 2026-06-12 01:15:31.244873 | controller | >f+++++++++ repos/config/.git/objects/10/fc0dfa2fc1acd0736c9aa548c0d95dccbeaa98 2026-06-12 01:15:31.244909 | controller | cd+++++++++ repos/config/.git/objects/17/ 2026-06-12 01:15:31.244945 | controller | >f+++++++++ repos/config/.git/objects/17/89caa9f01b371ac8abfed022e02ed132d12821 2026-06-12 01:15:31.244981 | controller | cd+++++++++ repos/config/.git/objects/1c/ 2026-06-12 01:15:31.245016 | controller | >f+++++++++ repos/config/.git/objects/1c/6f36a657bfe3e48b277250f89007c1838d84a6 2026-06-12 01:15:31.245050 | controller | cd+++++++++ repos/config/.git/objects/20/ 2026-06-12 01:15:31.245086 | controller | >f+++++++++ repos/config/.git/objects/20/a686c6ceba7cd70250b1b90d812c4e01fab76f 2026-06-12 01:15:31.245121 | controller | cd+++++++++ repos/config/.git/objects/27/ 2026-06-12 01:15:31.245157 | controller | >f+++++++++ repos/config/.git/objects/27/e57f2116cd4ce685ac11b30c02e4027ed28864 2026-06-12 01:15:31.245192 | controller | cd+++++++++ repos/config/.git/objects/34/ 2026-06-12 01:15:31.245227 | controller | >f+++++++++ repos/config/.git/objects/34/d2cc409a0d89059c2efff32f7c62ae433efbaf 2026-06-12 01:15:31.245264 | controller | cd+++++++++ repos/config/.git/objects/41/ 2026-06-12 01:15:31.245299 | controller | >f+++++++++ repos/config/.git/objects/41/32f67486af42bf0989639f234f148e3863e097 2026-06-12 01:15:31.245334 | controller | cd+++++++++ repos/config/.git/objects/46/ 2026-06-12 01:15:31.245368 | controller | >f+++++++++ repos/config/.git/objects/46/7d37faf581920ee6231c7e1d46bc5907a03ca1 2026-06-12 01:15:31.245404 | controller | cd+++++++++ repos/config/.git/objects/48/ 2026-06-12 01:15:31.245480 | controller | >f+++++++++ repos/config/.git/objects/48/8178a4cc1bee3ade7d81ebdc9bfaa909cd7773 2026-06-12 01:15:31.245522 | controller | cd+++++++++ repos/config/.git/objects/59/ 2026-06-12 01:15:31.245643 | controller | >f+++++++++ repos/config/.git/objects/59/0acffde5f02f235eec34edfc2d28b15ab2b693 2026-06-12 01:15:31.245738 | controller | cd+++++++++ repos/config/.git/objects/65/ 2026-06-12 01:15:31.245827 | controller | >f+++++++++ repos/config/.git/objects/65/5a40a3d7214629ac925bb049792a7ebb7729d5 2026-06-12 01:15:31.245917 | controller | >f+++++++++ repos/config/.git/objects/65/e0432b8cb429f99d25c4521fd00caa146680c2 2026-06-12 01:15:31.246006 | controller | cd+++++++++ repos/config/.git/objects/6a/ 2026-06-12 01:15:31.246109 | controller | >f+++++++++ repos/config/.git/objects/6a/906645df0c95e3c0f28d78f55392f0c0ef8c10 2026-06-12 01:15:31.246198 | controller | cd+++++++++ repos/config/.git/objects/6c/ 2026-06-12 01:15:31.246246 | controller | >f+++++++++ repos/config/.git/objects/6c/e361d2a72c09a971f48751f5da1a9961581d2d 2026-06-12 01:15:31.246334 | controller | cd+++++++++ repos/config/.git/objects/6d/ 2026-06-12 01:15:31.246416 | controller | >f+++++++++ repos/config/.git/objects/6d/429eb4532a6eb3a7abbc3894933405432a0d81 2026-06-12 01:15:31.246574 | controller | cd+++++++++ repos/config/.git/objects/75/ 2026-06-12 01:15:31.246686 | controller | >f+++++++++ repos/config/.git/objects/75/026a20fdbeb3f69d8d51c8357b94cab9b33ae7 2026-06-12 01:15:31.246779 | controller | cd+++++++++ repos/config/.git/objects/7f/ 2026-06-12 01:15:31.246870 | controller | >f+++++++++ repos/config/.git/objects/7f/705f1aad3b6283b76b02a089759e3f7b5fe298 2026-06-12 01:15:31.246965 | controller | cd+++++++++ repos/config/.git/objects/81/ 2026-06-12 01:15:31.247066 | controller | >f+++++++++ repos/config/.git/objects/81/c6465de59b8289936d520ecd2d84a72719e7c6 2026-06-12 01:15:31.247214 | controller | cd+++++++++ repos/config/.git/objects/89/ 2026-06-12 01:15:31.247306 | controller | >f+++++++++ repos/config/.git/objects/89/8ecd3f7cefca9c974809eec1befff211b5b86a 2026-06-12 01:15:31.247361 | controller | cd+++++++++ repos/config/.git/objects/8e/ 2026-06-12 01:15:31.247506 | controller | >f+++++++++ repos/config/.git/objects/8e/dba784198eb01a016f00abe7f741d87f70781a 2026-06-12 01:15:31.247603 | controller | cd+++++++++ repos/config/.git/objects/8f/ 2026-06-12 01:15:31.247754 | controller | >f+++++++++ repos/config/.git/objects/8f/923453ce91972667fcbf8f8fea7bb84fdd33f7 2026-06-12 01:15:31.247854 | controller | cd+++++++++ repos/config/.git/objects/9c/ 2026-06-12 01:15:31.247947 | controller | >f+++++++++ repos/config/.git/objects/9c/a80e98d3635185ba1108a5c869dc26ec24f825 2026-06-12 01:15:31.248042 | controller | cd+++++++++ repos/config/.git/objects/ab/ 2026-06-12 01:15:31.248136 | controller | >f+++++++++ repos/config/.git/objects/ab/55d755e939257673514a55f380310d28baf950 2026-06-12 01:15:31.248231 | controller | cd+++++++++ repos/config/.git/objects/b4/ 2026-06-12 01:15:31.248325 | controller | >f+++++++++ repos/config/.git/objects/b4/8c64172c9d244e7dea5a851a55fa075c667c27 2026-06-12 01:15:31.248415 | controller | cd+++++++++ repos/config/.git/objects/c4/ 2026-06-12 01:15:31.248529 | controller | >f+++++++++ repos/config/.git/objects/c4/4142787c79648bb5eb8fd30da65fb2c9a5125a 2026-06-12 01:15:31.248771 | controller | cd+++++++++ repos/config/.git/objects/cc/ 2026-06-12 01:15:31.248876 | controller | >f+++++++++ repos/config/.git/objects/cc/6450d887904229c514a2a58f48d4f6231d6d67 2026-06-12 01:15:31.248972 | controller | cd+++++++++ repos/config/.git/objects/d9/ 2026-06-12 01:15:31.249066 | controller | >f+++++++++ repos/config/.git/objects/d9/a7ae22fa8bf9bc3b892d100aacc8e93e77fcc7 2026-06-12 01:15:31.249160 | controller | cd+++++++++ repos/config/.git/objects/f7/ 2026-06-12 01:15:31.249253 | controller | >f+++++++++ repos/config/.git/objects/f7/6c04a63c1fd5b8b4d1b74c3695b09395d55608 2026-06-12 01:15:31.249347 | controller | cd+++++++++ repos/config/.git/objects/info/ 2026-06-12 01:15:31.249469 | controller | cd+++++++++ repos/config/.git/objects/pack/ 2026-06-12 01:15:31.249576 | controller | >f+++++++++ repos/config/.git/objects/pack/pack-0312b17e48611c8dd32ec5a8c878865033c7ab74.idx 2026-06-12 01:15:31.249674 | controller | >f+++++++++ repos/config/.git/objects/pack/pack-0312b17e48611c8dd32ec5a8c878865033c7ab74.pack 2026-06-12 01:15:31.249770 | controller | >f+++++++++ repos/config/.git/objects/pack/pack-0312b17e48611c8dd32ec5a8c878865033c7ab74.rev 2026-06-12 01:15:31.249923 | controller | cd+++++++++ repos/config/.git/refs/ 2026-06-12 01:15:31.249980 | controller | cd+++++++++ repos/config/.git/refs/heads/ 2026-06-12 01:15:31.250075 | controller | >f+++++++++ repos/config/.git/refs/heads/master 2026-06-12 01:15:31.250170 | controller | cd+++++++++ repos/config/.git/refs/remotes/ 2026-06-12 01:15:31.250327 | controller | cd+++++++++ repos/config/.git/refs/remotes/gerrit/ 2026-06-12 01:15:31.250377 | controller | >f+++++++++ repos/config/.git/refs/remotes/gerrit/HEAD 2026-06-12 01:15:31.250493 | controller | >f+++++++++ repos/config/.git/refs/remotes/gerrit/master 2026-06-12 01:15:31.250606 | controller | cd+++++++++ repos/config/.git/refs/remotes/origin/ 2026-06-12 01:15:31.250655 | controller | >f+++++++++ repos/config/.git/refs/remotes/origin/HEAD 2026-06-12 01:15:31.250694 | controller | >f+++++++++ repos/config/.git/refs/remotes/origin/master 2026-06-12 01:15:31.250733 | controller | cd+++++++++ repos/config/.git/refs/rewritten/ 2026-06-12 01:15:31.250771 | controller | cd+++++++++ repos/config/.git/refs/tags/ 2026-06-12 01:15:31.250861 | controller | cd+++++++++ repos/config/nodepool/ 2026-06-12 01:15:31.250963 | controller | >f+++++++++ repos/config/nodepool/nodepool.yaml 2026-06-12 01:15:31.251009 | controller | cd+++++++++ repos/config/zuul/ 2026-06-12 01:15:31.251049 | controller | >f+++++++++ repos/config/zuul/main.yaml 2026-06-12 01:15:31.251088 | controller | cd+++++++++ repos/demo-project/ 2026-06-12 01:15:31.251126 | controller | >f+++++++++ repos/demo-project/.gitreview 2026-06-12 01:15:31.251164 | controller | cd+++++++++ repos/demo-project/.git/ 2026-06-12 01:15:31.251253 | controller | >f+++++++++ repos/demo-project/.git/COMMIT_EDITMSG 2026-06-12 01:15:31.251300 | controller | >f+++++++++ repos/demo-project/.git/FETCH_HEAD 2026-06-12 01:15:31.251340 | controller | >f+++++++++ repos/demo-project/.git/HEAD 2026-06-12 01:15:31.251379 | controller | >f+++++++++ repos/demo-project/.git/ORIG_HEAD 2026-06-12 01:15:31.251418 | controller | >f+++++++++ repos/demo-project/.git/config 2026-06-12 01:15:31.251492 | controller | >f+++++++++ repos/demo-project/.git/description 2026-06-12 01:15:31.251533 | controller | >f+++++++++ repos/demo-project/.git/index 2026-06-12 01:15:31.251573 | controller | >f+++++++++ repos/demo-project/.git/packed-refs 2026-06-12 01:15:31.251612 | controller | cd+++++++++ repos/demo-project/.git/hooks/ 2026-06-12 01:15:31.251650 | controller | >f+++++++++ repos/demo-project/.git/hooks/applypatch-msg.sample 2026-06-12 01:15:31.251690 | controller | >f+++++++++ repos/demo-project/.git/hooks/commit-msg 2026-06-12 01:15:31.251729 | controller | >f+++++++++ repos/demo-project/.git/hooks/commit-msg.sample 2026-06-12 01:15:31.251768 | controller | >f+++++++++ repos/demo-project/.git/hooks/fsmonitor-watchman.sample 2026-06-12 01:15:31.251807 | controller | >f+++++++++ repos/demo-project/.git/hooks/post-update.sample 2026-06-12 01:15:31.251846 | controller | >f+++++++++ repos/demo-project/.git/hooks/pre-applypatch.sample 2026-06-12 01:15:31.251886 | controller | >f+++++++++ repos/demo-project/.git/hooks/pre-commit.sample 2026-06-12 01:15:31.251999 | controller | >f+++++++++ repos/demo-project/.git/hooks/pre-merge-commit.sample 2026-06-12 01:15:31.252049 | controller | >f+++++++++ repos/demo-project/.git/hooks/pre-push.sample 2026-06-12 01:15:31.252088 | controller | >f+++++++++ repos/demo-project/.git/hooks/pre-rebase.sample 2026-06-12 01:15:31.252127 | controller | >f+++++++++ repos/demo-project/.git/hooks/pre-receive.sample 2026-06-12 01:15:31.252165 | controller | >f+++++++++ repos/demo-project/.git/hooks/prepare-commit-msg.sample 2026-06-12 01:15:31.252204 | controller | >f+++++++++ repos/demo-project/.git/hooks/push-to-checkout.sample 2026-06-12 01:15:31.252242 | controller | >f+++++++++ repos/demo-project/.git/hooks/sendemail-validate.sample 2026-06-12 01:15:31.252281 | controller | >f+++++++++ repos/demo-project/.git/hooks/update.sample 2026-06-12 01:15:31.252319 | controller | cd+++++++++ repos/demo-project/.git/info/ 2026-06-12 01:15:31.252358 | controller | >f+++++++++ repos/demo-project/.git/info/exclude 2026-06-12 01:15:31.252396 | controller | cd+++++++++ repos/demo-project/.git/logs/ 2026-06-12 01:15:31.252462 | controller | >f+++++++++ repos/demo-project/.git/logs/HEAD 2026-06-12 01:15:31.252510 | controller | cd+++++++++ repos/demo-project/.git/logs/refs/ 2026-06-12 01:15:31.252560 | controller | cd+++++++++ repos/demo-project/.git/logs/refs/heads/ 2026-06-12 01:15:31.252601 | controller | >f+++++++++ repos/demo-project/.git/logs/refs/heads/master 2026-06-12 01:15:31.252641 | controller | >f+++++++++ repos/demo-project/.git/logs/refs/heads/test_check_url 2026-06-12 01:15:31.252681 | controller | >f+++++++++ repos/demo-project/.git/logs/refs/heads/test_short_job 2026-06-12 01:15:31.252721 | controller | cd+++++++++ repos/demo-project/.git/logs/refs/remotes/ 2026-06-12 01:15:31.252761 | controller | cd+++++++++ repos/demo-project/.git/logs/refs/remotes/gerrit/ 2026-06-12 01:15:31.252800 | controller | >f+++++++++ repos/demo-project/.git/logs/refs/remotes/gerrit/HEAD 2026-06-12 01:15:31.252839 | controller | >f+++++++++ repos/demo-project/.git/logs/refs/remotes/gerrit/master 2026-06-12 01:15:31.252879 | controller | cd+++++++++ repos/demo-project/.git/logs/refs/remotes/origin/ 2026-06-12 01:15:31.252918 | controller | >f+++++++++ repos/demo-project/.git/logs/refs/remotes/origin/HEAD 2026-06-12 01:15:31.252957 | controller | >f+++++++++ repos/demo-project/.git/logs/refs/remotes/origin/master 2026-06-12 01:15:31.252997 | controller | cd+++++++++ repos/demo-project/.git/objects/ 2026-06-12 01:15:31.253099 | controller | cd+++++++++ repos/demo-project/.git/objects/18/ 2026-06-12 01:15:31.253145 | controller | >f+++++++++ repos/demo-project/.git/objects/18/c6bbd0cd6c778f8861481e96f3207c4b9a98fe 2026-06-12 01:15:31.253185 | controller | cd+++++++++ repos/demo-project/.git/objects/1c/ 2026-06-12 01:15:31.253224 | controller | >f+++++++++ repos/demo-project/.git/objects/1c/5b1ec62c0ae3fdf25e5e273a0197e3781dd173 2026-06-12 01:15:31.253264 | controller | cd+++++++++ repos/demo-project/.git/objects/26/ 2026-06-12 01:15:31.253357 | controller | >f+++++++++ repos/demo-project/.git/objects/26/a3816fbd763ed648023f02849f8c3b0db3966c 2026-06-12 01:15:31.253400 | controller | >f+++++++++ repos/demo-project/.git/objects/26/ba5f8deb7f39a5c543afba9bf1ea2ccfe51b77 2026-06-12 01:15:31.253471 | controller | cd+++++++++ repos/demo-project/.git/objects/34/ 2026-06-12 01:15:31.253515 | controller | >f+++++++++ repos/demo-project/.git/objects/34/7f1fe69e0d54e35c82849287f248194c6b66b9 2026-06-12 01:15:31.253555 | controller | cd+++++++++ repos/demo-project/.git/objects/35/ 2026-06-12 01:15:31.253594 | controller | >f+++++++++ repos/demo-project/.git/objects/35/65bb26eb6a84b2e5862e6b10e787a9872447cd 2026-06-12 01:15:31.253633 | controller | cd+++++++++ repos/demo-project/.git/objects/42/ 2026-06-12 01:15:31.253672 | controller | >f+++++++++ repos/demo-project/.git/objects/42/0a819826f9dae5b94667a576a0b2a977c4f1f2 2026-06-12 01:15:31.253711 | controller | cd+++++++++ repos/demo-project/.git/objects/45/ 2026-06-12 01:15:31.253749 | controller | >f+++++++++ repos/demo-project/.git/objects/45/ce6d643d215cc34a3a65cd753bd3bc77a7b708 2026-06-12 01:15:31.253788 | controller | cd+++++++++ repos/demo-project/.git/objects/48/ 2026-06-12 01:15:31.253827 | controller | >f+++++++++ repos/demo-project/.git/objects/48/1da4def7a63f5e73f385affc65293497000c65 2026-06-12 01:15:31.253864 | controller | >f+++++++++ repos/demo-project/.git/objects/48/c7e8a6339bdda2526991aa9fb3707cb253e2c4 2026-06-12 01:15:31.253903 | controller | cd+++++++++ repos/demo-project/.git/objects/4d/ 2026-06-12 01:15:31.253941 | controller | >f+++++++++ repos/demo-project/.git/objects/4d/d05ea0a58950ee887bfe1b67cfd7f44b8bba35 2026-06-12 01:15:31.253979 | controller | cd+++++++++ repos/demo-project/.git/objects/4e/ 2026-06-12 01:15:31.254017 | controller | >f+++++++++ repos/demo-project/.git/objects/4e/eeb126566a2be605581053ca771b4b6da470c2 2026-06-12 01:15:31.254055 | controller | cd+++++++++ repos/demo-project/.git/objects/51/ 2026-06-12 01:15:31.254093 | controller | >f+++++++++ repos/demo-project/.git/objects/51/febfc882d29214e8ddb275b148abb77a18bac4 2026-06-12 01:15:31.254245 | controller | cd+++++++++ repos/demo-project/.git/objects/5f/ 2026-06-12 01:15:31.254291 | controller | >f+++++++++ repos/demo-project/.git/objects/5f/a965ccd5f8194e7865f9e02143de7481c0ea8c 2026-06-12 01:15:31.254340 | controller | cd+++++++++ repos/demo-project/.git/objects/60/ 2026-06-12 01:15:31.254380 | controller | >f+++++++++ repos/demo-project/.git/objects/60/4a228bad7e3a0aeb33c04c5f610ca1774ff81c 2026-06-12 01:15:31.254419 | controller | cd+++++++++ repos/demo-project/.git/objects/68/ 2026-06-12 01:15:31.254497 | controller | >f+++++++++ repos/demo-project/.git/objects/68/c28cfb927e764eafe6861704356224053e473b 2026-06-12 01:15:31.254562 | controller | cd+++++++++ repos/demo-project/.git/objects/69/ 2026-06-12 01:15:31.254601 | controller | >f+++++++++ repos/demo-project/.git/objects/69/090bf4d02e1f0efed90184c0f91d89a86904b6 2026-06-12 01:15:31.254640 | controller | cd+++++++++ repos/demo-project/.git/objects/72/ 2026-06-12 01:15:31.254679 | controller | >f+++++++++ repos/demo-project/.git/objects/72/dfc9c9553ebbd3d3f399036f015fd433cea17c 2026-06-12 01:15:31.254722 | controller | cd+++++++++ repos/demo-project/.git/objects/74/ 2026-06-12 01:15:31.254762 | controller | >f+++++++++ repos/demo-project/.git/objects/74/32b55d7db19f8c788f8fe355819a630f28906d 2026-06-12 01:15:31.254802 | controller | cd+++++++++ repos/demo-project/.git/objects/76/ 2026-06-12 01:15:31.254841 | controller | >f+++++++++ repos/demo-project/.git/objects/76/329e0d45f54dea4bdf76328e8597e999225689 2026-06-12 01:15:31.254880 | controller | cd+++++++++ repos/demo-project/.git/objects/79/ 2026-06-12 01:15:31.254918 | controller | >f+++++++++ repos/demo-project/.git/objects/79/87f4dfc936f905a05c767a1c1cd85411bf814a 2026-06-12 01:15:31.254952 | controller | cd+++++++++ repos/demo-project/.git/objects/7d/ 2026-06-12 01:15:31.254974 | controller | >f+++++++++ repos/demo-project/.git/objects/7d/dec09d125d95fc7065f2ad8683f0b7c9669a79 2026-06-12 01:15:31.254996 | controller | cd+++++++++ repos/demo-project/.git/objects/80/ 2026-06-12 01:15:31.255018 | controller | >f+++++++++ repos/demo-project/.git/objects/80/3048e3ae8a6d2f451fc0352efe5c9f1d8c5424 2026-06-12 01:15:31.255040 | controller | cd+++++++++ repos/demo-project/.git/objects/84/ 2026-06-12 01:15:31.255062 | controller | >f+++++++++ repos/demo-project/.git/objects/84/e200f63e3a19c7e51838027798144a5f9de0e3 2026-06-12 01:15:31.255084 | controller | cd+++++++++ repos/demo-project/.git/objects/88/ 2026-06-12 01:15:31.255106 | controller | >f+++++++++ repos/demo-project/.git/objects/88/f56500eb5a1405a82e70e2113ec3d86f04b740 2026-06-12 01:15:31.255128 | controller | cd+++++++++ repos/demo-project/.git/objects/9d/ 2026-06-12 01:15:31.255151 | controller | >f+++++++++ repos/demo-project/.git/objects/9d/139d568fb3c661b5a0c54ac6e96a1c87231bbc 2026-06-12 01:15:31.255173 | controller | cd+++++++++ repos/demo-project/.git/objects/af/ 2026-06-12 01:15:31.255196 | controller | >f+++++++++ repos/demo-project/.git/objects/af/3a464d7cbe81b92c61fd47e06a6a5b834fd09e 2026-06-12 01:15:31.255218 | controller | >f+++++++++ repos/demo-project/.git/objects/af/b9c51ff287f6408185ec86d9f4781cbe40472e 2026-06-12 01:15:31.255240 | controller | cd+++++++++ repos/demo-project/.git/objects/c5/ 2026-06-12 01:15:31.255262 | controller | >f+++++++++ repos/demo-project/.git/objects/c5/b66007e5ff93cfd4b45a4fc56b6ef19b3ec858 2026-06-12 01:15:31.255284 | controller | cd+++++++++ repos/demo-project/.git/objects/d0/ 2026-06-12 01:15:31.255305 | controller | >f+++++++++ repos/demo-project/.git/objects/d0/2db411aaa63f2a85daf1c6c871d8ca080778ba 2026-06-12 01:15:31.255327 | controller | >f+++++++++ repos/demo-project/.git/objects/d0/e66ab409ee4347449c43a1e3773363c72488b5 2026-06-12 01:15:31.255348 | controller | cd+++++++++ repos/demo-project/.git/objects/d4/ 2026-06-12 01:15:31.255371 | controller | >f+++++++++ repos/demo-project/.git/objects/d4/ad8d0fd75f2c12b671a0a497958c9d366b672c 2026-06-12 01:15:31.255393 | controller | cd+++++++++ repos/demo-project/.git/objects/db/ 2026-06-12 01:15:31.255416 | controller | >f+++++++++ repos/demo-project/.git/objects/db/88e1596a47174224927e48b34ef6d9bb1dc61d 2026-06-12 01:15:31.255463 | controller | cd+++++++++ repos/demo-project/.git/objects/ea/ 2026-06-12 01:15:31.255494 | controller | >f+++++++++ repos/demo-project/.git/objects/ea/91df6e353b4b735bc77c5c6b8a9ed89f59fb3e 2026-06-12 01:15:31.255518 | controller | cd+++++++++ repos/demo-project/.git/objects/f8/ 2026-06-12 01:15:31.255542 | controller | >f+++++++++ repos/demo-project/.git/objects/f8/2ab53eb3807ceac57630723294d4aba3d7632a 2026-06-12 01:15:31.255565 | controller | cd+++++++++ repos/demo-project/.git/objects/info/ 2026-06-12 01:15:31.255588 | controller | cd+++++++++ repos/demo-project/.git/objects/pack/ 2026-06-12 01:15:31.255610 | controller | >f+++++++++ repos/demo-project/.git/objects/pack/pack-a1c926932e297bef08b264a8d8f8ee41c577886e.idx 2026-06-12 01:15:31.255633 | controller | >f+++++++++ repos/demo-project/.git/objects/pack/pack-a1c926932e297bef08b264a8d8f8ee41c577886e.pack 2026-06-12 01:15:31.255656 | controller | >f+++++++++ repos/demo-project/.git/objects/pack/pack-a1c926932e297bef08b264a8d8f8ee41c577886e.rev 2026-06-12 01:15:31.255678 | controller | cd+++++++++ repos/demo-project/.git/refs/ 2026-06-12 01:15:31.255700 | controller | cd+++++++++ repos/demo-project/.git/refs/heads/ 2026-06-12 01:15:31.255723 | controller | >f+++++++++ repos/demo-project/.git/refs/heads/master 2026-06-12 01:15:31.255745 | controller | >f+++++++++ repos/demo-project/.git/refs/heads/test_check_url 2026-06-12 01:15:31.255767 | controller | >f+++++++++ repos/demo-project/.git/refs/heads/test_short_job 2026-06-12 01:15:31.255790 | controller | cd+++++++++ repos/demo-project/.git/refs/remotes/ 2026-06-12 01:15:31.255812 | controller | cd+++++++++ repos/demo-project/.git/refs/remotes/gerrit/ 2026-06-12 01:15:31.255835 | controller | >f+++++++++ repos/demo-project/.git/refs/remotes/gerrit/HEAD 2026-06-12 01:15:31.255858 | controller | >f+++++++++ repos/demo-project/.git/refs/remotes/gerrit/master 2026-06-12 01:15:31.255880 | controller | cd+++++++++ repos/demo-project/.git/refs/remotes/origin/ 2026-06-12 01:15:31.255902 | controller | >f+++++++++ repos/demo-project/.git/refs/remotes/origin/HEAD 2026-06-12 01:15:31.255962 | controller | >f+++++++++ repos/demo-project/.git/refs/remotes/origin/master 2026-06-12 01:15:31.255993 | controller | cd+++++++++ repos/demo-project/.git/refs/rewritten/ 2026-06-12 01:15:31.256043 | controller | cd+++++++++ repos/demo-project/.git/refs/tags/ 2026-06-12 01:15:31.256073 | controller | cd+++++++++ repos/demo-project/.zuul.d/ 2026-06-12 01:15:31.256097 | controller | >f+++++++++ repos/demo-project/.zuul.d/jobs.yaml 2026-06-12 01:15:31.256119 | controller | >f+++++++++ repos/demo-project/.zuul.d/project.yaml 2026-06-12 01:15:31.256142 | controller | >f+++++++++ repos/demo-project/.zuul.d/secrets.yaml 2026-06-12 01:15:31.256165 | controller | cd+++++++++ repos/demo-project/playbooks/ 2026-06-12 01:15:31.256187 | controller | >f+++++++++ repos/demo-project/playbooks/microshift-pod.yml 2026-06-12 01:15:31.256209 | controller | >f+++++++++ repos/demo-project/playbooks/run-check-url.yaml 2026-06-12 01:15:31.256232 | controller | >f+++++++++ repos/demo-project/playbooks/run.yaml 2026-06-12 01:15:31.256295 | controller | cd+++++++++ repos/demo-project/zuul.d/ 2026-06-12 01:15:31.256319 | controller | >f+++++++++ repos/demo-project/zuul.d/config.yaml 2026-06-12 01:15:31.256341 | controller | cd+++++++++ repos/demo-tenant-config/ 2026-06-12 01:15:31.256363 | controller | >f+++++++++ repos/demo-tenant-config/.gitreview 2026-06-12 01:15:31.256385 | controller | cd+++++++++ repos/demo-tenant-config/.git/ 2026-06-12 01:15:31.256407 | controller | >f+++++++++ repos/demo-tenant-config/.git/COMMIT_EDITMSG 2026-06-12 01:15:31.256445 | controller | >f+++++++++ repos/demo-tenant-config/.git/HEAD 2026-06-12 01:15:31.256475 | controller | >f+++++++++ repos/demo-tenant-config/.git/ORIG_HEAD 2026-06-12 01:15:31.256498 | controller | >f+++++++++ repos/demo-tenant-config/.git/config 2026-06-12 01:15:31.256520 | controller | >f+++++++++ repos/demo-tenant-config/.git/description 2026-06-12 01:15:31.256543 | controller | >f+++++++++ repos/demo-tenant-config/.git/index 2026-06-12 01:15:31.256565 | controller | >f+++++++++ repos/demo-tenant-config/.git/packed-refs 2026-06-12 01:15:31.256593 | controller | cd+++++++++ repos/demo-tenant-config/.git/hooks/ 2026-06-12 01:15:31.256615 | controller | >f+++++++++ repos/demo-tenant-config/.git/hooks/applypatch-msg.sample 2026-06-12 01:15:31.256638 | controller | >f+++++++++ repos/demo-tenant-config/.git/hooks/commit-msg.sample 2026-06-12 01:15:31.256660 | controller | >f+++++++++ repos/demo-tenant-config/.git/hooks/fsmonitor-watchman.sample 2026-06-12 01:15:31.256682 | controller | >f+++++++++ repos/demo-tenant-config/.git/hooks/post-update.sample 2026-06-12 01:15:31.256704 | controller | >f+++++++++ repos/demo-tenant-config/.git/hooks/pre-applypatch.sample 2026-06-12 01:15:31.256726 | controller | >f+++++++++ repos/demo-tenant-config/.git/hooks/pre-commit.sample 2026-06-12 01:15:31.256747 | controller | >f+++++++++ repos/demo-tenant-config/.git/hooks/pre-merge-commit.sample 2026-06-12 01:15:31.256770 | controller | >f+++++++++ repos/demo-tenant-config/.git/hooks/pre-push.sample 2026-06-12 01:15:31.256792 | controller | >f+++++++++ repos/demo-tenant-config/.git/hooks/pre-rebase.sample 2026-06-12 01:15:31.256814 | controller | >f+++++++++ repos/demo-tenant-config/.git/hooks/pre-receive.sample 2026-06-12 01:15:31.256837 | controller | >f+++++++++ repos/demo-tenant-config/.git/hooks/prepare-commit-msg.sample 2026-06-12 01:15:31.256859 | controller | >f+++++++++ repos/demo-tenant-config/.git/hooks/push-to-checkout.sample 2026-06-12 01:15:31.256882 | controller | >f+++++++++ repos/demo-tenant-config/.git/hooks/sendemail-validate.sample 2026-06-12 01:15:31.256904 | controller | >f+++++++++ repos/demo-tenant-config/.git/hooks/update.sample 2026-06-12 01:15:31.256927 | controller | cd+++++++++ repos/demo-tenant-config/.git/info/ 2026-06-12 01:15:31.256950 | controller | >f+++++++++ repos/demo-tenant-config/.git/info/exclude 2026-06-12 01:15:31.256973 | controller | cd+++++++++ repos/demo-tenant-config/.git/logs/ 2026-06-12 01:15:31.256996 | controller | >f+++++++++ repos/demo-tenant-config/.git/logs/HEAD 2026-06-12 01:15:31.257019 | controller | cd+++++++++ repos/demo-tenant-config/.git/logs/refs/ 2026-06-12 01:15:31.257042 | controller | cd+++++++++ repos/demo-tenant-config/.git/logs/refs/heads/ 2026-06-12 01:15:31.257064 | controller | >f+++++++++ repos/demo-tenant-config/.git/logs/refs/heads/master 2026-06-12 01:15:31.257087 | controller | cd+++++++++ repos/demo-tenant-config/.git/logs/refs/remotes/ 2026-06-12 01:15:31.257109 | controller | cd+++++++++ repos/demo-tenant-config/.git/logs/refs/remotes/origin/ 2026-06-12 01:15:31.257132 | controller | >f+++++++++ repos/demo-tenant-config/.git/logs/refs/remotes/origin/HEAD 2026-06-12 01:15:31.257155 | controller | >f+++++++++ repos/demo-tenant-config/.git/logs/refs/remotes/origin/master 2026-06-12 01:15:31.257178 | controller | cd+++++++++ repos/demo-tenant-config/.git/objects/ 2026-06-12 01:15:31.257201 | controller | cd+++++++++ repos/demo-tenant-config/.git/objects/35/ 2026-06-12 01:15:31.257224 | controller | >f+++++++++ repos/demo-tenant-config/.git/objects/35/b27848a551ba9940a7d29be8ac540ae6bf76c6 2026-06-12 01:15:31.257247 | controller | cd+++++++++ repos/demo-tenant-config/.git/objects/71/ 2026-06-12 01:15:31.257270 | controller | >f+++++++++ repos/demo-tenant-config/.git/objects/71/766da1ed79ae81b8510541bc42a17123e9f4c7 2026-06-12 01:15:31.257293 | controller | cd+++++++++ repos/demo-tenant-config/.git/objects/7e/ 2026-06-12 01:15:31.257378 | controller | >f+++++++++ repos/demo-tenant-config/.git/objects/7e/56626d48d97eee76893616729b62b50ce1d6aa 2026-06-12 01:15:31.257410 | controller | cd+++++++++ repos/demo-tenant-config/.git/objects/82/ 2026-06-12 01:15:31.257495 | controller | >f+++++++++ repos/demo-tenant-config/.git/objects/82/7fb999b752e98c420a55a6844053be01b085ed 2026-06-12 01:15:31.257522 | controller | cd+++++++++ repos/demo-tenant-config/.git/objects/9e/ 2026-06-12 01:15:31.257545 | controller | >f+++++++++ repos/demo-tenant-config/.git/objects/9e/d5bc9a591ecf02f8b90e37ef0395c13113ad9d 2026-06-12 01:15:31.257568 | controller | cd+++++++++ repos/demo-tenant-config/.git/objects/b2/ 2026-06-12 01:15:31.257601 | controller | >f+++++++++ repos/demo-tenant-config/.git/objects/b2/9ffbd8fb2947c43ddcd388735096ad3451acaa 2026-06-12 01:15:31.257625 | controller | cd+++++++++ repos/demo-tenant-config/.git/objects/e4/ 2026-06-12 01:15:31.257648 | controller | >f+++++++++ repos/demo-tenant-config/.git/objects/e4/641b65f1174ec39331eff28a4e1223a9b05c89 2026-06-12 01:15:31.257671 | controller | cd+++++++++ repos/demo-tenant-config/.git/objects/f2/ 2026-06-12 01:15:31.257693 | controller | >f+++++++++ repos/demo-tenant-config/.git/objects/f2/8ffbf2fa121967285ce723c693394f4f57d2e9 2026-06-12 01:15:31.257716 | controller | cd+++++++++ repos/demo-tenant-config/.git/objects/info/ 2026-06-12 01:15:31.257738 | controller | cd+++++++++ repos/demo-tenant-config/.git/objects/pack/ 2026-06-12 01:15:31.257760 | controller | >f+++++++++ repos/demo-tenant-config/.git/objects/pack/pack-35255ba874d1a372312de623a3bf4696eecdac4c.idx 2026-06-12 01:15:31.257783 | controller | >f+++++++++ repos/demo-tenant-config/.git/objects/pack/pack-35255ba874d1a372312de623a3bf4696eecdac4c.pack 2026-06-12 01:15:31.257804 | controller | >f+++++++++ repos/demo-tenant-config/.git/objects/pack/pack-35255ba874d1a372312de623a3bf4696eecdac4c.rev 2026-06-12 01:15:31.257826 | controller | cd+++++++++ repos/demo-tenant-config/.git/refs/ 2026-06-12 01:15:31.257848 | controller | cd+++++++++ repos/demo-tenant-config/.git/refs/heads/ 2026-06-12 01:15:31.257871 | controller | >f+++++++++ repos/demo-tenant-config/.git/refs/heads/master 2026-06-12 01:15:31.257893 | controller | cd+++++++++ repos/demo-tenant-config/.git/refs/remotes/ 2026-06-12 01:15:31.257914 | controller | cd+++++++++ repos/demo-tenant-config/.git/refs/remotes/origin/ 2026-06-12 01:15:31.257937 | controller | >f+++++++++ repos/demo-tenant-config/.git/refs/remotes/origin/HEAD 2026-06-12 01:15:31.257960 | controller | >f+++++++++ repos/demo-tenant-config/.git/refs/remotes/origin/master 2026-06-12 01:15:31.257987 | controller | cd+++++++++ repos/demo-tenant-config/.git/refs/tags/ 2026-06-12 01:15:31.258009 | controller | cd+++++++++ repos/demo-tenant-config/playbooks/ 2026-06-12 01:15:31.258032 | controller | >f+++++++++ repos/demo-tenant-config/playbooks/gerrit-pre.yaml 2026-06-12 01:15:31.258055 | controller | cd+++++++++ repos/demo-tenant-config/zuul.d/ 2026-06-12 01:15:31.258077 | controller | >f+++++++++ repos/demo-tenant-config/zuul.d/gerrit-base-jobs.yaml 2026-06-12 01:15:31.258099 | controller | >f+++++++++ repos/demo-tenant-config/zuul.d/gerrit-pipeline.yaml 2026-06-12 01:15:31.258122 | controller | >f+++++++++ repos/demo-tenant-config/zuul.d/gerrit-project-pipeline.yaml 2026-06-12 01:15:31.258192 | controller | changed: All items complete 2026-06-12 01:15:31.258221 | 2026-06-12 01:15:31.796393 | controller | changed: .d..t...... ./ 2026-06-12 01:15:32.436215 | controller | changed: .d..t...... ./ 2026-06-12 01:15:32.465899 | 2026-06-12 01:15:32.466104 | TASK [include_role : fetch-output-openshift] 2026-06-12 01:15:32.483881 | controller | skipping: Conditional result was False 2026-06-12 01:15:32.493672 | 2026-06-12 01:15:32.493813 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-06-12 01:15:32.525237 | controller | skipping: Conditional result was False 2026-06-12 01:15:32.533658 | controller | skipping: Conditional result was False 2026-06-12 01:15:32.552279 | 2026-06-12 01:15:32.552422 | PLAY [localhost] 2026-06-12 01:15:32.563756 | 2026-06-12 01:15:32.564052 | TASK [add-fileserver : Create SSH private key tempfile] 2026-06-12 01:15:32.987180 | localhost | changed 2026-06-12 01:15:33.037243 | 2026-06-12 01:15:33.037395 | TASK [add-fileserver : Create SSH private key from secret] 2026-06-12 01:15:33.850456 | localhost | changed 2026-06-12 01:15:33.859813 | 2026-06-12 01:15:33.859992 | TASK [add-fileserver : Add fileserver ssh key] 2026-06-12 01:15:34.324778 | localhost | Identity added: /var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/work/tmp/ansible.1__73jzd (/var/lib/zuul/builds/d0412b82f8ae4a96a604fa1c8ccd9fad/work/tmp/ansible.1__73jzd) 2026-06-12 01:15:34.325137 | localhost | ok: Runtime: 0:00:00.018693 2026-06-12 01:15:34.332240 | 2026-06-12 01:15:34.332368 | TASK [add-fileserver : Remove SSH private key from disk] 2026-06-12 01:15:34.670802 | localhost | ok: Runtime: 0:00:00.009398 2026-06-12 01:15:34.674706 | 2026-06-12 01:15:34.674767 | TASK [add-fileserver : Add fileserver to inventory] 2026-06-12 01:15:34.754142 | localhost | changed 2026-06-12 01:15:34.760772 | 2026-06-12 01:15:34.760902 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-06-12 01:15:35.209854 | localhost | changed 2026-06-12 01:15:35.225194 | 2026-06-12 01:15:35.225333 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-06-12 01:15:35.688287 | localhost | changed 2026-06-12 01:15:35.707887 | 2026-06-12 01:15:35.708036 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-06-12 01:15:35.750123 | localhost | ok 2026-06-12 01:15:35.764223 | 2026-06-12 01:15:35.764353 | TASK [zuul_return] 2026-06-12 01:15:35.830769 | localhost | skipping: Conditional result was False 2026-06-12 01:15:35.835358 | 2026-06-12 01:15:35.835507 | PLAY [a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com] 2026-06-12 01:15:35.842147 | 2026-06-12 01:15:35.842272 | TASK [Set zuul-log-path fact] 2026-06-12 01:15:35.858980 | a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com | ok 2026-06-12 01:15:35.872141 | 2026-06-12 01:15:35.872264 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-06-12 01:15:35.899931 | a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com | ok 2026-06-12 01:15:35.904833 | 2026-06-12 01:15:35.905015 | TASK [upload-logs : Create log directories] 2026-06-12 01:15:36.767697 | a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com | changed 2026-06-12 01:15:36.771172 | 2026-06-12 01:15:36.771299 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-06-12 01:15:37.134512 | a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com -> localhost | ok: Runtime: 0:00:00.019711 2026-06-12 01:15:37.138743 | 2026-06-12 01:15:37.138877 | TASK [upload-logs : Upload logs to log server] 2026-06-12 01:15:58.532366 | a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com | changed: 2026-06-12 01:15:58.532656 | a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com | .d..tp..... ./ 2026-06-12 01:15:58.532708 | a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com |