2026-06-10T04:27:37-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-10T04:27:37-04:00 INFO Kubernetes Distribution found: Openshift 2026-06-10T04:27:37-04:00 INFO Deleting object, name: ca-cert 2026-06-10T04:27:37-04:00 INFO Updating configmap, name: zuul-scheduler-tooling-config-map 2026-06-10T04:27:37-04:00 INFO Updating object, name: zuul-scheduler-tooling-config-map 2026-06-10T04:27:37-04:00 INFO Statefulset "git-server" configuration changed, applying... 2026-06-10T04:27:37-04:00 INFO Updating object, name: git-server 2026-06-10T04:27:38-04:00 INFO Statefulset "logserver" configuration changed, applying... 2026-06-10T04:27:38-04:00 INFO Updating object, name: logserver 2026-06-10T04:27:38-04:00 INFO Waiting for deployment, name: gateway 2026-06-10T04:27:38-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-10T04:27:38-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-10T04:27:38-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-10T04:27:38-04:00 INFO Waiting for GitServer and MariaDB services to be ready ... 2026-06-10T04:27:38-04:00 INFO - Config: Waiting ... - Gateway: OK - GitServer: Waiting ... - HoundSearch: OK - LogJuicer: OK - Logserver: Waiting ... - MariaDB: OK - Zookeeper: OK 2026-06-10T04:27:38-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-10T04:27:43-04:00 INFO Deleting object, name: ca-cert 2026-06-10T04:27:44-04:00 INFO Waiting for statefulset, name: git-server 2026-06-10T04:28:00-04:00 INFO Waiting for statefulset, name: logserver 2026-06-10T04:28:30-04:00 INFO Statefulset "logserver" not ready after 30s 2026-06-10T04:28:30-04:00 INFO Waiting for deployment, name: gateway 2026-06-10T04:28:30-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-10T04:28:30-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-10T04:28:30-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-10T04:28:30-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-10T04:28:30-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-10T04:28:30-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-10T04:28:30-04:00 INFO Updating secret, name: zuul-config 2026-06-10T04:28:30-04:00 INFO Updating object, name: zuul-config 2026-06-10T04:28:31-04:00 INFO Statefulset "zuul-scheduler" configuration changed, applying... 2026-06-10T04:28:31-04:00 INFO Updating object, name: zuul-scheduler 2026-06-10T04:28:33-04:00 INFO Statefulset "zuul-web" configuration changed, applying... 2026-06-10T04:28:33-04:00 INFO Updating object, name: zuul-web 2026-06-10T04:28:33-04:00 INFO - Config: Waiting ... - Gateway: OK - GitServer: OK - HoundSearch: OK - LogJuicer: OK - Logserver: Waiting ... - MariaDB: OK - NodePoolBuilder: OK - NodePoolLauncher: OK - Zookeeper: OK - Zuul: Waiting ... - |_ Config Secrets: OK - |_ Executor: OK - |_ Merger: OK - |_ Scheduler: Waiting ... - |_ Web: Waiting ... 2026-06-10T04:28:33-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-10T04:28:38-04:00 INFO Deleting object, name: ca-cert 2026-06-10T04:28:39-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-10T04:28:39-04:00 INFO Logserver authorized_keys is up to date 2026-06-10T04:28:39-04:00 INFO Waiting for deployment, name: gateway 2026-06-10T04:28:39-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-10T04:28:39-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-10T04:28:39-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-10T04:28:39-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-10T04:28:40-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-10T04:28:40-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-10T04:28:41-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-10T04:29:11-04:00 INFO Statefulset "zuul-scheduler" not ready after 30s 2026-06-10T04:29:11-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-10T04:29:11-04:00 INFO deployment rollout not ok, name: zuul-web 2026-06-10T04:29:11-04:00 INFO - Config: Waiting ... - Gateway: OK - GitServer: OK - HoundSearch: OK - LogJuicer: OK - Logserver: OK - MariaDB: OK - NodePoolBuilder: OK - NodePoolLauncher: OK - Zookeeper: OK - Zuul: Waiting ... - |_ Config Secrets: OK - |_ Executor: OK - |_ Merger: OK - |_ Scheduler: Waiting ... - |_ Web: Waiting ... 2026-06-10T04:29:11-04:00 INFO [attempt #3] Waiting 5s for the next reconcile call ... 2026-06-10T04:29:16-04:00 INFO Deleting object, name: ca-cert 2026-06-10T04:29:17-04:00 INFO Waiting for deployment, name: gateway 2026-06-10T04:29:17-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-10T04:29:17-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-10T04:29:17-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-10T04:29:17-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-10T04:29:18-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-10T04:29:18-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-10T04:29:19-04:00 INFO Waiting for statefulset, name: zuul-scheduler 2026-06-10T04:29:37-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-10T04:29:37-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-10T04:29:37-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-10T04:29:37-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-10T04:29:38-04:00 INFO - Config: OK - Gateway: OK - GitServer: OK - HoundSearch: OK - LogJuicer: OK - Logserver: OK - MariaDB: OK - NodePoolBuilder: OK - NodePoolLauncher: OK - Zookeeper: OK - Zuul: OK 2026-06-10T04:29:38-04:00 INFO Updating controller configmap ... 2026-06-10T04:29:38-04:00 INFO Standalone reconcile done. 2026-06-10T04:29:42-04:00 INFO OPENSHIFT_USER environment variable is not set, discovering Kubernetes Distribution 2026-06-10T04:29:42-04:00 INFO Kubernetes Distribution found: Openshift 2026-06-10T04:29:42-04:00 INFO Deleting object, name: ca-cert 2026-06-10T04:29:42-04:00 INFO Volume expansion required for logserver-logserver-0. current size: 2Gi -> new size: 4Gi 2026-06-10T04:29:42-04:00 INFO Expansion started for volume logserver-logserver-0 2026-06-10T04:29:42-04:00 INFO Waiting for deployment, name: gateway 2026-06-10T04:29:42-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-10T04:29:42-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-10T04:29:42-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-10T04:29:43-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-10T04:29:43-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-10T04:29:43-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-10T04:29:44-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-10T04:29:44-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-10T04:29:45-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-10T04:29:45-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-10T04:29:46-04:00 INFO - Config: Waiting ... - Gateway: OK - GitServer: OK - HoundSearch: OK - LogJuicer: OK - Logserver: Waiting ... - MariaDB: OK - NodePoolBuilder: OK - NodePoolLauncher: OK - Zookeeper: OK - Zuul: OK 2026-06-10T04:29:46-04:00 INFO [attempt #1] Waiting 5s for the next reconcile call ... 2026-06-10T04:29:51-04:00 INFO Deleting object, name: ca-cert 2026-06-10T04:29:52-04:00 INFO Volume logserver-logserver-0 resizing in progress, not ready 2026-06-10T04:29:52-04:00 INFO Waiting for deployment, name: gateway 2026-06-10T04:29:52-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-10T04:29:52-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-10T04:29:52-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-10T04:29:52-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-10T04:29:53-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-10T04:29:53-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-10T04:29:54-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-10T04:29:54-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-10T04:29:55-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-10T04:29:55-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-10T04:29:55-04:00 INFO - Config: Waiting ... - Gateway: OK - GitServer: OK - HoundSearch: OK - LogJuicer: OK - Logserver: Waiting ... - MariaDB: OK - NodePoolBuilder: OK - NodePoolLauncher: OK - Zookeeper: OK - Zuul: OK 2026-06-10T04:29:55-04:00 INFO [attempt #2] Waiting 5s for the next reconcile call ... 2026-06-10T04:30:00-04:00 INFO Deleting object, name: ca-cert 2026-06-10T04:30:01-04:00 INFO Volume logserver-logserver-0 resizing in progress, not ready 2026-06-10T04:30:01-04:00 INFO Waiting for deployment, name: gateway 2026-06-10T04:30:01-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-10T04:30:01-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-10T04:30:01-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-10T04:30:01-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-10T04:30:02-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-10T04:30:02-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-10T04:30:03-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-10T04:30:03-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-10T04:30:04-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-10T04:30:04-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-10T04:30:05-04:00 INFO - Config: Waiting ... - Gateway: OK - GitServer: OK - HoundSearch: OK - LogJuicer: OK - Logserver: Waiting ... - MariaDB: OK - NodePoolBuilder: OK - NodePoolLauncher: OK - Zookeeper: OK - Zuul: OK 2026-06-10T04:30:05-04:00 INFO [attempt #3] Waiting 5s for the next reconcile call ... 2026-06-10T04:30:10-04:00 INFO Deleting object, name: ca-cert 2026-06-10T04:30:10-04:00 INFO Volume logserver-logserver-0 resizing in progress, not ready 2026-06-10T04:30:10-04:00 INFO Waiting for deployment, name: gateway 2026-06-10T04:30:10-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-10T04:30:10-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-10T04:30:10-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-10T04:30:11-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-10T04:30:11-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-10T04:30:11-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-10T04:30:12-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-10T04:30:12-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-10T04:30:13-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-10T04:30:13-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-10T04:30:14-04:00 INFO - Config: Waiting ... - Gateway: OK - GitServer: OK - HoundSearch: OK - LogJuicer: OK - Logserver: Waiting ... - MariaDB: OK - NodePoolBuilder: OK - NodePoolLauncher: OK - Zookeeper: OK - Zuul: OK 2026-06-10T04:30:14-04:00 INFO [attempt #4] Waiting 5s for the next reconcile call ... 2026-06-10T04:30:19-04:00 INFO Deleting object, name: ca-cert 2026-06-10T04:30:20-04:00 INFO Volume logserver-logserver-0 resizing in progress, not ready 2026-06-10T04:30:20-04:00 INFO Waiting for deployment, name: gateway 2026-06-10T04:30:20-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-10T04:30:20-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-10T04:30:20-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-10T04:30:20-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-10T04:30:20-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-10T04:30:20-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-10T04:30:21-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-10T04:30:21-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-10T04:30:22-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-10T04:30:22-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-10T04:30:23-04:00 INFO - Config: Waiting ... - Gateway: OK - GitServer: OK - HoundSearch: OK - LogJuicer: OK - Logserver: Waiting ... - MariaDB: OK - NodePoolBuilder: OK - NodePoolLauncher: OK - Zookeeper: OK - Zuul: OK 2026-06-10T04:30:23-04:00 INFO [attempt #5] Waiting 5s for the next reconcile call ... 2026-06-10T04:30:28-04:00 INFO Deleting object, name: ca-cert 2026-06-10T04:30:29-04:00 INFO Volume logserver-logserver-0 resizing in progress, not ready 2026-06-10T04:30:29-04:00 INFO Waiting for deployment, name: gateway 2026-06-10T04:30:29-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-10T04:30:29-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-10T04:30:29-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-10T04:30:29-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-10T04:30:30-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-10T04:30:30-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-10T04:30:31-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-10T04:30:31-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-10T04:30:32-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-10T04:30:32-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-10T04:30:32-04:00 INFO - Config: Waiting ... - Gateway: OK - GitServer: OK - HoundSearch: OK - LogJuicer: OK - Logserver: Waiting ... - MariaDB: OK - NodePoolBuilder: OK - NodePoolLauncher: OK - Zookeeper: OK - Zuul: OK 2026-06-10T04:30:32-04:00 INFO [attempt #6] Waiting 5s for the next reconcile call ... 2026-06-10T04:30:37-04:00 INFO Deleting object, name: ca-cert 2026-06-10T04:30:38-04:00 INFO Volume logserver-logserver-0 resizing in progress, not ready 2026-06-10T04:30:38-04:00 INFO Waiting for deployment, name: gateway 2026-06-10T04:30:38-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-10T04:30:38-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-10T04:30:38-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-10T04:30:38-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-10T04:30:39-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-10T04:30:39-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-10T04:30:40-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-10T04:30:40-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-10T04:30:41-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-10T04:30:41-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-10T04:30:42-04:00 INFO - Config: Waiting ... - Gateway: OK - GitServer: OK - HoundSearch: OK - LogJuicer: OK - Logserver: Waiting ... - MariaDB: OK - NodePoolBuilder: OK - NodePoolLauncher: OK - Zookeeper: OK - Zuul: OK 2026-06-10T04:30:42-04:00 INFO [attempt #7] Waiting 5s for the next reconcile call ... 2026-06-10T04:30:47-04:00 INFO Deleting object, name: ca-cert 2026-06-10T04:30:47-04:00 INFO Volume logserver-logserver-0 resizing in progress, not ready 2026-06-10T04:30:47-04:00 INFO Waiting for deployment, name: gateway 2026-06-10T04:30:47-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-10T04:30:47-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-10T04:30:47-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-10T04:30:48-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-10T04:30:48-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-10T04:30:48-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-10T04:30:49-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-10T04:30:49-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-10T04:30:50-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-10T04:30:50-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-10T04:30:51-04:00 INFO - Config: Waiting ... - Gateway: OK - GitServer: OK - HoundSearch: OK - LogJuicer: OK - Logserver: Waiting ... - MariaDB: OK - NodePoolBuilder: OK - NodePoolLauncher: OK - Zookeeper: OK - Zuul: OK 2026-06-10T04:30:51-04:00 INFO [attempt #8] Waiting 5s for the next reconcile call ... 2026-06-10T04:30:56-04:00 INFO Deleting object, name: ca-cert 2026-06-10T04:30:56-04:00 INFO Volume logserver-logserver-0 resizing in progress, not ready 2026-06-10T04:30:56-04:00 INFO Waiting for deployment, name: gateway 2026-06-10T04:30:56-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-10T04:30:57-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-10T04:30:57-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-10T04:30:57-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-10T04:30:57-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-10T04:30:57-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-10T04:30:58-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-10T04:30:58-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-10T04:30:59-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-10T04:30:59-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-10T04:31:00-04:00 INFO - Config: Waiting ... - Gateway: OK - GitServer: OK - HoundSearch: OK - LogJuicer: OK - Logserver: Waiting ... - MariaDB: OK - NodePoolBuilder: OK - NodePoolLauncher: OK - Zookeeper: OK - Zuul: OK 2026-06-10T04:31:00-04:00 INFO [attempt #9] Waiting 5s for the next reconcile call ... 2026-06-10T04:31:05-04:00 INFO Deleting object, name: ca-cert 2026-06-10T04:31:06-04:00 INFO Running pod execution pod: logserver-0, command: [cat /tmp/home/.ssh/authorized_keys] 2026-06-10T04:31:06-04:00 INFO Logserver authorized_keys is up to date 2026-06-10T04:31:06-04:00 INFO Waiting for deployment, name: gateway 2026-06-10T04:31:06-04:00 INFO Checking deployment ready replicas, name: gateway 2026-06-10T04:31:06-04:00 INFO Waiting for deployment, name: logjuicer 2026-06-10T04:31:06-04:00 INFO Checking deployment ready replicas, name: logjuicer 2026-06-10T04:31:06-04:00 INFO Deploying Zuul and Nodepool ... 2026-06-10T04:31:07-04:00 INFO Waiting for deployment, name: nodepool-launcher 2026-06-10T04:31:07-04:00 INFO Checking deployment ready replicas, name: nodepool-launcher 2026-06-10T04:31:08-04:00 INFO Waiting for deployment, name: zuul-weeder 2026-06-10T04:31:08-04:00 INFO Checking deployment ready replicas, name: zuul-weeder 2026-06-10T04:31:09-04:00 INFO Waiting for deployment, name: zuul-web 2026-06-10T04:31:09-04:00 INFO Checking deployment ready replicas, name: zuul-web 2026-06-10T04:31:10-04:00 INFO - Config: OK - Gateway: OK - GitServer: OK - HoundSearch: OK - LogJuicer: OK - Logserver: OK - MariaDB: OK - NodePoolBuilder: OK - NodePoolLauncher: OK - Zookeeper: OK - Zuul: OK 2026-06-10T04:31:10-04:00 INFO Updating controller configmap ... 2026-06-10T04:31:10-04:00 INFO Standalone reconcile done.