2026-06-11T10:26:50.604876343-04:00 stderr F /usr/local/lib/python3.11/site-packages/nodepool/version.py:18: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
2026-06-11T10:26:50.604876343-04:00 stderr F   import pkg_resources
2026-06-11T10:26:51.197568131-04:00 stdout F 2026-06-11 14:26:51,196 INFO nodepool.NodePool: Nodepool launcher 11.0.1.dev1 8472a37a starting
2026-06-11T10:26:51.340828739-04:00 stdout F 2026-06-11 14:26:51,340 INFO nodepool.ComponentRegistry: Noticed new launcher component nodepool-launcher-7fcf69d9bb-vmzff0000000004
2026-06-11T10:26:51.342127959-04:00 stdout F 2026-06-11 14:26:51,341 INFO nodepool.ComponentRegistry: Component launcher nodepool-launcher-7fcf69d9bb-vmzff0000000004 updated: {'hostname': 'nodepool-launcher-7fcf69d9bb-vmzff', 'kind': 'launcher', 'model_api': 0, 'state': 'running', 'version': '11.0.1.dev1 8472a37a'}
2026-06-11T10:26:51.344042219-04:00 stdout F 2026-06-11 14:26:51,343 INFO nodepool.ComponentRegistry: System minimum data model version 0; this component 0
2026-06-11T10:26:51.344466862-04:00 stdout F 2026-06-11 14:26:51,344 INFO nodepool.Component: Registering component in ZooKeeper /nodepool/components/launcher/nodepool-launcher-6c9689c54c-xcchc
2026-06-11T10:26:51.350136170-04:00 stdout F 2026-06-11 14:26:51,348 INFO nodepool.ComponentRegistry: Noticed new launcher component nodepool-launcher-6c9689c54c-xcchc0000000005
2026-06-11T10:26:51.351640607-04:00 stdout F 2026-06-11 14:26:51,351 INFO nodepool.CleanupWorker: Starting
2026-06-11T10:26:51.352389860-04:00 stdout F 2026-06-11 14:26:51,352 INFO nodepool.DeletedNodeWorker: Starting
2026-06-11T10:26:51.353761864-04:00 stdout F 2026-06-11 14:26:51,353 INFO nodepool.StatsWorker: Starting
2026-06-11T10:26:51.354675332-04:00 stdout F 2026-06-11 14:26:51,353 INFO nodepool.ComponentRegistry: Component launcher nodepool-launcher-6c9689c54c-xcchc0000000005 updated: {'hostname': 'nodepool-launcher-6c9689c54c-xcchc', 'kind': 'launcher', 'model_api': 0, 'state': 'running', 'version': '11.0.1.dev1 8472a37a'}
2026-06-11T10:26:54.379556678-04:00 stdout F 2026-06-11 14:26:54,379 INFO nodepool.ComponentRegistry: Noticed new builder component nodepool-builder-00000000006
2026-06-11T10:26:54.380937821-04:00 stdout F 2026-06-11 14:26:54,380 INFO nodepool.ComponentRegistry: Component builder nodepool-builder-00000000006 updated: {'hostname': 'nodepool-builder-0', 'kind': 'builder', 'model_api': 0, 'state': 'stopped', 'version': '11.0.1.dev1 06cc723a'}
2026-06-11T10:27:14.592688063-04:00 stdout F 2026-06-11 14:27:14,592 INFO nodepool.ComponentRegistry: Noticed launcher component nodepool-launcher-7fcf69d9bb-vmzff0000000004 disappeared
2026-06-11T10:27:14.594961984-04:00 stdout F 2026-06-11 14:27:14,594 INFO nodepool.StatsWorker: Won stats reporter election
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider: Couldn't load context openshiftpods from config
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:   Traceback (most recent call last):
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:     File "/usr/local/lib/python3.11/site-packages/nodepool/driver/utils_k8s.py", line 43, in get_client
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:       conf = _get_conf(log, context)
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:              ^^^^^^^^^^^^^^^^^^^^^^^
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:     File "/usr/local/lib/python3.11/site-packages/nodepool/driver/utils_k8s.py", line 26, in _get_conf
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:       return k8s_config.new_client_from_config(context=context)
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:     File "/usr/local/lib/python3.11/site-packages/kubernetes/config/kube_config.py", line 878, in new_client_from_config
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:       load_kube_config(config_file=config_file, context=context,
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:     File "/usr/local/lib/python3.11/site-packages/kubernetes/config/kube_config.py", line 819, in load_kube_config
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:       loader = _get_kube_config_loader(
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:                ^^^^^^^^^^^^^^^^^^^^^^^^
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:     File "/usr/local/lib/python3.11/site-packages/kubernetes/config/kube_config.py", line 779, in _get_kube_config_loader
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:       return KubeConfigLoader(
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:              ^^^^^^^^^^^^^^^^^
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:     File "/usr/local/lib/python3.11/site-packages/kubernetes/config/kube_config.py", line 206, in __init__
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:       self.set_active_context(active_context)
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:     File "/usr/local/lib/python3.11/site-packages/kubernetes/config/kube_config.py", line 259, in set_active_context
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:       self._current_context = self._config['contexts'].get_with_name(
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:     File "/usr/local/lib/python3.11/site-packages/kubernetes/config/kube_config.py", line 662, in get_with_name
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:       raise ConfigException(
2026-06-11T10:31:55.137923902-04:00 stdout F 2026-06-11 14:31:55,134 ERROR nodepool.driver.openshiftpods.OpenshiftPodsProvider:   kubernetes.config.config_exception.ConfigException: Invalid kube-config file. Expected object with name openshiftpods in /var/lib/nodepool/.kube/config/contexts list
2026-06-11T10:31:55.141240475-04:00 stdout F 2026-06-11 14:31:55,141 INFO nodepool.NodePool: Starting PoolWorker.microshiftLocal-nodepool
2026-06-11T10:31:55.142072381-04:00 stdout F 2026-06-11 14:31:55,141 INFO nodepool.Component: Registering component in ZooKeeper /nodepool/components/pool/nodepool-launcher-6c9689c54c-xcchc
2026-06-11T10:31:55.148915305-04:00 stdout F 2026-06-11 14:31:55,148 INFO nodepool.ComponentRegistry: Noticed new pool component nodepool-launcher-6c9689c54c-xcchc0000000000
2026-06-11T10:31:55.150311088-04:00 stdout F 2026-06-11 14:31:55,150 INFO nodepool.ComponentRegistry: Component pool nodepool-launcher-6c9689c54c-xcchc0000000000 updated: {'hostname': 'nodepool-launcher-6c9689c54c-xcchc', 'id': 'nodepool-launcher-6c9689c54c-xcchc-PoolWorker.microshiftLocal-nodepool-c6ff94ed1c51495eb84582cf7f2260cd', 'kind': 'pool', 'model_api': 0, 'name': 'nodepool', 'paused': False, 'priority': 100, 'provider_name': 'microshiftLocal', 'state': 'running', 'supported_labels': ['zuul-worker-sf-operator-ci-sxtugz69'], 'version': '11.0.1.dev1 8472a37a'}
2026-06-11T10:38:03.971149640-04:00 stdout F 2026-06-11 14:38:03,970 INFO paste.httpserver.ThreadPool: kill_hung_threads status: 10 threads (0 working, 10 idle, 0 starting) ave time N/A, max time 0.00sec, killed 0 workers
2026-06-11T10:38:10.476887109-04:00 stdout F 2026-06-11 14:38:10,475 INFO nodepool.PoolWorker.microshiftLocal-nodepool: [e: aecb58c3bcd04f04b141580815d76ebb] [node_request: 200-0000000000] Assigning node request <NodeRequest {'state': 'requested', 'state_time': 1781188690.2081666, 'declined_by': [], 'node_types': ['zuul-worker-sf-operator-ci-sxtugz69'], 'nodes': [], 'reuse': True, 'requestor': '6bbac3f11af84aa28391d4fbac8cde84', 'requestor_data': {'build_set_uuid': '6df13a9eea7f40d0bcbc97039077fe46', 'tenant_name': 'demo-tenant', 'pipeline_name': 'check', 'job_uuid': '96b559e116fb4aa2aab13860d87ecb1c', 'job_name': 'microshift-pod', 'span_info': {'name': 'RequestNodes', 'trace_id': 210339928276501247184956390875922724137, 'span_id': 16769843073773400995, 'trace_flags': 1, 'start_time': 1781188690208174848, 'parent': {'trace_id': 210339928276501247184956390875922724137, 'span_id': 5496387773341765039, 'is_remote': True}}}, 'provider': None, 'relative_priority': 0, 'event_id': 'aecb58c3bcd04f04b141580815d76ebb', 'created_time': 1781188690.208175, 'tenant_name': 'demo-tenant', 'id': '200-0000000000', 'stat': ZnodeStat(czxid=19611, mzxid=19611, ctime=1781188690209, mtime=1781188690209, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=817, numChildren=0, pzxid=19611)}>
2026-06-11T10:38:10.514292437-04:00 stdout F 2026-06-11 14:38:10,510 ERROR nodepool.NodeLauncher: [e: aecb58c3bcd04f04b141580815d76ebb] [node_request: 200-0000000000] [node: 0000000000] Launch attempt 1/3 failed for node 0000000000:
2026-06-11T10:38:10.514292437-04:00 stdout F 2026-06-11 14:38:10,510 ERROR nodepool.NodeLauncher:   Traceback (most recent call last):
2026-06-11T10:38:10.514292437-04:00 stdout F 2026-06-11 14:38:10,510 ERROR nodepool.NodeLauncher:     File "/usr/local/lib/python3.11/site-packages/nodepool/driver/openshift/handler.py", line 69, in launch
2026-06-11T10:38:10.514292437-04:00 stdout F 2026-06-11 14:38:10,510 ERROR nodepool.NodeLauncher:       self._launchLabel()
2026-06-11T10:38:10.514292437-04:00 stdout F 2026-06-11 14:38:10,510 ERROR nodepool.NodeLauncher:     File "/usr/local/lib/python3.11/site-packages/nodepool/driver/openshiftpods/handler.py", line 29, in _launchLabel
2026-06-11T10:38:10.514292437-04:00 stdout F 2026-06-11 14:38:10,510 ERROR nodepool.NodeLauncher:       self.handler.manager.createPod(self.node, self.handler.pool.name,
2026-06-11T10:38:10.514292437-04:00 stdout F 2026-06-11 14:38:10,510 ERROR nodepool.NodeLauncher:     File "/usr/local/lib/python3.11/site-packages/nodepool/driver/openshift/provider.py", line 231, in createPod
2026-06-11T10:38:10.514292437-04:00 stdout F 2026-06-11 14:38:10,510 ERROR nodepool.NodeLauncher:       self.k8s_client.create_namespaced_pod(project, pod_body)
2026-06-11T10:38:10.514292437-04:00 stdout F 2026-06-11 14:38:10,510 ERROR nodepool.NodeLauncher:       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-06-11T10:38:10.514292437-04:00 stdout F 2026-06-11 14:38:10,510 ERROR nodepool.NodeLauncher:   AttributeError: 'NoneType' object has no attribute 'create_namespaced_pod'
2026-06-11T10:38:10.515346729-04:00 stdout F 2026-06-11 14:38:10,514 ERROR nodepool.NodeLauncher: [e: aecb58c3bcd04f04b141580815d76ebb] [node_request: 200-0000000000] [node: 0000000000] Launch attempt 2/3 failed for node 0000000000:
2026-06-11T10:38:10.515346729-04:00 stdout F 2026-06-11 14:38:10,514 ERROR nodepool.NodeLauncher:   Traceback (most recent call last):
2026-06-11T10:38:10.515346729-04:00 stdout F 2026-06-11 14:38:10,514 ERROR nodepool.NodeLauncher:     File "/usr/local/lib/python3.11/site-packages/nodepool/driver/openshift/handler.py", line 69, in launch
2026-06-11T10:38:10.515346729-04:00 stdout F 2026-06-11 14:38:10,514 ERROR nodepool.NodeLauncher:       self._launchLabel()
2026-06-11T10:38:10.515346729-04:00 stdout F 2026-06-11 14:38:10,514 ERROR nodepool.NodeLauncher:     File "/usr/local/lib/python3.11/site-packages/nodepool/driver/openshiftpods/handler.py", line 29, in _launchLabel
2026-06-11T10:38:10.515346729-04:00 stdout F 2026-06-11 14:38:10,514 ERROR nodepool.NodeLauncher:       self.handler.manager.createPod(self.node, self.handler.pool.name,
2026-06-11T10:38:10.515346729-04:00 stdout F 2026-06-11 14:38:10,514 ERROR nodepool.NodeLauncher:     File "/usr/local/lib/python3.11/site-packages/nodepool/driver/openshift/provider.py", line 231, in createPod
2026-06-11T10:38:10.515346729-04:00 stdout F 2026-06-11 14:38:10,514 ERROR nodepool.NodeLauncher:       self.k8s_client.create_namespaced_pod(project, pod_body)
2026-06-11T10:38:10.515346729-04:00 stdout F 2026-06-11 14:38:10,514 ERROR nodepool.NodeLauncher:       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-06-11T10:38:10.515346729-04:00 stdout F 2026-06-11 14:38:10,514 ERROR nodepool.NodeLauncher:   AttributeError: 'NoneType' object has no attribute 'create_namespaced_pod'
2026-06-11T10:38:10.516364852-04:00 stdout F 2026-06-11 14:38:10,515 ERROR nodepool.NodeLauncher: [e: aecb58c3bcd04f04b141580815d76ebb] [node_request: 200-0000000000] [node: 0000000000] Launch attempt 3/3 failed for node 0000000000:
2026-06-11T10:38:10.516364852-04:00 stdout F 2026-06-11 14:38:10,515 ERROR nodepool.NodeLauncher:   Traceback (most recent call last):
2026-06-11T10:38:10.516364852-04:00 stdout F 2026-06-11 14:38:10,515 ERROR nodepool.NodeLauncher:     File "/usr/local/lib/python3.11/site-packages/nodepool/driver/openshift/handler.py", line 69, in launch
2026-06-11T10:38:10.516364852-04:00 stdout F 2026-06-11 14:38:10,515 ERROR nodepool.NodeLauncher:       self._launchLabel()
2026-06-11T10:38:10.516364852-04:00 stdout F 2026-06-11 14:38:10,515 ERROR nodepool.NodeLauncher:     File "/usr/local/lib/python3.11/site-packages/nodepool/driver/openshiftpods/handler.py", line 29, in _launchLabel
2026-06-11T10:38:10.516364852-04:00 stdout F 2026-06-11 14:38:10,515 ERROR nodepool.NodeLauncher:       self.handler.manager.createPod(self.node, self.handler.pool.name,
2026-06-11T10:38:10.516364852-04:00 stdout F 2026-06-11 14:38:10,515 ERROR nodepool.NodeLauncher:     File "/usr/local/lib/python3.11/site-packages/nodepool/driver/openshift/provider.py", line 231, in createPod
2026-06-11T10:38:10.516364852-04:00 stdout F 2026-06-11 14:38:10,515 ERROR nodepool.NodeLauncher:       self.k8s_client.create_namespaced_pod(project, pod_body)
2026-06-11T10:38:10.516364852-04:00 stdout F 2026-06-11 14:38:10,515 ERROR nodepool.NodeLauncher:       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-06-11T10:38:10.516364852-04:00 stdout F 2026-06-11 14:38:10,515 ERROR nodepool.NodeLauncher:   AttributeError: 'NoneType' object has no attribute 'create_namespaced_pod'
2026-06-11T10:38:10.518360683-04:00 stdout F 2026-06-11 14:38:10,516 ERROR nodepool.NodeLauncher: [e: aecb58c3bcd04f04b141580815d76ebb] [node_request: 200-0000000000] [node: 0000000000] Launch failed for node 0000000000: tenant=demo-tenant label=['zuul-worker-sf-operator-ci-sxtugz69'] hostname=None
2026-06-11T10:38:10.518360683-04:00 stdout F 2026-06-11 14:38:10,516 ERROR nodepool.NodeLauncher:   Traceback (most recent call last):
2026-06-11T10:38:10.518360683-04:00 stdout F 2026-06-11 14:38:10,516 ERROR nodepool.NodeLauncher:     File "/usr/local/lib/python3.11/site-packages/nodepool/driver/utils.py", line 78, in run
2026-06-11T10:38:10.518360683-04:00 stdout F 2026-06-11 14:38:10,516 ERROR nodepool.NodeLauncher:       self.launch()
2026-06-11T10:38:10.518360683-04:00 stdout F 2026-06-11 14:38:10,516 ERROR nodepool.NodeLauncher:     File "/usr/local/lib/python3.11/site-packages/nodepool/driver/openshift/handler.py", line 69, in launch
2026-06-11T10:38:10.518360683-04:00 stdout F 2026-06-11 14:38:10,516 ERROR nodepool.NodeLauncher:       self._launchLabel()
2026-06-11T10:38:10.518360683-04:00 stdout F 2026-06-11 14:38:10,516 ERROR nodepool.NodeLauncher:     File "/usr/local/lib/python3.11/site-packages/nodepool/driver/openshiftpods/handler.py", line 29, in _launchLabel
2026-06-11T10:38:10.518360683-04:00 stdout F 2026-06-11 14:38:10,516 ERROR nodepool.NodeLauncher:       self.handler.manager.createPod(self.node, self.handler.pool.name,
2026-06-11T10:38:10.518360683-04:00 stdout F 2026-06-11 14:38:10,516 ERROR nodepool.NodeLauncher:     File "/usr/local/lib/python3.11/site-packages/nodepool/driver/openshift/provider.py", line 231, in createPod
2026-06-11T10:38:10.518360683-04:00 stdout F 2026-06-11 14:38:10,516 ERROR nodepool.NodeLauncher:       self.k8s_client.create_namespaced_pod(project, pod_body)
2026-06-11T10:38:10.518360683-04:00 stdout F 2026-06-11 14:38:10,516 ERROR nodepool.NodeLauncher:       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-06-11T10:38:10.518360683-04:00 stdout F 2026-06-11 14:38:10,516 ERROR nodepool.NodeLauncher:   AttributeError: 'NoneType' object has no attribute 'create_namespaced_pod'
2026-06-11T10:38:16.432435107-04:00 stdout F 2026-06-11 14:38:16,432 INFO nodepool.DeletedNodeWorker: Deleting failed instance None from microshiftLocal
2026-06-11T10:38:16.440609021-04:00 stdout F 2026-06-11 14:38:16,440 INFO nodepool.NodeDeleter: Deleting ZK node id=0000000000, state=deleting, external_id=None
2026-06-11T10:49:14.157964060-04:00 stdout F 2026-06-11 14:49:14,157 INFO paste.httpserver.ThreadPool: kill_hung_threads status: 10 threads (0 working, 10 idle, 0 starting) ave time N/A, max time 0.00sec, killed 0 workers