2026-06-11 10:31:25.681972 | Job console starting 2026-06-11 10:31:25.784807 | Updating git repos 2026-06-11 10:31:25.817002 | Cloning repos into workspace 2026-06-11 10:31:26.321201 | Restoring repo states 2026-06-11 10:31:26.332311 | Merging changes 2026-06-11 10:31:27.344331 | Checking out repos 2026-06-11 10:31:27.453404 | Preparing playbooks 2026-06-11 10:31:31.649019 | Running Ansible setup 2026-06-11 10:31:35.319689 | PRE-RUN START: [trusted : softwarefactory-project.io/config/playbooks/base/pre.yaml@master] 2026-06-11 10:31:35.891927 | 2026-06-11 10:31:35.892026 | PLAY [localhost] 2026-06-11 10:31:35.899151 | 2026-06-11 10:31:35.899234 | TASK [Gathering Facts] 2026-06-11 10:31:36.870867 | localhost | ok 2026-06-11 10:31:36.885319 | 2026-06-11 10:31:36.885511 | TASK [Setup log path fact] 2026-06-11 10:31:36.918045 | localhost | ok 2026-06-11 10:31:36.939422 | 2026-06-11 10:31:36.939560 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-06-11 10:31:36.983264 | localhost | ok 2026-06-11 10:31:36.996023 | 2026-06-11 10:31:36.996160 | TASK [emit-job-header : Print job information] 2026-06-11 10:31:37.038502 | # Job Information 2026-06-11 10:31:37.038755 | Ansible Version: 2.16.18 2026-06-11 10:31:37.038822 | Job: sf-infra-grafana-dashboards 2026-06-11 10:31:37.038866 | Pipeline: check 2026-06-11 10:31:37.038905 | Executor: 38.102.83.51 2026-06-11 10:31:37.038944 | Triggered by: https://softwarefactory-project.io/r/c/software-factory/sf-infra/+/35217 2026-06-11 10:31:37.038992 | Log URL (when completed): https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/logs/2cd/local/2cd542bc0fd44a9ca268e05bb952d1a9/ 2026-06-11 10:31:37.039033 | Event ID: de92ac2f15e042a0aa98ef05ca6a2b4b 2026-06-11 10:31:37.044325 | 2026-06-11 10:31:37.044484 | LOOP [emit-job-header : Print node information] 2026-06-11 10:31:37.153340 | localhost | ok: 2026-06-11 10:31:37.153828 | localhost | # Node Information 2026-06-11 10:31:37.153893 | localhost | Inventory Hostname: primary 2026-06-11 10:31:37.153935 | localhost | Hostname: np0000070602 2026-06-11 10:31:37.153975 | localhost | Username: zuul-worker 2026-06-11 10:31:37.154020 | localhost | Distro: CentOS 9 2026-06-11 10:31:37.154069 | localhost | Provider: vexxhost-nodepool-sf 2026-06-11 10:31:37.154122 | localhost | Region: RegionOne 2026-06-11 10:31:37.154161 | localhost | Label: cloud-centos-9-stream 2026-06-11 10:31:37.154198 | localhost | Product Name: OpenStack Nova 2026-06-11 10:31:37.154234 | localhost | Interface IP: 38.102.83.115 2026-06-11 10:31:37.174891 | 2026-06-11 10:31:37.175054 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-06-11 10:31:37.607792 | localhost -> localhost | changed 2026-06-11 10:31:37.617444 | 2026-06-11 10:31:37.617581 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-06-11 10:31:38.666640 | localhost -> localhost | changed 2026-06-11 10:31:38.672458 | 2026-06-11 10:31:38.672515 | PLAY [all] 2026-06-11 10:31:38.677795 | 2026-06-11 10:31:38.677854 | TASK [include_role : start-zuul-console] 2026-06-11 10:31:38.695323 | primary | ok 2026-06-11 10:31:38.704913 | 2026-06-11 10:31:38.704976 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-06-11 10:31:39.132992 | primary | ok 2026-06-11 10:31:39.151308 | 2026-06-11 10:31:39.151471 | TASK [include_role : validate-host] 2026-06-11 10:31:39.174204 | primary | ok 2026-06-11 10:31:39.210308 | 2026-06-11 10:31:39.210465 | TASK [validate-host : Define zuul_info_dir fact] 2026-06-11 10:31:39.254114 | primary | ok 2026-06-11 10:31:39.261881 | 2026-06-11 10:31:39.262002 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-06-11 10:31:39.550996 | primary -> localhost | ok 2026-06-11 10:31:39.560720 | 2026-06-11 10:31:39.560802 | TASK [validate-host : Collect information about the host] 2026-06-11 10:31:40.273574 | primary | ok 2026-06-11 10:31:40.291293 | 2026-06-11 10:31:40.291464 | TASK [validate-host : Sanitize hostname] 2026-06-11 10:31:40.377777 | primary | ok 2026-06-11 10:31:40.386784 | 2026-06-11 10:31:40.386928 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-06-11 10:31:41.003394 | primary -> localhost | changed 2026-06-11 10:31:41.012970 | 2026-06-11 10:31:41.013128 | TASK [validate-host : Collect information about zuul worker] 2026-06-11 10:31:41.440895 | primary | ok 2026-06-11 10:31:41.450411 | 2026-06-11 10:31:41.450543 | TASK [validate-host : Write out all zuul information for each host] 2026-06-11 10:31:41.926028 | primary -> localhost | changed 2026-06-11 10:31:41.940409 | 2026-06-11 10:31:41.940529 | TASK [include_role : prepare-workspace] 2026-06-11 10:31:41.973067 | primary | ok 2026-06-11 10:31:42.006104 | 2026-06-11 10:31:42.006204 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-06-11 10:31:42.269805 | primary | ok 2026-06-11 10:31:42.277818 | 2026-06-11 10:31:42.277951 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-06-11 10:31:43.532422 | primary | Output suppressed because no_log was given 2026-06-11 10:31:43.537789 | 2026-06-11 10:31:43.537847 | TASK [include_role : add-build-sshkey] 2026-06-11 10:31:43.556335 | primary | ok 2026-06-11 10:31:43.572774 | 2026-06-11 10:31:43.572841 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-06-11 10:31:43.859587 | primary -> localhost | ok 2026-06-11 10:31:43.865504 | 2026-06-11 10:31:43.865595 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-06-11 10:31:43.904824 | primary | ok 2026-06-11 10:31:43.920885 | primary | included: /var/lib/zuul/builds/2cd542bc0fd44a9ca268e05bb952d1a9/trusted/project_2/softwarefactory-project.io/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-06-11 10:31:43.926713 | 2026-06-11 10:31:43.926798 | TASK [add-build-sshkey : Create Temp SSH key] 2026-06-11 10:31:44.569601 | primary -> localhost | Generating public/private rsa key pair. 2026-06-11 10:31:44.569913 | primary -> localhost | Your identification has been saved in /var/lib/zuul/builds/2cd542bc0fd44a9ca268e05bb952d1a9/work/2cd542bc0fd44a9ca268e05bb952d1a9_id_rsa 2026-06-11 10:31:44.569971 | primary -> localhost | Your public key has been saved in /var/lib/zuul/builds/2cd542bc0fd44a9ca268e05bb952d1a9/work/2cd542bc0fd44a9ca268e05bb952d1a9_id_rsa.pub 2026-06-11 10:31:44.570015 | primary -> localhost | The key fingerprint is: 2026-06-11 10:31:44.570056 | primary -> localhost | SHA256:b9pU6NJAR1LIPfiscZ6aeHrB+gzNxXxgLY6X+UFtpD4 zuul-build-sshkey 2026-06-11 10:31:44.570097 | primary -> localhost | The key's randomart image is: 2026-06-11 10:31:44.570136 | primary -> localhost | +---[RSA 3072]----+ 2026-06-11 10:31:44.570176 | primary -> localhost | | ..=o . | 2026-06-11 10:31:44.570215 | primary -> localhost | | +oo. + | 2026-06-11 10:31:44.570253 | primary -> localhost | | .o=.+ o | 2026-06-11 10:31:44.570442 | primary -> localhost | | ..B+O . | 2026-06-11 10:31:44.570496 | primary -> localhost | | .S=X.E | 2026-06-11 10:31:44.570535 | primary -> localhost | | o+Bo+ o | 2026-06-11 10:31:44.570572 | primary -> localhost | | .o++* . | 2026-06-11 10:31:44.570610 | primary -> localhost | | oo=* | 2026-06-11 10:31:44.570647 | primary -> localhost | | .=+ . | 2026-06-11 10:31:44.570683 | primary -> localhost | +----[SHA256]-----+ 2026-06-11 10:31:44.570768 | primary -> localhost | ok: Runtime: 0:00:00.151550 2026-06-11 10:31:44.578245 | 2026-06-11 10:31:44.578419 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-06-11 10:31:44.615579 | primary | ok 2026-06-11 10:31:44.630896 | primary | included: /var/lib/zuul/builds/2cd542bc0fd44a9ca268e05bb952d1a9/trusted/project_2/softwarefactory-project.io/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-06-11 10:31:44.646703 | 2026-06-11 10:31:44.646825 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-06-11 10:31:44.682430 | primary | skipping: Conditional result was False 2026-06-11 10:31:44.690340 | 2026-06-11 10:31:44.690497 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-06-11 10:31:45.156103 | primary | changed 2026-06-11 10:31:45.160873 | 2026-06-11 10:31:45.160955 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-06-11 10:31:45.436824 | primary | ok 2026-06-11 10:31:45.446633 | 2026-06-11 10:31:45.446792 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-06-11 10:31:46.239156 | primary | changed 2026-06-11 10:31:46.243581 | 2026-06-11 10:31:46.243663 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-06-11 10:31:47.035684 | primary | changed 2026-06-11 10:31:47.043784 | 2026-06-11 10:31:47.043916 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-06-11 10:31:47.070968 | primary | skipping: Conditional result was False 2026-06-11 10:31:47.079283 | 2026-06-11 10:31:47.080332 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-06-11 10:31:47.595778 | primary -> localhost | changed 2026-06-11 10:31:47.612788 | 2026-06-11 10:31:47.612983 | TASK [add-build-sshkey : Add back temp key] 2026-06-11 10:31:47.952023 | primary -> localhost | Identity added: /var/lib/zuul/builds/2cd542bc0fd44a9ca268e05bb952d1a9/work/2cd542bc0fd44a9ca268e05bb952d1a9_id_rsa (zuul-build-sshkey) 2026-06-11 10:31:47.952390 | primary -> localhost | ok: Runtime: 0:00:00.017733 2026-06-11 10:31:47.960080 | 2026-06-11 10:31:47.960265 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-06-11 10:31:48.328817 | primary | ok 2026-06-11 10:31:48.336052 | 2026-06-11 10:31:48.336272 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-06-11 10:31:48.374298 | primary | skipping: Conditional result was False 2026-06-11 10:31:48.387896 | 2026-06-11 10:31:48.388025 | TASK [include_role : prepare-workspace-openshift] 2026-06-11 10:31:48.416420 | primary | skipping: Conditional result was False 2026-06-11 10:31:48.425236 | 2026-06-11 10:31:48.425397 | TASK [include_role : remove-zuul-sshkey] 2026-06-11 10:31:48.452661 | primary | skipping: Conditional result was False 2026-06-11 10:31:48.462331 | 2026-06-11 10:31:48.462495 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-06-11 10:31:48.733677 | primary | ok: "logs" 2026-06-11 10:31:48.733974 | primary | ok: All items complete 2026-06-11 10:31:48.734009 | 2026-06-11 10:31:48.943001 | primary | ok: "artifacts" 2026-06-11 10:31:49.161322 | primary | ok: "docs" 2026-06-11 10:31:49.208964 | 2026-06-11 10:31:49.209117 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-06-11 10:31:49.498522 | primary | changed: "logs" 2026-06-11 10:31:49.727825 | primary | changed: "artifacts" 2026-06-11 10:31:49.954401 | primary | changed: "docs" 2026-06-11 10:31:49.978586 | 2026-06-11 10:31:49.978798 | TASK [include_role : rhel-registration] 2026-06-11 10:31:49.996030 | primary | skipping: Conditional result was False 2026-06-11 10:31:49.999225 | 2026-06-11 10:31:49.999322 | PLAY RECAP 2026-06-11 10:31:49.999579 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-06-11 10:31:49.999697 | primary | ok: 23 changed: 10 unreachable: 0 failed: 0 skipped: 6 rescued: 0 ignored: 0 2026-06-11 10:31:49.999757 | 2026-06-11 10:31:50.187406 | PRE-RUN END RESULT_NORMAL: [trusted : softwarefactory-project.io/config/playbooks/base/pre.yaml@master] 2026-06-11 10:31:50.189093 | RUN START: [untrusted : softwarefactory-project.io/software-factory/sf-infra/tests/grafana.yaml@master] 2026-06-11 10:31:50.771025 | 2026-06-11 10:31:50.771136 | PLAY [Check Grafana dashboards] 2026-06-11 10:31:50.781325 | 2026-06-11 10:31:50.781419 | TASK [Read monitoring host variables to get Grafana container_images value] 2026-06-11 10:31:50.844121 | primary | ok 2026-06-11 10:31:50.853681 | 2026-06-11 10:31:50.853826 | TASK [Read group_vars monitoring file] 2026-06-11 10:31:50.923952 | primary | ok 2026-06-11 10:31:50.943107 | 2026-06-11 10:31:50.943238 | TASK [Setup Grafana] 2026-06-11 10:31:50.989455 | primary | ok 2026-06-11 10:31:51.029221 | 2026-06-11 10:31:51.029335 | LOOP [grafana : Create host directories] 2026-06-11 10:31:51.534515 | primary | changed: 2026-06-11 10:31:51.534868 | primary | { 2026-06-11 10:31:51.534942 | primary | "path": "/etc/grafana/provisioning/datasources" 2026-06-11 10:31:51.535062 | primary | } 2026-06-11 10:31:51.821687 | primary | changed: 2026-06-11 10:31:51.821845 | primary | { 2026-06-11 10:31:51.821901 | primary | "path": "/etc/grafana/provisioning/dashboards" 2026-06-11 10:31:51.821942 | primary | } 2026-06-11 10:31:52.093218 | primary | changed: 2026-06-11 10:31:52.093425 | primary | { 2026-06-11 10:31:52.093490 | primary | "path": "/etc/grafana/secrets" 2026-06-11 10:31:52.093541 | primary | } 2026-06-11 10:31:52.365292 | primary | changed: 2026-06-11 10:31:52.365509 | primary | { 2026-06-11 10:31:52.365562 | primary | "owner": 472, 2026-06-11 10:31:52.365601 | primary | "path": "/var/lib/grafana" 2026-06-11 10:31:52.365639 | primary | } 2026-06-11 10:31:52.381202 | 2026-06-11 10:31:52.381439 | TASK [grafana : Install main dashboard configuration file] 2026-06-11 10:31:53.558293 | primary | changed 2026-06-11 10:31:53.571874 | 2026-06-11 10:31:53.572416 | LOOP [grafana : Install dashboards] 2026-06-11 10:31:59.784401 | primary | changed: "infra" 2026-06-11 10:31:59.784839 | primary | changed: All items complete 2026-06-11 10:31:59.784897 | 2026-06-11 10:32:13.594901 | primary | changed: "ng-ci-dashboard" 2026-06-11 10:32:20.355849 | primary | changed: "osp-ci" 2026-06-11 10:32:21.116046 | primary | changed: "opendev" 2026-06-11 10:32:23.008854 | primary | changed: "vexxhost" 2026-06-11 10:32:24.318232 | primary | changed: "RDO" 2026-06-11 10:32:24.337226 | 2026-06-11 10:32:24.337501 | TASK [grafana : Find jsonnetfile.json files] 2026-06-11 10:32:24.777882 | primary | ok: All paths examined 2026-06-11 10:32:24.792289 | 2026-06-11 10:32:24.792463 | LOOP [grafana : Remove jsonnetfile.json] 2026-06-11 10:32:25.063104 | primary | changed: 2026-06-11 10:32:25.063673 | primary | { 2026-06-11 10:32:25.063748 | primary | "atime": 1781173932.3157222, 2026-06-11 10:32:25.063795 | primary | "ctime": 1781173932.3187222, 2026-06-11 10:32:25.063840 | primary | "dev": 64513, 2026-06-11 10:32:25.063885 | primary | "gid": 0, 2026-06-11 10:32:25.063928 | primary | "gr_name": "root", 2026-06-11 10:32:25.063970 | primary | "inode": 67109151, 2026-06-11 10:32:25.064013 | primary | "isblk": false, 2026-06-11 10:32:25.064058 | primary | "ischr": false, 2026-06-11 10:32:25.064103 | primary | "isdir": false, 2026-06-11 10:32:25.064141 | primary | "isfifo": false, 2026-06-11 10:32:25.064183 | primary | "isgid": false, 2026-06-11 10:32:25.064221 | primary | "islnk": false, 2026-06-11 10:32:25.064262 | primary | "isreg": true, 2026-06-11 10:32:25.064298 | primary | "issock": false, 2026-06-11 10:32:25.064385 | primary | "isuid": false, 2026-06-11 10:32:25.064447 | primary | "mode": "0644", 2026-06-11 10:32:25.064587 | primary | "mtime": 1781173932.0617123, 2026-06-11 10:32:25.064633 | primary | "nlink": 1, 2026-06-11 10:32:25.064667 | primary | "path": "/etc/grafana/provisioning/dashboards/ng-ci-dashboard/jsonnet/jsonnetfile.json", 2026-06-11 10:32:25.064700 | primary | "pw_name": "root", 2026-06-11 10:32:25.064732 | primary | "rgrp": true, 2026-06-11 10:32:25.064763 | primary | "roth": true, 2026-06-11 10:32:25.064794 | primary | "rusr": true, 2026-06-11 10:32:25.064826 | primary | "size": 266, 2026-06-11 10:32:25.064857 | primary | "uid": 0, 2026-06-11 10:32:25.064889 | primary | "wgrp": false, 2026-06-11 10:32:25.064921 | primary | "woth": false, 2026-06-11 10:32:25.064953 | primary | "wusr": true, 2026-06-11 10:32:25.064985 | primary | "xgrp": false, 2026-06-11 10:32:25.065016 | primary | "xoth": false, 2026-06-11 10:32:25.065046 | primary | "xusr": false 2026-06-11 10:32:25.065077 | primary | } 2026-06-11 10:32:25.301392 | primary | changed: 2026-06-11 10:32:25.301595 | primary | { 2026-06-11 10:32:25.301642 | primary | "atime": 1781173938.8829813, 2026-06-11 10:32:25.301680 | primary | "ctime": 1781173938.8879817, 2026-06-11 10:32:25.301736 | primary | "dev": 64513, 2026-06-11 10:32:25.301771 | primary | "gid": 0, 2026-06-11 10:32:25.301804 | primary | "gr_name": "root", 2026-06-11 10:32:25.301836 | primary | "inode": 20971758, 2026-06-11 10:32:25.301868 | primary | "isblk": false, 2026-06-11 10:32:25.301900 | primary | "ischr": false, 2026-06-11 10:32:25.302079 | primary | "isdir": false, 2026-06-11 10:32:25.302118 | primary | "isfifo": false, 2026-06-11 10:32:25.302152 | primary | "isgid": false, 2026-06-11 10:32:25.302184 | primary | "islnk": false, 2026-06-11 10:32:25.302216 | primary | "isreg": true, 2026-06-11 10:32:25.302247 | primary | "issock": false, 2026-06-11 10:32:25.302279 | primary | "isuid": false, 2026-06-11 10:32:25.302310 | primary | "mode": "0644", 2026-06-11 10:32:25.302341 | primary | "mtime": 1781173938.6039703, 2026-06-11 10:32:25.302409 | primary | "nlink": 1, 2026-06-11 10:32:25.302443 | primary | "path": "/etc/grafana/provisioning/dashboards/osp-ci/jsonnet/jsonnetfile.json", 2026-06-11 10:32:25.302476 | primary | "pw_name": "root", 2026-06-11 10:32:25.302508 | primary | "rgrp": true, 2026-06-11 10:32:25.302539 | primary | "roth": true, 2026-06-11 10:32:25.302571 | primary | "rusr": true, 2026-06-11 10:32:25.302601 | primary | "size": 267, 2026-06-11 10:32:25.302632 | primary | "uid": 0, 2026-06-11 10:32:25.302663 | primary | "wgrp": false, 2026-06-11 10:32:25.302694 | primary | "woth": false, 2026-06-11 10:32:25.302725 | primary | "wusr": true, 2026-06-11 10:32:25.302756 | primary | "xgrp": false, 2026-06-11 10:32:25.302786 | primary | "xoth": false, 2026-06-11 10:32:25.302817 | primary | "xusr": false 2026-06-11 10:32:25.302849 | primary | } 2026-06-11 10:32:25.321794 | 2026-06-11 10:32:25.322034 | TASK [grafana : Fail when there is no datasource] 2026-06-11 10:32:25.409871 | primary | skipping: Conditional result was False 2026-06-11 10:32:25.420265 | 2026-06-11 10:32:25.420433 | LOOP [grafana : Install config templates] 2026-06-11 10:32:27.079907 | primary | Output suppressed because no_log was given 2026-06-11 10:32:27.096846 | 2026-06-11 10:32:27.097002 | TASK [grafana : Create admin secret file] 2026-06-11 10:32:27.166718 | primary | skipping: Conditional result was False 2026-06-11 10:32:27.176694 | 2026-06-11 10:32:27.176836 | TASK [grafana : Create admin user file] 2026-06-11 10:32:27.235462 | primary | skipping: Conditional result was False 2026-06-11 10:32:27.244503 | 2026-06-11 10:32:27.244638 | TASK [ansible.builtin.include_role : service/container] 2026-06-11 10:32:27.276159 | primary | ok 2026-06-11 10:32:27.300949 | 2026-06-11 10:32:27.301028 | TASK [service/container : Ensure podman is installed] 2026-06-11 10:33:14.958085 | primary | changed 2026-06-11 10:33:14.964645 | 2026-06-11 10:33:14.964729 | TASK [service/container : Check if container exists] 2026-06-11 10:33:16.000233 | primary | ok: Runtime: 0:00:00.143340 2026-06-11 10:33:16.008512 | 2026-06-11 10:33:16.008640 | TASK [service/container : Write a recreation script] 2026-06-11 10:33:16.856092 | primary | changed 2026-06-11 10:33:16.865493 | 2026-06-11 10:33:16.865631 | TASK [service/container : Stop the service before recreation] 2026-06-11 10:33:16.914962 | primary | skipping: Conditional result was False 2026-06-11 10:33:16.924492 | 2026-06-11 10:33:16.924635 | TASK [service/container : Delete the old container] 2026-06-11 10:33:17.461424 | primary | skipping: Conditional result was False 2026-06-11 10:33:17.472663 | 2026-06-11 10:33:17.472814 | TASK [service/container : Create container if needed] 2026-06-11 06:33:17.854489 | primary | Trying to pull docker.io/grafana/grafana:latest... 2026-06-11 06:33:18.244954 | primary | Getting image source signatures 2026-06-11 06:33:18.245294 | primary | Copying blob sha256:ae2bb398229f2913844b687a99c4008b94db89cc08e364e9915216ca2e0be8df 2026-06-11 06:33:18.245331 | primary | Copying blob sha256:74d8a3a790841a2baf283376ff320637251cd73b5fe1cec6fbbfdda03d4ff184 2026-06-11 06:33:18.245342 | primary | Copying blob sha256:01af952bd5a9c8a62f718134e36732a840139805526c5d5fd74c3589322c493f 2026-06-11 06:33:18.245385 | primary | Copying blob sha256:6513f998b3a15e56e45001df003639dd465eda469c383a86ac0c6fc44e3803c6 2026-06-11 06:33:18.245403 | primary | Copying blob sha256:6a0ac1617861a677b045b7ff88545213ec31c0ff08763195a70a4a5adda577bb 2026-06-11 06:33:18.245416 | primary | Copying blob sha256:38e67c1f799cfc60cfda99c2bc519b5b9ab54783bfe35a0c3a17ab9f4a5dbb52 2026-06-11 06:33:18.293356 | primary | Copying blob sha256:413bf89f4b8ed2880e82639fe97e2a85152272937feb2486c18ec967f8e3a0d7 2026-06-11 06:33:18.337099 | primary | Copying blob sha256:d4c060f3b932ea36fbfc9b5b0b0724fe46d57a99163e8f0863fc3da9340bc842 2026-06-11 06:33:18.351764 | primary | Copying blob sha256:a3e1ec1858e33393e4b4c0153e6a1801ac9afd6230b8c788747578d6ec505b8b 2026-06-11 06:33:18.398903 | primary | Copying blob sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1 2026-06-11 06:33:18.435443 | primary | Copying blob sha256:b508b56b15dd74159a527878122069a706ed7a21022f802ff7e4500305758743 2026-06-11 06:33:31.124014 | primary | Copying config sha256:072d3db0101e9fa5776fa9c454d8221994aeedf43e9abebe6652f42bf19bdc59 2026-06-11 06:33:31.132916 | primary | Writing manifest to image destination 2026-06-11 06:33:31.209179 | primary | 9bf5dfd532832fc9203757f6486dc2080c7f7623f9a7f233e4b16cc198c356bc 2026-06-11 10:33:31.531585 | primary | ok: Runtime: 0:00:13.410541 2026-06-11 10:33:31.540752 | 2026-06-11 10:33:31.540886 | TASK [service/container : Install service file] 2026-06-11 10:33:32.430199 | primary | changed 2026-06-11 10:33:32.439859 | 2026-06-11 10:33:32.439987 | TASK [service/container : Enable the service] 2026-06-11 10:33:33.626503 | primary | changed 2026-06-11 10:33:33.640821 | 2026-06-11 10:33:33.640994 | TASK [service/container : Restart the service if needed] 2026-06-11 10:33:34.910902 | primary | changed 2026-06-11 10:33:34.920628 | 2026-06-11 10:33:34.920713 | TASK [service/container : Ensure service is active] 2026-06-11 06:33:35.223222 | primary | active 2026-06-11 10:33:35.459318 | primary | ok: Runtime: 0:00:00.013513 2026-06-11 10:33:35.486775 | 2026-06-11 10:33:35.487118 | TASK [Run Grafana tests] 2026-06-11 10:33:35.537325 | primary | ok 2026-06-11 10:33:35.581604 | 2026-06-11 10:33:35.581812 | TASK [grafana : Configure environment] 2026-06-11 10:33:35.624426 | primary | ok 2026-06-11 10:33:35.678691 | primary | included: /var/lib/zuul/builds/2cd542bc0fd44a9ca268e05bb952d1a9/work/src/softwarefactory-project.io/software-factory/sf-infra/roles/tests/grafana/tasks/pre-grafana-dash.yaml 2026-06-11 10:33:35.683547 | 2026-06-11 10:33:35.683628 | TASK [Create grafana-image-renderer container] 2026-06-11 10:33:35.723599 | primary | ok 2026-06-11 10:33:35.745271 | 2026-06-11 10:33:35.745400 | TASK [service/container : Ensure podman is installed] 2026-06-11 10:33:36.608841 | primary | ok: Nothing to do 2026-06-11 10:33:36.618175 | 2026-06-11 10:33:36.618307 | TASK [service/container : Check if container exists] 2026-06-11 10:33:37.162943 | primary | ok: Runtime: 0:00:00.042031 2026-06-11 10:33:37.168577 | 2026-06-11 10:33:37.168659 | TASK [service/container : Write a recreation script] 2026-06-11 10:33:37.982616 | primary | changed 2026-06-11 10:33:37.994666 | 2026-06-11 10:33:37.994804 | TASK [service/container : Stop the service before recreation] 2026-06-11 10:33:38.042613 | primary | skipping: Conditional result was False 2026-06-11 10:33:38.053470 | 2026-06-11 10:33:38.053676 | TASK [service/container : Delete the old container] 2026-06-11 10:33:38.597129 | primary | skipping: Conditional result was False 2026-06-11 10:33:38.608167 | 2026-06-11 10:33:38.608309 | TASK [service/container : Create container if needed] 2026-06-11 06:33:38.991723 | primary | Trying to pull docker.io/grafana/grafana-image-renderer:latest... 2026-06-11 06:33:39.372470 | primary | Getting image source signatures 2026-06-11 06:33:39.372750 | primary | Copying blob sha256:81914e81f68cb064e507b1c15dbc0f041a7c7b73984dc14e39734d8281db12b2 2026-06-11 06:33:39.372765 | primary | Copying blob sha256:7741c53350e52e992f1eac375771920ed11924cfdd409423b5d3121cef0749cb 2026-06-11 06:33:39.372777 | primary | Copying blob sha256:b06d22562d7f847d7a5878d80a93ac332f027eb490466c2042150460fcc2fb58 2026-06-11 06:33:39.372815 | primary | Copying blob sha256:a09371a3282e4e4946957060029b4e23eefd9e049f6818c7546225e4353bf546 2026-06-11 06:33:39.372828 | primary | Copying blob sha256:bd0d131c22266de0ee490d6b52156567b05b6f10270149adcf9c25d123216887 2026-06-11 06:33:39.372839 | primary | Copying blob sha256:f9d034de2792464556344c192af1a4784c128416259c5457c49f93dc31751ae0 2026-06-11 06:33:39.414711 | primary | Copying blob sha256:74a4497de2a73161e5a32b4950f252b7d943a2c1badaf29a1422d83aac4edb1c 2026-06-11 06:33:39.470753 | primary | Copying blob sha256:06fbec25c97f00bc7ddf64b53bbb44e73564d34cfafaeb1452c57a77b94d9e3e 2026-06-11 06:33:39.500961 | primary | Copying blob sha256:b3c8cd810d5c0ffc11acea397233a5bfedc2cb28f21bb1482e91a932b71f2d66 2026-06-11 06:33:39.559852 | primary | Copying blob sha256:5364ef36fbfb5a3e9641fac913bc844c650b1d732e13635cbc6ecfe001b25136 2026-06-11 06:33:39.571171 | primary | Copying blob sha256:bd95634ab74e5d948928b7fb9c8762b4e57e8f585815b36e8e17258499b6de56 2026-06-11 06:33:39.607649 | primary | Copying blob sha256:93e4b09b6aec053d529c84c768b84938c4be34f2f0a62e7decf9fcda3bd9679b 2026-06-11 06:33:39.619416 | primary | Copying blob sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1 2026-06-11 06:33:39.619558 | primary | Copying blob sha256:1a4767203dcd7f7813aef481973d9d54a21f93c5406bf78cc8b3f34a0eaf1ca6 2026-06-11 06:33:52.941706 | primary | Copying config sha256:463e768ca623c6e26e06992aaf8a0a3c12b907060e10943a28d39165e8a6bfba 2026-06-11 06:33:52.951376 | primary | Writing manifest to image destination 2026-06-11 06:33:53.077945 | primary | 985a8f48dfabf6ca2aea7fc709cbb31bf3497fd611f223863f881849bdb42de3 2026-06-11 10:33:53.183396 | primary | ok: Runtime: 0:00:14.126051 2026-06-11 10:33:53.192378 | 2026-06-11 10:33:53.192517 | TASK [service/container : Install service file] 2026-06-11 10:33:54.043221 | primary | changed 2026-06-11 10:33:54.054917 | 2026-06-11 10:33:54.055068 | TASK [service/container : Enable the service] 2026-06-11 10:33:54.905772 | primary | changed 2026-06-11 10:33:54.919652 | 2026-06-11 10:33:54.919834 | TASK [service/container : Restart the service if needed] 2026-06-11 10:33:54.965991 | primary | skipping: Conditional result was False 2026-06-11 10:33:54.974483 | 2026-06-11 10:33:54.974582 | TASK [service/container : Ensure service is active] 2026-06-11 06:33:55.273191 | primary | active 2026-06-11 10:33:55.510569 | primary | ok: Runtime: 0:00:00.013264 2026-06-11 10:33:55.559454 | 2026-06-11 10:33:55.559692 | LOOP [grafana : Change settings in Grafana ini - server url] 2026-06-11 10:33:56.051946 | primary | changed: option added 2026-06-11 10:33:56.052282 | primary | changed: All items complete 2026-06-11 10:33:56.052320 | 2026-06-11 10:33:56.301785 | primary | changed: option added 2026-06-11 10:33:56.316616 | 2026-06-11 10:33:56.316749 | TASK [grafana : Restart Grafana] 2026-06-11 10:33:57.421032 | primary | changed 2026-06-11 10:33:57.435901 | 2026-06-11 10:33:57.436061 | TASK [grafana : Start grafana-image-renderer service] 2026-06-11 10:33:58.144682 | primary | changed 2026-06-11 10:33:58.159529 | 2026-06-11 10:33:58.159671 | TASK [grafana : Run tests] 2026-06-11 10:33:58.201938 | primary | ok 2026-06-11 10:33:58.211546 | primary | included: /var/lib/zuul/builds/2cd542bc0fd44a9ca268e05bb952d1a9/work/src/softwarefactory-project.io/software-factory/sf-infra/roles/tests/grafana/tasks/grafana-dash.yaml 2026-06-11 10:33:58.219236 | 2026-06-11 10:33:58.219317 | TASK [grafana : Create log directory] 2026-06-11 10:33:58.496444 | primary | changed 2026-06-11 10:33:58.505508 | 2026-06-11 10:33:58.505642 | LOOP [grafana : Create required dirs for Grafana] 2026-06-11 10:33:58.817644 | primary | ok: "dashboards" 2026-06-11 10:33:59.071841 | primary | ok: "datasources" 2026-06-11 10:33:59.317793 | primary | changed: "plugins" 2026-06-11 10:33:59.335477 | 2026-06-11 10:33:59.335696 | LOOP [grafana : Run tests for Grafana dashboards] 2026-06-11 10:33:59.388250 | primary | ok: "infra" 2026-06-11 10:33:59.388647 | primary | changed: All items complete 2026-06-11 10:33:59.388701 | 2026-06-11 10:33:59.410828 | primary | included: /var/lib/zuul/builds/2cd542bc0fd44a9ca268e05bb952d1a9/work/src/softwarefactory-project.io/software-factory/sf-infra/roles/tests/grafana/tasks/run-tests.yaml 2026-06-11 10:33:59.421850 | 2026-06-11 10:33:59.421983 | TASK [grafana : Get available dashboards] 2026-06-11 10:33:59.965964 | primary | ok: Runtime: 0:00:00.014481 2026-06-11 10:33:59.976976 | 2026-06-11 10:33:59.977120 | LOOP [grafana : Create directories] 2026-06-11 10:34:00.271067 | primary | changed: "/tmp/puppeteer" 2026-06-11 10:34:00.500235 | primary | ok: "/tmp/log" 2026-06-11 10:34:00.516757 | 2026-06-11 10:34:00.516913 | LOOP [grafana : Get screenshots] 2026-06-11 10:34:00.551513 | 2026-06-11 10:34:00.551705 | TASK [Read monitoring host variables to get Grafana container_images value] 2026-06-11 10:34:00.588608 | primary | skipping: Conditional result was False 2026-06-11 10:34:00.599997 | 2026-06-11 10:34:00.600148 | TASK [Read group vars monitoring file] 2026-06-11 10:34:00.637843 | primary | skipping: Conditional result was False 2026-06-11 10:34:00.648131 | 2026-06-11 10:34:00.648283 | TASK [Setup Grafana] 2026-06-11 10:34:00.687431 | primary | skipping: Conditional result was False 2026-06-11 10:34:00.701027 | 2026-06-11 10:34:00.701173 | TASK [Run Grafana tests] 2026-06-11 10:34:00.729676 | primary | skipping: Conditional result was False 2026-06-11 10:34:00.732258 | 2026-06-11 10:34:00.732400 | PLAY RECAP 2026-06-11 10:34:00.732564 | primary | ok: 33 changed: 24 unreachable: 0 failed: 0 skipped: 13 rescued: 0 ignored: 0 2026-06-11 10:34:00.732624 | 2026-06-11 10:34:00.927474 | RUN END RESULT_NORMAL: [untrusted : softwarefactory-project.io/software-factory/sf-infra/tests/grafana.yaml@master] 2026-06-11 10:34:00.929169 | POST-RUN START: [untrusted : softwarefactory-project.io/software-factory/sf-infra/tests/post-grafana-dash.yml@master] 2026-06-11 10:34:01.576835 | 2026-06-11 10:34:01.576966 | PLAY [all] 2026-06-11 10:34:01.586302 | 2026-06-11 10:34:01.586388 | TASK [Copy screenshot files] 2026-06-11 10:34:02.314232 | primary | changed: cd+++++++++ ./ 2026-06-11 10:34:02.316293 | 2026-06-11 10:34:02.316399 | PLAY RECAP 2026-06-11 10:34:02.316466 | primary | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-06-11 10:34:02.316539 | 2026-06-11 10:34:02.437078 | POST-RUN END RESULT_NORMAL: [untrusted : softwarefactory-project.io/software-factory/sf-infra/tests/post-grafana-dash.yml@master] 2026-06-11 10:34:02.439236 | POST-RUN START: [trusted : softwarefactory-project.io/config/playbooks/base/post.yaml@master] 2026-06-11 10:34:03.146247 | 2026-06-11 10:34:03.146392 | PLAY [all] 2026-06-11 10:34:03.156404 | 2026-06-11 10:34:03.156474 | TASK [include_role : fetch-output] 2026-06-11 10:34:03.197093 | primary | ok 2026-06-11 10:34:03.209533 | 2026-06-11 10:34:03.209606 | TASK [fetch-output : Set log path for multiple nodes] 2026-06-11 10:34:03.285970 | primary | skipping: Conditional result was False 2026-06-11 10:34:03.297547 | 2026-06-11 10:34:03.297714 | TASK [fetch-output : Set log path for single node] 2026-06-11 10:34:03.367035 | primary | ok 2026-06-11 10:34:03.375728 | 2026-06-11 10:34:03.375879 | LOOP [fetch-output : Ensure local output dirs] 2026-06-11 10:34:03.857085 | primary -> localhost | changed: "/var/lib/zuul/builds/2cd542bc0fd44a9ca268e05bb952d1a9/work/logs" 2026-06-11 10:34:04.109392 | primary -> localhost | changed: "/var/lib/zuul/builds/2cd542bc0fd44a9ca268e05bb952d1a9/work/artifacts" 2026-06-11 10:34:04.449537 | primary -> localhost | changed: "/var/lib/zuul/builds/2cd542bc0fd44a9ca268e05bb952d1a9/work/docs" 2026-06-11 10:34:04.467282 | 2026-06-11 10:34:04.467550 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-06-11 10:34:05.271287 | primary | changed: .d..t...... ./ 2026-06-11 10:34:05.271881 | primary | changed: All items complete 2026-06-11 10:34:05.271948 | 2026-06-11 10:34:05.841914 | primary | changed: .d..t...... ./ 2026-06-11 10:34:06.413571 | primary | changed: .d..t...... ./ 2026-06-11 10:34:06.437076 | 2026-06-11 10:34:06.437344 | TASK [include_role : fetch-output-openshift] 2026-06-11 10:34:06.465772 | primary | skipping: Conditional result was False 2026-06-11 10:34:06.475872 | 2026-06-11 10:34:06.476031 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-06-11 10:34:06.995500 | primary -> localhost | ok: Item: artifacts Runtime: 0:00:00.014380 2026-06-11 10:34:07.327286 | primary -> localhost | ok: Item: docs Runtime: 0:00:00.013923 2026-06-11 10:34:07.354824 | 2026-06-11 10:34:07.355052 | TASK [include_role : rhel-registration] 2026-06-11 10:34:07.382326 | primary | skipping: Conditional result was False 2026-06-11 10:34:07.387852 | 2026-06-11 10:34:07.387962 | PLAY [localhost] 2026-06-11 10:34:07.400425 | 2026-06-11 10:34:07.400556 | TASK [add-fileserver : Create SSH private key tempfile] 2026-06-11 10:34:07.841502 | localhost | changed 2026-06-11 10:34:07.891551 | 2026-06-11 10:34:07.891715 | TASK [add-fileserver : Create SSH private key from secret] 2026-06-11 10:34:08.694270 | localhost | changed 2026-06-11 10:34:08.703555 | 2026-06-11 10:34:08.703694 | TASK [add-fileserver : Add fileserver ssh key] 2026-06-11 10:34:09.079481 | localhost | Identity added: /var/lib/zuul/builds/2cd542bc0fd44a9ca268e05bb952d1a9/work/tmp/ansible.2t47hzq2 (/var/lib/zuul/builds/2cd542bc0fd44a9ca268e05bb952d1a9/work/tmp/ansible.2t47hzq2) 2026-06-11 10:34:09.079950 | localhost | ok: Runtime: 0:00:00.019722 2026-06-11 10:34:09.087496 | 2026-06-11 10:34:09.087629 | TASK [add-fileserver : Remove SSH private key from disk] 2026-06-11 10:34:09.421060 | localhost | ok: Runtime: 0:00:00.005242 2026-06-11 10:34:09.430123 | 2026-06-11 10:34:09.430270 | TASK [add-fileserver : Add fileserver to inventory] 2026-06-11 10:34:09.487739 | localhost | changed 2026-06-11 10:34:09.494694 | 2026-06-11 10:34:09.494822 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-06-11 10:34:09.947761 | localhost | changed 2026-06-11 10:34:09.956762 | 2026-06-11 10:34:09.956850 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-06-11 10:34:10.333781 | localhost | changed 2026-06-11 10:34:10.354509 | 2026-06-11 10:34:10.354660 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-06-11 10:34:10.399839 | localhost | ok 2026-06-11 10:34:10.415004 | 2026-06-11 10:34:10.415133 | TASK [include_role : report-logjuicer] 2026-06-11 10:34:10.483314 | localhost | skipping: Conditional result was False 2026-06-11 10:34:10.487913 | 2026-06-11 10:34:10.488021 | PLAY [a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com] 2026-06-11 10:34:10.496953 | 2026-06-11 10:34:10.497085 | TASK [Set zuul-log-path fact] 2026-06-11 10:34:10.519300 | a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com | ok 2026-06-11 10:34:10.535391 | 2026-06-11 10:34:10.535529 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-06-11 10:34:10.574665 | a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com | ok 2026-06-11 10:34:10.580773 | 2026-06-11 10:34:10.580930 | TASK [upload-logs : Create log directories] 2026-06-11 10:34:11.418478 | a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com | changed 2026-06-11 10:34:11.422513 | 2026-06-11 10:34:11.422665 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-06-11 10:34:11.779325 | a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com -> localhost | ok: Runtime: 0:00:00.010253 2026-06-11 10:34:11.784627 | 2026-06-11 10:34:11.784766 | TASK [upload-logs : Upload logs to log server] 2026-06-11 10:34:12.920278 | a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com | changed: 2026-06-11 10:34:12.920621 | a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com | .d..tp..... ./ 2026-06-11 10:34:12.920691 | a71a93e18f1524007a0994a866a4da93-48298913.us-east-1.elb.amazonaws.com |