2026-06-10 08:27:23.310 16 DEBUG aodh.storage [-] looking for 'mysql+pymysql' driver in 'aodh.storage' get_connection_from_config /usr/lib/python3.9/site-packages/aodh/storage/__init__.py:60
2026-06-10 08:27:23.329 18 DEBUG aodh.storage [-] looking for 'mysql+pymysql' driver in 'aodh.storage' get_connection_from_config /usr/lib/python3.9/site-packages/aodh/storage/__init__.py:60
2026-06-10 08:27:23.571 14 DEBUG aodh.storage [-] looking for 'mysql+pymysql' driver in 'aodh.storage' get_connection_from_config /usr/lib/python3.9/site-packages/aodh/storage/__init__.py:60
2026-06-10 08:27:23.614 18 INFO aodh.coordination [-] Coordination backend started successfully.
2026-06-10 08:27:23.628 20 DEBUG aodh.storage [-] looking for 'mysql+pymysql' driver in 'aodh.storage' get_connection_from_config /usr/lib/python3.9/site-packages/aodh/storage/__init__.py:60
2026-06-10 08:27:23.731 16 INFO aodh.coordination [-] Coordination backend started successfully.
2026-06-10 08:27:23.743 16 INFO aodh.coordination [-] Joined partitioning group alarm_evaluator
2026-06-10 08:27:23.743 20 INFO aodh.coordination [-] Coordination backend started successfully.
2026-06-10 08:27:23.796 20 INFO aodh.coordination [-] Joined partitioning group alarm_evaluator
2026-06-10 08:27:23.914 14 INFO aodh.coordination [-] Coordination backend started successfully.
2026-06-10 08:27:23.926 14 INFO aodh.coordination [-] Joined partitioning group alarm_evaluator
2026-06-10 08:27:24.662 18 INFO aodh.coordination [-] Joined partitioning group alarm_evaluator
2026-06-10 08:28:23.750 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:28:23.785 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:28:23.792 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:28:23.793 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:28:23.794 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:28:23.804 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:28:23.837 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:28:23.844 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:28:23.846 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:28:23.846 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:28:23.933 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:28:23.966 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:28:23.975 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:28:23.975 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:28:23.976 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:28:24.668 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:28:24.697 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:28:24.704 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:28:24.704 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:28:24.705 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:29:23.745 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:29:23.756 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:29:23.759 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:29:23.760 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:29:23.760 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:29:23.798 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:29:23.812 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:29:23.815 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:29:23.816 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:29:23.816 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:29:23.928 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:29:23.938 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:29:23.941 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:29:23.941 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:29:23.941 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:29:24.665 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:29:24.675 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:29:24.683 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:29:24.683 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:29:24.683 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:30:23.745 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:30:23.752 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:30:23.755 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:30:23.755 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:30:23.755 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:30:23.798 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:30:23.807 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:30:23.811 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:30:23.811 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:30:23.811 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:30:23.928 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:30:23.937 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:30:23.943 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:30:23.943 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:30:23.943 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:30:24.665 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:30:24.677 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:30:24.683 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:30:24.683 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:30:24.684 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:31:23.746 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:31:23.756 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:31:23.762 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:31:23.762 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:31:23.762 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:31:23.798 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:31:23.810 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:31:23.816 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:31:23.816 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:31:23.817 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:31:23.929 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:31:23.939 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:31:23.945 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:31:23.946 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:31:23.946 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:31:24.665 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:31:24.677 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:31:24.683 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:31:24.684 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:31:24.684 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:32:23.748 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:32:23.761 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:32:23.768 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:32:23.768 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:32:23.768 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:32:23.800 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:32:23.816 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:32:23.823 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:32:23.824 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:32:23.825 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:32:23.930 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:32:23.944 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:32:23.951 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:32:23.951 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:32:23.952 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:32:24.667 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:32:24.679 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:32:24.686 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:32:24.686 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:32:24.686 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:33:23.746 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:33:23.755 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:33:23.759 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:33:23.760 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:33:23.760 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:33:23.799 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:33:23.810 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:33:23.817 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:33:23.817 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:33:23.818 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:33:23.930 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:33:23.941 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:33:23.947 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:33:23.947 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:33:23.948 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:33:24.666 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:33:24.676 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:33:24.681 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:33:24.681 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:33:24.681 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:34:23.747 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:34:23.759 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:34:23.766 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:34:23.766 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:34:23.766 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:34:23.800 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:34:23.810 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:34:23.817 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:34:23.818 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:34:23.818 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:34:23.930 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:34:23.940 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:34:23.948 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:34:23.949 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:34:23.949 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:34:24.666 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:34:24.676 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:34:24.683 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:34:24.683 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:34:24.683 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:35:23.748 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:35:23.762 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:35:23.769 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:35:23.769 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:35:23.770 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:35:23.800 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:35:23.811 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:35:23.815 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:35:23.815 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:35:23.816 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:35:23.930 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:35:23.943 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:35:23.949 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:35:23.949 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:35:23.950 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:35:24.667 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:35:24.681 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:35:24.687 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:35:24.687 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:35:24.688 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:36:23.748 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:36:23.758 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:36:23.764 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:36:23.765 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:36:23.765 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:36:23.800 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:36:23.812 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:36:23.818 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:36:23.818 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:36:23.818 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:36:23.930 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:36:23.941 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:36:23.947 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:36:23.947 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:36:23.947 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:36:24.667 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:36:24.681 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:36:24.688 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:36:24.688 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:36:24.688 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:37:23.749 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:37:23.760 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:37:23.766 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:37:23.766 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:37:23.767 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:37:23.800 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:37:23.810 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:37:23.814 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:37:23.814 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:37:23.815 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:37:23.931 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:37:23.940 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:37:23.943 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:37:23.943 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:37:23.943 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:37:24.667 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:37:24.676 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:37:24.680 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:37:24.680 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:37:24.680 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:38:23.749 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:38:23.763 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:38:23.771 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:38:23.772 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:38:23.772 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:38:23.801 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:38:23.812 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:38:23.819 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:38:23.819 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:38:23.819 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:38:23.931 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:38:23.943 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:38:23.949 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:38:23.949 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:38:23.949 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:38:24.668 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:38:24.679 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:38:24.685 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:38:24.685 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:38:24.686 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:39:23.749 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:39:23.801 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:39:23.931 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:39:24.033 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:39:24.035 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:39:24.032 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:39:24.041 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:39:24.041 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:39:24.041 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:39:24.042 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:39:24.043 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:39:24.043 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:39:24.046 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:39:24.046 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:39:24.046 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:39:24.668 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:39:28.327 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.327 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.328 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.329 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.337 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.337 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.338 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.340 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.343 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.343 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.343 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator [-] alarm evaluation cycle failed: redis.exceptions.ConnectionError: Connection closed by server.
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator Traceback (most recent call last):
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/aodh/evaluator/__init__.py", line 248, in _evaluate_assigned_alarms
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     alarms = self._assigned_alarms()
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/aodh/evaluator/__init__.py", line 300, in _assigned_alarms
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     selected_ids = self.partition_coordinator.extract_my_subset(
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/tenacity/__init__.py", line 333, in wrapped_f
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     return self(f, *args, **kw)
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/tenacity/__init__.py", line 423, in __call__
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     do = self.iter(retry_state=retry_state)
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/tenacity/__init__.py", line 360, in iter
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     return fut.result()
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib64/python3.9/concurrent/futures/_base.py", line 439, in result
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     return self.__get_result()
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     raise self._exception
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/tenacity/__init__.py", line 426, in __call__
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     result = fn(*args, **kwargs)
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/aodh/coordination.py", line 229, in extract_my_subset
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     members = self._get_members(group_id)
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/aodh/coordination.py", line 206, in _get_members
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     return get_members_req.get()
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/tooz/coordination.py", line 666, in get
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     return self._fut.result(timeout=timeout)
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib64/python3.9/concurrent/futures/_base.py", line 446, in result
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     return self.__get_result()
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     raise self._exception
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/futurist/_utils.py", line 49, in run
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     result = self.fn(*self.args, **self.kwargs)
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/redis/client.py", line 803, in transaction
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     pipe.watch(*watches)
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/redis/client.py", line 4041, in watch
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     return self.execute_command('WATCH', *names)
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/redis/client.py", line 3822, in execute_command
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     return self.immediate_execute_command(*args, **kwargs)
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/redis/client.py", line 3836, in immediate_execute_command
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     conn = self.connection_pool.get_connection(command_name,
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 1192, in get_connection
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     connection.connect()
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 567, in connect
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     self.on_connect()
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 643, in on_connect
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     auth_response = self.read_response()
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 739, in read_response
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     response = self._parser.read_response()
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 324, in read_response
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     raw = self._buffer.readline()
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 256, in readline
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     self._read_from_socket()
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 201, in _read_from_socket
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator     raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator redis.exceptions.ConnectionError: Connection closed by server.
2026-06-10 08:39:28.339 18 ERROR aodh.evaluator 
2026-06-10 08:39:28.342 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.358 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.367 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.368 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.368 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.372 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.371 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.372 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.374 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.374 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.376 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.377 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.377 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.378 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.378 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.379 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.380 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.380 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.380 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.382 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.382 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.382 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.386 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.386 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.386 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.387 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.387 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.388 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.389 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.389 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.390 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:28.390 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:32.056 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:32.057 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:32.057 20 DEBUG tooz.drivers.redis [-] Redis connection error, retry limit has been reached, aborting - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:57
2026-06-10 08:39:32.058 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:32.057 20 ERROR aodh.coordination [-] Error sending a heartbeat to coordination backend.: tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:32.057 20 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:32.057 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 52, in wrapper
2026-06-10 08:39:32.057 20 ERROR aodh.coordination     return func(*args, **kwargs)
2026-06-10 08:39:32.057 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 539, in heartbeat
2026-06-10 08:39:32.057 20 ERROR aodh.coordination     self._client.psetex(beat_id, time_ms=expiry_ms,
2026-06-10 08:39:32.057 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 1733, in psetex
2026-06-10 08:39:32.057 20 ERROR aodh.coordination     return self.execute_command('PSETEX', name, time_ms, value)
2026-06-10 08:39:32.057 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 898, in execute_command
2026-06-10 08:39:32.057 20 ERROR aodh.coordination     conn = self.connection or pool.get_connection(command_name, **options)
2026-06-10 08:39:32.057 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 1192, in get_connection
2026-06-10 08:39:32.057 20 ERROR aodh.coordination     connection.connect()
2026-06-10 08:39:32.057 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 567, in connect
2026-06-10 08:39:32.057 20 ERROR aodh.coordination     self.on_connect()
2026-06-10 08:39:32.057 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 643, in on_connect
2026-06-10 08:39:32.057 20 ERROR aodh.coordination     auth_response = self.read_response()
2026-06-10 08:39:32.057 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 739, in read_response
2026-06-10 08:39:32.057 20 ERROR aodh.coordination     response = self._parser.read_response()
2026-06-10 08:39:32.057 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 324, in read_response
2026-06-10 08:39:32.057 20 ERROR aodh.coordination     raw = self._buffer.readline()
2026-06-10 08:39:32.057 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 256, in readline
2026-06-10 08:39:32.057 20 ERROR aodh.coordination     self._read_from_socket()
2026-06-10 08:39:32.057 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 201, in _read_from_socket
2026-06-10 08:39:32.057 20 ERROR aodh.coordination     raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
2026-06-10 08:39:32.057 20 ERROR aodh.coordination redis.exceptions.ConnectionError: Connection closed by server.
2026-06-10 08:39:32.057 20 ERROR aodh.coordination 
2026-06-10 08:39:32.057 20 ERROR aodh.coordination The above exception was the direct cause of the following exception:
2026-06-10 08:39:32.057 20 ERROR aodh.coordination 
2026-06-10 08:39:32.057 20 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:32.057 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/aodh/coordination.py", line 153, in heartbeat
2026-06-10 08:39:32.057 20 ERROR aodh.coordination     self._coordinator.heartbeat()
2026-06-10 08:39:32.057 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 61, in wrapper
2026-06-10 08:39:32.057 20 ERROR aodh.coordination     utils.raise_with_cause(
2026-06-10 08:39:32.057 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/utils.py", line 224, in raise_with_cause
2026-06-10 08:39:32.057 20 ERROR aodh.coordination     excutils.raise_with_cause(exc_cls, message, *args, **kwargs)
2026-06-10 08:39:32.057 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 142, in raise_with_cause
2026-06-10 08:39:32.057 20 ERROR aodh.coordination     raise exc_cls(message, *args, **kwargs) from kwargs.get('cause')
2026-06-10 08:39:32.057 20 ERROR aodh.coordination tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:32.057 20 ERROR aodh.coordination 
2026-06-10 08:39:34.589 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.591 16 DEBUG tooz.drivers.redis [-] Redis connection error, retry limit has been reached, aborting - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:57
2026-06-10 08:39:34.591 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.592 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.593 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.592 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.594 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.591 16 ERROR aodh.coordination [-] Error sending a heartbeat to coordination backend.: tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.591 16 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.591 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 52, in wrapper
2026-06-10 08:39:34.591 16 ERROR aodh.coordination     return func(*args, **kwargs)
2026-06-10 08:39:34.591 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 539, in heartbeat
2026-06-10 08:39:34.591 16 ERROR aodh.coordination     self._client.psetex(beat_id, time_ms=expiry_ms,
2026-06-10 08:39:34.591 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 1733, in psetex
2026-06-10 08:39:34.591 16 ERROR aodh.coordination     return self.execute_command('PSETEX', name, time_ms, value)
2026-06-10 08:39:34.591 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 898, in execute_command
2026-06-10 08:39:34.591 16 ERROR aodh.coordination     conn = self.connection or pool.get_connection(command_name, **options)
2026-06-10 08:39:34.591 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 1192, in get_connection
2026-06-10 08:39:34.591 16 ERROR aodh.coordination     connection.connect()
2026-06-10 08:39:34.591 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 567, in connect
2026-06-10 08:39:34.591 16 ERROR aodh.coordination     self.on_connect()
2026-06-10 08:39:34.591 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 643, in on_connect
2026-06-10 08:39:34.591 16 ERROR aodh.coordination     auth_response = self.read_response()
2026-06-10 08:39:34.591 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 739, in read_response
2026-06-10 08:39:34.591 16 ERROR aodh.coordination     response = self._parser.read_response()
2026-06-10 08:39:34.591 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 324, in read_response
2026-06-10 08:39:34.591 16 ERROR aodh.coordination     raw = self._buffer.readline()
2026-06-10 08:39:34.591 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 256, in readline
2026-06-10 08:39:34.591 16 ERROR aodh.coordination     self._read_from_socket()
2026-06-10 08:39:34.591 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 201, in _read_from_socket
2026-06-10 08:39:34.591 16 ERROR aodh.coordination     raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
2026-06-10 08:39:34.591 16 ERROR aodh.coordination redis.exceptions.ConnectionError: Connection closed by server.
2026-06-10 08:39:34.591 16 ERROR aodh.coordination 
2026-06-10 08:39:34.591 16 ERROR aodh.coordination The above exception was the direct cause of the following exception:
2026-06-10 08:39:34.591 16 ERROR aodh.coordination 
2026-06-10 08:39:34.591 16 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.591 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/aodh/coordination.py", line 153, in heartbeat
2026-06-10 08:39:34.591 16 ERROR aodh.coordination     self._coordinator.heartbeat()
2026-06-10 08:39:34.591 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 61, in wrapper
2026-06-10 08:39:34.591 16 ERROR aodh.coordination     utils.raise_with_cause(
2026-06-10 08:39:34.591 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/utils.py", line 224, in raise_with_cause
2026-06-10 08:39:34.591 16 ERROR aodh.coordination     excutils.raise_with_cause(exc_cls, message, *args, **kwargs)
2026-06-10 08:39:34.591 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 142, in raise_with_cause
2026-06-10 08:39:34.591 16 ERROR aodh.coordination     raise exc_cls(message, *args, **kwargs) from kwargs.get('cause')
2026-06-10 08:39:34.591 16 ERROR aodh.coordination tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.591 16 ERROR aodh.coordination 
2026-06-10 08:39:34.598 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.598 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.598 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.599 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.600 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.601 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.601 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.601 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.601 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.602 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.603 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.603 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.604 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.604 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.604 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.605 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.606 18 DEBUG tooz.drivers.redis [-] Redis connection error, retry limit has been reached, aborting - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:57
2026-06-10 08:39:34.607 14 DEBUG tooz.drivers.redis [-] Redis connection error, retry limit has been reached, aborting - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:57
2026-06-10 08:39:34.606 18 ERROR aodh.coordination [-] Error sending a heartbeat to coordination backend.: tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.606 18 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.606 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 52, in wrapper
2026-06-10 08:39:34.606 18 ERROR aodh.coordination     return func(*args, **kwargs)
2026-06-10 08:39:34.606 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 539, in heartbeat
2026-06-10 08:39:34.606 18 ERROR aodh.coordination     self._client.psetex(beat_id, time_ms=expiry_ms,
2026-06-10 08:39:34.606 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 1733, in psetex
2026-06-10 08:39:34.606 18 ERROR aodh.coordination     return self.execute_command('PSETEX', name, time_ms, value)
2026-06-10 08:39:34.606 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 898, in execute_command
2026-06-10 08:39:34.606 18 ERROR aodh.coordination     conn = self.connection or pool.get_connection(command_name, **options)
2026-06-10 08:39:34.606 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 1192, in get_connection
2026-06-10 08:39:34.606 18 ERROR aodh.coordination     connection.connect()
2026-06-10 08:39:34.606 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 567, in connect
2026-06-10 08:39:34.606 18 ERROR aodh.coordination     self.on_connect()
2026-06-10 08:39:34.606 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 643, in on_connect
2026-06-10 08:39:34.606 18 ERROR aodh.coordination     auth_response = self.read_response()
2026-06-10 08:39:34.606 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 739, in read_response
2026-06-10 08:39:34.606 18 ERROR aodh.coordination     response = self._parser.read_response()
2026-06-10 08:39:34.606 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 324, in read_response
2026-06-10 08:39:34.606 18 ERROR aodh.coordination     raw = self._buffer.readline()
2026-06-10 08:39:34.606 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 256, in readline
2026-06-10 08:39:34.606 18 ERROR aodh.coordination     self._read_from_socket()
2026-06-10 08:39:34.606 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 201, in _read_from_socket
2026-06-10 08:39:34.606 18 ERROR aodh.coordination     raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
2026-06-10 08:39:34.606 18 ERROR aodh.coordination redis.exceptions.ConnectionError: Connection closed by server.
2026-06-10 08:39:34.606 18 ERROR aodh.coordination 
2026-06-10 08:39:34.606 18 ERROR aodh.coordination The above exception was the direct cause of the following exception:
2026-06-10 08:39:34.606 18 ERROR aodh.coordination 
2026-06-10 08:39:34.606 18 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.606 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/aodh/coordination.py", line 153, in heartbeat
2026-06-10 08:39:34.606 18 ERROR aodh.coordination     self._coordinator.heartbeat()
2026-06-10 08:39:34.606 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 61, in wrapper
2026-06-10 08:39:34.606 18 ERROR aodh.coordination     utils.raise_with_cause(
2026-06-10 08:39:34.606 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/utils.py", line 224, in raise_with_cause
2026-06-10 08:39:34.606 18 ERROR aodh.coordination     excutils.raise_with_cause(exc_cls, message, *args, **kwargs)
2026-06-10 08:39:34.606 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 142, in raise_with_cause
2026-06-10 08:39:34.606 18 ERROR aodh.coordination     raise exc_cls(message, *args, **kwargs) from kwargs.get('cause')
2026-06-10 08:39:34.606 18 ERROR aodh.coordination tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.606 18 ERROR aodh.coordination 
2026-06-10 08:39:34.607 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.607 14 ERROR aodh.coordination [-] Error sending a heartbeat to coordination backend.: tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.607 14 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.607 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 52, in wrapper
2026-06-10 08:39:34.607 14 ERROR aodh.coordination     return func(*args, **kwargs)
2026-06-10 08:39:34.607 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 539, in heartbeat
2026-06-10 08:39:34.607 14 ERROR aodh.coordination     self._client.psetex(beat_id, time_ms=expiry_ms,
2026-06-10 08:39:34.607 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 1733, in psetex
2026-06-10 08:39:34.607 14 ERROR aodh.coordination     return self.execute_command('PSETEX', name, time_ms, value)
2026-06-10 08:39:34.607 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 898, in execute_command
2026-06-10 08:39:34.607 14 ERROR aodh.coordination     conn = self.connection or pool.get_connection(command_name, **options)
2026-06-10 08:39:34.607 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 1192, in get_connection
2026-06-10 08:39:34.607 14 ERROR aodh.coordination     connection.connect()
2026-06-10 08:39:34.607 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 567, in connect
2026-06-10 08:39:34.607 14 ERROR aodh.coordination     self.on_connect()
2026-06-10 08:39:34.607 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 643, in on_connect
2026-06-10 08:39:34.607 14 ERROR aodh.coordination     auth_response = self.read_response()
2026-06-10 08:39:34.607 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 739, in read_response
2026-06-10 08:39:34.607 14 ERROR aodh.coordination     response = self._parser.read_response()
2026-06-10 08:39:34.607 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 324, in read_response
2026-06-10 08:39:34.607 14 ERROR aodh.coordination     raw = self._buffer.readline()
2026-06-10 08:39:34.607 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 256, in readline
2026-06-10 08:39:34.607 14 ERROR aodh.coordination     self._read_from_socket()
2026-06-10 08:39:34.607 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 201, in _read_from_socket
2026-06-10 08:39:34.607 14 ERROR aodh.coordination     raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
2026-06-10 08:39:34.607 14 ERROR aodh.coordination redis.exceptions.ConnectionError: Connection closed by server.
2026-06-10 08:39:34.607 14 ERROR aodh.coordination 
2026-06-10 08:39:34.607 14 ERROR aodh.coordination The above exception was the direct cause of the following exception:
2026-06-10 08:39:34.607 14 ERROR aodh.coordination 
2026-06-10 08:39:34.607 14 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.607 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/aodh/coordination.py", line 153, in heartbeat
2026-06-10 08:39:34.607 14 ERROR aodh.coordination     self._coordinator.heartbeat()
2026-06-10 08:39:34.607 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 61, in wrapper
2026-06-10 08:39:34.607 14 ERROR aodh.coordination     utils.raise_with_cause(
2026-06-10 08:39:34.607 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/utils.py", line 224, in raise_with_cause
2026-06-10 08:39:34.607 14 ERROR aodh.coordination     excutils.raise_with_cause(exc_cls, message, *args, **kwargs)
2026-06-10 08:39:34.607 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 142, in raise_with_cause
2026-06-10 08:39:34.607 14 ERROR aodh.coordination     raise exc_cls(message, *args, **kwargs) from kwargs.get('cause')
2026-06-10 08:39:34.607 14 ERROR aodh.coordination tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.607 14 ERROR aodh.coordination 
2026-06-10 08:39:34.609 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.610 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.611 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.611 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.612 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.613 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.613 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.614 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.615 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.615 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.615 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.616 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.616 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.616 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.616 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.616 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.617 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.617 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.617 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.617 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.618 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.618 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.618 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.619 20 DEBUG tooz.drivers.redis [-] Redis connection error, retry limit has been reached, aborting - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:57
2026-06-10 08:39:34.619 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.619 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.619 20 ERROR aodh.coordination [-] Error sending a heartbeat to coordination backend.: tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.619 20 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.619 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 52, in wrapper
2026-06-10 08:39:34.619 20 ERROR aodh.coordination     return func(*args, **kwargs)
2026-06-10 08:39:34.619 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 539, in heartbeat
2026-06-10 08:39:34.619 20 ERROR aodh.coordination     self._client.psetex(beat_id, time_ms=expiry_ms,
2026-06-10 08:39:34.619 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 1733, in psetex
2026-06-10 08:39:34.619 20 ERROR aodh.coordination     return self.execute_command('PSETEX', name, time_ms, value)
2026-06-10 08:39:34.619 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 898, in execute_command
2026-06-10 08:39:34.619 20 ERROR aodh.coordination     conn = self.connection or pool.get_connection(command_name, **options)
2026-06-10 08:39:34.619 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 1192, in get_connection
2026-06-10 08:39:34.619 20 ERROR aodh.coordination     connection.connect()
2026-06-10 08:39:34.619 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 567, in connect
2026-06-10 08:39:34.619 20 ERROR aodh.coordination     self.on_connect()
2026-06-10 08:39:34.619 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 643, in on_connect
2026-06-10 08:39:34.619 20 ERROR aodh.coordination     auth_response = self.read_response()
2026-06-10 08:39:34.619 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 739, in read_response
2026-06-10 08:39:34.619 20 ERROR aodh.coordination     response = self._parser.read_response()
2026-06-10 08:39:34.619 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 324, in read_response
2026-06-10 08:39:34.619 20 ERROR aodh.coordination     raw = self._buffer.readline()
2026-06-10 08:39:34.619 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 256, in readline
2026-06-10 08:39:34.619 20 ERROR aodh.coordination     self._read_from_socket()
2026-06-10 08:39:34.619 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 201, in _read_from_socket
2026-06-10 08:39:34.619 20 ERROR aodh.coordination     raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
2026-06-10 08:39:34.619 20 ERROR aodh.coordination redis.exceptions.ConnectionError: Connection closed by server.
2026-06-10 08:39:34.619 20 ERROR aodh.coordination 
2026-06-10 08:39:34.619 20 ERROR aodh.coordination The above exception was the direct cause of the following exception:
2026-06-10 08:39:34.619 20 ERROR aodh.coordination 
2026-06-10 08:39:34.619 20 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.619 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/aodh/coordination.py", line 153, in heartbeat
2026-06-10 08:39:34.619 20 ERROR aodh.coordination     self._coordinator.heartbeat()
2026-06-10 08:39:34.619 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 61, in wrapper
2026-06-10 08:39:34.619 20 ERROR aodh.coordination     utils.raise_with_cause(
2026-06-10 08:39:34.619 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/utils.py", line 224, in raise_with_cause
2026-06-10 08:39:34.619 20 ERROR aodh.coordination     excutils.raise_with_cause(exc_cls, message, *args, **kwargs)
2026-06-10 08:39:34.619 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 142, in raise_with_cause
2026-06-10 08:39:34.619 20 ERROR aodh.coordination     raise exc_cls(message, *args, **kwargs) from kwargs.get('cause')
2026-06-10 08:39:34.619 20 ERROR aodh.coordination tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.619 20 ERROR aodh.coordination 
2026-06-10 08:39:34.620 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.620 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.620 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.620 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.621 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.621 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.621 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.621 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.621 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.622 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.622 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.623 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.624 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.627 16 DEBUG tooz.drivers.redis [-] Redis connection error, retry limit has been reached, aborting - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:57
2026-06-10 08:39:34.627 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.628 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.628 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.627 16 ERROR aodh.coordination [-] Error sending a heartbeat to coordination backend.: tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.627 16 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.627 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 52, in wrapper
2026-06-10 08:39:34.627 16 ERROR aodh.coordination     return func(*args, **kwargs)
2026-06-10 08:39:34.627 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 539, in heartbeat
2026-06-10 08:39:34.627 16 ERROR aodh.coordination     self._client.psetex(beat_id, time_ms=expiry_ms,
2026-06-10 08:39:34.627 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 1733, in psetex
2026-06-10 08:39:34.627 16 ERROR aodh.coordination     return self.execute_command('PSETEX', name, time_ms, value)
2026-06-10 08:39:34.627 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 898, in execute_command
2026-06-10 08:39:34.627 16 ERROR aodh.coordination     conn = self.connection or pool.get_connection(command_name, **options)
2026-06-10 08:39:34.627 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 1192, in get_connection
2026-06-10 08:39:34.627 16 ERROR aodh.coordination     connection.connect()
2026-06-10 08:39:34.627 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 567, in connect
2026-06-10 08:39:34.627 16 ERROR aodh.coordination     self.on_connect()
2026-06-10 08:39:34.627 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 643, in on_connect
2026-06-10 08:39:34.627 16 ERROR aodh.coordination     auth_response = self.read_response()
2026-06-10 08:39:34.627 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 739, in read_response
2026-06-10 08:39:34.627 16 ERROR aodh.coordination     response = self._parser.read_response()
2026-06-10 08:39:34.627 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 324, in read_response
2026-06-10 08:39:34.627 16 ERROR aodh.coordination     raw = self._buffer.readline()
2026-06-10 08:39:34.627 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 256, in readline
2026-06-10 08:39:34.627 16 ERROR aodh.coordination     self._read_from_socket()
2026-06-10 08:39:34.627 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 201, in _read_from_socket
2026-06-10 08:39:34.627 16 ERROR aodh.coordination     raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
2026-06-10 08:39:34.627 16 ERROR aodh.coordination redis.exceptions.ConnectionError: Connection closed by server.
2026-06-10 08:39:34.627 16 ERROR aodh.coordination 
2026-06-10 08:39:34.627 16 ERROR aodh.coordination The above exception was the direct cause of the following exception:
2026-06-10 08:39:34.627 16 ERROR aodh.coordination 
2026-06-10 08:39:34.627 16 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.627 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/aodh/coordination.py", line 153, in heartbeat
2026-06-10 08:39:34.627 16 ERROR aodh.coordination     self._coordinator.heartbeat()
2026-06-10 08:39:34.627 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 61, in wrapper
2026-06-10 08:39:34.627 16 ERROR aodh.coordination     utils.raise_with_cause(
2026-06-10 08:39:34.627 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/utils.py", line 224, in raise_with_cause
2026-06-10 08:39:34.627 16 ERROR aodh.coordination     excutils.raise_with_cause(exc_cls, message, *args, **kwargs)
2026-06-10 08:39:34.627 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 142, in raise_with_cause
2026-06-10 08:39:34.627 16 ERROR aodh.coordination     raise exc_cls(message, *args, **kwargs) from kwargs.get('cause')
2026-06-10 08:39:34.627 16 ERROR aodh.coordination tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.627 16 ERROR aodh.coordination 
2026-06-10 08:39:34.628 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.628 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.628 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.629 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.630 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.630 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.630 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.631 18 DEBUG tooz.drivers.redis [-] Redis connection error, retry limit has been reached, aborting - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:57
2026-06-10 08:39:34.631 14 DEBUG tooz.drivers.redis [-] Redis connection error, retry limit has been reached, aborting - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:57
2026-06-10 08:39:34.631 18 ERROR aodh.coordination [-] Error sending a heartbeat to coordination backend.: tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.631 18 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.631 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 52, in wrapper
2026-06-10 08:39:34.631 18 ERROR aodh.coordination     return func(*args, **kwargs)
2026-06-10 08:39:34.631 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 539, in heartbeat
2026-06-10 08:39:34.631 18 ERROR aodh.coordination     self._client.psetex(beat_id, time_ms=expiry_ms,
2026-06-10 08:39:34.631 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 1733, in psetex
2026-06-10 08:39:34.631 18 ERROR aodh.coordination     return self.execute_command('PSETEX', name, time_ms, value)
2026-06-10 08:39:34.631 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 898, in execute_command
2026-06-10 08:39:34.631 18 ERROR aodh.coordination     conn = self.connection or pool.get_connection(command_name, **options)
2026-06-10 08:39:34.631 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 1192, in get_connection
2026-06-10 08:39:34.631 18 ERROR aodh.coordination     connection.connect()
2026-06-10 08:39:34.631 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 567, in connect
2026-06-10 08:39:34.631 18 ERROR aodh.coordination     self.on_connect()
2026-06-10 08:39:34.631 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 643, in on_connect
2026-06-10 08:39:34.631 18 ERROR aodh.coordination     auth_response = self.read_response()
2026-06-10 08:39:34.631 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 739, in read_response
2026-06-10 08:39:34.631 18 ERROR aodh.coordination     response = self._parser.read_response()
2026-06-10 08:39:34.631 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 324, in read_response
2026-06-10 08:39:34.631 18 ERROR aodh.coordination     raw = self._buffer.readline()
2026-06-10 08:39:34.631 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 256, in readline
2026-06-10 08:39:34.631 18 ERROR aodh.coordination     self._read_from_socket()
2026-06-10 08:39:34.631 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 201, in _read_from_socket
2026-06-10 08:39:34.631 18 ERROR aodh.coordination     raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
2026-06-10 08:39:34.631 18 ERROR aodh.coordination redis.exceptions.ConnectionError: Connection closed by server.
2026-06-10 08:39:34.631 18 ERROR aodh.coordination 
2026-06-10 08:39:34.631 18 ERROR aodh.coordination The above exception was the direct cause of the following exception:
2026-06-10 08:39:34.631 18 ERROR aodh.coordination 
2026-06-10 08:39:34.631 18 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.631 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/aodh/coordination.py", line 153, in heartbeat
2026-06-10 08:39:34.631 18 ERROR aodh.coordination     self._coordinator.heartbeat()
2026-06-10 08:39:34.631 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 61, in wrapper
2026-06-10 08:39:34.631 18 ERROR aodh.coordination     utils.raise_with_cause(
2026-06-10 08:39:34.631 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/utils.py", line 224, in raise_with_cause
2026-06-10 08:39:34.631 18 ERROR aodh.coordination     excutils.raise_with_cause(exc_cls, message, *args, **kwargs)
2026-06-10 08:39:34.631 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 142, in raise_with_cause
2026-06-10 08:39:34.631 18 ERROR aodh.coordination     raise exc_cls(message, *args, **kwargs) from kwargs.get('cause')
2026-06-10 08:39:34.631 18 ERROR aodh.coordination tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.631 18 ERROR aodh.coordination 
2026-06-10 08:39:34.631 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.631 14 ERROR aodh.coordination [-] Error sending a heartbeat to coordination backend.: tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.631 14 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.631 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 52, in wrapper
2026-06-10 08:39:34.631 14 ERROR aodh.coordination     return func(*args, **kwargs)
2026-06-10 08:39:34.631 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 539, in heartbeat
2026-06-10 08:39:34.631 14 ERROR aodh.coordination     self._client.psetex(beat_id, time_ms=expiry_ms,
2026-06-10 08:39:34.631 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 1733, in psetex
2026-06-10 08:39:34.631 14 ERROR aodh.coordination     return self.execute_command('PSETEX', name, time_ms, value)
2026-06-10 08:39:34.631 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 898, in execute_command
2026-06-10 08:39:34.631 14 ERROR aodh.coordination     conn = self.connection or pool.get_connection(command_name, **options)
2026-06-10 08:39:34.631 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 1192, in get_connection
2026-06-10 08:39:34.631 14 ERROR aodh.coordination     connection.connect()
2026-06-10 08:39:34.631 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 567, in connect
2026-06-10 08:39:34.631 14 ERROR aodh.coordination     self.on_connect()
2026-06-10 08:39:34.631 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 643, in on_connect
2026-06-10 08:39:34.631 14 ERROR aodh.coordination     auth_response = self.read_response()
2026-06-10 08:39:34.631 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 739, in read_response
2026-06-10 08:39:34.631 14 ERROR aodh.coordination     response = self._parser.read_response()
2026-06-10 08:39:34.631 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 324, in read_response
2026-06-10 08:39:34.631 14 ERROR aodh.coordination     raw = self._buffer.readline()
2026-06-10 08:39:34.631 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 256, in readline
2026-06-10 08:39:34.631 14 ERROR aodh.coordination     self._read_from_socket()
2026-06-10 08:39:34.631 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 201, in _read_from_socket
2026-06-10 08:39:34.631 14 ERROR aodh.coordination     raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
2026-06-10 08:39:34.631 14 ERROR aodh.coordination redis.exceptions.ConnectionError: Connection closed by server.
2026-06-10 08:39:34.631 14 ERROR aodh.coordination 
2026-06-10 08:39:34.631 14 ERROR aodh.coordination The above exception was the direct cause of the following exception:
2026-06-10 08:39:34.631 14 ERROR aodh.coordination 
2026-06-10 08:39:34.631 14 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.631 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/aodh/coordination.py", line 153, in heartbeat
2026-06-10 08:39:34.631 14 ERROR aodh.coordination     self._coordinator.heartbeat()
2026-06-10 08:39:34.631 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 61, in wrapper
2026-06-10 08:39:34.631 14 ERROR aodh.coordination     utils.raise_with_cause(
2026-06-10 08:39:34.631 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/utils.py", line 224, in raise_with_cause
2026-06-10 08:39:34.631 14 ERROR aodh.coordination     excutils.raise_with_cause(exc_cls, message, *args, **kwargs)
2026-06-10 08:39:34.631 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 142, in raise_with_cause
2026-06-10 08:39:34.631 14 ERROR aodh.coordination     raise exc_cls(message, *args, **kwargs) from kwargs.get('cause')
2026-06-10 08:39:34.631 14 ERROR aodh.coordination tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.631 14 ERROR aodh.coordination 
2026-06-10 08:39:34.632 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.636 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.637 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.638 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.639 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.640 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.641 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.642 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:34.643 20 DEBUG tooz.drivers.redis [-] Redis connection error, retry limit has been reached, aborting - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:57
2026-06-10 08:39:34.643 20 ERROR aodh.coordination [-] Error sending a heartbeat to coordination backend.: tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.643 20 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.643 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 52, in wrapper
2026-06-10 08:39:34.643 20 ERROR aodh.coordination     return func(*args, **kwargs)
2026-06-10 08:39:34.643 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 539, in heartbeat
2026-06-10 08:39:34.643 20 ERROR aodh.coordination     self._client.psetex(beat_id, time_ms=expiry_ms,
2026-06-10 08:39:34.643 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 1733, in psetex
2026-06-10 08:39:34.643 20 ERROR aodh.coordination     return self.execute_command('PSETEX', name, time_ms, value)
2026-06-10 08:39:34.643 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 898, in execute_command
2026-06-10 08:39:34.643 20 ERROR aodh.coordination     conn = self.connection or pool.get_connection(command_name, **options)
2026-06-10 08:39:34.643 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 1192, in get_connection
2026-06-10 08:39:34.643 20 ERROR aodh.coordination     connection.connect()
2026-06-10 08:39:34.643 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 567, in connect
2026-06-10 08:39:34.643 20 ERROR aodh.coordination     self.on_connect()
2026-06-10 08:39:34.643 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 643, in on_connect
2026-06-10 08:39:34.643 20 ERROR aodh.coordination     auth_response = self.read_response()
2026-06-10 08:39:34.643 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 739, in read_response
2026-06-10 08:39:34.643 20 ERROR aodh.coordination     response = self._parser.read_response()
2026-06-10 08:39:34.643 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 324, in read_response
2026-06-10 08:39:34.643 20 ERROR aodh.coordination     raw = self._buffer.readline()
2026-06-10 08:39:34.643 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 256, in readline
2026-06-10 08:39:34.643 20 ERROR aodh.coordination     self._read_from_socket()
2026-06-10 08:39:34.643 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 201, in _read_from_socket
2026-06-10 08:39:34.643 20 ERROR aodh.coordination     raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
2026-06-10 08:39:34.643 20 ERROR aodh.coordination redis.exceptions.ConnectionError: Connection closed by server.
2026-06-10 08:39:34.643 20 ERROR aodh.coordination 
2026-06-10 08:39:34.643 20 ERROR aodh.coordination The above exception was the direct cause of the following exception:
2026-06-10 08:39:34.643 20 ERROR aodh.coordination 
2026-06-10 08:39:34.643 20 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:34.643 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/aodh/coordination.py", line 153, in heartbeat
2026-06-10 08:39:34.643 20 ERROR aodh.coordination     self._coordinator.heartbeat()
2026-06-10 08:39:34.643 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 61, in wrapper
2026-06-10 08:39:34.643 20 ERROR aodh.coordination     utils.raise_with_cause(
2026-06-10 08:39:34.643 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/utils.py", line 224, in raise_with_cause
2026-06-10 08:39:34.643 20 ERROR aodh.coordination     excutils.raise_with_cause(exc_cls, message, *args, **kwargs)
2026-06-10 08:39:34.643 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 142, in raise_with_cause
2026-06-10 08:39:34.643 20 ERROR aodh.coordination     raise exc_cls(message, *args, **kwargs) from kwargs.get('cause')
2026-06-10 08:39:34.643 20 ERROR aodh.coordination tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:34.643 20 ERROR aodh.coordination 
2026-06-10 08:39:36.135 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.136 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.144 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.144 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.145 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.146 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.146 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.146 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.153 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.153 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.154 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.154 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.155 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.156 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.156 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.156 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.158 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.158 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.159 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.159 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.160 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.160 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.161 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.161 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.162 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.162 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.163 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.164 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.164 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.165 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.166 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.166 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.166 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.168 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.168 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.168 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.170 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.170 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.170 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.171 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.172 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.172 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.172 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.173 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.175 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.176 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.176 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.177 20 DEBUG tooz.drivers.redis [-] Redis connection error, retry limit has been reached, aborting - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:57
2026-06-10 08:39:36.178 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.178 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.178 20 ERROR aodh.coordination [-] Error sending a heartbeat to coordination backend.: tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:36.178 20 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:36.178 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 52, in wrapper
2026-06-10 08:39:36.178 20 ERROR aodh.coordination     return func(*args, **kwargs)
2026-06-10 08:39:36.178 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 539, in heartbeat
2026-06-10 08:39:36.178 20 ERROR aodh.coordination     self._client.psetex(beat_id, time_ms=expiry_ms,
2026-06-10 08:39:36.178 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 1733, in psetex
2026-06-10 08:39:36.178 20 ERROR aodh.coordination     return self.execute_command('PSETEX', name, time_ms, value)
2026-06-10 08:39:36.178 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 898, in execute_command
2026-06-10 08:39:36.178 20 ERROR aodh.coordination     conn = self.connection or pool.get_connection(command_name, **options)
2026-06-10 08:39:36.178 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 1192, in get_connection
2026-06-10 08:39:36.178 20 ERROR aodh.coordination     connection.connect()
2026-06-10 08:39:36.178 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 567, in connect
2026-06-10 08:39:36.178 20 ERROR aodh.coordination     self.on_connect()
2026-06-10 08:39:36.178 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 643, in on_connect
2026-06-10 08:39:36.178 20 ERROR aodh.coordination     auth_response = self.read_response()
2026-06-10 08:39:36.178 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 739, in read_response
2026-06-10 08:39:36.178 20 ERROR aodh.coordination     response = self._parser.read_response()
2026-06-10 08:39:36.178 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 324, in read_response
2026-06-10 08:39:36.178 20 ERROR aodh.coordination     raw = self._buffer.readline()
2026-06-10 08:39:36.178 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 256, in readline
2026-06-10 08:39:36.178 20 ERROR aodh.coordination     self._read_from_socket()
2026-06-10 08:39:36.178 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 201, in _read_from_socket
2026-06-10 08:39:36.178 20 ERROR aodh.coordination     raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
2026-06-10 08:39:36.178 20 ERROR aodh.coordination redis.exceptions.ConnectionError: Connection closed by server.
2026-06-10 08:39:36.178 20 ERROR aodh.coordination 
2026-06-10 08:39:36.178 20 ERROR aodh.coordination The above exception was the direct cause of the following exception:
2026-06-10 08:39:36.178 20 ERROR aodh.coordination 
2026-06-10 08:39:36.178 20 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:36.178 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/aodh/coordination.py", line 153, in heartbeat
2026-06-10 08:39:36.178 20 ERROR aodh.coordination     self._coordinator.heartbeat()
2026-06-10 08:39:36.178 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 61, in wrapper
2026-06-10 08:39:36.178 20 ERROR aodh.coordination     utils.raise_with_cause(
2026-06-10 08:39:36.178 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/utils.py", line 224, in raise_with_cause
2026-06-10 08:39:36.178 20 ERROR aodh.coordination     excutils.raise_with_cause(exc_cls, message, *args, **kwargs)
2026-06-10 08:39:36.178 20 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 142, in raise_with_cause
2026-06-10 08:39:36.178 20 ERROR aodh.coordination     raise exc_cls(message, *args, **kwargs) from kwargs.get('cause')
2026-06-10 08:39:36.178 20 ERROR aodh.coordination tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:36.178 20 ERROR aodh.coordination 
2026-06-10 08:39:36.180 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.181 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.182 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.182 16 DEBUG tooz.drivers.redis [-] Redis connection error, retry limit has been reached, aborting - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:57
2026-06-10 08:39:36.183 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.183 16 ERROR aodh.coordination [-] Error sending a heartbeat to coordination backend.: tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:36.183 16 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:36.183 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 52, in wrapper
2026-06-10 08:39:36.183 16 ERROR aodh.coordination     return func(*args, **kwargs)
2026-06-10 08:39:36.183 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 539, in heartbeat
2026-06-10 08:39:36.183 16 ERROR aodh.coordination     self._client.psetex(beat_id, time_ms=expiry_ms,
2026-06-10 08:39:36.183 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 1733, in psetex
2026-06-10 08:39:36.183 16 ERROR aodh.coordination     return self.execute_command('PSETEX', name, time_ms, value)
2026-06-10 08:39:36.183 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 898, in execute_command
2026-06-10 08:39:36.183 16 ERROR aodh.coordination     conn = self.connection or pool.get_connection(command_name, **options)
2026-06-10 08:39:36.183 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 1192, in get_connection
2026-06-10 08:39:36.183 16 ERROR aodh.coordination     connection.connect()
2026-06-10 08:39:36.183 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 567, in connect
2026-06-10 08:39:36.183 16 ERROR aodh.coordination     self.on_connect()
2026-06-10 08:39:36.183 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 643, in on_connect
2026-06-10 08:39:36.183 16 ERROR aodh.coordination     auth_response = self.read_response()
2026-06-10 08:39:36.183 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 739, in read_response
2026-06-10 08:39:36.183 16 ERROR aodh.coordination     response = self._parser.read_response()
2026-06-10 08:39:36.183 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 324, in read_response
2026-06-10 08:39:36.183 16 ERROR aodh.coordination     raw = self._buffer.readline()
2026-06-10 08:39:36.183 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 256, in readline
2026-06-10 08:39:36.183 16 ERROR aodh.coordination     self._read_from_socket()
2026-06-10 08:39:36.183 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 201, in _read_from_socket
2026-06-10 08:39:36.183 16 ERROR aodh.coordination     raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
2026-06-10 08:39:36.183 16 ERROR aodh.coordination redis.exceptions.ConnectionError: Connection closed by server.
2026-06-10 08:39:36.183 16 ERROR aodh.coordination 
2026-06-10 08:39:36.183 16 ERROR aodh.coordination The above exception was the direct cause of the following exception:
2026-06-10 08:39:36.183 16 ERROR aodh.coordination 
2026-06-10 08:39:36.183 16 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:36.183 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/aodh/coordination.py", line 153, in heartbeat
2026-06-10 08:39:36.183 16 ERROR aodh.coordination     self._coordinator.heartbeat()
2026-06-10 08:39:36.183 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 61, in wrapper
2026-06-10 08:39:36.183 16 ERROR aodh.coordination     utils.raise_with_cause(
2026-06-10 08:39:36.183 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/utils.py", line 224, in raise_with_cause
2026-06-10 08:39:36.183 16 ERROR aodh.coordination     excutils.raise_with_cause(exc_cls, message, *args, **kwargs)
2026-06-10 08:39:36.183 16 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 142, in raise_with_cause
2026-06-10 08:39:36.183 16 ERROR aodh.coordination     raise exc_cls(message, *args, **kwargs) from kwargs.get('cause')
2026-06-10 08:39:36.183 16 ERROR aodh.coordination tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:36.183 16 ERROR aodh.coordination 
2026-06-10 08:39:36.183 14 DEBUG tooz.drivers.redis [-] Redis connection error, retry limit has been reached, aborting - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:57
2026-06-10 08:39:36.185 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.184 14 ERROR aodh.coordination [-] Error sending a heartbeat to coordination backend.: tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:36.184 14 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:36.184 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 52, in wrapper
2026-06-10 08:39:36.184 14 ERROR aodh.coordination     return func(*args, **kwargs)
2026-06-10 08:39:36.184 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 539, in heartbeat
2026-06-10 08:39:36.184 14 ERROR aodh.coordination     self._client.psetex(beat_id, time_ms=expiry_ms,
2026-06-10 08:39:36.184 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 1733, in psetex
2026-06-10 08:39:36.184 14 ERROR aodh.coordination     return self.execute_command('PSETEX', name, time_ms, value)
2026-06-10 08:39:36.184 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 898, in execute_command
2026-06-10 08:39:36.184 14 ERROR aodh.coordination     conn = self.connection or pool.get_connection(command_name, **options)
2026-06-10 08:39:36.184 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 1192, in get_connection
2026-06-10 08:39:36.184 14 ERROR aodh.coordination     connection.connect()
2026-06-10 08:39:36.184 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 567, in connect
2026-06-10 08:39:36.184 14 ERROR aodh.coordination     self.on_connect()
2026-06-10 08:39:36.184 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 643, in on_connect
2026-06-10 08:39:36.184 14 ERROR aodh.coordination     auth_response = self.read_response()
2026-06-10 08:39:36.184 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 739, in read_response
2026-06-10 08:39:36.184 14 ERROR aodh.coordination     response = self._parser.read_response()
2026-06-10 08:39:36.184 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 324, in read_response
2026-06-10 08:39:36.184 14 ERROR aodh.coordination     raw = self._buffer.readline()
2026-06-10 08:39:36.184 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 256, in readline
2026-06-10 08:39:36.184 14 ERROR aodh.coordination     self._read_from_socket()
2026-06-10 08:39:36.184 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 201, in _read_from_socket
2026-06-10 08:39:36.184 14 ERROR aodh.coordination     raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
2026-06-10 08:39:36.184 14 ERROR aodh.coordination redis.exceptions.ConnectionError: Connection closed by server.
2026-06-10 08:39:36.184 14 ERROR aodh.coordination 
2026-06-10 08:39:36.184 14 ERROR aodh.coordination The above exception was the direct cause of the following exception:
2026-06-10 08:39:36.184 14 ERROR aodh.coordination 
2026-06-10 08:39:36.184 14 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:36.184 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/aodh/coordination.py", line 153, in heartbeat
2026-06-10 08:39:36.184 14 ERROR aodh.coordination     self._coordinator.heartbeat()
2026-06-10 08:39:36.184 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 61, in wrapper
2026-06-10 08:39:36.184 14 ERROR aodh.coordination     utils.raise_with_cause(
2026-06-10 08:39:36.184 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/utils.py", line 224, in raise_with_cause
2026-06-10 08:39:36.184 14 ERROR aodh.coordination     excutils.raise_with_cause(exc_cls, message, *args, **kwargs)
2026-06-10 08:39:36.184 14 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 142, in raise_with_cause
2026-06-10 08:39:36.184 14 ERROR aodh.coordination     raise exc_cls(message, *args, **kwargs) from kwargs.get('cause')
2026-06-10 08:39:36.184 14 ERROR aodh.coordination tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:36.184 14 ERROR aodh.coordination 
2026-06-10 08:39:36.186 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.188 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:36.189 18 DEBUG tooz.drivers.redis [-] Redis connection error, retry limit has been reached, aborting - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:57
2026-06-10 08:39:36.189 18 ERROR aodh.coordination [-] Error sending a heartbeat to coordination backend.: tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:36.189 18 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:36.189 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 52, in wrapper
2026-06-10 08:39:36.189 18 ERROR aodh.coordination     return func(*args, **kwargs)
2026-06-10 08:39:36.189 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 539, in heartbeat
2026-06-10 08:39:36.189 18 ERROR aodh.coordination     self._client.psetex(beat_id, time_ms=expiry_ms,
2026-06-10 08:39:36.189 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 1733, in psetex
2026-06-10 08:39:36.189 18 ERROR aodh.coordination     return self.execute_command('PSETEX', name, time_ms, value)
2026-06-10 08:39:36.189 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/client.py", line 898, in execute_command
2026-06-10 08:39:36.189 18 ERROR aodh.coordination     conn = self.connection or pool.get_connection(command_name, **options)
2026-06-10 08:39:36.189 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 1192, in get_connection
2026-06-10 08:39:36.189 18 ERROR aodh.coordination     connection.connect()
2026-06-10 08:39:36.189 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 567, in connect
2026-06-10 08:39:36.189 18 ERROR aodh.coordination     self.on_connect()
2026-06-10 08:39:36.189 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 643, in on_connect
2026-06-10 08:39:36.189 18 ERROR aodh.coordination     auth_response = self.read_response()
2026-06-10 08:39:36.189 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 739, in read_response
2026-06-10 08:39:36.189 18 ERROR aodh.coordination     response = self._parser.read_response()
2026-06-10 08:39:36.189 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 324, in read_response
2026-06-10 08:39:36.189 18 ERROR aodh.coordination     raw = self._buffer.readline()
2026-06-10 08:39:36.189 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 256, in readline
2026-06-10 08:39:36.189 18 ERROR aodh.coordination     self._read_from_socket()
2026-06-10 08:39:36.189 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/redis/connection.py", line 201, in _read_from_socket
2026-06-10 08:39:36.189 18 ERROR aodh.coordination     raise ConnectionError(SERVER_CLOSED_CONNECTION_ERROR)
2026-06-10 08:39:36.189 18 ERROR aodh.coordination redis.exceptions.ConnectionError: Connection closed by server.
2026-06-10 08:39:36.189 18 ERROR aodh.coordination 
2026-06-10 08:39:36.189 18 ERROR aodh.coordination The above exception was the direct cause of the following exception:
2026-06-10 08:39:36.189 18 ERROR aodh.coordination 
2026-06-10 08:39:36.189 18 ERROR aodh.coordination Traceback (most recent call last):
2026-06-10 08:39:36.189 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/aodh/coordination.py", line 153, in heartbeat
2026-06-10 08:39:36.189 18 ERROR aodh.coordination     self._coordinator.heartbeat()
2026-06-10 08:39:36.189 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/drivers/redis.py", line 61, in wrapper
2026-06-10 08:39:36.189 18 ERROR aodh.coordination     utils.raise_with_cause(
2026-06-10 08:39:36.189 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/tooz/utils.py", line 224, in raise_with_cause
2026-06-10 08:39:36.189 18 ERROR aodh.coordination     excutils.raise_with_cause(exc_cls, message, *args, **kwargs)
2026-06-10 08:39:36.189 18 ERROR aodh.coordination   File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 142, in raise_with_cause
2026-06-10 08:39:36.189 18 ERROR aodh.coordination     raise exc_cls(message, *args, **kwargs) from kwargs.get('cause')
2026-06-10 08:39:36.189 18 ERROR aodh.coordination tooz.coordination.ToozConnectionError: Connection closed by server.
2026-06-10 08:39:36.189 18 ERROR aodh.coordination 
2026-06-10 08:39:37.496 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:37.497 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:37.498 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:37.500 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:37.501 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:37.501 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:37.502 18 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:37.502 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:37.503 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:37.503 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:37.504 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:37.507 16 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:37.507 14 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:39:37.508 20 DEBUG tooz.drivers.redis [-] Redis connection error, will retry - Connection closed by server. wrapper /usr/lib/python3.9/site-packages/tooz/drivers/redis.py:65
2026-06-10 08:40:23.749 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:40:23.763 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:40:23.767 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:40:23.767 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:40:23.767 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:40:23.802 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:40:23.812 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:40:23.819 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:40:23.820 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:40:23.820 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:40:23.932 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:40:23.941 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:40:23.945 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:40:23.945 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:40:23.945 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:40:24.669 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:40:24.680 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:40:24.687 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:40:24.687 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:40:24.687 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:41:23.749 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:41:23.756 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:41:23.759 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:41:23.759 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:41:23.759 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:41:23.802 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:41:23.814 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:41:23.817 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:41:23.817 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:41:23.817 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:41:23.932 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:41:23.940 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:41:23.943 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:41:23.943 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:41:23.943 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:41:24.669 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:41:24.681 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:41:24.687 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:41:24.687 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:41:24.688 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:42:23.750 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:42:23.800 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:42:23.802 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:42:23.808 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:42:23.808 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:42:23.809 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:42:23.813 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:42:23.818 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:42:23.818 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:42:23.818 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:42:23.933 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:42:23.946 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:42:23.951 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:42:23.951 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:42:23.951 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:42:24.670 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:42:24.682 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:42:24.689 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:42:24.689 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:42:24.689 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:43:23.750 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:43:23.762 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:43:23.769 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:43:23.769 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:43:23.769 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:43:23.803 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:43:23.814 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:43:23.820 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:43:23.820 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:43:23.821 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:43:23.933 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:43:23.945 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:43:23.951 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:43:23.952 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:43:23.952 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:43:24.670 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:43:24.680 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:43:24.684 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:43:24.684 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:43:24.684 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:44:23.751 16 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:44:23.763 16 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'4f56fb5e-0f27-474c-a05f-86dad1a10775' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:44:23.770 16 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:44:23.770 16 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:44:23.770 16 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:44:23.803 20 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:44:23.813 20 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f7d44190-b5f1-4c19-a56a-7db52fbb893c' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:44:23.818 20 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:44:23.819 20 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:44:23.819 20 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:44:23.934 14 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:44:23.947 14 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'f71381e2-8934-4f65-a238-d89d9292d45e' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:44:23.955 14 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:44:23.955 14 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:44:23.956 14 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:44:24.670 18 WARNING oslo_db.sqlalchemy.utils [-] Unique keys not in sort_keys. The sorting order may be unstable.
2026-06-10 08:44:24.681 18 DEBUG aodh.coordination [-] Members of group: {b'0cc56aaf-a660-4a2d-bd1e-955746045e98', b'f71381e2-8934-4f65-a238-d89d9292d45e', b'e3d9a634-a908-4928-acb3-e9e7558495d7', b'ff3a4ab9-5c89-4045-bc16-81bf417bc74c', b'3e0bf06a-c9f9-4d7a-8fe3-1117982879b2', b'7a28bea5-d075-44c7-a026-e40d440e67a7', b'4f56fb5e-0f27-474c-a05f-86dad1a10775', b'518417dc-b941-4c6e-aae8-10988b15be26', b'd8c5993f-a7ff-4504-83b7-53443b516f5a', b'f7d44190-b5f1-4c19-a56a-7db52fbb893c', b'6b0b6e6f-3527-43b7-896a-2707c2ed1552', b'dd4db7e1-1f6c-45e6-8a3b-bf38d09704bb'}, Me: b'd8c5993f-a7ff-4504-83b7-53443b516f5a' extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:230
2026-06-10 08:44:24.688 18 DEBUG aodh.coordination [-] Universal set: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:240
2026-06-10 08:44:24.688 18 DEBUG aodh.coordination [-] My subset: [] extract_my_subset /usr/lib/python3.9/site-packages/aodh/coordination.py:243
2026-06-10 08:44:24.689 18 INFO aodh.evaluator [-] initiating evaluation cycle on 0 alarms
2026-06-10 08:45:03.396 2 INFO cotyledon._service_manager [-] Caught SIGTERM signal, graceful exiting of master process
2026-06-10 08:45:03.498 18 INFO cotyledon._service [-] Caught SIGTERM signal, graceful exiting of service AlarmEvaluationService(2) [18]
2026-06-10 08:45:03.498 14 INFO cotyledon._service [-] Caught SIGTERM signal, graceful exiting of service AlarmEvaluationService(0) [14]
2026-06-10 08:45:03.499 20 INFO cotyledon._service [-] Caught SIGTERM signal, graceful exiting of service AlarmEvaluationService(3) [20]
2026-06-10 08:45:03.498 16 INFO cotyledon._service [-] Caught SIGTERM signal, graceful exiting of service AlarmEvaluationService(1) [16]
2026-06-10 08:45:03.499 14 INFO aodh.coordination [-] Left partitioning group alarm_evaluator
2026-06-10 08:45:03.499 18 INFO aodh.coordination [-] Left partitioning group alarm_evaluator
2026-06-10 08:45:03.500 16 INFO aodh.coordination [-] Left partitioning group alarm_evaluator
2026-06-10 08:45:03.500 20 INFO aodh.coordination [-] Left partitioning group alarm_evaluator