Skip to content

[18.0-fr7] [OSPRH-32145] Configure scraping of all mysqld pods - #1105

Open
vyzigold wants to merge 1 commit into
openstack-k8s-operators:18.0-fr7from
vyzigold:all-galeras-fr7wq
Open

vyzigold wants to merge 1 commit into
openstack-k8s-operators:18.0-fr7from
vyzigold:all-galeras-fr7wq

Conversation

@vyzigold

@vyzigold vyzigold commented Oct 19, 2026 •

Copy link
Copy Markdown
Contributor

Change the configuration of mysqld_exporter and its scrapeconfig to scrape all galera replicas. To do this, we need to discover each replica's IP address through the EndpointSlice object. This fixes a bug where metrics for other replicas weren't being scraped at all.

This is a similar solution as previously used for RabbitMQ scraping in: #780

Assisted-By: Claude-Code claude-opus-4-6
Cherry-Pick-Of: #1104
Depends-On: infrawatch/feature-verification-tests#481

Change the configuration of mysqld_exporter and its scrapeconfig
to scrape all galera replicas. To do this, we need to discover
each replica's IP address through the EndpointSlice object. This fixes a
bug where metrics for other replicas weren't being scraped at all.

This is a similar solution as previously used for RabbitMQ scraping
in: openstack-k8s-operators#780

Assisted-By: Claude-Code claude-opus-4-6
Depends-On: infrawatch/feature-verification-tests#454
@openshift-ci
openshift-ci Bot requested review from jlarriba and paramite October 19, 2026 08:12
@coderabbitai

coderabbitai Bot commented Oct 19, 2026

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration
  • Configuration used: Central YAML (base), Organization UI (inherited)
  • Review profile: CHILL
  • Plan: Enterprise
  • Run ID: f0bbdf39-5463-4e87-bd76-7f637c9880e5

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Comment @coderabbitai help to get the list of available commands.

@jlarriba

Copy link
Copy Markdown
Collaborator

/lgtm

@centosinfra-prod-github-app

Copy link
Copy Markdown

This change depends on a change that failed to merge.

Change #1098 is needed.

@vyzigold

Copy link
Copy Markdown
Contributor Author

this is still pulling quay.rdoproject.org cs10 images in the kuttl-tests, ignoring Depends-On. We'll need to get the depends on PRs merged first if they ever manage to pass CI.

@vyzigold

Copy link
Copy Markdown
Contributor Author

recheck

@vyzigold

Copy link
Copy Markdown
Contributor Author

/retest

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/e031b7135c4d46d8bff6e6369491d3b9

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 5h 35m 57s
✔️ telemetry-operator-multinode-cloudkitty SUCCESS in 1h 39m 23s
✔️ telemetry-openstack-meta-content-provider-all-services-master SUCCESS in 3h 52m 12s
❌ telemetry-operator-multinode-master FAILURE in 1h 27m 20s
✔️ openstack-k8s-operators-content-provider SUCCESS in 3h 43m 39s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 31m 10s
❌ functional-audit-logging-tests-osp18 POST_FAILURE in 22m 05s
❌ functional-tests-osp18 TIMED_OUT in 3h 24m 53s

Warning:
File ansible/tmp/35fb6de320db4b00830a7c68a099556d found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job functional-audit-logging-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/c5c026bad23949ffae1bf7b773c34c0c found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job functional-audit-logging-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/cd362fb76cef49aea96a9dd86df8b94e found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job functional-audit-logging-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/35fb6de320db4b00830a7c68a099556d found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job functional-audit-logging-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/c5c026bad23949ffae1bf7b773c34c0c found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job functional-audit-logging-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/88f9553fb14448c28de161548f860bc8 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-cloudkitty. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/b0964ea2fb43472b9184c40fcefcbda2 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-cloudkitty. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/88f9553fb14448c28de161548f860bc8 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-cloudkitty. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/b0964ea2fb43472b9184c40fcefcbda2 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-cloudkitty. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/88f9553fb14448c28de161548f860bc8 found in build home directory during playbook review.rdoproject.org/config/playbooks/crc/print-machineconfigpool.yaml for job telemetry-operator-multinode-cloudkitty. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/known_hosts.old found in build home directory during playbook review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml for job telemetry-operator-multinode-cloudkitty. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/b330b515e17440959cb7427c72348ded found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/6bc3b74081484c3983e5b554cadafb82 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/b330b515e17440959cb7427c72348ded found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/6bc3b74081484c3983e5b554cadafb82 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/b330b515e17440959cb7427c72348ded found in build home directory during playbook review.rdoproject.org/config/playbooks/crc/print-machineconfigpool.yaml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/known_hosts.old found in build home directory during playbook review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/95b76fd9122b4095a718b4f13dada787 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-master. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/78cdcdf5815a42fb88e3f7d0ab6e9888 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-master. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/806de6944dfc4132951953e6dd2b52e0 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-master. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/aa38cd6f118a4b95b4b3f5c59b477932 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-master. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/95b76fd9122b4095a718b4f13dada787 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-master. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/known_hosts.old found in build home directory during playbook review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml for job telemetry-operator-multinode-master. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/b1da7a02c06d45bb96db67e14dd41d7e found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job functional-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/49105e4796014fdcbd17adecf0ab61f6 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job functional-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/61411c42b091420d9738217aa4860b76 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job functional-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/4f8cec027590419eaaa1bbdcbd739637 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job functional-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/b1da7a02c06d45bb96db67e14dd41d7e found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job functional-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/known_hosts.old found in build home directory during playbook review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml for job functional-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.

@vyzigold

Copy link
Copy Markdown
Contributor Author

recheck with depends on to prevent ovn metric verification

@openshift-ci

openshift-ci Bot commented Oct 23, 2026

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: danpawlik, vyzigold

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/63370f26a5154f9fb98409ee1a0ce689

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 3h 05m 59s
❌ telemetry-operator-multinode-cloudkitty FAILURE in 1h 24m 14s
✔️ telemetry-openstack-meta-content-provider-all-services-master SUCCESS in 2h 08m 06s
❌ telemetry-operator-multinode-master FAILURE in 1h 24m 28s
✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 57m 10s
✔️ telemetry-operator-multinode-default-telemetry SUCCESS in 1h 27m 21s
✔️ functional-audit-logging-tests-osp18 SUCCESS in 1h 25m 18s
❌ functional-tests-osp18 FAILURE in 2h 28m 41s

Warning:
File ansible/tmp/69cc89be85a4400481c55a57eb78689c found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-cloudkitty. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/0fc999f7dcb04ee193bd27a366ae3806 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-cloudkitty. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/0d0ddee1a7054844b37bb38ca197ef6f found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-cloudkitty. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/46e2e1e69640486abb37383a740f9b80 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-cloudkitty. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/69cc89be85a4400481c55a57eb78689c found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-cloudkitty. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/known_hosts.old found in build home directory during playbook review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml for job telemetry-operator-multinode-cloudkitty. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/8d7c5f04122f480c8031f91d295f0eaa found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job functional-audit-logging-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/1e35abd2352a45daa4d76e88d64fcdea found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job functional-audit-logging-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/8d7c5f04122f480c8031f91d295f0eaa found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job functional-audit-logging-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/1e35abd2352a45daa4d76e88d64fcdea found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job functional-audit-logging-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/8d7c5f04122f480c8031f91d295f0eaa found in build home directory during playbook review.rdoproject.org/config/playbooks/crc/print-machineconfigpool.yaml for job functional-audit-logging-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/known_hosts.old found in build home directory during playbook review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml for job functional-audit-logging-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/947f6e1524f84c27a48a7e2542b60303 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/d80f6284d370467ab60bfcad1d7b1b51 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/947f6e1524f84c27a48a7e2542b60303 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/d80f6284d370467ab60bfcad1d7b1b51 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/947f6e1524f84c27a48a7e2542b60303 found in build home directory during playbook review.rdoproject.org/config/playbooks/crc/print-machineconfigpool.yaml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/known_hosts.old found in build home directory during playbook review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml for job telemetry-operator-multinode-default-telemetry. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/bc9640032f75459ea1e0798a2b5176c8 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-master. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/31443ec3977d4a60ab28b0aa85be419f found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-master. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/325083e1c02849f2ba5c8bc0a0e37018 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-master. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/caff551e39204d69bba5432e6df9c12d found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job telemetry-operator-multinode-master. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/bc9640032f75459ea1e0798a2b5176c8 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job telemetry-operator-multinode-master. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/known_hosts.old found in build home directory during playbook review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml for job telemetry-operator-multinode-master. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/567fd3b3d8f14894bc0985778ae24837 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job functional-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/429386912fb3406282d3aa1f915b4f09 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job functional-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/7b1e6a7789c847a7ba08236e04e50e89 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job functional-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/9ed6469507634135a09eff6305dd1411 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml for job functional-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File ansible/tmp/567fd3b3d8f14894bc0985778ae24837 found in build home directory during playbook github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml for job functional-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.
File .ssh/known_hosts.old found in build home directory during playbook review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml for job functional-tests-osp18. Add to preserve-home-paths if safe, or otherwise remove.

@vyzigold

Copy link
Copy Markdown
Contributor Author

oh nice. Finally some results. Turns out, I didn't realize this relies on another change, which is currently only on main.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants