Commit Graph

774 Commits

Author SHA1 Message Date
Zuul 2d19472f19 Merge "[Neutron-tempest-plugin] Update Grafana Dashboard" 2024-01-09 16:19:09 +00:00
Brian Haley 222b2da517 [Neutron-tempest-plugin] Update Grafana Dashboard
Updated to the latest jobs run in the check and gate
queues. Removed old releases and added new ones as
we only test 2023.2/2023.1/Zed/Yoga now.

Change-Id: I5a5e7fa7dd479774334e2751448c0e7379f47063
2023-11-29 15:03:27 -05:00
Brian Haley 59bfdd48d7 [Neutron-lib] Update Grafana Dashboard
Updated to the latest py311 jobs, removed some of the
periodic jobs we no longer run.

Change-Id: I3d5b307f33b912307380cdbe17f5389c8d7c5826
2023-11-28 12:22:21 -05:00
yatinkarel 804cb28b00 [Neutron] Update Grafana Dashboard
Depends-On: https://review.opendev.org/c/openstack/neutron/+/899746
Change-Id: I049e74603ca02c563a3e7b1f1b3fdab07bdac96d
2023-11-15 16:17:34 +05:30
yatinkarel 45f0c8c4c9 Update Grafana dashboard for Neutron master
Update dashboard as per recent changes in the neutron
job pipelines.

Depends-On: https://review.opendev.org/c/openstack/neutron/+/899450
Change-Id: Ic7e9739fd016f00139cf617e67196b03eaef6a12
2023-10-27 10:20:57 +05:30
Clark Boylan 244a14c71b Remove fedora image from dib status
We are no longer building these images so don't need them on the dib
status grafana dashboard any longer. This dashboard lists all images in
graphite to generate a list of images to produce statuses for. We
exclude the fedora images using a negative lookahead regex.

Change-Id: I2d7ba7984c98ec103142fa23e3a7b31e9d1c7485
2023-09-19 15:20:09 -07:00
Zuul c91056866a Merge "Grafana: remove networking-odl board" 2023-07-25 16:34:21 +00:00
elajkat b0bdbf31cc Grafana: remove networking-odl board
networking-odl is deprecated (see [1]), so no need for
these old graphs.

[1]: https://review.opendev.org/c/openstack/networking-odl/+/886752

Change-Id: I16cce758922377fd4ae82d44825d61129ad909bc
2023-07-25 17:23:36 +02:00
elajkat 09bd23f8d5 Grafana: remove tap-as-a-service board
TAAS is monitored by Neutron team, it has weekly jobs,
these old graphs are not necessary any more.

Change-Id: If1297eaa1ad71b423be7db2cd3f38d2b7aaf6b84
2023-07-25 17:20:55 +02:00
Clark Boylan f06b263740 Revert "Pull grafyaml from quay.io"
This reverts commit 01cbb2cdab.

OpenDev is moving back to docker.io to preserve speculative container
image testing.

Depends-On: https://review.opendev.org/c/opendev/grafyaml/+/884291
Change-Id: I37061889efe876511b21209295d9a8124a6f5bcb
2023-05-24 13:54:28 -07:00
Michal Nasiadka d423a4ae9d grafana: Update kolla dashboards with proper job names
Change-Id: Id44d29533f5bac444d316cc46e1b239b69286ea5
2023-05-16 10:05:19 +02:00
Clark Boylan 01cbb2cdab Pull grafyaml from quay.io
The grafyaml image is being published to quay.io now. Update our
location for this image to ensure we pull it from the correct location.

Depends-On: https://review.opendev.org/c/opendev/grafyaml/+/882493
Change-Id: I28a5a735b4e60281ec96c95887ba8d96d106063c
2023-05-08 08:55:09 -07:00
Rodolfo Alonso Hernandez 8a4e699b71 Remove "neutron-ovn-tempest-ovs-release-ubuntu-old" job
Neutron is no longer tested in "Ubuntu Focal".

Related-Bug: #2017500

Change-Id: I97f4ff0021a44d5e80b22fb84f1b9b2b1c06038f
2023-04-21 03:04:33 +02:00
Jeremy Stanley 7c81cf6eda
Farewell limestone
The mirror in our Limestone Networks donor environment is now
unreachable, but we ceased using this region years ago due to
persistent networking trouble and the admin hasn't been around for
roughly as long, so it's probably time to go ahead and say goodbye
to it.

In preparation for cleanup of credentials in system-config, first
remove configuration here except leave the nodepool provider with an
empty diskimages list so that it will have a chance to pick up after
itself.

Change-Id: I504682884a1439fac84d514880757c2cd041ada6
2023-02-14 08:25:10 +11:00
Sławek Kapłoński 4bc3936945 Update Grafana's dasboard for Neutron
This patch updates jobs which are run in check and gate queues for the
Neutron project.
It also removes periodic jobs graphs as those jobs are always run only
once a day and there's no need to keep them in the dashboard really.

Change-Id: Id640ea182837d46a3010a65a2d17b887192d54a6
2022-12-19 12:17:27 +01:00
Clark Boylan 7b0629e2cb Remove iweb nodepool configs
This removes iweb configs from the project-config repo. We'll still have
a few system-config items to clean up in a separate change.

Change-Id: I7bd2f0f6fcd7449e724815ed0c0fe743702ae8f3
2022-12-12 08:43:43 -08:00
Clark Boylan 4ef6ea4d10 Fix nodepool API ops Grafana graphs
openstacksdk statsd records for API operations are not response code
specific. This change adds a glob to the statsd record path to include
all return code response metrics in our API graphs. I believe this
change may have come with the openstacksdk 0.103.0 update. We also
update paths for servers POST, server details, and flavor details as
they have changed.

Note the network info is empty which is why we don't get graphs for
them, but the paths appear correct. I think this may be beacuse we don't
need to query network info in any of our clouds currently.

While we are at it we stop updating the airship and inap cloud graphs
since those should be cleaned up and this keeps the review overhead
smaller.

Change-Id: I5a6b80118afaf3b7782a1d1c131787f208583799
2022-12-08 15:42:45 -08:00
James E. Blair e15b9cae77 Update ZK followers graph
ZK 3.6 no longer emits zk_followers so the best source for this
graph is zk_synced_followers now.

Change-Id: I6eecf834fe7b357f9ba4126135487e09e51900e2
2022-11-02 09:48:36 -07:00
Neil Hanlon d39b89c486
Add rockylinux 9 to OSA grafana
Change-Id: Ie0cfc69eccc4238b8b20250ec2cda0438ea076a4
2022-10-03 10:19:03 -04:00
Slawek Kaplonski f0a79a72c3 [Grafana] Neutron dasboard change Fedora job to Centos 9 Stream
Periodic job based on Fedora image was recently changed to be run
on Centos 9 Stream.
This patch updates neutron grafana dashboard accordingly.

Change-Id: Ic2d44e553103bf95696f094271c078e254801213
2022-08-04 10:01:52 +02:00
Ian Wienand 081f477991 grafana: pull grafyaml in helper script
Make sure before running the grafana image is pulled so we get any
updates before trying to load the dashboards.

Change-Id: I01d1a2874cc96926ff60746af617e75c19f99b1b
2022-08-04 13:58:52 +10:00
Zuul 75442701aa Merge "grafana: better loop for container start" 2022-08-04 03:23:22 +00:00
Zuul 7c212c5cec Merge "grafana: helper script updates" 2022-08-04 03:16:54 +00:00
Ian Wienand 3bebc2d0dd grafana: better loop for container start
Make this more reliable by probing for the service

Change-Id: I8a7d1577d416e4833cc5925667600f7a0540fc68
2022-08-04 11:16:41 +10:00
Zuul 6f85cb6672 Merge "grafana: update nodepool-dib status page" 2022-08-04 00:11:09 +00:00
Zuul 00fb975c9c Merge "grafana: add helper script" 2022-08-04 00:11:07 +00:00
Zuul 34aa3aeb1b Merge "grafana: Add infra deployment overview" 2022-08-04 00:11:04 +00:00
Ian Wienand 3dbb32adb3 grafana: helper script updates
Responding to comments from Ibbc2b116d0c496655a7ce6bb6971e8270ac32647

Make the script run in the grafana .yaml directory so you don't have
working-directory issues.

Put the secrets in this directory and add them to .gitignore

No need for a tty on the loading call

Additionally make it executable, and have a short pause to let the
container start.

Change-Id: Icf0a2cfb1a0f5599704d6c8c9e85345d61884cd5
2022-08-04 10:03:34 +10:00
Slawek Kaplonski 6452e53157 Add Grafana dashboard for the Tobiko CI
Change-Id: Icf762f6aae68abf4e4885f7d48483d1698570706
2022-07-25 23:57:06 +02:00
elajkat b863397eed VPNAAS: remove old jobs from grafana
neutron-vpnaas Train and Ussuri branches are no more maintained (see
[1]), so the EOL process has been started on them (see [2]), and as a
consequence not existing jobs can be removed from grafana dashboard.

[1]: http://lists.openstack.org/pipermail/openstack-discuss/2022-May/028728.html
[2]: https://review.opendev.org/c/openstack/releases/+/843167

Change-Id: I683a61b1bae1a809caf724aee87a21af2e18fb0c
2022-07-22 15:37:15 +02:00
Ian Wienand 5c57b07f96 grafana: update nodepool-dib status page
Update this to new panel types and modify layout a bit.  This uses a
variable to map over the stats, rather than the old template model.

This replaces the non-working thresholds that show the "OK"/"FAILED"
with value mappings which should be more reliable.

This also includes a heatmap at the top -- it's a bit weird because
it's mapping the return values of the builds, so can range between
0->128.  The return code value doesn't really help diagnose anything,
but it can highlight if things are failing in the same way (i.e. with
the same return code).

Change-Id: I74822881251c627d8e783438fa82e39aeca5645e
2022-06-30 15:50:41 +10:00
Ian Wienand 859005d497 grafana: add helper script
Add a helper script and assocated README.rst to explain the
interactive development process.

Depends-On: https://review.opendev.org/c/opendev/grafyaml/+/833212
Change-Id: Ibbc2b116d0c496655a7ce6bb6971e8270ac32647
2022-06-30 14:37:01 +10:00
Ian Wienand 1cf5b35fa0 grafana: Add infra deployment overview
This replaces the old bridge runtime graph with a new graph that uses
the stats from I90dfb7a25cb5ab08403c89ef59ea21972cf2aae2.

Note this is the first use of a .json based graph.  This graph uses
the new "time series" panel [1].

[1] https://grafana.com/docs/grafana/latest/visualizations/time-series/

Change-Id: I8b1854a0dd7ff2c6249d02e066a8df979f85c799
2022-06-30 14:37:01 +10:00
Jonathan Rosser 4a018763f9 Update openstack-ansible grafana dashboard job status rates
1) Update plots to include current operating systems for master
branch.

2) Calculate the rates with respect to all returned statuses rather
that just SUCCESS/FAILURE/TIMEOUT.

3) Add a plot specifically for POST_FAILURE

Change-Id: I0f5dea071cb2b6212538ef42bad169a089f6e458
2022-06-28 16:33:21 +01:00
Jonathan Rosser a3b0174994 Update openstack-ansible grafana dashboard
Update with the current set of operating systems running jobs on
master branch:

Remove Centos 7
Switch Centos 8 to Centos 8 stream
Add Centos 9 Stream
Remove Ubuntu Bionic
Add Ubuntu Jammy
Add Rockylinux 8

Change-Id: I1c4705ccf92b2d4c6ca372b26572e674d93e1bdb
2022-06-28 14:28:38 +01:00
yatinkarel 284172c14c neutron-tempest-plugin grafana update
Replace jobs which are no longer running with
jobs which are running from recent releases.

queens/rocky/stein/train jobs are no longer running
in neutron-tempest-plugin gate, instead now we run
wallaby/xena/yoga jobs, update dashboard to reflect
the same.

Change-Id: Ibba8260fb13e6baf6d33103b9ea71c142cddc7c6
2022-06-15 17:27:27 +05:30
yatinkarel 4486d28ebd Update Neutron Grafana as per recent changes
neutron-tempest-plugin scenario jobs were renamed and api
job was dropped with [1], more jobs are added to neutron-lib [2].

This patch adapts dashboard as per it.

[1] https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/836912
[2] https://review.opendev.org/c/openstack/neutron-lib/+/837590

Change-Id: I70c468090204354bdf7ec0a45c715b30a2343f19
2022-06-15 17:06:32 +05:30
Zuul 9d87ca5a01 Merge "Add py38/py39 jobs to Grafana" 2022-06-14 15:58:43 +00:00
Zuul 4c8efad872 Merge "Remove lower-constraints and tox-py36 from Neutron Grafana" 2022-06-14 15:58:41 +00:00
elajkat 97945117ba Add py38/py39 jobs to Grafana
Add py39 job to neutron-dynamic-routing and neutron-lib graphs, py38 to
neutron graphs.

Change-Id: Id731812c56a526c7dd196a96ff8668de996a8a27
2022-06-13 16:25:35 +02:00
Zuul 5d1c260495 Merge "grafana ceph: add nova stable/(xena|yoga) branches" 2022-06-06 18:54:10 +00:00
Dr. Jens Harbott a161fa321e Update kolla grafana panel
Try to see whether averaging over 72h instead of 24h gives more useful
graphs.

Fix names for centos jobs.

Add panel for cephadm jobs.

Change-Id: I2e81551c3a618a31ef902e7abeb21b2ba1fe9161
2022-06-03 09:25:29 +02:00
Dr. Jens Harbott d391c5b04a Fix kolla panel for Grafana, part 2
This is a follow-up to [0] fixing some pipeline names.

[0] I27fe7f3ca1ae4e821240d97b97fbf0c7fb09600d

Change-Id: I9be97564806ade48a49556d8e595bcbeea123db4
2022-05-28 11:47:01 +02:00
Dr. Jens Harbott 7be0824a6e Fix kolla panel for Grafana
Drop binary jobs that no longer run. Add aarch64 jobs and publish jobs.

Change-Id: I27fe7f3ca1ae4e821240d97b97fbf0c7fb09600d
2022-05-28 10:40:13 +02:00
Dr. Jens Harbott 3e4641eb6e Add missing volumes to Grafana AFS page
Seems it was missed to add them when they were created.

Change-Id: I9f3783c74ee9d3dd1953f5fdb76284366f18db8f
2022-05-24 14:16:00 +02:00
Ghanshyam Mann df5a9f05f2 Migrate neutron-lib-master testing to py39
From Zed cycle onwards, py36 support has been dropped, this
migrate neutron-lib master testing by replacing
openstack-tox-py36-with-neutron-lib-master with
openstack-tox-py39-with-neutron-lib-master

Depends-On: https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/842646
Change-Id: Ic10aadbffd76b134e9a546dc1c29ca6116e45a92
2022-05-21 09:17:09 -05:00
Rodolfo Alonso Hernandez e67be4ceec Remove lower-constraints and tox-py36 from Neutron Grafana
This patch removes the following graphs:
- lower-constraints from any Neutron related project.
- tox-py36 from any Neutron related project in master branch.

Change-Id: Ia7a07b62b492f7065ac478abb6554c2e667591d1
2022-05-16 11:40:03 +00:00
Dr. Jens Harbott 1bdccd42e5 Start launching Jammy images
The first image was built successfully, so we can start launching them.

Change-Id: Ie84d1700b6f4f7696e14dfe01bc887e422163d7e
2022-04-26 13:53:29 +02:00
Clark Boylan 5aa6452aa9 Remove geard graphing from zuul-status dashboard
The zuul job queue is no longer stored in geard so we can safely remove
this graph which has been empty for a long time. Additionally we remove
the geard queue graph for logstash as we are beginning the process of
shutting down those services.

We update the span size of the remaining graphs to make them render a
bit more nicely without the old graphs in place.

Change-Id: I1a690cc90279547b9766c6043db6dbbe3e66deb9
2022-04-12 13:31:20 -07:00
Ian Wienand 64b8adeb69 grafana: update afs for centos 9 wheel volumes
Also remove some random extra newlines that have appeared

Change-Id: Ic935bba94e2c640ffd51bf12fcf4da04f88a04b2
2022-04-08 11:53:37 +10:00