Commit Graph

49 Commits

Author SHA1 Message Date
James E. Blair e15b9cae77 Update ZK followers graph
ZK 3.6 no longer emits zk_followers so the best source for this
graph is zk_synced_followers now.

Change-Id: I6eecf834fe7b357f9ba4126135487e09e51900e2
2022-11-02 09:48:36 -07:00
Clark Boylan 5aa6452aa9 Remove geard graphing from zuul-status dashboard
The zuul job queue is no longer stored in geard so we can safely remove
this graph which has been empty for a long time. Additionally we remove
the geard queue graph for logstash as we are beginning the process of
shutting down those services.

We update the span size of the remaining graphs to make them render a
bit more nicely without the old graphs in place.

Change-Id: I1a690cc90279547b9766c6043db6dbbe3e66deb9
2022-04-12 13:31:20 -07:00
James E. Blair c36bb59458 Add zuul-web stats to zuul-status page
This adds some newly created stats (which are already being recorded
in grafana).

Change-Id: Ifbc42fb7e5fc520cb539bad6b8fa5898b6d37c34
2022-02-09 13:02:57 -08:00
Clark Boylan 6572d21490 Limit grafana for zk to zk04-06
We have replaced zk01-03 with zk04-06. We are less interested in the
data for 01-03 on the dashboard now so limit what the dashboard renders
to 04-06.

Change-Id: I5404ba40035f259e234c79529388d8af01fdc0ba
2021-04-27 15:19:32 -07:00
Zuul 44bd894b17 Merge "Add ZooKeeper stats to Zuul dashboard" 2021-03-18 08:13:17 +00:00
James E. Blair 2b087b2de1 Add ZooKeeper stats to Zuul dashboard
This adds the event queue processing time to the zuul dashboard;
that shows the effect of ZK on event processing.  It also adds
several ZooKeeper server performance metrics.

Change-Id: I56196b781e8f7950c3db40647f84d7e8bc6c499d
2021-03-17 19:06:38 -07:00
Clark Boylan 3edb31a778 Update grafana for opendev zuul executors
The zuul executors are ze01-ze12.opendev.org now and not
ze01-ze12.openstack.org. We need to update the zuul status grafana
dashboard to only select the opendev servers and render them properly.

Change-Id: Iff6f311f7ba5bcfb9d23f2d289f071b791a788e8
2021-03-09 14:59:51 -08:00
Andreas Jaeger a494d238b0 Update infra-manual links
The infra-manual publishes now to docs.opendev.org, change links to it.

New location is: https://docs.opendev.org/opendev/infra-manual/latest/

Link specs.o.o contributors link to OpenStack Contributor Guide.

Change http to https for docs.o.o and specs.o.o everywhere.

Depends-On: https://review.opendev.org/713929
Needed-By: https://review.opendev.org/713930
Change-Id: I46bf9e9527941f2120de59fdbc355337f4c019c1
2020-03-21 09:29:14 +01:00
Andreas Jaeger d4673d4539 Add promote pipeline to grafana
We have nearly all pipelines in grafana, add promote add as well.

Change-Id: I3d1d416e025ec98235f4a040844d60c2ad767795
2019-09-14 20:20:59 +02:00
Andreas Jaeger c1c135087d Update grafana for OpenDev
Use opendev.org everywhere.

Change-Id: I688fe1d949eaee39e20bc74f7aea39583ca14f6f
2019-04-20 19:39:11 +02:00
James E. Blair f0f6190d0b Grafana: set zuul node requests yaxis min
Since node requests are something that we generally want to see
reduced to 0, it can be misleading to show a graph where the lowest
point on the y axis is, for example (as I write this) nearly 4,000.
Fix the minimum to zero so it's easier to see what the overall trend
toward zero is.

Change-Id: Iad1b5667fd6d1d4bfa9fe50706ad71debd01d5c6
2018-09-28 13:45:33 +10:00
Roman Gorshunov 70cc48afe0 Minor typo fix: duplicate HDD label
Change-Id: I3d2c9020c6cc52be1d1a5c5003ca5b7811130ea8
2018-07-26 17:49:18 +02:00
Clark Boylan 8bbd215c24 Clarify Zuul Ram and HDD usage graphs
Make it clear that these values are percentages. We update labels to
convey that and scale the values so that we get 71% instead of 7.145.

Change-Id: I64bb9cfa536c2ba395be0264839a7a50929d7477
2018-07-19 09:52:42 -07:00
Paul Belanger 0a911a8b63
Add executor used HDD metric to zuul-status dashboard
Start tracking HDD usage for zuul-executors, as it now has the
ability to stop / start builds.

Change-Id: Ibf891deadcaa8e5d323992e9626765341ca5c44a
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-07-03 16:18:48 -04:00
Ian Wienand c32432c67c zuul grafana: fix load average graph
The scale argument was incorrectly outside the function for the load
average graph.  Also we seem to have acquired some extra ")"'s somehow

Change-Id: I0a6a90ed30fac11aedc889cfdcfd4dbb3f815b5a
2018-06-07 09:40:07 +10:00
James E. Blair 741c026e49 Update executor labels
We're back to using zeXX_openstack_org in the metric names, this
translates them to zeXX in the legend.

Change-Id: I39af625885c3cd179555b3d3143a2391e49a7c81
2018-05-23 16:27:25 -07:00
James E. Blair feb5912f3b Grafana: update zuul executor metrics
The metrics names have changed to replace '.' in hostnames with '_'.

Change-Id: I6271b3ce6a870909f6375bab74cbe590f76f3e39
2018-03-12 11:05:21 -07:00
James E. Blair ce88a73a1e Grafana: switch zuul executor ram metric
This metric name has changed.

Change-Id: Ibd778f8c9fe8011bd1da4aaedd4f4d27b959d26d
Depends-On: https://review.openstack.org/544742
2018-02-14 16:03:35 -08:00
Andreas Jaeger a477736ab8 Remove TripleO pipelines from grafana
These pipelines are dead, remove them from grafana.

Change-Id: I2c8c253688d1525fbebc6238db563ba9dd81fa13
2018-02-06 08:50:33 +01:00
James E. Blair 83b18f08be Add new zuul executor metrics
This adds starting builds (builds which have not yet run their
first playbook), and percent available memory.  Both of these are
used to control whether new jobs are accepted.

Change-Id: Ia0312d13c739da1d19983c8678f0198b0d8ca314
2018-02-04 08:34:12 -08:00
James E. Blair a32db95277 Grafana: reorder zuul graphs
Due to differing heights, the current layout wastes a lot of space
at lower screen widths.  This rearranges the graphs so that the
taller ones are on the bottom and therefore tile better.

Change-Id: I062cd1d96d236c564b15ca96acb72e7f2e49f012
2017-12-13 07:23:48 -08:00
James E. Blair a5c9e1bb35 Add node requests graph to zuul dashboard
This is perhaps the most useful of the indicators which might show
our backlog.

Change-Id: Id48bb17ef2dcb7e906624b2b7ee4b5428a39f824
2017-12-12 15:21:52 -08:00
Andreas Jaeger dae607f47f Remove obsolete silent pipeline from grafana
With Zuul v3 we do not have a silent pipeline, remove it from grafana
display.

Change-Id: Ie247856c08c96dcb648ddbd9f54607eaa0b5367a
2017-11-05 21:14:25 +01:00
David Moreau-Simard d89d62a5e1
Re-order Zuul graphs
There is an easy correlation between the Executor load and the
amount of Running builds. By re-ordering graphs, we're able to get
them to show one directly above the other, making it easier to
spot trends in the data.

When they're in different columns, it's harder to see the
correlation.

Change-Id: I7706c3293fbd702695fb3e4e917e33ca947beef9
2017-10-31 22:27:44 -04:00
James E. Blair ae15463a43 Grafana: drop geard workers gauge
This metric is no longer sent in newer versions of geard.  If we
aren't running it now, we will be soon.  Go ahead and drop it
from the graphs.

Change-Id: I2ee92f0673b28704a6e28b400554cd5a2c9642cd
2017-10-31 17:49:53 -07:00
James E. Blair 21a089c7e9 Grafana: fix gerrit event graph
Change-Id: I1258ba8e3100471784327a16de5b7a17f79ace41
2017-10-31 17:49:53 -07:00
James E. Blair 5382371631 Grafana: add more zuul executor/merger info
Change-Id: Idb1a2ad9b080a7ba55c33b0c8ccfc81687d532f9
2017-10-31 17:49:53 -07:00
Paul Belanger 6a4de836a2
Add 'Accepting Builds' panel for zuul-status
We have a new metric to track if executors are accepting builds or
not.

Change-Id: Icd8671c026e2ed93b0acff536df795b3fa030539
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-10-31 14:00:09 -04:00
Paul Belanger eb52ff84e7
Use new targets for Test Nodes panel
Update zuul-status to use zuulv3 statsd information.

Change-Id: Ida83ad181d30acaec33fa39f7ef353ef99e232eb
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-10-21 14:24:54 -04:00
James E. Blair 7209b0f9c7 Grafana: fix zuul pipeline gauges
This is the correct key under zuulv3.  A bug (fix in progress) still
had some reports occasionally being emitted under the old key (on
reconfiguration events).

Change-Id: I5e2e65b1c9831f2f60e7916e26a3792d86ec25ae
2017-10-21 09:11:21 -07:00
James E. Blair 4c551bcc9b Grafana: fix gerrit event graph
Change-Id: I3c25bc0dc2ccb25210c55a98ceecdfaf106bbef3
2017-10-21 08:59:32 -07:00
James E. Blair a209e5eaed Grafana: fix zuul job launch graph
Change-Id: I73779c3b1eef06779b3fbdc92d92ec8f1fca5e4d
2017-10-21 08:57:36 -07:00
James E. Blair 01748e47d1 Grafana: scale zuul executor load correctly
The load is *100, so scale it appropriately.

Change-Id: I861c498429dd14df2f45021a25afc9d418de61db
2017-10-21 07:37:57 -07:00
James E. Blair 7a33cd6f26 Graphana: Add Zuul v3 executor graphs
Remove the tempest run count which doesn't provide a lot of insight.

Add graphs for two new metrics emitted by executors.

Change-Id: I23c563f1aa155fed341155a5f887c95448a17a07
2017-10-16 17:12:54 -07:00
Dirk Mueller 880d561cad Update zuul-status rendering for the Tempest/Grenade graphs
Change-Id: I0f441ae041b9c9dec3a506afd6a41869be178d7b
2017-07-11 23:30:19 +02:00
Andreas Jaeger e698d683c7 grafana: Follow xenial renames
Rename the jobs for xenial changes.

Change-Id: Ie69c371d6bf92582236eda92d5c99f94a9bbc123
2016-07-29 19:28:54 +02:00
Paul Belanger d044f028d7
Add remaining pipelines to zuul-status dashboard
The ordering is based on what we have in zuul/layout.yaml.

Change-Id: Idcb46c6c3a630bf032192642aa733a545ab03eea
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-04-21 17:50:24 -04:00
James E. Blair 4828abff2f Grafana: Add Tempest check runs graph
This graph approximately answers the question "How many runs would
a third-party CI system be expected to handle for the integrated
gate?"

Change-Id: Iae74306ce3c922be3d82d61ca86e724f7e048dff
2016-03-17 14:21:41 -07:00
James E. Blair dad4da02e5 Add max servers line to all node graphs
Change-Id: Ifb4bd9aa843f7334052a29f54fcf6c4c30ca1bbc
2016-01-11 08:34:16 -08:00
James E. Blair 6d951009f3 Grafana: Update OVH graph with axis labels
Add axis labels and units where appropriate.

Change the launch attempts graphs to summarize to 1m rather than
1h since grafana lets us zoom in.  1m is the lowest native unit
of time that will always show whole numbers for this metric (whose
lowest non-zero value is 1 event / 10 seconds).

Change the test nodes graph to stacked to match the way we normally
draw this graph, but change the tooltip to 'individual' so that
when hovering, individual values for the different states are
displayed, rather than cumulative (which does not make sense for
this application).

Also change the tooltip for the node graphs on the zuul dashboard
in the same manner.

Change-Id: I500aa486362476cff76a3d254093723f27021bed
Depends-On: Ie542dc4d0e151a00e84cc970c2cfa8c02377d7bf
2016-01-07 17:23:27 -08:00
Jenkins e2c5451a75 Merge "Use current valueName for zuul-stats singlestats" 2015-11-20 19:03:46 +00:00
James E. Blair a0dbad04f8 Update nodepool graph to new metrics path
Change-Id: I0ebb3b17c34ca3ef7f645f303fd88bed315a66fe
2015-11-19 17:03:28 -08:00
Paul Belanger 4224caa242 Use current valueName for zuul-stats singlestats
Right now, the values we display are averages, which is confusing
to people.  Setting valueName to current, we'll actually display the
current count for singlestats.

Change-Id: Icb1a62fb8b289165679ceec16e7d65dab98bf602
Depends-On: I4df8d130fce45cf58b01808997fc561cf8c4b42d
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2015-11-19 19:53:56 -05:00
Jenkins 5134316a7c Merge "Rework pipeline singlestat panel" 2015-11-19 22:47:49 +00:00
Paul Belanger 6064cc9a79 Rework pipeline singlestat panel
Add missing tag, pre-release and release stats.

Change-Id: I4fc0aa0849213912715626ca68ec73b2f36d43d2
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2015-11-13 09:43:01 -05:00
James E. Blair 9ebb83c22f Deep link in grafyaml description
Change-Id: I184b68209727f6b2ae55badc23bff55fc31dd855
2015-11-12 10:20:18 -08:00
Paul Belanger 328d501995 Add description to zuul-status dashboard
Change-Id: I7c725ddd51db17c8db79d8241559c5b717d930cf
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2015-11-10 13:58:10 -05:00
Paul Belanger d88e897f2c Update row names for zuul status dashboard
Trivial change that updates the name of the rows for the zuul status
dashboard.  This is also to ensure our gate is working currently.

Change-Id: I68d8f40bee4ee9230d5abc3a4391eb66b2188d93
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2015-10-06 08:27:12 -04:00
Paul Belanger 25932eca7c Add grafana dashboard for status.o.o/zuul
This is our first grafyaml dashboard which reproduces the current
graphs on status.o.o/zuul rendered by graphite. While we aren't
actually running grafyaml upstream yet, we can get started on building
our dashboards.

We also added a tox job to properly gate on the configuration.

Change-Id: Ia738bcb510e146ab38566f0c13ff483ec618a6ed
Depends-On: I16b9affd4402fe5d1637238a2e27f22fdd3986ff
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2015-10-05 16:09:32 -04:00