Commit Graph

304 Commits

Author SHA1 Message Date
Zuul 59f747814a Merge "Revert "Make centos 9 stream jobs non-voting"" 2024-03-15 12:16:44 +00:00
Jaromir 083ccea2d1 Make regex for excluding tests more specific
Change-Id: I524fb2ad7e064aeaecf5515a13e33adcac9588e7
2024-03-11 15:52:19 +01:00
Takashi Kajinami 63622b85ce Revert "Make centos 9 stream jobs non-voting"
This reverts commit 30b484312f.

Reason for revert:
The libvirt bug has been fixed in libvirt 10.0.0.

Change-Id: I62acbb437e894bf3fefb19bbb533aa8ba13a6bcf
2024-03-08 14:16:05 +00:00
Jaromir Wysoglad b8fd0674ad Fix sg-core test scenario.
The scenario assumed, there is an image in glance, which may
not always be the case. This patch creates a new image based
on path configured in CONF.scenario.img_file. To add this
functionality the TestTelemetryIntegrationPrometheus class
was moved to inherit from tempest.scenario.manager.ScenarioTest.
Requirements on glance and ceilometer were added too. Ceilometer
was required even before this change, but the requirement check
was missing.

The scenario assumed the ceilometer pipeline interval is less
than 2 minutes. This patch adds a config option for this.
By default 300s is used, which is the default interval when
installing devstack. It's then changed to 15s in .zuul.yaml,
which is the interval used in our tests.

Change-Id: Ifae664540fc5a749b2965822267d7c54b34a77a5
2024-03-08 14:14:57 +00:00
Takashi Kajinami 74d1968199 Drop dib-utils
This repository was retired as part of retirement of TripleO.

Also filter out some of the failing scenario tests to unblock gate.

Co-Authored-By: Erno Kuvaja <jokke@usr.fi>

Change-Id: Ida1c84c6db338fa5cc7f842f4bf16b5613acdc9f
2024-03-07 16:48:58 +00:00
Jaromir Wysoglad 429550decd Fix typo to enable sg-core service in tempest conf
The telemetry_tempest_plugin.scenario.test_telemetry_integration_prometheus test is currently being skipped, because sg-core isn't configured correctly as available.

See https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_57b/908258/2/gate/telemetry-dsvm-integration/57bd243/testr_results.html where it's skipped.

Change-Id: I02fba4a64afb5765f47d48283b17d2f54d951bb7
2024-02-13 14:49:14 +00:00
Takashi Kajinami 08f36e0ff0 Fix typo in alarm backend name
It should be postgresq"l" instead of postgresq.

Change-Id: I0b8ab464bdf0227a8efb29a90087adc900d60225
2024-02-07 19:28:13 +09:00
Takashi Kajinami 30b484312f Make centos 9 stream jobs non-voting
... because these are now broken by a bug in libvirt 9.10.0[1].

[1] https://issues.redhat.com/browse/RHEL-20609

Change-Id: I3436d30db7538d406de996dc16202fab4407b07c
2024-02-07 19:28:13 +09:00
Takashi Kajinami 0beea18cea Refactor options to enabled backends
Aodh can use only one database so having multiple options per backend
software is very redundant.

Also, gnocchi and prometheus are used for the same purpose so can use
a single option instead.

Change-Id: I134cf61d8137409ef5f5d959177e349781110eaa
2024-02-01 01:52:45 +09:00
Zuul 7cb127ad95 Merge "Separate backends by type" 2024-01-31 10:30:10 +00:00
Zuul 764fdc6aa1 Merge "Revert "Remove autoscaling until gate issues sorted out"" 2024-01-30 17:10:34 +00:00
Zuul 003e2456d9 Merge "Increase attempts to delete archive policy" 2024-01-30 17:10:33 +00:00
Jaromir Wysoglad 41ba667c29 Increase attempts to delete archive policy
We have suspected autoscaling tests failing, because the "gabbilive" archive policy can't be
deleted in time. Yet the recent experiments does not support it. This bumps the number of
retries from 360 to 1000 attempts to avoid this happening in the gate where the environment
can be slightly different.

Change-Id: I0936c9c6a12af0ea8ca2d8cb24f0807132125d45
2024-01-30 14:50:24 +00:00
Zuul 54d4d23a18 Merge "Remove usage of six" 2024-01-22 15:12:19 +00:00
Matthias Runge 85721b65b4 Revert "Remove autoscaling until gate issues sorted out"
This reverts commit 34e514a482.

In general, we'd want to check autoscaling from end to end.

Until now this plugin could only scale up the stack by adding
an instance. With this change, scaling down of instance is
also tested using a scaledown policy and an alarm which
is triggered if instance CPU usage falls below the threshold.

Depends-On: https://review.opendev.org/865386
Depends-On: https://review.opendev.org/868105
Depends-On: https://review.opendev.org/c/openstack/telemetry-tempest-plugin/+/904746

Co-authored-by: Yadnesh Kulkarni <ykulkarn@redhat.com>

Change-Id: I7f19dcaf327b636ef8328c6634d295414b7c8e65
2024-01-04 13:12:42 +00:00
Erno Kuvaja b0e0912d95 Separate backends by type
Adding telemetry_services config group.

Deprecating old gnocchi and sg-core service options.

Splitting the backend specific tests into their own paths so they
can be disabled based on configuration.

Change-Id: I4ca0e217998825589f755d1169aa0600cef14248
2023-12-21 10:59:44 +00:00
Takashi Kajinami dc52290672 Remove usage of six
Because this plugin now supports pyton 3 only, usage of six is no
longer necessary.

Change-Id: I00cd2c6f9fd466c2a6fe486be6ad6929e893c9b0
2023-12-20 21:58:37 +09:00
Takashi Kajinami 4cdadb6425 Remove unused babel.cfg
This file is no longer used since [1] was merged.

[1] 7716ce070e

Change-Id: I995cf9dd1bc71d4e5cab82610d246971d4f75484
2023-12-20 21:42:58 +09:00
Jaromir Wysoglad b8ab3aa628 Cleanup .zuul.yaml
If we agree, that we don't need to test anything older than
wallaby, then we can clean .zuul.yaml like this. After we drop
wallaby in the future, we can remove even more.

Change-Id: Ie437138a5befde3fe559fc9e75b7a5772f543f98
2023-12-04 06:07:13 +00:00
Zuul de403c5fb5 Merge "Add test_addtitions to the TOC tree" 2023-11-30 12:11:22 +00:00
Zuul 0ac5e7dc2d Merge "Disable sg-core related tests by default" 2023-11-30 11:41:50 +00:00
Zuul daa8eb59d4 Merge "Add functional integration test coverage for Aodh" 2023-11-30 05:31:05 +00:00
Erno Kuvaja 5007212cbd Add functional integration test coverage for Aodh
These additional tests are covering the former fuctional
test from Aodh in-tree tests.

Change-Id: Ib6df8cd9d6c09736df1b13a8bb4b0781ef1dafa3
2023-11-29 12:13:53 +00:00
Takashi Kajinami 76400660fb Disable sg-core related tests by default
The sg-core is not required to run Telemetry services. Enabling tests
requiring sg-core by default is not backword-compatible and affects
testing in distributions(eg. RDO) or any users using tempest to
validate their deployments.

Change-Id: Ib08a42f22325d4029b5148f081e1b095fbfc723e
2023-11-29 19:46:23 +09:00
Jaromir Wysoglad 3dd1d0df75 Separate prometheus related tests
We have an issue, that tempest doesn't distinguish between
branches. New features aren't available on old branches and
so we can't execute testing, which involves sg-core or prometheus
on old branches. Separating sg-core and prometheus related tests
allows us to use tempest regex to execute those tests only on
branches, which have the required features.

This also fills in service_available requirements, to make it
clear which tests are runable on prometheus based storage
and which are runable on gnocchi based storage.

Change-Id: Ic5bea08295d8c85303c676706415e093625ee16f
2023-11-23 05:32:25 -05:00
Joel Capitao 3f1b99f10f Add test_addtitions to the TOC tree
As follow-up of [1]

[1] https://review.opendev.org/c/openstack/telemetry-tempest-plugin/+/900543

Change-Id: Ic55c2f0f879e5b0785246f0b1f0c88ca9f3fa172
2023-11-21 14:33:09 +01:00
Zuul 8271356a67 Merge "Add sg-core integration test" 2023-11-21 04:53:22 +00:00
Zuul 18127f5816 Merge "Add a description about how to add new tests." 2023-11-21 03:57:28 +00:00
Jaromír Wysoglad d6c4972d41 Add sg-core integration test
Depends-On: I01ed2c96395baf294aa84e4f989ab82f9b387fc4
Change-Id: Ibedd21fee25214409a3683bb58e18017918c59b2
2023-11-14 07:49:38 +00:00
Jaromir Wysoglad 4259a2c7a2 Add a description about how to add new tests.
Change-Id: I927f6eb994741315d7728e2a03271bc6c5ac931b
2023-11-09 11:21:34 -05:00
Takashi Kajinami 1759b9e404 Disable GLOBAL_VENV and disable "telemetry-dsvm-integration-train"
* Devstack recently introduced the functionality to use a single venv[1]
but some devstack plugins in telemetry project are not compatible with
this change.

This disables the option as a short term workaround.

* Tempest CI job "telemetry-dsvm-integration-train" for Train release
fails due to
```
Obtaining file:///opt/stack/nova
nova requires Python '>=3.8' but the running Python is 3.6.9
```
Train release of Nova and Heat projects have reached EOL which are
fetched while running this job. If any issues are identified in these
releases fixing them might not be possible.

[1] https://review.opendev.org/c/openstack/devstack/+/558930

Change-Id: I01ed2c96395baf294aa84e4f989ab82f9b387fc4
2023-09-08 17:58:27 +05:30
Zuul 2064db7dc7 Merge "Pin stable/wallaby jobs nodeset to Ubuntu Focal (20.04)" 2023-04-20 16:21:36 +00:00
Takashi Kajinami c6061685cc Replace reference to deprecated [service_available] aodh_plugin
This option was deprecated in favor of the new aodh option. However
the old name is still used by code which causes the following warning
message.

WARNING oslo_config.cfg [-] Config option service_available.aodh_plugin
is deprecated. Use option service_available.aodh instead.

Change-Id: If10cec87a2f07f9dbe09005bb22070ca7a6e9364
2023-03-22 00:06:15 +09:00
Sean Mooney 5ba27fb82d Add gnocchi to required projects
The latest release of gnocchi is not installable
due to the protobuf version we use in upper constraints.
This change adds gnocchi as a required project so that
it will be cloned by Zuul and added to LIBS_FROM_GIT

Depends-On: https://review.opendev.org/c/openstack/devstack/+/872902

Change-Id: Ie70fec0a79b8c9ba1354cf32d6740ac710976c5c
2023-02-08 12:22:11 +00:00
Yadnesh Kulkarni 2aaba3318b Set aodh_threshold to "6000000000" in tempest.conf
For autoscaling granularity is set to 60 and the heat
stack is expected to scale out after instance reaches
CPU utilization higher than 10%.

According to this configuration the cpu time must be
10**9*60*(10/100) which is 6000000000 ns.

The default threshold for aodh alarms is "10000000"
which comes from ceilometer's devstack settings.

This change overrides the aodh_threshold value in
tempest.conf to the correct cpu time as per
cpu util and granularity values.

Signed-off-by: Yadnesh Kulkarni <ykulkarn@redhat.com>
Change-Id: Ic90613b70556d0ce5bcf64c2305a3351928bf83e
2022-12-20 02:52:13 -05:00
Yadnesh Kulkarni eff7af3610 Disable SSL validation in gabbi tests
Disable SSL validation to prevent autoscaling tests
from failing with error
"certificate verify failed: unable to get local issuer certificate"

Set parameter "disable_ssl_certificate_validation" to True
which was introduced in 959fc69e49

Signed-off-by: Yadnesh Kulkarni <ykulkarn@redhat.com>
Change-Id: Iaa61eebf0e652b60182f893bba009b30d4734f95
2022-11-23 07:39:05 -05:00
Zuul 885adad3ff Merge "remove unicode from code" 2022-10-18 06:18:50 +00:00
Ghanshyam Mann 0db0376764 Pin stable/wallaby jobs nodeset to Ubuntu Focal (20.04)
In 2023.1 cycle. we are moving the default distro
version of Ubuntu to Jammy (22.04)[1] so we need to pin
the nodeset for stable branch job in master gate so that
they continue run on their supporting distro version which is
Ubuntu Focal since stable/victoria.

[1] https://governance.openstack.org/tc/goals/selected/migrate-ci-jobs-to-ubuntu-jammy.html

Change-Id: Ia3f329f9f0e4d8f7541d002ad7c8e77083b44bca
2022-10-15 21:41:19 -05:00
Takashi Kajinami 82abe002d7 zuul: Declare queue at top level
Zuul deprecated declaring shared queues at a pipeline level with
release 4.1.0[1]. This updates the job definition to use the top level
declaration instead.

See [2] for details.

[1] https://zuul-ci.org/docs/zuul/latest/releasenotes.html#relnotes-4-1-0-deprecation-notes
[2] http://lists.openstack.org/pipermail/openstack-discuss/2022-May/028603.html

Change-Id: Ib621978bc27a33bbb568ad89d51f0aecf9a5c9f1
2022-10-05 12:05:38 +09:00
Emma Foley 60633b244f Add stable branch tests for centos-8s tempest tests
Add a variation of the telemetry-dsvm-integration-centos-8s jobs using
branch selectors and provide a config for python 3.6 on older branches
(i.e. pre-yoga)

Change-Id: Ia57b83c7d764e2bb4eda19a46034ff2d3353aff7
2022-09-08 15:13:41 +00:00
afariasa 935428a868 Fix FIPS job - nslookup_target
This patch sets a zuul variable "nslookup_target" to 'opendev.org'
to fix the FIPS jobs.

The nslookup_target var was added as a required var for the enable-fips
role in [1].

[1] 25caf7ef5e

Change-Id: Ifb0f929cf7cb9dddedcf4f0bd930b4bd7ca2dd72
2022-08-26 10:40:24 +00:00
wangjiaqi07 24782ee1ee remove unicode from code
Change-Id: I49d4ae027ea41f78b309a39de8cc611a2fae7e10
2022-08-25 09:08:39 +08:00
Zuul e5ef4e7c6e Merge "setup.cfg: Replace dashes with underscores" 2022-05-09 09:39:03 +00:00
Takashi Kajinami 0d8ebb6140 Replace CentOS Stream 8 by 9
The latest cinder requires Python >=3.8 which is not available in
CentOS Stream 8. This bumps the base OS version to 9 which has Python
3.9.

Note CentOS Stream 8 jobs are still left now but will be removed once
job definitions in aodh/ceilometer are updated.

Change-Id: I6add67a23a5d39852a1cdca9e2baf3faa1ac0cbb
2022-05-07 00:53:53 +09:00
Zuul 6cd5f0274d Merge "Enable tls-proxy support in test jobs" 2021-10-14 11:30:58 +00:00
Zuul c410268ab1 Merge "Focus testing on train and wallaby" 2021-09-01 09:09:06 +00:00
Zuul df2e4d5531 Merge "Adding FIPS job definitions for telemetry components" 2021-08-18 16:59:54 +00:00
Matthias Runge d5c98fde19 Focus testing on train and wallaby
Stein is dead, the current long term supported releases
are train and wallaby.

Change-Id: I6cddccfef0c1929d312bcb05f3a15ca240f61e18
2021-08-18 18:03:35 +02:00
Matthias Runge aade82540e Make telemetry-dsvm-integration patches vote again
The failing part of the integration test was disabled until
we figured out what exactly fails and why. In the mean time,
we can take advantage of the rest of the integration tests.

Change-Id: Iaefaa06b37deb5ecf2108c027ac7db98130c8c98
2021-08-16 18:15:52 +02:00
Chris Sibbitt d42dc01a32 Adding FIPS job definitions for telemetry components
Change-Id: I05713ed77b79e583ad1073ff80ccd7a031e34c26
Depends-On: I74d4ab548a6319390100cb0a067c190e20a2e9a2
2021-08-12 16:40:48 +00:00