Commit Graph

85 Commits

Author SHA1 Message Date
Takashi Kajinami 4d61af64a1 Add upgrade job from 2023.1
The 2024.1 release will support direct upgrade from 2023.1, so this
scenario should be tested in CI.

Change-Id: Idbe56fd0eaa2e4b04ce64051bd706ad7757cddf2
2024-02-05 23:02:51 +09:00
Stephen Finucane 13ceadd26e Add job to test with SQLAlchemy master (2.x)
Change-Id: Ib5ba66ba32dd1b2981be338682556018fc41826c
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
2023-09-27 15:01:59 +00:00
OpenStack Release Bot 4e345e55c2 Switch to 2023.1 Python3 unit tests and generic template name
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for antelope. Also,
updating the template name to generic one.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I7bef657a342fa8b7b08ffcca4459e2831204ee60
2022-09-22 14:59:34 +00:00
Rajesh Tailor 4fff36d52b Fix typos
This change fixes typos in comments, log messages and tests.

Change-Id: Ic035853facfad866be5f99ac28247b2864ca5f8b
2022-07-08 21:46:57 +05:30
Takashi Kajinami d013b37066 Update python testing as per zed cycle testing runtime
In Zed cycle, we have dropped the python 3.6/3.7[1] testing
and its support. Add release notes and update the python
classifier for the same.

[1] https://governance.openstack.org/tc/reference/runtimes/zed.html

Co-Authored-By: Ghanshyam Mann <gmann@ghanshyammann.com>
Change-Id: I998b34f884a2869d46ff05a179708a7f775e1615
2022-06-08 08:14:53 +09:00
Ghanshyam Mann 03d567928e Drop lower-constraints.txt and its testing
As discussed in TC PTG[1] and TC resolution[2], we are
dropping the lower-constraints.txt file and its testing.
We will keep lower bounds in the requirements.txt file but
with a note that these are not tested lower bounds and we
try our best to keep them updated.

[1] https://etherpad.opendev.org/p/tc-zed-ptg#L326
[2] https://governance.openstack.org/tc/resolutions/20220414-drop-lower-constraints.html#proposal

Change-Id: Ieba7daf39fa3323e8c9a7396747449f24189fcd5
2022-05-01 00:39:43 +00:00
OpenStack Release Bot 333fe55b76 Add Python3 zed unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for zed.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: Ie37ed6ec079985bd6bc14de9517e6669d8b2b259
2022-03-10 08:21:35 +00:00
Ghanshyam Mann 1141597b5a Updating python testing as per Yoga testing runtime
Yoga testing runtime[1] has been updated to add py39
testing as voting. Unit tests update are
handled by the job template change in openstack-zuul-job

- https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/820286

this commit makes other required changes in zuul.yaml and
update the classifier in setup.cfg file.

[1] https://governance.openstack.org/tc/reference/runtimes/yoga.html

Change-Id: I50c125df4ee03377caf16da5824e2ed492d4b7da
2021-12-14 02:24:04 +00:00
Ghanshyam Mann 6d49b6df1d Use 'functional-without-sample-db-tests' tox env for placement nova job
Nova defines (depends-on) a new tox env 'functional-without-sample-db-tests'
to run the nova functional test by exlcuding the api|notification
sample_tests, and db-related tests.

We can use that to fix the error  are facing currently for this job
- https://zuul.openstack.org/build/a8c186b2c7124856ae32477f10e2b9a4

Depends-On: https://review.opendev.org/c/openstack/nova/+/813679
Change-Id: If7e6060c867df21360a1f588ca872d65d75eb3c1
2021-10-12 23:37:19 +00:00
OpenStack Release Bot 7541d94d20 Add Python3 yoga unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for yoga.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: Ib9494839df2546d8a9ffcae752a12d98d50f1dc7
2021-09-16 10:36:26 +00:00
Elod Illes a0749aec17 Add periodic-stable-jobs template
Periodic stable jobs (one py3 and a docs job) are not running towards
placement. This patch adds the template to .zuul.yaml

Change-Id: Ia9dce4590d5656f8d5f777e158a1ff67c059c87a
2021-05-06 19:11:39 +02:00
Sean Mooney 2150dbf688 Add weekly jobs
This change intoduces a set of jobs
that will run weekly in the periodic-weekly pipeline.
The intention of these jobs is to check the health
of the placement gate in the absence of frequent patch
submissions to ensure that new lib releases and or changes
in upper constraints or other placment related projects do
not result in broken jobs. The result of these jobs will
be review in our weekly meetings.

Change-Id: I456e44e69e503f2444ce9153aacee5783ea2b2eb
2021-04-22 09:59:48 +01:00
OpenStack Release Bot 6f00ba5f68 Add Python3 xena unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for xena.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: Ie137d670fb778b80160cc190de388af4243fe0db
2021-03-26 09:35:49 +00:00
Balazs Gibizer 46947d52b8 Add functional-py3[89] tox targets
This also adds a non voting functional-py39 job

Depends-On: https://review.opendev.org/760932

Change-Id: I5557535967a721037731c6108acee4c6f5582bbc
2020-11-04 13:41:45 +01:00
Zuul c4fb76511f Merge "Adds py38 functional tests to gate" 2020-11-04 01:37:31 +00:00
OpenStack Release Bot 34ec036364 Add Python3 wallaby unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for wallaby.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: Ia8a84395b5959f44f59dee2834fc7494f6ad3b4b
2020-09-28 09:32:11 +00:00
Tetsuro Nakamura 8685ca0e2e Adds py38 functional tests to gate
Python 3.8 is now our highest level supported python runtime,
but there are no functional tests run in the gate.
This patch adds the tests to the gate.

Change-Id: Ia81b3983ea3636beadf0e58c1b584d607bd567b4
2020-09-11 07:00:25 +00:00
Andreas Jaeger 37a01df4af Switch to new grenade job name
The integrated gate templates has switched to the new grenade name
(grenade-py3 -> grenade). This repo uses an integrated gate template
but also listed the job for irrelevant files an extra entry.

Rename the job following the template change to avoid duplicate
grenade runs.

Details:
- http://lists.openstack.org/pipermail/openstack-discuss/2020-May/014602.html

Change-Id: I0a981738034468bc8e0ef2944cb8b2b7a68e3851
2020-05-04 08:40:49 +02:00
OpenStack Release Bot bf926c5ef0 Add Python3 victoria unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for victoria.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I53732ebc4b744afb23b04f67e7e88735513cb735
2020-04-24 18:00:08 +00:00
Tetsuro Nakamura 4e58f8a56b Add check-requirements to project template
This patch adds a job to check the requirements in the gate.
To pass the test, this patch includes several fixes:

* Revert following commits:
    - https://review.opendev.org/#/c/671249
      (baaaff17b5)
* Add missing packages in lower-constraints.txt
    - osprofiler
    - setuptools
* Adjust psycopg2 version in test-requirements.txt
  to that in lower-constraints.txt.
  This has been bumped in:
    - https://review.opendev.org/#/c/614559/.
      (4469a813cb)

Change-Id: Ib9942a8310a74bf48a2b05a78a4971cba87d7689
Depends-On: https://review.opendev.org/#/c/698960
Story: #2007023
Task: #37813
2019-12-08 18:51:53 +00:00
Chris Dent 8436f45d01 Drop support for python 2
This is modelled on the similar change in nova [1] but is
simpler because Placement was already using python3 for
"integration" style tests.

The 'train' python3 template is replaced with corresponding 'ussuri'.

The python template is removed (it is 2.7) and the pep8 job that was
included in that template is now listed in check and gate jobs.

.zuul.yaml is updated to not do a generic 'funtional' test,
instead versioned tests only.

setup.cfg removes indications of support for python 2.

A reno is added.

tox.ini is changed to make the functional environment a
base environment for specific functional jobs.

[1] Ie1a0cbd82a617dbcc15729647218ac3e9cd0e5a9

Change-Id: Ifce3b0c0ff11553f32b2d02df07fde81efc34100
2019-10-18 12:58:36 +00:00
Chris Dent ed03085187 Add apache benchmark (ab) to end of perfload jobs
Start the process of reporting some concurrency numbers by including
a 500 x 10 'ab' run against the query URL used in each perfload job.

There's duplication removal that could be done here, but we leave
that until we've determined if this is working well.

The PLACEMENT_URL is updated to use 127.0.0.1 instead of localhost;
ab will attempt to use the IPV6 version of localhost if that's the
case, and we've not bound the placement server to that interface.

The timeout on the placement-nested-perfload job has been raised to
1 hour as the default 30 minutes is leading to a timeout. If that's
still not enough we'll explore lowering concurrency.

We will quite likely need to adapt the mysql configuration if we
intend to continue down this road.

Change-Id: Ic0bf2ab666dab546dd7b03955473c246fd0f380a
2019-08-06 09:18:44 +01:00
Zuul fe6ec89020 Merge "Run 'tempest-ipv6-only' job in gate" 2019-07-30 16:52:03 +00:00
Chris Dent b1a7338d2f Use integrated-gate-placement zuul template
The integrated-gate-placement adds the tempest-integrated-placement
and grenade-py3 jobs. tempest-integrated-placement runs a subset of
tempest tests which are relevant for placement, e.g. it does not
run keystone tests.

The integrated-gate-py3 template is replaced by this change. It
specified the tempest-full-py3, meaning many tests not relevant
to placement were run.

See the depends-on for more information on the rationale.

Depends-On: https://review.opendev.org/669309
Change-Id: I509ded97085fbae5a0cc55fe66f6e30e638b72bc
2019-07-25 16:18:38 +01:00
Ghanshyam Mann 8eedcfcea5 Run 'tempest-ipv6-only' job in gate
As part of Train community goal 'Support IPv6-Only Deployments and Testing'[1],
Tempest has defined the new job 'tempest-ipv6-only'(adding
in Depends-On patch) which will deploy services on IPv6 and run smoke
tests and IPv6 related tests present in Tempest.

This job will be part of Nova, Neutron, Cinder, Keystone, Glance, Swift
gate.

Verification structure will be:
- 'devstack-IPv6' deploy the service on IPv6
- 'devstack-tempest-ipv6' run will verify the IPv6-only setting and listen address
- 'tempest-ipv6-only' will run the smoke + IPv6 related test case.

This commit adds the new job 'tempest-ipv6-only' run on gate.

Story: #2005477
Task: #35919

Depends-On: https://review.opendev.org/#/c/671231/

[1] https://governance.openstack.org/tc/goals/train/ipv6-support-and-testing.html

Change-Id: Iff0e8d91048a4644cca4fd9242535b940b721d3b
2019-07-20 17:54:00 +00:00
Corey Bryant 7858375439 Add Python 3 Train unit tests
This is a mechanically generated patch to ensure unit testing is in place
for all of the Tested Runtimes for Train.

See the Train python3-updates goal document for details:
https://governance.openstack.org/tc/goals/train/python3-updates.html

Change-Id: I2ef60794a2606a7d7abfd413c6ba50689c52e67b
Story: #2005924
Task: #34236
2019-07-10 21:09:52 +00:00
Chris Dent 8723bd7772 Nested provider performance testing
This change duplicates the ideas started in with the placement-perfload
job and builds on it to create a set of nested trees that can be
exercised.

In placement-perfload, placeload is used to create the providers. This
proves to be cumbersome for nested topologies so this change starts
a new model: Using parallel [1] plus instrumented gabbi to create
nested topologies in a declarative fashion.

gate/perfload-server.sh sets up placement db and starts a uwsgi server.

gate/perfload-nested-loader.sh is called in the playbook to cause gabbi
to create the nested topology described in
gate/gabbits/nested-perfload.yaml. That topology is intentionally very
naive right now but should be made more realisitc as we continue to
develop nested features.

There's some duplication between perfload.yaml and
nested-perfload.yaml that will be cleared up in a followup.

[1] https://www.gnu.org/software/parallel/ (although the version on
ubuntu is a non-GPL clone)

Story: 2005443
Task: 30487
Change-Id: I617161fde5b844d7f52dc766f85c1b9f1b139e4a
2019-06-20 12:37:28 +01:00
Chris Dent e0b35bc3b8 Don't run functional.db tests in nova functional run
To further refine the tests being run during the nova functional
test job, remove the functional.db tests. These shouldn't be
interacting with placement and because some of them use live
mysql or postgresql services for the migration tests, are more
susceptible to intermittent failures when nodes are being slow.

Change-Id: I2cfc6cb74d3acf78043a20cc7254d1315d6fabf0
2019-05-24 14:00:58 +00:00
Chris Dent df12d4d2c9 Skip notification sample tests when running nova functional
The notification sample tests are many and at least some of
them contribute quite a bit of time so may as well not run
them when placement runs the nova functional tests.

In a recent run those tests took ~11.5 minutes to run in total,
with ~6.5 minutes being devoted to the actual tests.

Tuning this to perfection is probably a fools errand but
making tweaks when there are obviously useless (in this
context) time consumers, may as well kill them.

(Not listing a task here as the story has already merged
so the following syntax will operate similar to related-bug.)

Change-Id: I8f762cbf0ce2126609b7c24a8054785e252bdd03
Story: 2005562
2019-05-06 13:59:36 -07:00
Chris Dent e621d30097 Run nova-tox-functional-py36 in the placement gate
This requires some slight adjustsments to the job in nova,
found in the depends-on.

The result of this will be _this_ placement change running
against nova master.

In order to blacklist the api_sample_tests (to save some time)
the job is inherited and some args are added to the tox command.

Story: 2005562
Task: 30746
Depends-On: https://review.opendev.org/657074
Change-Id: I72ae7f552879be13777fea90fa7055e056d309a7
2019-05-03 17:17:45 -06:00
Ghanshyam Mann da3e8795f3 Dropping the py35 testing
All the integration testing has been moved to
Bionic now[1] and py3.5 is not tested runtime for
Train or stable/stein[2].

As per below ML thread, we are good to drop the py35
testing now:
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/005097.html

[1] http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004647.html
[2]
https://governance.openstack.org/tc/reference/runtimes/stein.html
https://governance.openstack.org/tc/reference/runtimes/train.html

Change-Id: I5e4a9148c0e0649ff0e4657ea4c87e50c1b3fd2d
2019-04-22 23:12:02 +00:00
OpenDev Sysadmins 931a9e1242 OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:41:22 +00:00
Zuul be69734728 Merge "Add irrelevant files list to perfload job" 2019-01-22 04:41:13 +00:00
Takashi NATSUME 692fe58728 Add release-notes-jobs-python3 job
Add the release-notes-jobs-python3 job to publish releasenotes.

Depends-On: https://review.openstack.org/631308
Change-Id: I53a6f25038f7f9973b25d0121cbf5d3505267e46
2019-01-16 19:12:36 +00:00
Zuul 0e97f2b9b9 Merge "Add irrelevant-files for integrated-gate-py35 jobs" 2019-01-15 18:20:42 +00:00
Ghanshyan Mann 08201b881e Add irrelevant-files for integrated-gate-py35 jobs
placement gate run integrated-gate-py35 template,

Adding corresponding irrelevant-files for integrated-gate-py35
template jobs[1] to avoid running those on doc, test etc only
changes. Example- https://review.openstack.org/#/c/624705/

This commit renames the integrated-gate-py35 template
to integrated-gate-py3 for clear readability about py3
version as that template is not specific to minor version
of py3 - https://review.openstack.org/#/c/626078/

[1] http://git.openstack.org/cgit/openstack-infra/openstack-zuul-jobs/tree/zuul.d/project-templates.yaml#n1397

Change-Id: Iae26251cb455640fbc74dad326666d2015e7a46c
2019-01-15 08:42:24 +00:00
Chris Dent 9628a5904e Add irrelevant files list to perfload job
We don't want perfload to run on docs, tox, or test changes, but
because it is based off a very basic job (to avoid weight) there was
no built in irrlevant-files list. This adds one to ensure that the
job only runs on code-related changes.

We need a slightly different list of files from the list used by
integrated gate jobs so do not use the changes made in
Iae26251cb455640fbc74dad326666d2015e7a46c .

Change-Id: I092b5ed19ef51c42a714984127e2fdc91d5c6c70
2018-12-17 12:35:34 +00:00
Corey Bryant d32daccbca Add python3.7 unit test job
python3.5 was the only supported python3 version on Xenial. Now that
we have Bionic nodes supporting python3.6 and python3.7, let's also
test with python3.7. Eventually we'd like to remove python 3.5, but not
yet.

See ML discussion here [1] for context.

[1] http://lists.openstack.org/pipermail/openstack-dev/2018-October/135626.html

Change-Id: I78517d8a873ed3d41a8e06b4193fdb677f0705d7
Story: #2004073
Task: #27433
2018-12-11 18:17:03 +00:00
Chris Dent 3ae8653338 Use a smaller base job for the perfload run
In this job we install placement by hand, based on the
instructions in
https://docs.openstack.org/placement/latest/contributor/quick-dev.html
and run the placeload command against it. This avoids a lot of node
set up time.

* mysql is installed, placement is installed, uwsgi is installed
* the database is synced
* the service started, via uwsgi, which run with 5 processs each
  with 25 threads, otherwise writing the resource providers is
  very slow and causes errors in placeload. It's an 8 core vm.
* placeload is called

A post.yaml is added to get the generated logs back to zuul.

Change-Id: I93875e3ce1f77fdb237e339b7b3e38abe3dad8f7
2018-11-30 15:00:57 +00:00
Chris Dent e6545dc2b2 Add a perfload job.
This adds the placeload perf output as its own job, using a
very basic devstack set up. It is non-voting. If it reports as
failing it means it was unable to generate the correct number
of resource providers against which to test.

It ought to be possible to do this without devstack, and thus speed
things up, but some more digging in existing zuul playbooks is
needed first, and having some up to date performance info is useful
now.

Change-Id: Ic1a3dc510caf2655eebffa61e03f137cc09cf098
2018-11-30 14:59:47 +00:00
Chris Dent d719c7ade2 Add integrated-gate-py35 template to .zuul.yaml
This adds full tempest and grenade runs to placement changes
to ensure placement doesn't break the world. This runs just
py3 jobs to avoid duplication.

The Depends-On are to

* the devstack change which provides an extracted placement.
  That change depends on the necessary database and CLI
  changes in placement itself.
* addition of grenade-py35 job to the template
* fix to grenade for openstack client + swift under python3

Depends-On: https://review.openstack.org/600162
Depends-On: https://review.openstack.org/617662
Depends-On: https://review.openstack.org/619728
Change-Id: I5ac7c1cdffe2956d3091a6052058068ee1b067da
2018-11-23 13:03:19 +00:00
Takashi NATSUME dbaf410349 Remove build-openstack-api-ref jobs
The api-ref-jobs has been added
since Ia4680f24d78af1260f2f0106a458b78a079c1287.
It includes build-openstack-api-ref jobs in check and gate.

So remove the build-openstack-api-ref job definitions
in .zuul.yaml because they are unnecessary.

Change-Id: I4b612fa87609240bd0a0f838163ee87c45a41a46
2018-11-14 15:46:45 +00:00
Takashi NATSUME 5490d4cbce Publish placement documents
Use publish-openstack-docs-pti job instead of
build-openstack-docs-pti job to publish placement documents
as https://docs.openstack.org/placement/latest/ .

Change-Id: I667387ec262680af899a628520c107fa0d4eec24
2018-10-30 00:05:56 +09:00
Chris Dent 81d40b37b3 Add a zuul check job for coverage
This will add coverage results to the check results. We don't
necessarily need to care about this, but it is a useful thing
to have and because the tests don't take much time, it's not
very costly.

Change-Id: I1de581dd6921b722d012adfac6181fd7c3f06666
2018-09-14 13:30:14 -06:00
Andreas Jaeger 5102e7f815 Add lower-constraints job
Add the common lower-constraints job via a zuul template.

Change-Id: I3e46ce1f046631f99777fa31546889d81b085f49
2018-09-06 11:45:11 -05:00
Andreas Jaeger d57b46d90b Use templates in .zuul.yaml
Use templates that run same jobs as they replace to have a "cleaner"
.zuul.yaml file. Sort entries alphabetically.

Change-Id: Ie644b6c8ead6ec7ebe1fa3d10c5256b1aa0d26f9
2018-09-06 11:45:11 -05:00
Eric Fried 9b584fcd1d Make docs build
This patch does pretty much the minimum possible to get `tox -e docs`
building and gating. Much, much more needs to be done to make the
content good.

Also corrects a link in the api-ref which, once these are publishing,
would have pointed to the wrong place.

Change-Id: I5cbc3a3cceeaeaa7be5593658b6a03fa25fb69d0
2018-09-06 11:45:11 -05:00
Balazs Gibizer 8c2bb44181 Add api-ref job
As placement-api-ref is renamed to api-ref we can use the standard job
for the doc generation. This patch adds a voting api-ref generation job
for both queues

Change-Id: I0d8a2919e6af4bf41385e7d2324cbad72f7f9a7c
2018-09-06 11:44:21 -05:00
Chris Dent c0ec9b4f86 Add python 3.6 test jobs
We'd like to run tests in py3.6 as well as 3.5 and 2.7. This adds jobs
for doing so. The functional job is new, thus the depends-on.

Depends-On: https://review.openstack.org/599553
Change-Id: Ibd00bdf93c60eae6c1bf686c7f13aaa23bc242d4
2018-09-04 10:31:29 -05:00
Chris Dent cf4ea34911 Make pep8 tests voting
In the prior commit pep8 started passing.

In a near future commit these jobs will be switched over to using
templates.

Change-Id: Ide953a393a60ccb3bea41e0936b57c4e3c731c57
2018-09-04 10:31:29 -05:00