Commit Graph

56 Commits

Author SHA1 Message Date
Rodolfo Alonso Hernandez 8bcaf1632f Limit tox version to <4
This patch is a workaround until we find why fullstack job is failing
with tox 4.

Depends-On: https://review.opendev.org/c/zuul/zuul-jobs/+/866943

Related-Bug: #1999558
Change-Id: I9c62d429bb819336da05055fecd08e3816986bf8
2022-12-10 20:43:54 +01:00
Slawek Kaplonski 92dbc66135 Add new role "prepare_functional_tests_logs"
This new role will prepare archive with the logs from all
functional/fullstack tests. It will be more efficient to upload one
archive to swift after tests are done instead of uploading to Swift
many small files with logs from each test.

Change-Id: I4bb614778893caa7fb3519412a87196086420a21
2022-09-09 08:28:35 +00:00
Slawek Kaplonski 58f80b4ec7 Remove "fetch_journal_log" role as it's not needed
We don't need to run that ansible role in the functional and fullstack
jobs as devstack already stores archive with journal log from the test
node.
It is available in the "devstack.journal.gz" file in logs.

Change-Id: Id527e7b5240240f5299a6f163bc124002c64fa18
2022-09-05 12:56:30 +02:00
yatinkarel 1a2da88b90 Fix multinode ovn/ovs with source deploy jobs
Since in these jobs ovs/ovn built/installed from
source during devstack installation, infra bridge
i.e br-infra prepared during pre-run get's lost.

After devstack setup rerunning the multinode setup
roles with install_ovs=false(role var added in depends-on
patch) to fix it.

It's alternative approach to [1].

[1] https://review.opendev.org/c/openstack/neutron/+/762654

Depends-On: https://review.opendev.org/c/zuul/zuul-jobs/+/832497
Closes-Bug: #1904117
Change-Id: Ie2cd53881cb043bc72f201b6aac9eacd0c0c7c88
2022-03-21 14:23:13 +05:30
Slawek Kaplonski d8c76db952 Run configure_for_func_testing script after enable fips
It should be run after FIPS are enabled and node is rebooted to
make sure that openvswitch is running properly during tests.

Change-Id: I35411f177a432985795940947fd5440d8f929251
2022-03-11 16:02:22 +01:00
Slawek Kaplonski 836592a8bc Add functional and fullstack jobs with FIPS enabled
This patch adds definition of the functional and fullstack jobs
with enabled support for FIPS [1].
Jobs are based on the Centos 8 stream as this disto allows to enable
FIPS support.
Jobs are added to the experimental queue for now.

This patch also makes some changes in the bindep and
configure_functional_tests role to make functional/fullstack tests
working on the Centos.

[1] https://csrc.nist.gov/publications/detail/fips/140/3/final

Co-Authored-By: Ade Lee <alee@redhat.com>
Change-Id: I582495826155740ad2660ee2a8717696b0393d26
2021-11-17 13:41:40 +01:00
Slawek Kaplonski 83f57021d6 Remove run-devstack role from run_functional_job playbook
There is no need to run that role in the functional nor fullstack jobs
not running it can save few minutes in each job's run.

Change-Id: Ic363c5c805d02bdc93317423b95a1cd89c16876a
2021-11-12 14:58:58 +00:00
Rodolfo Alonso Hernandez f7d2c3608d Add periodic jobs to test "nftables" binaries
In order to check how the "nftables" binaries work with Neutron, two
new jobs have been added to the periodic queue:
- neutron-tempest-plugin-scenario-linuxbridge-nftables
- neutron-tempest-plugin-scenario-openvswitch-iptables_hybrid-nftables

In those two jobs, the binaries for "iptables", "ip6tables",
"arptables" and "ebtables" are replaced with the "nftables"
counterparts; by default, newer operating systems use the "nftables"
versions, providing the legacy API to the user but executing the
new packet handling in Netfilter.

Change-Id: Idec6d480886298f6d71b1dd649c9255ee6b7bebb
Related-Bug: #1508155
Related-Bug: #1922892
2021-04-12 09:48:11 +00:00
Zuul ce251a804f Merge "Convert neutron-grenade-ovn job to be zuulv3" 2020-10-11 16:50:14 +00:00
Slawek Kaplonski 3503022ce7 Convert neutron-grenade-ovn job to be zuulv3
This patch converts neutron-grenade-ovn job to be Zuulv3 native
and adds it as non-voting job to the check queue.

Depends-On: https://review.opendev.org/752412

Change-Id: Ie27f7c9313ff4b18eba739e40fdb136036652313
2020-10-06 10:58:27 +02:00
Slawek Kaplonski a8ceb09f98 Use ebtables-legacy also in ovn multinode jobs
For other jobs which inherits from neutron-tempest-base it
was changed some time ago.
But ovn multinode jobs don't inherits from that base job
so this patch fixes it for those jobs as well by adding same
configure_ebtables.yaml playbook to pre-run in the
neutron-ovn-multinode-base job.

Change-Id: Icb4fd80133ee10ad6c40e160013b4ab91d2c5a6b
Closes-Bug: #1898211
2020-10-02 17:10:00 +02:00
Slawek Kaplonski 31a95c085f Use ebtables-legacy on Ubuntu Focal
On Ubuntu 20.04 there is by default ebtables-nft used. The problem with
that is that nftables don't supports syntax for source and destination
ipv4 address in arp tables right now.
So to workaround/fix this problem at least in our gate jobs we have to
switch to ebtables-legacy for now.
And that's exactly what this patch is doing.

Change-Id: I0aca119f1feca1d8f31a0104dde40d5d52c1b25c
Closes-Bug: #1889779
2020-08-04 10:57:37 +00:00
Ghanshyam Mann 86e90bfce2 Add ensure-tox in functional job
neutron functional jobs run tests using the tox env.
Even tempest jobs need tox to be present to run the tempest
tests in venv. But functional job derived from devstack-minimal
jobs does not make sure tox is present or not. devstack jobs does not
mak sure that as those are not only used for tox run but also for
other integration testing.

Current neutorn functional job failure-
- https://zuul.opendev.org/t/openstack/build/59865004855c404ab18f06fc0ec1d005

let's call ensure-tox role in job to make sure tox is present.

Change-Id: I9b4161946daa5863ddab94a57ad282e82bcf6e5c
Closes-Bug: 1884256
2020-06-19 09:19:23 -05:00
Slawek Kaplonski bc2a23a36a Migrate neutron grenade jobs to be native Zuul v3
This commit migrates neutron-grenade multinode jobs.
OVN job will be switched later.

Change-Id: Ibe613a48116aed9cbcc7c689a50c1ef9fba60f05
2020-05-03 13:52:54 +02:00
Zuul 515a8693fb Merge "Disable not needed services in grenade jobs" 2020-01-22 17:07:14 +00:00
Rodolfo Alonso Hernandez 1986865bd5 Add MariaDB 10.3 repository for Ubuntu Bionic
In order to execute the periodic job "neutron-tempest-mariadb-full",
using Ubuntu Bionic and MariaDB, a newer version is needed than the
default package version distributed (10.1).

Devstack gates are tested with MySQL 5.7. Current Neutron DB schema
is not working with the reported version 10.1.

Change-Id: Ie2b5f85a9c0fc26676d44074424cf5a699303805
Related-Bug: #1855912
Related-Bug: #1841907
2020-01-16 10:05:36 +00:00
Slawek Kaplonski 0bf005b3c3 Disable not needed services in grenade jobs
Things like swift, cinder and etcd aren't needed in neutron
grenade jobs so lets try to disable it to save some resources on test
node.

Change-Id: Id9dd91b50506670da8fb7485e2adbd5b9b6031b4
2019-12-21 09:48:51 +00:00
Ghanshyam Mann 0166a1f286 Remove the neutron-grenade job definition
All the user of neutron-grenade from Ussuri gate
onwards has been switched to grenade-py3 job (except
neutron which is running neutron-grenade-multinode).

We can remove the job definition also now and all
stable gate using this job will find the job definition
from neutron stable branches.

Depends-On: https://review.opendev.org/#/c/694234/
Change-Id: I631f0bfbe7e4ee2df89e2eca2060331796e7a0b2
2019-12-17 18:54:36 +00:00
Slawek Kaplonski 9c6d3e073e Rehome networking-ovn CI jobs to neutron repository
As networking-ovn driver is going to be in neutron tree now, lets move
also networking-ovn jobs definitions to the neutron repo.

Change-Id: Ie1c66c773ee2d217b25bd915189e56254744a3d4
Related-Blueprint: neutron-ovn-merge
2019-11-27 10:38:04 +01:00
Zuul f6aef3c434 Merge "Switch neutron-tempest-with-os-ken-master job to zuul v3" 2019-11-25 10:52:21 +00:00
Ghanshyam Mann e1a79995b9 Explicit mention py2 for neutron-grenade job
Devstack is moving to py3 by default[1] and neutron-grenade
will fail. There are patches up to drop the neutron-grenade
job but those are not merged yet.

let's keep this job runnable by explicitly mention the py2
and dropping plan will continue as it is.

[1] http://lists.openstack.org/pipermail/openstack-discuss/2019-November/010938.html

Change-Id: I086b5eee710b80e95703abb46a076aff5b7741f2
2019-11-19 17:05:53 +00:00
Slawek Kaplonski 3593b0dc69 Switch neutron-tempest-with-os-ken-master job to zuul v3
This patch switches neutron-tempest-with-os-ken-master to zuul v3
syntax.
It also switches this job to only run networking related tests instead
of full tempest test suite.

Change-Id: I4e9aa4bbafed4de0e3c13ece44f8e700952da568
2019-11-18 16:42:13 +00:00
Slawek Kaplonski 17706412e2 Switch neutron-tempest-postgres-full job definition to Zuul v3
And also switch it to be inheriting from tempest-integrated-networking
to run only neutron and nova related tests on it and make it faster.

Change-Id: Ie7e03848fc5f1bb1425987d4413dd6c02045a879
2019-10-02 11:55:37 +00:00
OpenDev Sysadmins 5d607a13ba OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:38:27 +00:00
Ian Wienand 983d659d76
Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: I4c9b513eb65ec4c50bdb9a66dfcc676360bdaa28
2019-03-25 11:31:17 +01:00
Slawek Kaplonski 303598289d Switch neutron-functional-with-wsgi job to zuul v3 syntax
This patch removes also legacy playbooks used before by
this experimental job and it also removes
neutron/tests/contrib/post_test_hook.sh script as it was used
only by functional and fullstack tests and it's not used anymore.

Change-Id: Ibc48ce8e80e11dcbb13da121aa86bbf01b98a3d9
Related-Bug: #1804844
2019-03-21 15:01:55 +00:00
Slawek Kaplonski 6ef6f2b59b Migrate fullstack job definition to zuulv3 syntax
Now, as neutron-functional job is moved to zuulv3 syntax,
the same can be easily done with fullstack job.

This patch also switches experimental neutron-fullstack-with-wsgi
job.

This patch removes also fullstack part from gate scripts
and it removes hooks for dstat and stack_base as both are not
used anywhere else.

Related-Bug: #1804844
Change-Id: Iac7583f01651410a3df3e349b2c843b109a8bb18
2019-03-16 09:59:59 +01:00
Zuul 325d19eaea Merge "Migrate neutron-functional job to zuul v3 syntax" 2019-03-13 23:25:03 +00:00
Slawek Kaplonski 33110fb7e8 Migrate neutron-functional job to zuul v3 syntax
This patch migrates also neutron-functional-python27 job to
zuul v3 syntax.

Neutron's functional tests have to be run on host with
deployed minimal devstack but without running any e.g. neutron
services. Because of that new job's template inherits from
devstack-minimal job instead of devstack-tox-functional and
we need to have own run_functional_job and post_functional_job
playbooks.

It also adds ansible roles:
- configure_functional_tests
- setup_logdir
- fetch_journal_log

which are used in new neutron-functional job definition.
Those roles can be also used later e.g. for fullstack job.

Change-Id: I80bc17c8c9f43050ac0c21176fbc4be46c11ce35
Related-bug: #1804844
2019-03-13 11:07:38 +00:00
Slawek Kaplonski b3d26ab2dd Migrate neutron-tempest-dvr-ha-multinode-full job to zuulv3
This patch migrates definition of
neutron-tempest-dvr-ha-multinode-full job to zuul v3 syntax.

Additionally this patch sets l3_ha config option in neutron
to True to make sure that routers created in tests are HA
always.

Change-Id: I3e48c5109dddc2fca6f3b9c289f416ed4a018a41
Related-Bug: #1804844
2019-03-13 08:06:55 +00:00
Slawek Kaplonski 45a7a45961 Store journal log in functional tests results
It may helpdebug some issues related to keepalived and/or
dnsmasq which are logging to journal only.

Change-Id: I42c311f9111e0a0d1a6ea3a7aeab0fef8d77c549
2019-03-06 14:53:16 +00:00
Slawek Kaplonski e5e56ba0f0 Switch neutron-tempest-dvr-ha-multinode-full job to python3
It is last step to have all CI jobs from check and gate queues
to be run on Python 3.

Change-Id: I8275ff7d6346fb62aec16b022d27caaab96a5893
2019-02-22 11:51:19 +01:00
Bernard Cafarelli 789438ec9a
Switch multinode grenade jobs to python3
neutron-grenade stays on python 2 and we already have grenade-py3 job
for single node python 3

Change-Id: Idf99b9755598a7f3d9e8df9a0d936643a82381e5
2019-02-19 10:53:55 +01:00
Bernard Cafarelli 9359366d93 Switch default functional tests to python3, add job for python2
As a part of the python 3 community goal, this converts the functional
tests to run with python3 by default, and in Zuul.

As discussed at the Stein PTG in Denver, unit and functional tests will
still run on both versions, so this adds a python2 job for functional
tests.

This patch also suppress logging levels from some external libraries
to avoid issues with subunit.parser and python 3. For details see bug
reported for Cinder [1].

[1] https://bugs.launchpad.net/cinder/+bug/1728640

Co-Authored-By: Slawek Kaplonski <skaplons@redhat.com>

Change-Id: I8958d0b5b9147ffd1ef2d1cef5dcbf79c8be5cd4
2019-01-30 13:31:29 +00:00
Slawek Kaplonski eacdf1f18f Migrate neutron-tempest-linuxbridge job to zuulv3 and python 3
Related-bug: #1804844

Change-Id: I800aa23d2dd176db512fb1539639301b87279ae4
2019-01-17 20:07:33 +00:00
Zuul 4cddf62bbe Merge "Migrate neutron-tempest-dvr job to zuulv3 and python 3" 2019-01-10 01:58:11 +00:00
Slawek Kaplonski 7ae764eff9 Migrate neutron-tempest-dvr job to zuulv3 and python 3
Related-bug: #1804844

Change-Id: I34ec9081ac87aed26abc09bcfa06d4fd2d6aaff8
2019-01-04 08:28:51 +00:00
Slawek Kaplonski 0364c05de1 Migrate neutron-tempest-iptables_hybrid job to zuulv3 and python 3
This patch also removes config of osprofiler middleware in api-paste.ini
file in neutron-tempest-iptables_hybrid job as this middleware is
currently enabled by default.

Change-Id: Ifd3fdc33ba5c489618a568cccc20ee14e7d600a6
2018-12-30 12:32:21 +01:00
Hongbin Lu 7a2b4dcff1 Replace ryu with os_ken
Implements: blueprint ryu-framework-maintenace-transition
Change-Id: Ic721efc7cd0066be0ea7b6239b273e656643e9c1
2018-12-13 10:00:17 +00:00
Slawek Kaplonski c1407db676 Store journal log from host in fullstack's job results
Change-Id: Ibd16e111927d4c999cd668de9c04fc4c3146f347
Related-Bug: #1798475
2018-11-25 21:30:48 +01:00
Bernard Cafarelli e67d99b654
Make neutron-fullstack job run py3
In the Neutron CI meeting on 2018-10-02 [1] we decided on the proper
approach for fullstack testing of Neutron in Zuul.  The approach is:

1. There should be only one fullstack CI job, named "neutron-fullstack"
2. The neutron-fullstack job should invoke python3 in tox.ini

This change implements the agreed-upon approach.
Switching the nodeset to newer OS will be handled in a separate step

[1] http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-10-02-16.00.html

Co-Authored-By: Nate Johnston <nate.johnston@redhat.com>
Change-Id: I37c1cb42b3a94532e7b7fea21a929a39fe63f00b
2018-11-13 14:31:19 +01:00
Matt Riedemann a98766d758 Revert "Add openstack/placement as a required project for neutron-grenade*"
This reverts commit 0014c0c373.

This is handled generically now with this change and its dependency:

  https://review.openstack.org/#/c/606853/

Change-Id: I360211cf60afb5611fb9e77fe6332fa59159708f
2018-10-24 08:46:21 -04:00
Matt Riedemann 0014c0c373 Add openstack/placement as a required project for neutron-grenade*
In order to get openstack/placement installed as part of the
neutron grenade jobs, we have to list it as a required project.

Needed by https://review.openstack.org/604454/

Change-Id: I742660f398b52c62503acf00aaf7faa9a5a8650a
2018-10-03 10:00:14 +00:00
Nate Johnston 15ba1d7d64 Make neutron-fullstack-python36 job voting
The neutron-fullstack-python3[56] job has a record of stability at least
as good as the neutron-fullstack job at this point for the past 2 weeks
[1].  Make it a voting check and add it to the gate queue.

[1] http://graphite.openstack.org/render/?width=1242&height=553&_salt=1533933299.32&from=-14days&drawNullAsZero=true&lineMode=connected&connectedLimit=&areaMode=all&yStep=1&title=neutron-fullstack-python35%20job%20data&target=stats_counts.zuul.tenant.openstack.pipeline.check.project.git_openstack_org.openstack_neutron.master.job.neutron-fullstack-python35.SUCCESS&target=stats_counts.zuul.tenant.openstack.pipeline.check.project.git_openstack_org.openstack_neutron.master.job.neutron-fullstack-python35.FAILURE

Change-Id: I6e647cb502485bef8fed55046a2cd7778eb64ab2
2018-09-21 17:23:37 -04:00
Slawek Kaplonski 157e3218da Use tempest-multinode-full job from Tempest
This job is defined in Tempest to replace
neutron-tempest-multinode-full which was job defined
in Neutron's repo.

This job is set as non-voting in Neutron because old
neutron-tempest-multinode-full job was non-voting also.
If stability of this new job will be fine for us, we
can switch it to voting later.

Depends-On: https://review.openstack.org/#/c/598610/
Change-Id: I2dcbf4ade83760797b4e5072f0e05dac877842c9
2018-09-15 05:44:05 -06:00
Nguyen Phuong An b790213788 WSGI: Add experimental jobs with uwsgi
This patch adds exprimental tempest, functional and fullstack
jobs when neutron-api is served by a webserver as a part of
community goal.

Change-Id: Id88ca1a6997d39bf0d14589c0a2725b4ac109cec
2018-07-30 09:46:52 +07:00
Slawek Kaplonski 50ddf4b5ad Replace ovsfw tempest job with iptables-hybrid tempest job
In commit [1] openvswitch firewall driver is switched to be
default one used in devstack.
So various tempest jobs will use this driver and it will be
tested.
We now need separate job to test non-default firewall driver
which currently is iptables-hybrid driver.

[1] https://review.openstack.org/#/c/568297/

Depends-On: https://review.openstack.org/#/c/568297/
Change-Id: I6061a173c95c8a41a61bfa298ae5964cc9b5d2e8
2018-06-03 11:14:03 +02:00
Andrey Kurilin 49e3b37e28 [ci][rally] make the job inherit the right parent
Rally team finally added native Zuul V3 jobs (with a bunch of separate
roles and etc) and for simplification of maintainance, it would be nice
to use them.

Change-Id: I755e776a7c24e1bcdf144d7af071a52633aeb94d
2018-05-16 17:05:43 +03:00
Jakub Libosvar 3242a57a15 python3: Add experimental jobs for functional and fullstack
As part of community goal to have services working with Python 3.5, this
patch adds back the exeperimental Python 3.5 functional and fullstack jobs
that got lost somewhere during zuul v3 migration.

Change-Id: I24506b94f3f4e111b3968e57deb683e9c874941c
2018-05-15 10:23:05 +02:00
Miguel Lavalle cf8c4c5a06 Move periodic jobs to Neutron repo
We are also expected to move the periodic jobs to Neutron repo

Change-Id: I508768baceb68ada4ee9de4168a67de7fc646470
2018-02-12 11:41:03 -06:00