Commit Graph

26 Commits

Author SHA1 Message Date
Rodolfo Alonso Hernandez daa0d1c5a2 Restore the tempest nftables jobs in experimental and periodic queues
The job names were changed but not replaced in the
"neutron-periodic-jobs" template.

This patch is also adding new binaries to the nftables installation
role, that includes all the "-save" and "-restore" ones.

Closes-Bug: #2039027

Change-Id: Ia4c140af74db29f4e40299648f1b5091b4801b51
2023-10-11 13:27:17 +00:00
Rodolfo Alonso Hernandez acc6ff0580 Add "jammy" distribution release to the legacy ebtables installation
Change-Id: Ia8393f0e4f736dafb3ba7fb50cd2b679c24b1a01
2023-10-05 10:52:39 +00:00
yatinkarel 42ae944870 Switch fullstack/functional fips jobs to 9-stream
Master no longer support py3.6, so let's switch
these jobs to CentOS 9-stream which includes py3.9.

Also dbcounter[1] is not installable on CentOS 8-stream
and hence these jobs are currently broken.

Other fips jobs already switched with[2].

[1] https://review.opendev.org/c/openstack/devstack/+/839820
[2] https://review.opendev.org/c/openstack/neutron/+/833173

Closes-Bug: #1976323
Change-Id: Ie4e807b1490d59390316ec20b499b7676acfe410
2023-07-03 07:46:19 +00:00
yatinkarel 135daae62d Use same ovs/ovn versions in local test setups
Currently we using different defaults in CI and
local run, also defaults in local run using ovs
master branch which is broken currently. Let's
use same version by definining defaults in
configure_for_func_testing.sh rather than at job
level, jobs can override these only when really
needed.

Drop unneeded source of functions, this was wrongly
detecting ovs/ovn versions. Anything required
should be sourced as part of configure_for_func_testing.sh.

Related-Bug: #1999154
Change-Id: I04a2b0b974d11a525c850b1e641a19749dee93f6
2022-12-09 19:06:50 +05:30
Slawek Kaplonski 4eaa526c5a [Functional] Prepare test logs archive only if logs are available
Recent change [1] moved all functional and fullstack tests to be
uploaded in single archive to Swift.
Sometimes, like e.g. in case of the networking-bgpvpn functional
tests, there is no logs directory at all so ansible tasks to prepare
tar.gz archive shouldn't be created at all.

[1] https://review.opendev.org/c/openstack/neutron/+/855868

Change-Id: I50cb1187ef772b6411fe91d6d74aba04a2d3e936
2022-09-14 14:32:34 +00:00
Slawek Kaplonski 92dbc66135 Add new role "prepare_functional_tests_logs"
This new role will prepare archive with the logs from all
functional/fullstack tests. It will be more efficient to upload one
archive to swift after tests are done instead of uploading to Swift
many small files with logs from each test.

Change-Id: I4bb614778893caa7fb3519412a87196086420a21
2022-09-09 08:28:35 +00:00
Slawek Kaplonski 58f80b4ec7 Remove "fetch_journal_log" role as it's not needed
We don't need to run that ansible role in the functional and fullstack
jobs as devstack already stores archive with journal log from the test
node.
It is available in the "devstack.journal.gz" file in logs.

Change-Id: Id527e7b5240240f5299a6f163bc124002c64fa18
2022-09-05 12:56:30 +02:00
yatinkarel 7f5fb86232 Switch Fips fullstack/functional tests to py3.8
Master has dropped py3.6 support so upper-constraints
requirements are not installable with python3.6
and due to this fips jobs which are running on py3.6
are failing. Let's run the functional/fullstack tests
with python3.8 on CentOS 8-Stream itself.

Also disable dbcounter installation as it's not
installing on python3.6.
The hacks can be cleaned up when these jobs are
switched to CentOS 9-Stream, currently have some
issues as mentioned in the Related Bug.

Depends-On: https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/843989
Related-Bug: #1976323
Change-Id: I757dbf929cb1dc27027614bbb2147a61606f85a9
2022-05-31 06:03:49 +00:00
yatinkarel 9bc447077b Enable dstat and memory_tracker in functional/fullstack jobs
This Will help in troubleshooting failures related to high
memory or cpu usage.

Related-Bug: #1966394
Change-Id: I74b0d53bfc54b71d3e8b2d46739a944e5f5a6b6f
2022-04-11 06:02:34 +00:00
Slawek Kaplonski ddf0568f39 Make configure_for_func_testing compatible with e.g. Centos
This is basically revert of the [1] which was revert of the [2]
but now it should not break our CI jobs.

In the configure_for_func_testing script openvswitch is installed
from source. We need to set proper flag (Q_BUILD_OVS_FROM_GIT) which
is used in Devstack to tell Devstack to install it from source and
not from packages.

This patch also removes flag BUILD_OVS_FROM_SOURCE from the
configure_for_func_testing file as it was only used in that file
and was actually duplicating the Q_BUILD_OVS_FROM_GIT option used also
in Devstack.

[1] https://review.opendev.org/c/openstack/neutron/+/824750
[2] https://review.opendev.org/c/openstack/neutron/+/824750

Change-Id: I35715a047d23ed87312afd294cc898de7c164583
2022-01-17 12:32:04 +01:00
Slawek Kaplonski bedd24caff [Fullstack] Don't install OVN in the fullstack job
It's not needed at all so if we avoid installation, especially from
sources, it may save us few minutes of the job's execution time.
It may also save some resources on the node.

To save a bit more time in the fullstack job's execution this patch also
disables compilation of the OVS from source in that job. We can use OVS
installed from packages provided by the distro instead.

Change-Id: Ic4b6740671e51f0d306967013e3d500f4d0cd6a5
2021-11-23 11:35:53 +01:00
Slawek Kaplonski 836592a8bc Add functional and fullstack jobs with FIPS enabled
This patch adds definition of the functional and fullstack jobs
with enabled support for FIPS [1].
Jobs are based on the Centos 8 stream as this disto allows to enable
FIPS support.
Jobs are added to the experimental queue for now.

This patch also makes some changes in the bindep and
configure_functional_tests role to make functional/fullstack tests
working on the Centos.

[1] https://csrc.nist.gov/publications/detail/fips/140/3/final

Co-Authored-By: Ade Lee <alee@redhat.com>
Change-Id: I582495826155740ad2660ee2a8717696b0393d26
2021-11-17 13:41:40 +01:00
Lucas Alvares Gomes 7f0ca67ed6 Remove the devstack/lib/ovs in favour of "ovs_source" from DevStack
This patch removes the devstack/lib/ovs module and update the scripts to
use the ovs_source module from DevStack instead.

Depends-On: https://review.opendev.org/c/openstack/devstack/+/791085
Change-Id: I65fe53ee753ac68340f7d4d928643d3d8e5c8694
Signed-off-by: Lucas Alvares Gomes <lucasagomes@gmail.com>
2021-05-31 09:41:57 +01:00
Rodolfo Alonso Hernandez 97e34498f7 Fix "nftables" ansible role
Fixed "iptables" restore tasks:
- Using the "ipvX_rules_file.stat.exists" flag
- Retrieving the correct path name from the stored variable.

Change-Id: I61a07b9b0c0fd3c0906ed8efe0b09bf0988ccdfb
Closes-Bug: #1926313
2021-04-27 15:56:43 +00:00
Rodolfo Alonso Hernandez f7d2c3608d Add periodic jobs to test "nftables" binaries
In order to check how the "nftables" binaries work with Neutron, two
new jobs have been added to the periodic queue:
- neutron-tempest-plugin-scenario-linuxbridge-nftables
- neutron-tempest-plugin-scenario-openvswitch-iptables_hybrid-nftables

In those two jobs, the binaries for "iptables", "ip6tables",
"arptables" and "ebtables" are replaced with the "nftables"
counterparts; by default, newer operating systems use the "nftables"
versions, providing the legacy API to the user but executing the
new packet handling in Netfilter.

Change-Id: Idec6d480886298f6d71b1dd649c9255ee6b7bebb
Related-Bug: #1508155
Related-Bug: #1922892
2021-04-12 09:48:11 +00:00
Lucas Alvares Gomes 68ec29abf0 [OVN] Use the OVN DevStack module
The DevStack module for OVN has now been moved to the DevStack repository,
this patch is deletes it from the Neutron repository.

Depends-On: https://review.opendev.org/#/c/748140/
Change-Id: I2c30b8130525380234d767a7cb46f9bcca2a0d6b
Signed-off-by: Lucas Alvares Gomes <lucasagomes@gmail.com>
2020-08-26 10:09:28 +01:00
Slawek Kaplonski 31a95c085f Use ebtables-legacy on Ubuntu Focal
On Ubuntu 20.04 there is by default ebtables-nft used. The problem with
that is that nftables don't supports syntax for source and destination
ipv4 address in arp tables right now.
So to workaround/fix this problem at least in our gate jobs we have to
switch to ebtables-legacy for now.
And that's exactly what this patch is doing.

Change-Id: I0aca119f1feca1d8f31a0104dde40d5d52c1b25c
Closes-Bug: #1889779
2020-08-04 10:57:37 +00:00
Maciej Jozefczyk fb2806f808 [OVN] Unify OVN/OVS compilation
There were duplicated methods doing almost the same in terms
of OVS/OVN compilation.

This change:
 * move of OVS related compilation code to devstack/lib/ovs
 * delete of OVS related compilation code from devstack/lib/ovn_agent
 * source unified functions in devstack/lib/ovn_agent from
   devstack/lib/ovs
 * Unify NEUTRON_PATH variable to NEUTRON_DIR

Closes-Bug: #1877377

Change-Id: Ia012a8e116a276a6674f86366c803e0e2d8ff704
2020-07-07 22:05:59 +00:00
Jakub Libosvar d086058895 ovn: Use newer OVS
OVS tag v2.13.0 is not compatible with current used kernel on upstream
Bionic Ubuntu kernel 4.15.0. This patch sticks to commit hash to unblock
the gate. We can either change to newer 2.13 tag once released or better
stop compiling OVS and use one packaged by Ubuntu.

Run functional/fullstack tests with selected OVN and OVS versions

Previously for functional tests OVS version was hardcoded - v2.12.0,
and OVN was installed from OVS repository.

After we merged OVN driver to Neutron tree we run both
Neutron/OVS and Neutron/OVN functional tests in one job.

This patch adds possibility to specify from which tag/branch OVS and OVN
should be checkout.

Change-Id: I83688031951b97bfe64f3aaa761ad7afc1d5ea55
Closes-Bug: #1883601
Closes-Bug: #1878160
2020-06-19 15:57:28 +02:00
Rodolfo Alonso Hernandez 1986865bd5 Add MariaDB 10.3 repository for Ubuntu Bionic
In order to execute the periodic job "neutron-tempest-mariadb-full",
using Ubuntu Bionic and MariaDB, a newer version is needed than the
default package version distributed (10.1).

Devstack gates are tested with MySQL 5.7. Current Neutron DB schema
is not working with the reported version 10.1.

Change-Id: Ie2b5f85a9c0fc26676d44074424cf5a699303805
Related-Bug: #1855912
Related-Bug: #1841907
2020-01-16 10:05:36 +00:00
Jens Harbott 86feb7916b Fix log directory permissions for functional job
After [0] devstack no longer changes the ownership of the whole
/opt/stack tree to the stack user unconditionally. So we need to create
/opt/stack/logs with the correct owner directly.

[0] https://review.opendev.org/203698

Change-Id: I4597c83bfce6267ef93bb8f7b0de62fa3ac94db4
Closes-Bug: 1838811
2019-08-03 12:06:32 +00:00
Slawek Kaplonski 9f857631d8 Add "project_name" variable to configure_functional_tests role
It will be useful when neutron-functional or neutron-fullstack
job will be used in stadium projects like e.g. in neutron-fwaas.

Change-Id: I73c446d43e44b8f06c93752ebf98684f165e6fcd
Related-Bug: #1804844
2019-05-22 15:30:46 +02:00
ZhongShengping 161e6b80f0 Replace git.openstack.org URLs with opendev.org URLs
Thorough replacement of git.openstack.org URLs with their opendev.org
counterparts.

Change-Id: Ifc446e00d7f69cb23411b3a50c8d880c719f1e73
2019-04-23 10:00:45 +08:00
OpenDev Sysadmins 5d607a13ba OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:38:27 +00:00
Slawek Kaplonski b6550e568d Remove "msg" from tasks in ansible roles
It looks that 'msg' isn't valid attribute for a Task and
it cause problem with jobs which uses this role.

Change-Id: I43d09e645f60526d251703ce7ee91c29281f1eeb
Closes-Bug: #1820993
2019-03-20 13:46:17 +01:00
Slawek Kaplonski 33110fb7e8 Migrate neutron-functional job to zuul v3 syntax
This patch migrates also neutron-functional-python27 job to
zuul v3 syntax.

Neutron's functional tests have to be run on host with
deployed minimal devstack but without running any e.g. neutron
services. Because of that new job's template inherits from
devstack-minimal job instead of devstack-tox-functional and
we need to have own run_functional_job and post_functional_job
playbooks.

It also adds ansible roles:
- configure_functional_tests
- setup_logdir
- fetch_journal_log

which are used in new neutron-functional job definition.
Those roles can be also used later e.g. for fullstack job.

Change-Id: I80bc17c8c9f43050ac0c21176fbc4be46c11ce35
Related-bug: #1804844
2019-03-13 11:07:38 +00:00