Commit Graph

68 Commits

Author SHA1 Message Date
Zuul 0433afbead Merge "Bump cirros version" 2024-02-29 09:29:19 +00:00
Takashi Kajinami 7562653f38 Bump cirros version
The current version is quite old. Let's use the version currently used
in devstack jobs.

Change-Id: Iada429df4d7aa5ba360e00c99c5c2e5fff4e53fc
2024-01-09 14:59:39 +09:00
Takashi Kajinami 9a2b6dddbb Remove script logic for CentOS/RHEL < 7
CentOS/RHEL 7 support was removed during Ussuri cycle.

Change-Id: If226e95500038f819227afccaec4b7fc345ea90e
2024-01-09 14:52:25 +09:00
Takashi Kajinami 552b45be5e Fix dstat options
--top-io-adv and --top-cpu-adv aren't options in c8, so let's make
their usage dynamic.

This imports https://review.opendev.org/801659 from the upstream
p-o-i repo.

Co-Authored-By: Alex Schultz <aschultz@next-development.com>
Change-Id: I0a77a4711a8eb03deda15574ba309ae2df5ccbeb
2022-06-08 01:22:51 +09:00
Joel Capitao 8a5700cd1e Add CentOS Stream 9 preview support
CentOS is publishing some preview composes of CentOS Stream 9. In RDO,
we are working to get ready for it ASAP.

This patch is proposing some changes needed for current status of
CentOS9 so that i can use this patch for it:

- Set rsync to be executed without xinetd (xinetd is not in CS9)
- Added the creation of initiatorname.iscsi using openstacklib::iscsid

It's also creating packstack-centos9 and packstack-multinode-centos9
base jobs so that we can start running packstack jobs in third-party
zuul servers.

Change-Id: I64edd1876ccc32f98ab2330024d9ab513f42a158
2021-10-05 15:11:21 +02:00
yatinkarel d24fd0acf3 Remove usage of deprecated params for nova::network::neutron
neutron_* parameters were deprecated earlier and are
now removed with [1], let's use recommended params
now.

Also upgrade pip as latest cryptography needs rust[1] to build,
to use published wheel binaries for cryptography atleast 19.1.1 pip
is needed, so let's update pip to latest.

Also pin puppet-systemd to working commit as master puppet-systemd
is not compatible with puppet-rabbitmq, until it's fixed let's
pin like it's done in rdoinfo[3].

[1] https://review.opendev.org/c/openstack/puppet-nova/+/772175
[2] https://github.com/pyca/cryptography/issues/5771
[3] https://review.rdoproject.org/r/#/c/32088

Change-Id: I45a6585b24ed8ae694b21fb0b9617d843e95cdd9
2021-03-01 20:37:17 +05:30
yatinkarel 026d2feefd Rely on ID/VERSION_ID to detect distro
REDHAT_SUPPORT_PRODUCT* are removed from recent
CentOS8.3 release[1], Let's use ID/VERSION_ID instead
which are available[2] and would serve our purpose.

[1] https://git.centos.org/rpms/centos-linux-release/c/2e3df0
[2] https://www.freedesktop.org/software/systemd/man/os-release.html

Change-Id: Ic10b461dde012e01de87eaf03745f17fbaf704e8
2020-12-14 12:51:27 +00:00
Alfredo Moralejo 19c71e92d1 Move nova:pci class invocation to before nova::api
After [1] nova::pci is included nova::api and packstack fails with
duplicate declaration.

This patch is moving nova:pci class invocation to before nova::api
in order to handle the duplicate declaration.

Also, this patch is installing python3-wheel to unblock CI jobs which
are failing with error:

"ERROR: 'pip wheel' requires the 'wheel' package. To fix this, run: pip install wheel"

[1] https://review.opendev.org/#/c/760327/

Change-Id: I264a0104aaf9ad8b927126cb523a4e8df9c5e6b7
2020-11-10 13:49:12 +00:00
Alfredo Moralejo 92fba26e82 Move to cirros version 0.5.1 by default
We are still using old 0.3.5 version, let's move to the most recent one.

This patch also removes usage of UEC cirros image for tempesa. This was
introduced long time ago [1] because of hitting issue reported in [2].
This should be fixed in newer cirros versions so let's make it simple
and do not use extra image only for tempest.

[1] https://review.opendev.org/#/c/322139/
[2] https://bugs.launchpad.net/cirros/+bug/1312199

Change-Id: I1bc286f6264538f4be920e5bf2b5d113c0b57280
2020-10-02 18:02:14 +02:00
Alfredo Moralejo 36aff644d2 Some fixes required for CentOS 8
This patch is doing some changes related to CentOS8 transition.

- Pre-install python-pyyaml, otherwise is installed with pip at a later
  stage and jobs fail when trying to install from package from CBS
  build.
- Collect dnf related logs
- Use puppet-passed-ci RDO Trunk repo
- Make CentOS 8 jobs voting (we'll remove CentOS7 soon)
- Add CentOS 8 jobs to gate pipeline.

Change-Id: I68a5eb6a547286469e73e57bd6ace02e0aec4532
2020-02-28 10:30:57 +01:00
Alfredo Moralejo 7fc7293762 Use same Puppetfile for CentOS8 and CentOS7
mariadb has been updated in centos7-master to version mariadb-10.3.20
which should work fine with latest puppet-mysql so we shouldn't need to
pin it anymore.

Change-Id: I308fcf161f5344a7b927f17b3ff385f1c5b0ecd1
2020-02-25 11:41:17 +01:00
Alfredo Moralejo c86f30c1dd Do not create heat_stack_owner role in keystone.pp
It's created in heat::keystone::auth and after [1] it's complaining of
duplicate declaration.

Also pinning gettext as version 3.3.0 is not compatible with the ruby
version in CentOS7.

[1] https://review.opendev.org/#/c/692664

Change-Id: I8d226aa2218eafc07119f88eca5be24c3514b717
2020-01-08 18:16:59 +01:00
yatinkarel a344b9cd36 Add jobs for CentOS 8
As part of adoption of CentOS 8 in RDO, this patch is adding support to
test with it:

- Adapt run_tests.sh for CentOS8.
- Add the option to have different versions of puppet modules (needed
for puppet-mysql until we can update mariadb in CentOS7.
- Add centos8 playbooks and jobs definition.

Change-Id: Ie53a8cb5517651487436e24bf60f51bc531f16d6
2019-12-19 14:44:24 +01:00
Alfredo Moralejo 97e5a40dbb Use https for cirros downloads
http is being much slower and anyway using https is a good practice.

Change-Id: Ib9b4194c88cd9065babb81c788ed52b2ee5b8d2f
2019-10-22 16:00:46 +02:00
Alfredo Moralejo 7417aef9bc Use upper-constraints when installing packstack from source
Currently, it's not using the constraints file so we may use different
versions that other services.

Change-Id: I3f8eb965b6f08ddf6c0bc89a53e051e43047aecb
2019-08-14 10:49:44 +02:00
Zuul d781240f86 Merge "Replace openstack.org git:// URLs with https://" 2019-03-25 15:34:28 +00:00
Ian Wienand 3bb518d9ce Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: I0b4e3ec44d4e577f6a8af4c8a94ea9ca78c3c20d
2019-03-24 20:35:33 +00:00
Javier Pena 82046eb49e Add iptables-services to installed packages in run_tests.sh
The puppet-firewall code uses /usr/libexec/iptables/iptables.init,
which is provided by the iptables-services package. This package is
commonly included, but let's be safe.

Change-Id: Ifb917f370b63184378ea6b399ca3a5a3f85eabc0
2019-02-25 12:59:12 +01:00
Javier Pena 316fad0d10 Additional fixes for RHEL 8 support
- pip install needs /usr as a prefix, otherwise packstack is installed
  under /usr/local/bin, which is not a valid path for sudo.
- iptables package is required.
- SSL certificates need to be decoded when writing, to avoid string
  issues.

Change-Id: Ia49ebda480ace91c6727c887c4cd8394cfefcfff
2019-02-19 17:49:35 +01:00
Javier Pena fe9620acd4 Fix pip setup for RHEL 8
On RHEL 8, we have no pip but we have pip3, so we need to adapt the
pip detection and setup to this.

This also requires taking into account a new possible location for
packstack.rst, under /usr/local/share.

Change-Id: I3b93449fb4b7faabb15a8b186d2be1c174b754b6
2019-02-19 17:33:59 +01:00
Javier Pena d84fd14687 Fix package installs in run_tests.sh for RHEL 8
Some packages we always install in run_tests.sh are either not present
in RHEL 8, or need to be named differently.

Change-Id: I14b98e8a4d237bed77581ae4364351913234c9ba
2019-02-19 17:33:59 +01:00
Javier Pena 627e2f77cd Work around Fedora umask issues in run_tests.sh
We are having issues in some CI jobs running on Fedora images. They
are caused by a combination of factors that create the wrong umask.

Change-Id: I2114f688a8fd78311cb045a9b7560ed3360970ad
2019-01-17 08:49:58 +00:00
Tobias Urdin 926bc175be Remove port 35357
This removes port 35357 for Keystone as will be
done in [1] and changes all references to that port.

I can't see that packstack will need to keep the support
for both ports as done in TripleO recently [2].

[1] https://review.openstack.org/#/c/619257/
[2] https://review.openstack.org/#/c/627793/

Change-Id: I4b6dcd396e1e5e666e7429929240bca7aadbc3bb
2019-01-07 16:00:11 +00:00
Alfredo Moralejo 966fcf3250 Add a new job on fedora-28 images to test python3
This patch is creating a new job running on fedora-28 images which
runs scenario-py3.sh to validate python3 builds on fedora.

Job is non-voting.

Additionally this patch is fixing puppetfile to get newer versions,
aligned with what we have in p-o-i.

Change-Id: I404fc6d38dd5177a3aaef51b0450ad2850595e32
2018-10-05 16:15:03 +02:00
Javier Pena 4f8e95eccf Pin r10k to version 2.6.4
r10k version 3.0.0 and later require a newer version of the cri gem,
which only work with ruby >= 2.3. This does not work on CentOS 7,
where we have an earlier version.

Change-Id: I99958dd82bb95b8f3d7a6a2b0c86fd2c1f21c802
2018-09-27 11:12:43 +02:00
Zuul 6c8454d96b Merge "Revert "Pin puppet_forge gem to version 2.2.6 for tests"" 2018-08-21 10:51:50 +00:00
Adam Kimball 2aef0edad8 Add basic system arch support to test scenarios
Currently, test scenarios 001-003 will only look for x86 cirros
images. This patch adds support by grabbing the system arch and
creating a string to match the downloaded cirros image in
run_tests.sh.

Currently, ppc64le and x86 will use different cirros versions,
as x86 experiences kernel panics with 0.4.0, which power needs.

Change-Id: Ibc9c2f4d9d8d34e416b3b57cfde0a51d0917e689
2018-04-17 17:34:53 +00:00
Michael Turek e0dca01ebd Use system arch to determine what cirros images to use in run_tests.sh
Currently run_tests.sh hardcodes what images are downloaded and used
for testing. This patch grabs the system's arch and uses it to build
the urls and filenames for the cirros images. Additionally, ppc64le
images are not provided until 4.0 so switching cirros version based
on arch is also added here.

Change-Id: I73b65c566153c027988b5781870e44c47c6e8b1f
2018-03-26 19:19:14 +00:00
Javier Peña 918cbd2cc8 Revert "Pin puppet_forge gem to version 2.2.6 for tests"
We now have puppet_forge 2.2.9, r10k 2.6.2 and semantic_puppet 1.0.1, which do not create any incompatibility.

This reverts commit edbf361c7c.

Change-Id: I54ccdd24ce3717feaf4600c4cb4df38bae8b9b06
2018-03-13 14:39:30 +00:00
Chandan Kumar e7f235f411 Switch to stestr for generating subunit results
* https://review.openstack.org/#/c/504345/ moves the tempest run
  cli to stestr. In order to avoid breakage switch to stestr from testr.
* Check for .testresposity and .stestr folder and then use
  respective test runner. It will avoid the breakage in CI.

Change-Id: I1fdbe2f441a73f80d8d6e7a8263d300939a4fba3
2018-02-14 15:38:52 +05:30
Javier Pena c1dd9435ee Add multinode CI job
Packstack has traditionally allowed multinode deployments with
1 controller, one or more network nodes and several compute nodes,
but this has never been properly tested in our CI.

This job enables an option to use a 2-node architecture, with one
controller and one compute node. It adds a job running scenario002,
but enables scenario001 and scenario003, so they can be used on
demand if needed.

Change-Id: Ide96a232c902370f3ec25ed54f2b272cc1757dad
2018-02-08 08:22:18 +00:00
David Moreau-Simard 1989771673
Update Cirros image to 0.3.5
It turns out that Cirros 0.3.5 has been out for a while, we should
use the updated image. The changelog for cirros is not published
but it's available here [1].
This is also what devstack has been using [2].

[1]: http://paste.openstack.org/raw/625252/
[2]: https://git.openstack.org/cgit/openstack-dev/devstack/tree/stackrc?id=2c9343e5db44fa7a41ca6924737331dd9088ef8f#n671

Change-Id: Iea145f69ee461192e6d4d2d7d9427c3acb954c27
2017-11-01 15:25:31 -04:00
Javier Pena df7cb04857 Zuul v3 support for Packstack jobs
- Do not generate the SSH private key if it already exists
- Set skipsdist = True in tox.ini
- Add Zuul v3 layout

Change-Id: I4b0254bf175d51c0a468b01f8ac034db43859572
2017-10-16 12:55:47 +02:00
Javier Peña c96bea09d6 Revert "Use alternative cirros url until download.cirros-cloud.net is fixed"
The domain is back, so we can undo the workaround.

This reverts commit 187af0d761.

Change-Id: I2a5a3de4b04acf191ae957675dddffb869d7277f
2017-08-28 14:47:52 +00:00
yatin 187af0d761 Use alternative cirros url until download.cirros-cloud.net is fixed
Change-Id: I98e3b04e18137809b6ff7806fa43de3ca672e743
Closes-Bug: #1713358
2017-08-28 13:21:06 +05:30
Javier Pena edbf361c7c Pin puppet_forge gem to version 2.2.6 for tests
The latest puppet_forge version (2.2.7) requires semantic_puppet ~> 1.0,
which is not compatible with r10k.

Change-Id: Ie1ecfcc8ba579ae52007dd924851ed47a2ccb5dc
2017-07-07 15:28:55 +02:00
Javier Pena 14e0eaaa35 Make SELinux enforcing/permisssive configurable for tests
When running tests using run_tests.sh, we want to have the option
to select if we want to run SELinux in enforcing (default) or
permissive mode.

Change-Id: I76776ff975a251c62f70c826913cd329b57c20c3
2017-05-23 17:37:18 +02:00
Emilien Macchi 224ae9ecb2 Switch trunk/cbs/buildlogs to use https
There is a permanent redirection from http to https in buildlogs, cbs
and trunk repos that might create issues when the redirection fails for
some reasons.
Let's use https directly.

Change-Id: I84f29d6761a80d95c15ca2db97fce02185dbd8de
2017-03-21 08:26:25 -04:00
Chandan Kumar eab6d1fdcb Install tempest from rpm
In RDO, from ocata release tempest rpm is using upstream tempest
as a source. It would be good to use the same rpm for installing
and configure tempest.

Depends-On: Ia9e48d951e0f37e985e628b7a49401d75c9e4729

Change-Id: Ie6b20063944d3e6307bd332c624572e0cb3f1158
2017-02-03 08:49:30 +00:00
Alfredo Moralejo 3bb99624ee Add update step after enabling OpenStack repos
In specific cases, there may be conflicts between packages
provided by Centos and RDO repos. In that case RDO repos
should be used.

To avoid any of these issues, this patch updates packages
right after enabling the repos.

Note this will be required when gate jobs move to CentOS 7.3
because of conflicts between mariadb-libs in CentOS and
mariadb-common in RDO repos.

Change-Id: Icaeed8602378780f2c9bc8b22621c09b65bf95a8
2016-12-02 14:12:57 -05:00
Javier Pena a8432173a9 Use centos-master for tests and fix Puppet4 compatibility
We were still using the Newton repos to test, because we had no
CI-passed repo for Ocata. This changed long time ago.

Also, certain late changes to Puppet modules have broken Puppet 4
compatibility for Packstack, such as
e86ac7fb4b

We need to fix Puppet 4 support for Packstack at the same time
we enable centos-master.

Change-Id: Iaf28404b9ac1b3e0ab16962b28c5b6be758a551f
2016-11-30 13:13:42 +01:00
Javier Pena 3aee627396 Ensure Puppet4 compatibility
Packstack needs to support Puppet4. This patch will include all
fixes needed to achieve this.

Change-Id: Ifaac917308c5d524c3ec51243d92093f0139c9fe
2016-10-18 12:50:56 +02:00
David Moreau-Simard fd4ac4b7d6 Use ADDITIONAL_ARGS to pass extra commands to Packstack scenarios
This is a generic variable that'll allow to pass extra commands to
Packstack integration testing scenarios so that we do not have to
parameterize everything and extend testing easily if required.

For example, this will allow testing frameworks to send the extra
argument "--enable-rdo-testing=y" in order to test Packstack against
the testing repositories.

Change-Id: I5b510aabe6749e329b19ef178e6b8870ee66c1a7
2016-10-03 13:51:29 +00:00
Javier Pena 7d4e949def Use proper tox directory when printing Tempest results
When running with run_tests.sh, the .tox venv is created under
/var/lib/tempest/.tox/tempest (as opposed to .tox/all).

Change-Id: Ic7e1a639d3e5283b0550347101be277028917a24
2016-09-14 16:51:27 +02:00
David Moreau-Simard a6c5f9d1de Use pre-cached images for tests (or pre-cache prior to testing)
Cirros downloads have been a big problem of unreliability in testing
Packstack in different environments.

This aims to use pre-cached Cirros image files (in OpenStack or RDO
gate) or it will download the images with wget (with retries) prior
to running the tests.

This will prove faster if there are pre-cached images available
and more reliable in case the images need to be downloaded.

The change is backwards compatible and affects testing from
run_tests.sh only. The glance_image provider from puppet-glance
accepts files or URLs, detecting if it's a path by leading slashes
in from the location.
The *_URL parameters are arguably no longer accurate but this can
be fixed in a future patch if we see the need to.

Change-Id: Ibd19fb69e080957165594953687efe5f096f93b2
2016-08-16 20:29:11 -04:00
David Moreau-Simard b4ff4914cb Follow redirects when using curl to setup repositories
current-passed-ci is now redirected and hosted on a CDN.

Change-Id: I27247b7e19a1fbbb72d10bfb8c4df3babbfbff59
2016-06-23 16:41:34 -04:00
Javier Pena e531ea5fb9 Enable SSL in scenario001
Let's add SSL coverage to our tests. By enabling it in scenario001,
we can cover rabbitmq and horizon.

Change-Id: I785b7daf6ea8d6b9016e4438271c11844ea48ba0
2016-06-08 07:21:26 +00:00
David Moreau-Simard b8a8c717e7 Bump repository to newton for master branch
Change-Id: I73d2028e70781415103e6621337fe18588d2e363
2016-05-25 11:33:19 -04:00
David Moreau-Simard 0d8dd7dfc9 Remove workaround for openstack gate locales
Fixed in https://review.openstack.org/#/c/316831/

Change-Id: I31b3091fc8ed0617d823a6d575aec218d41b0180
2016-05-18 16:41:50 -04:00
Jenkins 203b02f2ee Merge "Reserve keystone admin ports in test executions" 2016-05-17 11:22:52 +00:00