Commit Graph

78 Commits

Author SHA1 Message Date
Takashi Kajinami e91c3d6be4 Drop logic for old puppet-ceph branches
... because these were already removed.

Change-Id: Ibdac9f450d0dba2408e13fd2f2bc1f7c759ebd63
2024-03-08 18:23:24 +09:00
Takashi Kajinami 4690694faa Ignore case when comparing boolean values
In case an environment variable is set to a boolean value in ansible,
the actual value is capitalized(True or False). We have to ensure that
case is ignored when comparing such value with a reference.

Change-Id: Ic51e966acc7e6939dd17d60ab5e3971bd05e77d5
2023-11-17 03:04:01 +09:00
Takashi Kajinami 02e65c7fc1 Refactor puppet installation in integration job
This splits the existing function to repository set up and actual
package installation and adds an additional knob to skip setting up
puppetlabs repo (and install puppet from distributions).

Change-Id: I3568883537e8cc29f234754c78fc2425ad6a8f4b
2023-11-09 23:37:51 +09:00
Takashi Kajinami 95222a53aa Use structured facts in hiera.yaml
Legacy facts are no longer enabled by default since Puppet 8.

Change-Id: I2f97154115a120d944034b72260e4bee66553bff
2023-04-28 16:20:33 +09:00
Takashi Kajinami 82bc379060 Remove unused logic with outdated comments
We currently disable catch_selinux_alerts because of frequent timeout
caused by selinux alerts, but having these old logics/comments can be
confusing for future maintenance.

Change-Id: Idd433c333a38a968622a97e0628e9eb8feb6fa24
2023-02-26 04:42:44 +00:00
Takashi Kajinami 5cadc6d36e Update the logic to use stable branch of puppet-ceph
... so that we don't need to update it when switching Ceph to a new
release.

Change-Id: Ic3f0ccfa5a423b3ec48fc7bd9f289e31813d1176
2022-08-21 13:44:23 +09:00
Takashi Kajinami f94e042df5 CentOS 9: Switch back to puppetlabs packages
CnetOS 9 packages were already released in the puppetlabs repo.

This removes the workaround to use RDO packages, which was earlier
added to run integration jobs on CentOS Stream 9 before the packages
were released[1].

[1] f384effdb4

Change-Id: I0b9529b6a4f1c4beefa72b6e32b586b1ac9bea73
2022-07-10 01:02:49 +09:00
Alfredo Moralejo f384effdb4 Add support for for CentOS Stream 9
CentOS has published the official mirror for CentOS Stream 9 [1]. In RDO,
we are working to get ready for it ASAP and we have the required repos
to run p-o-i on CS9 [2].

This patch is adding support to CS9 in p-o-i repo with the required
fixes. Also is adding integrations jobs for scenarios 0-4 and adding
them as non-voting. Note that we don't have promotion pipeline working
so i think it's better to not make it voting yet.

[1] http://mirror.stream.centos.org/9-stream/
[2] https://trunk.rdoproject.org/centos9-master/report.html

Change-Id: I9da46a6aaef3559b24d5a47fb0bde9ae1d09abdb
2021-11-23 22:44:14 +09:00
Joel Capitao ceb720bd8c Switch to Ceph Pacific from Octopus
As discussed in [1] we'll go along with Pacific with Xena
on CS8.

[1] https://review.rdoproject.org/r/c/rdo-infra/ansible-role-weirdo-puppet-openstack/+/35706

Change-Id: Iafbcd03b03adfb8597f5a7025dd84574a08b952f
2021-09-27 10:08:54 +02:00
yatinkarel ea8824c436 Remove epel-release using yum/dnf
With [1] epel-next-release added as weak dep
to epel-release, so now epel-release cannot
be removed alone due to below error, so let's
used dnf/yum for removal as that will clean
the deps too.

epel-release = 8-11.el8 is needed by (installed)
epel-next-release-8-11.el8.noarch

[1] https://koji.mbox.centos.org/koji/buildinfo?buildID=18210

Change-Id: I893d63bf9ffa4b960ab76a54d76af5c58ef428a7
2021-07-01 18:15:20 +05:30
yatinkarel c218b2d33f Ignore sealerts in CentOS 9 too
We already disable for CentOS8, let's do for CentOS9
too for same reasons.

Removed VERSION_ID check as both supported C8 and C9
need to be ignored, and same should be there for future
CentOS releases.

Change-Id: Ie84e91a7fed16cd727e8cd9c50066617a1cb23b7
2021-05-27 19:44:05 +05:30
Thomas Goirand 6ce74b546e Fix installing puppet in Debian.
This patch fixes the install of the puppet packages in Debian.

Change-Id: I5674333169c8d961dbe29fc2f93bf42635cc2748
2021-04-07 18:58:58 +02:00
Takashi Kajinami a13001fc36 Switch to Ceph Octopus from Nautilus
EOL of Nautilus is coming soon (2021-06-01) so let's switch to newer
version now.

Change-Id: Idd9e509e49827ce490819df762108afd50585153
2021-03-22 14:10:20 +09:00
Takashi Kajinami fe029254fd Ubuntu: Switch to Focal and Victoria
We already have OpenStack Victoria releae available in cloud archive
so let's switch our master tests to that latest version.
Since Victoria release is only available in Focal this change also
switch base Ubuntu version from Bionic to Focal.

Change-Id: Ie78b6ef1c3f09fbbc3bc584ac99d2a0acfc5d9d9
2021-03-22 14:10:16 +09:00
Zuul ad94a7f237 Merge "Retry sealert command on failure" 2021-02-05 13:35:10 +00:00
yatinkarel ec57a35931 Improve retry_cmd function to handle set -e
In run_tests.sh we use 'set -e' which makes
script fail as soon as error hit but we don't
want to fail in case of retries, this patch fixes it.

Change-Id: Ia33ff3dbb88317171143a43e5b1c674038187254
2021-02-05 14:06:03 +05:30
yatinkarel 425f454bdc Retry sealert command on failure
We randomly see issues while running sealert
in RDO puppet promotion pipeline, sealert fails with:-
"SELinux is disabled or we can't open a policy file"
As per logs selinux is enabled and selinuxfs is mounted
so seems it's some filesystem issue.

Locally was able to reproduce only with selinux disabled
or umount /sys/fs/selinux. Adding retries in hope to
fix these random failures.

Change-Id: Icb07742d328827a41132cdd6a6c2bcfa3cde11ec
2021-02-04 21:01:56 +05:30
yatinkarel 8d5b34c552 Add retries to module installation with r10k
Since the modules are git cloned when installed via r10k and
clones may fail due to some network glich, adding retries should
help in these cases.

We randomly hit failures during git clone in RDO promotion
jobs running on ci.centos.org, adding retries to r10k
installation to handle those random failures.

Added function 'retry_cmd' which can also be used
with other commands.

Change-Id: I5f3b94eaa5a65c76877363e9ca41684445c9cb12
2021-02-02 14:37:43 +05:30
Takashi Kajinami eda1d55cf3 CentOS: Install gpg keys from repository
... instead of maintaining copies in our own repo.

Change-Id: Ie965151027dba330fb867c6ef28a36132e755d91
2021-01-23 23:43:32 +09:00
Takashi Kajinami 3f3da39c68 CentOS: Install new gpg key for puppet packages
This change ensures that the new gpg key for puppet packages[1] are
install before installing puppet-agent, so that we can install any
package signed with the new gpg key.

[1] https://puppet.com/blog/updated-puppet-gpg-signing-key-2020-edition/

Closes-Bug: #1912871
Change-Id: I015770275192d9834e38593e249b472f56d7ccd4
2021-01-23 23:43:25 +09:00
yatinkarel cb96526867 Rely on ID/VERSION_ID to detect distro
REDHAT_SUPPORT_PRODUCT* are removed from recent
CentOS8.3 release[1], Let's use ID/VERSION_ID instead
which are available[2] and would serve our purpose.

[1] https://git.centos.org/rpms/centos-linux-release/c/2e3df0
[2] https://www.freedesktop.org/software/systemd/man/os-release.html

Change-Id: If14f4edad391fd9ee61851859ecdd3a51b97a215
2020-12-11 15:55:18 +05:30
Zuul 31b1026b56 Merge "Remove Puppet 4 repo fixes" 2020-05-18 07:10:45 +00:00
Tobias Urdin 3376fc2b63 Remove Puppet 4 repo fixes
These are no longer needed since we dont run Puppet 4.
Also fixes some hardcoded EL 7 values.

Change-Id: Ia8ad51db49004b0a9c2b60a3b1f5bd12e7f56138
2020-05-14 19:48:30 +02:00
Alfredo Moralejo 88e0f5e99e Fix puppetfile name in install_all
r10k commands where updated in [1], and file name in install_all was
wrongly changed to Puppetfile1 instead of Puppetfile.

[1] https://review.opendev.org/#/c/726568/

Change-Id: I5edda0bac10ead8c78cc96a4b259fe52b5cc93fc
2020-05-14 18:10:52 +02:00
Takashi Kajinami baecae0460 r10k: Replace removed env parameters by options
The environment parameters, PUPPETFILE_DIR and PUPPETFILE is no longer
valid in r10k command, so should be replaced by options, --moduledir
and --puppetfile[1].

[1] ea477d4729

Change-Id: I0d12f2c4efafc7a8a998d846814c94eb39927c26
2020-05-11 11:23:27 +09:00
Alfredo Moralejo d2b34d006b Move CentOS8 to standard Puppetfile and bump puppet-mysql
mariadb has been updated in RDO CentOS7 for Ussuri so we can bump
puppet-mysql and use the same Puppetfile for all cases, no more
exceptions for CentOS8 are needed.

Change-Id: I1c4204c5b9fb893a2209666894792938f72b7548
2020-02-26 22:05:48 +01:00
Emilien Macchi 70ac070db1 Invert the logic of Puppetfile
I98fc088cd87c1412544f9590ce7a925b413297e2 broke unit 5.5 for
puppet-tripleo and probably puppet-pacemaker, since it can't find the
Puppetfile by default anymore.

Change-Id: I43718a849d09653e6c352b581aef6bbbf372fc41
2019-12-20 17:08:09 -05:00
yatinkarel b44d0bdd5a Add CentOS8 support and jobs
- scenario001 and 004 will be running without ceph
  until ceph repos get available for CentOS8
- scenario003 will run not run with linuxbridge until next CentOS
  minor version as it has issues:-
    - https://bugzilla.redhat.com/show_bug.cgi?id=1720637
- Add Puppetfile_centos7 to have different puppet modules
  as compared to other distros. Currently only puppet-mysql
  needs to be kept pinned for centos7 as newere mariadb version
  is required to remove the pin, CentOS8 and ubuntu have required
  mariadb version so pin is removed. So automatic updates of puppet
  modules will not be applied for CentOS7 as those jobs are going to
  be removed in coming months.
- check for rdo_dlrn url existence only for RedHat distros.

Change-Id: I98fc088cd87c1412544f9590ce7a925b413297e2
2019-12-20 10:18:18 +00:00
Tobias Urdin fff72afe75 Remove zuul-cloner usage
Depends-On: https://review.opendev.org/#/c/667439/
Change-Id: I6e11c12ad73c89466aefbb926c111ed1d00784b8
2019-06-26 23:16:01 +02:00
ZhongShengping a8bf4ac2e8 Move to opendev
Change-Id: I467e86b132314d6bf5331ff44a254d38a84dfab0
2019-04-22 09:11:52 +08:00
Tobias Urdin 0ccadc01ed Add Ceph Nautilus support
Adds support to set the jobs to use Ceph
Nautilus when testing.

Change-Id: Ibf2b82435a0f9c29d363c67a973399228bfb90a3
2019-04-04 14:35:41 +02:00
Ian Wienand 6208fc4f3c Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: I34c2be045d56d99792fcc1533b67c2c8de1aedac
2019-03-24 20:35:42 +00:00
Tobias Urdin a5b22a67fe Use hiera v5 format
Use hiera version 5 instead of version 3 which is
deprecated and outputs a warning.

Change-Id: I26ee3329aa75109625476d6c355e82fed2c050e6
2019-01-15 14:49:57 +01:00
yatin 0c938590d2 Add support to all Scenarios to work with Fedora and RedHat > 7
Disable SSL as currently there are known issues in services
to work with python3 + SSL on Fedora.

Also fixed following:-
- watcher to work without SSL
- Handle source /etc/bashrc for users don't have .bashrc created
- Install python3-rbd in Fedora and RedHat > 7

Change-Id: I5b67f40ec3c687f5282c65e10b4a1ee1fe5528f3
2019-01-09 20:11:43 +05:30
Tobias Urdin 047ea125dd Add puppet core providers for puppet6
In puppet 6 they have moved out a lot of builtin
resources to their owns modules since they didn't
belong in the Puppet core however in deb/rpm packaging
they are still bundled in but not when installing from
gem.

So we must add them in here so that they are available
in our unit tests.

Change-Id: I7060191395eff9c1e3146cb10594a38bef113117
2018-11-20 11:37:55 +01:00
Tobias Urdin eace0d6b15 Add puppet6 testing
Add puppet6 testing and run all those on Ubuntu Bionic.
Change from Xenial to Bionic for all other default jobs.

Run libraries unit for 6.0 on Ubuntu Bionic.

Change-Id: I4d9f1d1b62acece9bc0b4ce7bd49d2093af8e5ee
2018-11-15 10:19:25 +01:00
yatin dc9ccd6a20 Ignore sealert notices for Fedora also
Don't fail on selalert notices with scenario-py3,
Fedora jobs are failing on that, so remove the
Fedora check.

Change-Id: I46dc06d3e8e005ff0e18a10d17a75ef9e1c9e23d
2018-09-07 20:05:57 +05:30
Tobias Urdin 2daefe49a8 Change Puppet repo for Bionic
Puppet 5 for Bionic is now released and we don't need
to run the nightly puppet5 builds anymore.

Change-Id: If91bd851f3f67813cc44064be01290b9bd617cbb
2018-07-27 12:27:54 +02:00
Tobias Urdin a696192bf2 Add Ubuntu 18.04 Bionic to CI
We now have support to Mimic and can select that version
and this patch fixes Puppet 5 for Bionic we can add it to CI.

When this is fixed the only thing left is to add beaker acceptance
testing for Bionic.

Bionic only has Puppet 5 and can currently only use Ceph Mimic.

Change-Id: I6f94e214a70f92278f1f3806471ef2f622a938c3
2018-07-18 16:25:12 +02:00
Cloud User edca617537 Add new scenario to test python3 services
Also modify provision manifest to skip provisioning
some services.
The new scenario will be used for testing py3 services
starting with keystone and glance.

Also update puppet-apache reference to the required commit,
this can be updated once a new tag is released with the commit.

Change-Id: I55558f35068457175e2ef508f9e5989151db4aa2
2018-07-05 10:55:39 +05:30
Tobias Urdin 1cafb2d4fc Fix select ceph version failing beaker tests
Change-Id: Ie4bd3c46882a1cd4ec2be8c6bb4850e17fe79905
2018-07-03 11:05:30 +02:00
Tobias Urdin eaacd3f841 Add support to select ceph version
We are closing in on adding Ceph Mimic support and
want to ensure we can select either Luminous or Mimic
for running our tests.

For example Ubuntu 18.04 must run Ceph Mimic because
Luminous is not available (yet), Debian doesn't have
Ceph Mimic packages so we must run Luminous there.

Depends-On: https://review.openstack.org/#/c/576247/
Change-Id: If84ecbf86f3ebde8e69a1a26759ad967d061725a
2018-06-28 19:54:10 +02:00
yatin e931cd247a Allow running poi scenarios on Fedora
Change-Id: I409c11f31d4b82ef9a3d6ba20e2dd045156d66a9
2018-06-13 19:07:13 +05:30
Tobias Urdin b5ca31399a Use latest puppet5 repos
This change makes sure the latest puppet5 version
is used when running integration jobs for puppet5.

The puppetlabs yum mirror is ready to be used and
has the proper packages and is mirrored, example:

* http://mirror.mtl01.inap.openstack.org/yum-puppetlabs/puppet5/

For the puppetlabs apt mirror the puppet5 pool is
needed before this will work. A patch has been fixed
for that here [1]. Therefore this change cannot be
merged until [1] is merged.

[1] https://review.openstack.org/#/c/565867/

Change-Id: I1a2716fdd4b960b12ff24303038bec5ea8fb80a3
2018-05-08 23:28:18 +02:00
Mohammed Naser a45fae3c03 Fix MANAGE_REPOS for Debian-based OS
Change-Id: Iab59f0e818f8c5be1beba200f6c475669ce6ba0b
2018-04-16 19:40:14 +02:00
Thomas Goirand ca8fd0d8b8 Add GPG-KEY-ceph
At first, I thought this would go in puppet-ceph, but in fact,
every compute node needs a librados dependency which is in the
Ceph repo. So at then end, all nodes need GPG-KEY-ceph, so it
is a good idea to install the repository key there.

Change-Id: Ia33718a8350a60c69ce9632eddb6156f9b43c745
2018-04-11 22:24:00 +02:00
Mohammed Naser f416da3a9a Drop unnecessary clean-ups for Puppet
Nodepool images no longer have Puppet in them anymore so there
is no point in removing files and packages which are not there
anymore in the first place.

Change-Id: Idb89512251ca9125fcb3f44768873d2cb76eb879
2018-04-05 09:41:58 +02:00
Thomas Goirand 7a25b04990 Fixed puppet repo & key in Debian
It appears that the puppetlabs Debian repository is set to always
install a repository for Xenial (instead of using lsb_release to
find the OS), and that the Puppetlabs repo GPG key is outdated. This
patch fixes that.

Change-Id: I35231cdf7503d129bb408bc5d29a2cfe95c4e08e
2018-04-03 14:48:56 +02:00
ZhongShengping f8d4883f52 Grep command error
Error[1] when executing grep command. add sudo for the grep commands
when it is currently enabled.

[1]:http://logs.openstack.org/63/554163/1/check/puppet-openstack-integration-4-scenario002-tempest-ubuntu-xenial/dd454e9/job-output.txt.gz#_2018-03-19_08_44_16_398090

Change-Id: I5e5e89a4d691fc3890fbc863caa1fc87e42e7d87
Closes-Bug: #1756832
2018-03-19 17:47:42 +08:00
Emilien Macchi 3c8f4ccd85 Revert "Remove r10k env vars with proper args"
It broke all unit tests jobs:
http://logs.openstack.org/98/535698/16/gate/puppet-openstack-unit-4.8-centos-7/bd7dedf/job-output.txt.gz#_2018-02-05_23_19_05_369251


This reverts commit 9f14f75ec6.

Change-Id: Ibcb2bb60a668d232371e4d87febad6d67b3302d8
2018-02-06 03:34:38 +00:00