Commit Graph

22 Commits

Author SHA1 Message Date
Alfredo Moralejo 4f28c22b97 Remove deployment of panko
Panko project has been retired in Xena cycle [1].

This patch is removing the code to deploy panko with packstack.

[1] https://review.opendev.org/c/openstack/panko/+/791683

Change-Id: Iae2d7bc40732027990666819eca6d386ffa1804b
2021-06-02 10:50:07 +02:00
Zuul be903a2ebd Merge "Some fixes required for CentOS 8" 2020-02-28 13:06:24 +00:00
Alfredo Moralejo 36aff644d2 Some fixes required for CentOS 8
This patch is doing some changes related to CentOS8 transition.

- Pre-install python-pyyaml, otherwise is installed with pip at a later
  stage and jobs fail when trying to install from package from CBS
  build.
- Collect dnf related logs
- Use puppet-passed-ci RDO Trunk repo
- Make CentOS 8 jobs voting (we'll remove CentOS7 soon)
- Add CentOS 8 jobs to gate pipeline.

Change-Id: I68a5eb6a547286469e73e57bd6ace02e0aec4532
2020-02-28 10:30:57 +01:00
yatinkarel 098ae58c62 Remove explicit compress of log files
Explicit compress is not needed post [1], explicit
compress is making log files not browsable.

[1] http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011875.html

Change-Id: Id6e285e37759aadae9ebf27522d3145b77a6d691
2020-02-25 17:41:47 +05:30
Javier Pena cfdbeb5d02 Reduce unnecessary log storage
Previously we were storing the whole contents of /var/tmp/packstack,
which includes all Puppet modules and is unnecessarily filling up
the log server.

Instead, let's store /var/tmp/packstack/latest, where the last
Packstack execution logs are kept. That is really what we need.

Also added 'ip netns' command to logs to help troubleshooting issues
with dhcp agent.

Change-Id: Ia138c13c0797d2b83c9e3b4037c4648abf8f7295
2019-10-08 16:24:36 +02:00
Alfredo Moralejo c84e3b6e84 Force qemu emulation in CI and add dmidecode command to logs
Some upstream infra is enabling nested virtualization but it's failing
randomly so let's force qemu virt_type.

We need it to debugs issues with jobs incorrectly detecting
virtualization time.

Change-Id: I1e53bbdcccb6402d343c98abf2696d452717d1a9
2019-07-26 10:47:45 +02:00
Alfredo Moralejo fcdaff0d25 Fix URL to get the list of projects
It's used in copy-logs.sh. Also copy all content of /var/tmp/packstack
instead of only latest directory.

Change-Id: I7c6d72876e881f73d2421206e004f514563ad803
2019-05-17 16:03:18 +02:00
Alfredo Moralejo 966fcf3250 Add a new job on fedora-28 images to test python3
This patch is creating a new job running on fedora-28 images which
runs scenario-py3.sh to validate python3 builds on fedora.

Job is non-voting.

Additionally this patch is fixing puppetfile to get newer versions,
aligned with what we have in p-o-i.

Change-Id: I404fc6d38dd5177a3aaef51b0450ad2850595e32
2018-10-05 16:15:03 +02:00
Pradeep Kilambi 6029be0e30 Add Panko service support
Change-Id: Ifcd5a7af02755190389443bd33f336f3bc517dd4
2017-01-05 19:14:26 +00:00
Javier Pena 31c85d484f Move tox dependencies to requirements.txt/test-requirements.txt
Previously we had our requirements in two different places:
requirements/test-requirements for normal installation, and
tools/pip-requires & tools/test-requires for tox tests. Let's
unify them on a single location.

Change-Id: I3e31eeb70e7db24d87b8a7c67a427c53af814a32
2016-11-30 14:35:45 +01:00
coldmoment 6997e18066 Add reno cmd in tox venv
Now openstack can generate reno file by tox,
but there is an error in packstack when
using "tox -e venv -- reno new filename" for
there is no reno cmd in tox venv.
We need add the reno cmd to venv for supporting
the command above.

Change-Id: I3d76c787ce2f8fe143ed6693d3ef95ec3af50db5
2016-11-28 09:13:19 +08:00
Maciej Kucia eb2ab2ba53 Use ostestr instead of nosetest
This change aligns packstack unit tests runner with other Open Stack projects

Change-Id: I588f12a163e64d90a51f35e98ea20ff691339baa
Signed-off-by: Maciej Kucia <maciej@kucia.net>
2016-10-30 21:09:43 +01:00
David Moreau-Simard b6445bcda5 Don't fail everything if one copy-logs command momentarily fails
Change-Id: I794bbf81a2080260f563caec3a778573a577212b
2016-04-25 14:05:57 +00:00
David Moreau-Simard 4f6a3d4756 Add /etc/hosts and /etc/pip.conf to files retrieved for diagnostic
Change-Id: I6b3c81c93f126e85e560a445c276425a562711f9
2016-04-12 16:04:36 +00:00
David Moreau-Simard 5b2648aec3 Fix gate: Tempest setup and repositories
- We no longer need to setup Tempest in a virtual environment
  since that is now handled by tox
- Do not explicitely require python-openstackclient since that
  is now handled by puppet-tempest since
  https://review.openstack.org/301162
- Setup packstack to consume Mitaka repositories and OPM until
  Newton is actively tested
- Make swap configuration consistent
- Add an empty other-requirements.txt file to prevent the
  openstack gate environment to pre-install dependencies for
  us; these are installed within run_tests.sh
- Enforce locale, seems necessary since the switch to the new
  centos7 images in the openstack-infra gate

Co-Authored-By: David Moreau Simard <dms@redhat.com>
Co-Authored-By: Javier Peña <jpena@redhat.com>
Change-Id: I80813ee9404a3cbc837d0d9810855fb13c0d904b
2016-04-12 10:34:44 -04:00
David Moreau Simard 49c9374d10 Small fixes for copy-logs.sh
- Run diag commands in bash -c instead of using tee
  To try and make things a bit quieter and fix command not found
  errors.
- Only recover /var/tmp/packstack/latest, /var/tmp/packstack will
  contain a copy of the puppet modules and these take a long time
  to recover, zip and upload.
- Only recover /etc/httpd/conf.d, we don't really need the rest
- Send testrepository.subunit to the root of /logs for
  openstack health monitoring
- MySQL logs are really in /var/log/mariadb, not /var/log/mysql
- MySQL config is really in /etc/my.cnf.d, not /etc/mysql
- Also recover dstat.log for tracing resource consumption
- Use -L switch on cp to copy symlink'd contents
  (i.e /var/tmp/packstack/latest)
- Use -f switch on gzip for idempotency if/when run twice so that
  it overwrites existing logs and compresses the new logs.

Change-Id: Ia79f7dac5a33d2749e73b9a0940e33b94f2430f9
2016-02-29 18:53:12 +00:00
Emilien Macchi f5c884883a Fix integration jobs
- Add missing sudos (and remove needless ones)
- Don't carry sudo environment, we can add it back if it becomes
  necessary
- Fix permission errors when exporting command output to files
- Increase ulimit, we'd run into too many open files in the gate
- Add some relevant logfiles to help troubleshoot issues
- Re-export path to ensure common file paths are included
- Don't assume "ip" is installed, it's provided by iproute
- Don't assume "restorecon" is installed, it's provided by
  policycoreutils
- Don't run packstack twice (--allinone will trigger a run
  even if -gen-answer-file is used, so switch to using
  --default-password instead)
- Use symlink for defaults.yaml instead of common.yaml
- Handled Hiera cleanup
- Use debug mode in scenarios
- Fix tempest subunit retrieval with sudo

Co-Authored-By: Martin Magr <mmagr@redhat.com>
Co-Authored-By: David Moreau Simard <dms@redhat.com>
Change-Id: I7a363308cd9df981c0a1680171b9b2f2b95dd29e
2016-02-26 09:24:11 -05:00
David Moreau Simard e3d5022c73 Add tooling for run_tests to be able to recover service logs
This is a simplified (removed support for debian-like distros)
re-implementation of what was sent for review upstream in
https://review.openstack.org/#/c/270004/

We are moving this to be self contained within packstack as we
are not able to agree on an approach to be shared commonly with
other projects for the time being and this is required to move
forward with packstack gate job integration.

run_tests.sh will, by default, recover logs to be stored in
$WORKSPACE/logs (when in a jenkins job) or in /tmp/logs.

Change-Id: Ieab783e4b41324809c9f76285596f550994be2bf
2016-01-28 16:08:50 +00:00
Lukas Bezdicka 1c0c36bf40 Refactor SSL setup to use CA to sign certificates
Users can now use Packstack generated CA or provide Subordinate CA to packstack
to sign certificates used by OpenStack.

Resolves: rhbz#1163866

Change-Id: Idd89dbb7f197a194fd87576be6d95a75d059231e
2015-05-27 17:19:27 +02:00
Lukas Bezdicka aa45027939 [Packstack] enchange ipv6 support
We should support ipv6 or ipv4 only installation and we should
set firewall according to ip version.

Resolves-Bug: rhbz#1185652
Change-Id: I7bacf81373a6e0567e0c3fdebacf47cd5c683ad2
2015-04-15 09:17:48 +02:00
Javier Pena f448af7283 Merge serverprep and prescript plugins
After commit 012a812609 was merged,
some configurations could be broken, such as those requesting EPEL
repos to be configured by Packstack, as Puppet was installed before
the repo was enabled. The best way to fix this is by merging the
serverprep and prescript plugins into one.

Together with the required adjustments for the merge, a new
auxiliary function is created to detect the OS name and release, to
allow some functions previously in the serverprep plugin to run
before the host facts are collected.

This patch is rather large, so extensive testing should be applied
before merging. You have been warned :).

Change-Id: I0b89349827c403070b6daddbbfd0dab535a95c05
2015-04-08 16:40:13 +02:00
Derek Higgins 607acaf857 Creating a single unit and pep8 test
Starting with one of each to make sure the unit and pep8 gate tests work

Change-Id: Ia4e5595df8937c8612143e19e21e17cfdc18a4b1
2013-01-12 23:06:40 +00:00