Commit Graph

43 Commits

Author SHA1 Message Date
Andreas Jaeger 065e75ee2f Update include
Ansible is deprecating include, replace it with
include_task/import_playbook.

Change-Id: If9e9a5ff7918ae88b39d4fa225986bd3149301f4
2020-05-26 15:59:19 +02:00
Monty Taylor 9a49d142b2 Use a fake zuul_return and an .ansible-lint file
ansible-lint now supports settings in a file, including exclude_paths.
This lets us simplfy the ansible-lint command. Also, stop installing
zuul and just use a fake zuul_return to fake out ansible-lint.

Change-Id: I40291d4e861fe9e6e3341b075ab7d6c9f5315275
2020-03-12 07:29:39 +00:00
Monty Taylor 7b10451785 Remove mirror-info role and tests
This is in opendev/base-jobs, so we don't need a second copy over
here.

Change-Id: I55640615b2c363be38ce7f76ed1795b80854282f
2020-03-11 15:13:14 -05:00
James E. Blair 0c54a6f4e2 Remove base role integration testing
These jobs have moved to the zuul-jobs repo.

Change-Id: I6a5759e0fbc8f8a6bb37045ca5254412882972ea
2019-07-08 10:48:16 -07:00
James E. Blair 466436cccc Remove upload-git-mirror test job
This has been moved to the zuul-jobs repo.

Depends-On: https://review.opendev.org/668248
Change-Id: Ie6dd47255995387d143eaa2efe8b1592094415d9
2019-06-28 13:39:29 -07:00
Andreas Jaeger e4769d556b OpenDev changes
Use files.openstack.org instead of git.openstack.org for traceroute
test.

Update use-cached-repos tests to use new orgs.

Update fetch-zuul-cloner to use opendev.org as path, fix a typo.
Continue to use the legacy names since fetch-zuul-cloner is a legacy
tool.

Change-Id: Ia57bda9e6a36e3c98a28382c19703bc01fa8e8d9
2019-04-20 19:31:47 +02:00
OpenDev Sysadmins cae8e2bafd OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:29:57 +00:00
David Moreau Simard 6c843d976f
Pass ssh host key to upload-git-mirror for integration tests
We're adding a git_mirror_credentials.host_key variable and we're
renaming git_mirror_credentials.key to git_mirror_credentials.ssh_key.

We need the integration tests to support both formats while we undergo
these changes in order to keep the tests green.

Change-Id: Ia6e0f5b3972ecffae517eaec0e3531b8fb376bad
2019-04-01 16:24:53 -04:00
Zuul 211e5205f1 Merge "Replace openstack.org git:// URLs with https://" 2019-03-29 21:30:54 +00:00
David Moreau Simard 2b0214c010 Add job and integration tests for the upload-git-mirror role
Change-Id: I2d04f0fd99f093b1ac74eacf6031e54eee612ea2
2019-03-28 18:16:19 +00:00
Ian Wienand fa933ed8c5 Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: Ica1893f47f01e57674f5d3dbac54ef6bcb8c206f
2019-03-24 20:35:12 +00:00
Clark Boylan 10405004a5 Remove configure-unbound role
This role now lives in opendev/base-jobs so to reduce confusion we clean
it out of ozj.

Depends-On: https://review.openstack.org/635900
Change-Id: I27971ad1bd3ef93ea04aaede76e51afe9d770b5b
2019-02-08 09:49:18 -08:00
Monty Taylor c5183d416d
Use is instead of | for tests
Newer ansible wants us to use is. Also, it reads more nicer.

Change-Id: I368369d146a422abbf94265036a7d280e47eedc0
2019-01-07 14:10:32 +00:00
Monty Taylor d7eb4df0b0
Add fetch-output and ensure-output-dirs tests
We've added two new base-job roles, let's also add integration tests.

Depends-On: https://review.openstack.org/628734
Change-Id: I8b9b10983b2bc7bba37a19d2eb0d4107241d168c
2019-01-06 17:10:01 +00:00
Ian Wienand 3cdfbc6f67 Move prepare-zanata-client to o-z-j
This role is currently in project-config where it is untested.  Move
it to o-z-j, and rename to prepare-zanata-client for consistency with
other names.  Add integration test.  We will migrate the jobs to the
new name when this merges.

Change-Id: I26ee7057b9ad70507959286acc17d9c7bc1471db
2018-10-03 14:42:17 +02:00
Matthew Thode 3b03acabf4
add Gentoo jobs and vars and also fix install test
Based them on fedora-latest jobs

Depends-On: https://review.openstack.org/604677
Depends-On: https://review.openstack.org/604688
Change-Id: I45622ac18685b809a091edba2df96fc8040138a8
2018-09-25 20:57:29 -05:00
Clark Boylan ac90eed05d Test validate-host role
Add validate-host to our zuul role integration job. This will allow us
to test changes to the validate host role and be more confident in
making those changes.

Depends-On: https://review.openstack.org/563790
Change-Id: If2db235d143e3edace75db724928c9e482720b93
2018-04-23 16:03:32 -07:00
Zuul 7beda537c0 Merge "Don't assume nodepool.[private|public]_ipv4" 2018-03-27 21:18:56 +00:00
Ian Wienand da1b0f9b67 Don't assume nodepool.[private|public]_ipv4
Several places assume nodepool.[private|public]_ipv4 are set, which
may not be true in ipv6 environments like limestone.  Rework several
of the setup and checks to not assume they are there.

Depends-On: https://review.openstack.org/556784
Change-Id: I8cbe78bc127652229917d9e7f531a95f4b6fb0f7
2018-03-27 20:22:44 +11:00
Jens Harbott b00bd6afdf Set trusted flag for configure-mirrors test
As our mirrors aren't signed, we need to set this flag in order for
tests to pass when running on Ubuntu Bionic.

Change-Id: I2cbbda65e69f1f055d62e06286add215f9182102
2018-03-27 08:01:05 +00:00
David Moreau Simard 4d7a824070
Resolve Ansible variable precedence issue with include_vars
This patch effectively works around an issue we're seeing with
Ansible's var precedence with the "include -- with_first_found"
pattern.

TL;DR of what is happening is that a role, configure-unbound, has a
"vars" directory which is meant to be used by an "include_vars --
with_first_found" task.

However, since we have a "vars" directory at the playbook level, this
directory has precedence over the one in the role. This makes it so
the var files from the playbook directory are included instead of the
one in the role.

We wanted to address that by using {{ role_path }} within roles, but
it turns out that Zuul's protection mechanisms is actually
interfering [1]. Work around this for the time being.

Since this is all not very straightforward, it ought to be documented
properly somewhere -- this is in the README.rst file for the time
being. Let's figure out a better place later.

[1]: http://eavesdrop.openstack.org/irclogs/%23zuul/%23zuul.2018-01-15.log.html#t2018-01-15T22:44:13

Change-Id: Ia79a793200fcb89161783ff641b85106936084b5
2018-03-02 11:18:22 -05:00
David Moreau Simard f795128f21 Add support for configuring TTLs in configure-unbound
Given the volume and ephemeral nature of the nodes we are running jobs
on, we're interested in raising the minimum TTL to ensure we're not
needlessly querying domains all the time.

Some domains such as github.com or fedoraproject.org have low TTLs and
we suspect there is a correlation between their low TTLs and the fact
that we're seeing increased DNS lookup rates for these domains.

Change-Id: I6d9656cb07a694fc2f54f256a63af814c034ffb8
2017-11-28 17:29:59 +00:00
David Moreau Simard d3a30a01e1
General improvements to configure-unbound role
- Improve README
- Improve integration test coverage
- Prefix variable names with "unbound_" to avoid clashes between
  different roles
- Unbound will very likely be installed but don't assume it is.
  Add an assertion to fail early if it isn't.

Change-Id: Ib8ca105938afdc0ccb1f524df3cae916c845efb8
2017-11-28 11:52:30 -05:00
David Moreau-Simard 819b471612
Add integration test coverage for iptables persistence
If we restart iptables or the instance, we want the firewall rules
to persist.

Change-Id: Ic32614790eea04079b02b0e4cc8642f7c46cd415
Depends-On: I9d90f55323a33d6a0f0dda1f7ab25d10984fa6cb
2017-10-31 17:51:12 -04:00
David Moreau-Simard 61239d1ef7
Test that the project being tested was prepared, not necessarily o-z-j
When this job is ran against other repositories such as project-config
or zuul-jobs, the project being prepared won't be o-z-j.

Change-Id: I8487680ad573b1127e5d2e73fafbd0442e003c62
2017-10-22 23:06:11 -04:00
David Moreau-Simard 264a83e02f
Improve test coverage of the fetch-zuul-cloner role and the shim
This tests that we are indeed able to use the zuul cloner shim
and that it works as expected with and without required projects.

Change-Id: I537ce7ff417558edb3260acb6424a4a2b54046e4
2017-10-19 17:12:40 -04:00
David Moreau-Simard a80691a49c
Add integration tests for use-cached-repos
Change-Id: I7da4db4ddd058b507754178177344b99363025ac
2017-10-19 17:12:40 -04:00
David Moreau-Simard 36207c4f8d
Add integration tests for emit-job-header and set-zuul-log-path-fact
These two roles are included by default in base jobs, we don't want
to merge a regression that would break every job. Let's test them.

Change-Id: I8d014464b3ed580d4a0fc6dbdc9a42601ff107e5
2017-10-18 15:15:53 -04:00
David Moreau-Simard 79e2859162
Add integration tests for multi-node-bridge role
Change-Id: I1cf7d5de19b3426a9577b4ecbc3538813a16dfc7
2017-10-15 15:45:35 -04:00
Andreas Jaeger beb0737569 Limit multinode-integration, update base-integration
Limit when to run multinode integration.

Update base-integration for current tests.

Add notes to update the files section when updating.

Change-Id: I4e055511cb10113b93a0a18bab6d72aacf782e11
2017-10-15 19:50:21 +02:00
Zuul 4f7185959a Merge "Add integration tests for fetch-zuul-cloner" 2017-10-15 16:42:53 +00:00
Zuul ca16523952 Merge "Add integration tests for multi-node-firewall" 2017-10-15 12:29:17 +00:00
David Moreau-Simard 56eb8fc485
Add integration tests for fetch-zuul-cloner
This role is included by default in base jobs. We don't want to
merge a regression that would break every job. Let's test it.

Change-Id: Icb37cb43c40358719157ef7278b5e4df67574edb
2017-10-13 16:01:41 -04:00
David Moreau-Simard abf7edf91d
Add integration tests for multi-node-firewall
Change-Id: I60243a3a6016483b56f49e80c6744915194e65c8
2017-10-11 11:45:15 -04:00
Ian Wienand 401520e274 Add unbound role
As mentioned in the README, this adds the dynamic configuration for
unbound on hosts. If there is a ipv6 route, it will set forwarding to
ipv6 servers, otherwise use ipv4. This is ported from the
configure_mirror.sh script.

We add a basic test to integration tests

Change-Id: I70b41e45f3d53b191742533c2f3b6c0b6e6c2339
2017-10-11 10:20:16 +11:00
David Moreau-Simard 885cbae414
Integration tests: run mirror-info before configure-mirrors
We're running mirror-info before configure-mirrors in the base job.
Let's keep the role execution order the same so we don't run into
errors because of that.

Change-Id: Ia86c497f9e6788461fbdab8af1247f770dc2c302
2017-10-10 09:19:55 -04:00
David Moreau-Simard 0351a7af27
Add integration tests for multi-node-hosts-file
Change-Id: I633889011d25f120a936a145bdf6e12c3b89133f
2017-09-26 11:52:10 -04:00
David Moreau-Simard c588aebca3
Add multinode integration jobs and integration tests for known_hosts
This adds the required framework to test the 'multinode' job and adds
a first integration tested role: multi-node-known-hosts.
The groups 'switch' and 'peers' are bound to be used when integration
testing the 'multi-node-bridge' role.

Change-Id: Ia84189ce3e1b273ca8509d2a9796970750191977
Depends-On: Ia7480dab0f357b5710d1962a40499381837942b3
2017-09-26 11:52:06 -04:00
Ian Wienand 0c1ecb990f Add role to make /etc/ci/mirror_info.sh
The mirror info script is sourced by various jobs so needs to be
around for broad compatability.  Since it's full of openstack only
mirrors, this seems like the place for it.

Change-Id: I66164920642a6015a6524fdc3105e4099d26deff
2017-09-09 03:24:44 +00:00
David Moreau-Simard 5fbcc7e0e2 Move openstack-specific jobs to openstack-zuul-jobs
We're in the process of adding jobs to test our base job on different
distributions and ensure there's no regressions.
These are openstack-specific so let's move them from zuul-jobs.

Change-Id: Ic04c48d7a0e15459632b91bce81e777d12622222
Depends-On: Ie29ee24b631f659f3330f5c631e2850f6b8cb463
2017-09-07 15:24:00 -04:00
Paul Belanger 0d5c11029a Setup ANSIBLE_ROLES_PATH in tox.ini
It is possible we are going to depend on roles in other repos (like
the next patch). Move this to using an environmental variable to make
it easier to depend on external roles.

Change-Id: Ia90ac5674188d38a6a749c92de957430d5a5403c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-08-07 16:15:11 -04:00
Paul Belanger ea35d7ffc9
Include ansible-playbook syntax-check for tox pep8
Syntax check our playbooks / roles when we run pep8. This way we can
quickly tests if our playbooks are valid.

Change-Id: I2f4e3f617922c8578adb53e2c4a418488fcf230b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-07-17 13:18:19 -04:00
Paul Belanger c0c9653ab5
Ensure we load roles for linting
Did didn't have ansible-lint setup properly, as a results our roles
weren't actually linted properly.

Switch run-docs to command task, since we are not using any shell
variables.

Ignore ANSIBLE0012 for now.

Change-Id: Id184f7eb5dd67117e7dde9c8eb38a3a8af9dd892
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-07-17 13:18:17 -04:00