Commit Graph

383 Commits

Author SHA1 Message Date
Paul Belanger ac9c7e689f Stop running fedora testing
Change-Id: Ia87f360ece639e29c6f09e6f1a869604c8361af0
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2021-06-24 14:53:28 -04:00
Paul Belanger 2c45324123 Setup proper zuul_work_dir
This avoids other projects running our jobs from installing their
bindep.txt files.

Change-Id: Iddc755f16f51853d953e74df5d8848f24e3d9f07
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2021-06-24 14:19:41 -04:00
Paul Belanger ed63ea9351 Make windmill-src-ubuntu-bionic voting
Depends-On: https://review.opendev.org/c/zuul/nodepool/+/797740
Change-Id: If3cadb107ac7d2f9196322f077e60f1d255fb36e
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2021-06-23 15:10:06 -04:00
Paul Belanger 720b0b1ca9 Uncap zuul_pip_version
All of our fixes have now landed.

Depends-On: https://review.opendev.org/c/windmill/windmill-config/+/797656/
Depends-On: https://review.opendev.org/c/windmill/windmill-config/+/797663
Change-Id: I7c83244fd32adb5ae25dd0e1feea2da4aa8b0a92
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2021-06-23 14:13:25 -04:00
Paul Belanger 354747ab5f Hack in database support
This really needs to be a role, but don't have time to add it. For now,
just set it up manually.

Change-Id: If9a3378af1e5d94c068d27483f405aee30c8c691
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2021-06-23 11:31:43 -04:00
Paul Belanger 1ee05e252a Uncap nodepool_pip_version
Now that zookeeper is configured for TLS, we can uncap nodepool to use
the latest version.

Change-Id: I96ddf1349dabb42d0f4e28951a91ff4d34c64d6a
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2021-06-23 00:03:53 -04:00
Paul Belanger f3e4ecf406 Collect zookeeper logs
Change-Id: I3d8805a5ae6ef19fb3e56fe33a42e3ca8006086c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2021-06-10 19:22:53 -04:00
Paul Belanger a23d36067c Pin nodepool / zuul until zookeeper TLS support works
Also make windmill-ubuntu-bionic voting again.

Depends-On: https://review.opendev.org/c/windmill/windmill-config/+/795898
Change-Id: I39b24cdd0d1ee2801e2a7b1e87be17ab65a15419
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2021-06-10 17:25:42 -04:00
Paul Belanger 78f6c31ded Make windmill-jobs-bionic non-voting
Disable our testing while we work to make green again.

Change-Id: I70e90094f3c2313c349038c40cef04cac6b8afc2
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2021-06-10 17:18:54 -04:00
Paul Belanger d38f969429 Add zuul-registry support
Depends-On: https://review.opendev.org/763101
Change-Id: I67c08418df38d31a01c2ecf114aa52daf8af185c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2020-11-21 14:41:40 -05:00
Paul Belanger d21c7c01a6 Fix CI issues
This is a catch all to get CI working again. In some cases, like
ansible-lint we will just ignore the warnings for now, and loop back to
clean them up.

Change-Id: I3e09f8c2b470062634d981f2667b913820c58f7f
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2020-11-21 14:41:39 -05:00
Gonéri Le Bouder 1c14b66462
add AWS support
Depends on ansible-role-boto3 to install and configure the lib.

Depends-On: Id2cd819def3e83f92fcd8126a74aa19690dcf4c8

Change-Id: If66d975dedac16ba46522ab8183a7d6cff35d3d3
2020-05-04 12:24:21 -04:00
Gonéri Le Bouder 57cd9d06cc use python3-dnf on Fedora
`python2-dnf` does not exist anymore.

Change-Id: I41aa278e81f34e8331fdfdd9ec811ef1670aefb7
2020-04-29 19:08:19 +00:00
Paul Belanger bf61be4949 Enable windmill jobs for bionic
These are passing now.

Depends-On: https://review.opendev.org/702940
Depends-On: https://review.opendev.org/724382
Change-Id: I0d88e287c01d2c15209b6352745a18075771fa12
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2020-04-29 13:19:05 -04:00
Paul Belanger bfa252b9f0 Make windmill jobs non-voting
Unwedge jobs until we can stablize CI again.

Uncap sphinx to fix doc builds.

Change-Id: I6995bd815e137dd6b90d013d8b0d5e4d321487c1
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2020-04-29 12:38:46 -04:00
Donny Davis c692cb6d65 add ansible-roles-ansible to requirements.txt
Change-Id: Ib57996d5cb5ebe4604c0a668df90d34409ded379
2019-08-21 19:15:01 -04:00
Paul Belanger a67474e7e1 Switch to windmill for roles
Continue with the change from openstack to opendev for hosting.

Change-Id: I6d3ead6a49c3460484b18f672ead0022e1dc2858
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-04-20 15:55:18 -04:00
Paul Belanger b530bc4d60 Fix fallout from opendev migration
Clean up places where we expected git.o.o.

Depends-On: https://review.opendev.org/654021
Change-Id: Ic0c8f116c083ed6d4f930f787bef8b0299194e46
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-04-20 13:14:38 -04:00
OpenDev Sysadmins 0494180cf8 OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:52:08 +00:00
Paul Belanger bdc5925121 Add additional checks for nginx
Validate nginx service is running and also collect some logs.

Change-Id: I3d3daf0344d978cf72ea171e84e3f1439725d990
Depends-On: https://review.openstack.org/648850
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-31 15:41:05 -04:00
Paul Belanger 1718c834c5 Recursive delete nodepool elements
We seem to be leaking old files when removed from git.

Change-Id: Ifb380d22b8300cd40f8fbcf92fcc68256d158d69
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-28 15:50:43 -04:00
Paul Belanger c548ce678b Just disable hostkey checking everywhere
For testing, don't both with hostkey checking. We know ansible does the
right thing is proper ssh host keys are installed.

Change-Id: Ic6dfa63247741f904516897e9d27a2b57a4c2d7e
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-28 11:04:55 -04:00
Paul Belanger 0829dcf7bb Multi ansible support for zuul-executor
Change-Id: Ib9e07f2f7c8bb34ba2a5d64680cf4c4daa1b0ce7
Depends-On: https://review.openstack.org/646020
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-23 19:06:16 -04:00
Paul Belanger 1cbd015aff Manually pass secure.conf to nodepool command
This is for when we move our zookeeper information into secure.conf.

Change-Id: Ic68661933edd0738118c58c6a6c38e1c4afb0a04
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-22 22:13:11 -04:00
Paul Belanger 017053a93a Refactor our testing playbooks
As we try to run a windmill in zuul, it doesn't make sense to also run
our testing roles.  For now, we can move these into our prove playbook,
however long term I think we want to move to testinfra. Then people can
decide to also run testinfra against their production control plane.

Change-Id: I783e2e3b5f6fba224d761446c66aa9a58ecec9ca
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-20 16:04:58 -04:00
Paul Belanger 313df89a27 Fix gear virtualenv testing
Change-Id: I22fb917e5655d06e129b2cfc8d366109dc884529
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-20 15:34:05 -04:00
Paul Belanger 99e919a44c Fix assertion tests for nodepool
We didn't look in the right directory, if nodepool was installed into
something other then /opt/venv/nodepool.

Change-Id: Id06e2a807e4a798c9fefd552882e66ba74e242db
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-18 17:07:07 -04:00
Paul Belanger 401d3f6bbd Remove hardcoded statsd01 host
Since the statsd client only support a single server, we have to use the
first server in the statsd group.

Change-Id: Iebc7a89e7ce7fcb8d30208dd55a7013007cadf93
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-18 15:08:34 -04:00
Paul Belanger fb4ee9320e Remove statsd configuration
This has moved into windmill-config repo.

Change-Id: Ica10636cf6f5cf20c2a620b2e13a22222e03b9cc
Depends-On: https://review.openstack.org/643948
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-18 10:03:04 -04:00
Paul Belanger 0399fce301 Disable host_key_checking for testing
This is starting to become an issue, and since we are moving the
generation of ~/.ssh/known_hosts into windmill-ops, harder to deal with
SSH known hosts.  A future patch may dynamically generate our inventory
file, especially if we move to more multinode testing.

Change-Id: Id94228b20379decc4145701d0cb8d57791d1190c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-14 15:32:48 -04:00
Paul Belanger e467267dd2 Move files into windmill-config
This breaks out all configuration / inventory files into the
windmill-config repo.

Change-Id: I54233307afbe2b76e4456ab1d55073c79da718f5
Depends-On: https://review.openstack.org/640857
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-04 23:35:05 -05:00
Paul Belanger 609e460994 Create ansible virtualenv on bastion
Change-Id: I7b925ae283d25d42b2079d9ee5789b9fef97aab6
Depends-On: https://review.openstack.org/638208
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-04 13:57:22 -05:00
Paul Belanger 6efea7a8c1 Use multiple run playbooks for windmill jobs
This breaks out the specific things we need to do for testing, into
their own playbook runs.

Change-Id: I50964b393bc4c5977d7f59e9c4bac48c1ea405ac
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-04 00:36:11 -05:00
Paul Belanger 88eacbed7a Add ansible.cfg to inventory folder
We should provide a default ansible.cfg file that users can either use
or modify.

Change-Id: Id6258e7a5250428de85693184e51df41094f170c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-03-01 15:03:45 -05:00
Paul Belanger a09d86b5d0 Properly setup windmill-ops deployment
Seems we didn't propelry look at the logs of our jobs, otherwise we
would have seem this was completly missing.

Change-Id: Ied5116ebbcaf6db2d309cce0d7009b2c88521149
Depends-On: https://review.openstack.org/639907
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-02-27 23:05:27 -05:00
Paul Belanger 16fcc5e9a3 Install roles into ~/.ansible/roles
This allows for us to managed multiple project roles in a single
location.

Change-Id: I232931d8f490d3c2bf0b92ac9320218cc266fd42
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-02-27 21:29:44 -05:00
Zuul 677bf183f8 Merge "Bootstrap nodes using windmill-ops" 2019-02-28 00:33:15 +00:00
Paul Belanger 2dbf56a14f Parent to unittests for bindep installation
Change-Id: I9d20df46fa18d5fd822bde3145d84485d2c6c09c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-02-27 16:37:03 -05:00
Zuul a0fd5a0d2a Merge "Move sudoers include role into nodepool-builder only" 2019-02-27 16:25:32 +00:00
Paul Belanger 7c173d9ea5 Move playbooks/bastion.yaml into tests folder
This really isn't needed for production deployments, it is more to make
sure our testing in the gate is happy.

Change-Id: Ic8e367892fbb54a57d9864e9cdb8579783a5d83f
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-02-27 09:01:08 -05:00
Paul Belanger c77a8dee8f Bootstrap nodes using windmill-ops
Change-Id: I1078056dcf30529da8da86217417dae84428ee3b
Depends-On: https://review.openstack.org/639109
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-02-26 21:38:56 -05:00
Paul Belanger 267dc5ac5b Move sudoers include role into nodepool-builder only
Currently, we only need to give nodepool-builder sudoers access, so move
the code into that play only.

Change-Id: I0a39c8ec476e89c11bc758f000b89267d37183e3
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-02-26 16:36:58 -05:00
Paul Belanger 36ddb0a7ce Move back to bastion group
This allows for use to run multiple bastion servers, if wanted.

Change-Id: I715d52effd24b1cec110791735547ff6b7d8e2d6
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-02-22 22:51:26 -05:00
Paul Belanger a97e594eae Revert "Set fedora jobs non-voting"
This reverts commit a53172c74e.

Fedora-29 images are working again.

Change-Id: I052083491d5c0a825d9e5ee876b2bee73930cb1b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-02-05 14:16:59 -05:00
Paul Belanger a53172c74e Set fedora jobs non-voting
It seems fedora-29 jobs and network manager are not stable. As such, we
cannot gate on fedora-29 in their broken state.

Change-Id: I4c2295a9cde8d69189803af27f191904b5b78042
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-01-29 10:45:32 -05:00
Paul Belanger 7f5b2ca3f5 Use zuul[zuul_executor] for zuul_pip_name for executor
This entry point includes ARA and openstacksdk dependencies, which are
helpful for base jobs.

Change-Id: Icb7287dfc68c8599d35ac4991c9729c0da963395
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-01-22 11:45:38 -05:00
Paul Belanger 0fa7bd5de3 Update nodepool test roles to use nodepool_pip_virtualenv
This is the same as we did for zuul tests.

Change-Id: Ib474d2c2eb771032de4f1cf3ea39ee6b8545e2ce
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-01-21 00:35:48 -05:00
Paul Belanger 93f3880da8 Only validate nodepool system services if state is properly set
Like we did with zuul, we also need to do for nodepool.

Change-Id: Id065a1e56484973e9dd9e7cee1026639abbd7c68
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-01-20 22:24:39 -05:00
Paul Belanger f0016d1505 Invert nodepool logic to manage services
This now matches how we deal with zuul services.

Change-Id: I6cbd6df46470c8a6c754132cd2af1939c8194de8
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-01-20 22:04:16 -05:00
Paul Belanger 25a5b1d00d Update zuul test roles to use zuul_pip_virtualenv
We cannot expect users to use /opt/venv/zuul by default, instead use
zuul_pip_virtualenv setting.

Change-Id: I7ab71ed89248796936ae129c6da92eced9730108
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-01-20 18:45:41 -05:00