Commit Graph

308 Commits

Author SHA1 Message Date
Bjoern Teipel 12e85362a6 Fix missing cinder volume backend for ceph
- Adding cinder-volume on infra-hosts once ceph is enabled
- Fix missing osa_no_containers default value of false

Change-Id: Id7898c9dff84cbb981c9c0c916a65abcc5256dfd
2023-08-22 16:37:19 -05:00
Jonathan Rosser 9b1ea92f88 Remove "warn" parameter from command module
This is removed in ansible 2.14.

Change-Id: Ic228ba62d33e3056be71a1d2285b068fc82f32d9
2023-01-10 08:40:13 +00:00
James Denton effd1542c9 Correct OVNL3RouterPlugin path
This patch updates the OVNL3RouterPlugin path to
match previously updated documentation.

Change-Id: I7873a2c2575a7a1184d9b2c5534b7135eee3cc0d
2022-09-08 19:00:34 -05:00
James Denton ff7cbf5548 Update MNAIO to use Ansible Collections
This patch updates various playbooks within the MNAIO to use ansible
collections, which is required for the latest Ansible versions.

Change-Id: Ia7694e6b182dc8898b56730537cc99759a722b20
2022-07-23 21:01:25 +00:00
James Denton ab91446804 Update MNAIO for Focal
This patch removes legacy support for 14.04/16.04/18.04
on the deploy node and moves the default deploy to
Xena on 20.04 LTS. Root disk size has been bumped to support
upgrades (8 GB -> 12 GB).

Change-Id: I81a13464b9daa90090cb380e2b0d89e5eb8fe89a
2022-02-16 09:46:59 -06:00
Daniel Pawlik ea16ee62de Change get-pip urls
The path for get-pip.py script in versions 3.2 and 3.4 have been changed
with this commit [1].

[1] 2360f025eb

Change-Id: Iedef41b53c4e5fa28dac8206c5ba39dab5033815
2021-03-08 15:14:05 +01:00
Zuul 97c1326693 Merge "Implements support for OVS+DVR in an MNAIO" 2020-06-17 14:38:15 +00:00
Bjoern Teipel dd531b8cb2 Set MNAIO to Ubuntu 18.04
All OSA releases since Stein require Ubuntu 18.4, hence
the MNAIO should select it by default

Change-Id: Ide20295f3acf22adade5dc6668b81b52c399259b
2020-06-12 22:30:53 -05:00
James Denton 23ec2726ab Implements support for OVS+DVR in an MNAIO
This patch implements support for deploying an MNAIO with
Open vSwitch and DVR.

Change-Id: I0fb03e2eb0ead198c64019eb0cdd06451e1e7c94
Implements: openvswitch+dvr
2020-06-04 13:50:39 +00:00
James Denton aa25221298 Update MNAIO to use python3
This patch updates the bootstrap script for the MNAIO to use python3
rather than python2.7. This only impacts the deploy node and not
deployed VMs.

Change-Id: I41b5d746a8f31018e15bd282b7a358d50610eabb
2019-11-07 16:35:50 +00:00
Antony Messerli 3191e3b93d Use raw url for pip deps
Use the raw url to fix pip install and correct error
on build parameter.

Change-Id: I927bb7a720a67cc8ce9074f3d7d4540ee1699c67
2019-07-10 15:24:26 -05:00
Antony Messerli ab4919f656 Correct opendev.org urls
Previous commit had some of the urls incorrect

Change-Id: Ia36831ebe55014a0ca58f448f934382bd2b27e68
2019-07-09 16:02:12 -05:00
melissaml 87cbdd6649 Replace git.openstack.org URLs with opendev.org URLs
Change-Id: I790c1876a3e44da8623c74632332f0e453dce1f6
2019-07-09 16:36:22 +00:00
Zuul 87e6ddf5bf Merge "Adds vars file for centos" 2019-02-27 10:44:22 +00:00
Antony Messerli 4d904e2b7c Use updated Ubuntu installer kernels on MNAIO
Appears we ran into this bug on 16.04:

https://bugs.launchpad.net/ubuntu/+source/debian-installer/+bug/1816876

and the fix is in xenial-updates.  Switching all the ubuntu installer
kernels to the updated ones so that we can make sure we're using
latest and greatest.

Change-Id: I68cccbb142c8b4c657a60929ad21e8164d07a1ef
2019-02-22 13:58:26 -06:00
Antony Messerli 3e508b04f5 Adds vars file for centos
Deploying CentOS image was failing attempting to gather
vars.  This adds a needed variable file.

Change-Id: I136441f0711fe9b07dda6f1e9e49947e21396f30
2019-02-20 17:37:58 -06:00
James Denton a2c7616cb3 Correct formatting in README.rst
This patch corrects some formatting issues causing the README to
be rendered incorrectly.

Change-Id: Ia1f532fcf43443ebe6249af870ed820c6d575b52
2019-02-14 22:06:56 -05:00
Zuul 9bcd084542 Merge "Add ability to deploy Designate (DNSaaS)" 2019-02-13 03:01:29 +00:00
Zuul 079b179001 Merge "Add support for OVN in MNAIO deploy" 2019-02-03 17:34:58 +00:00
Jacob Wagner 98d66da191 Add ability to deploy Designate (DNSaaS)
This commit adds the ability for users to enable Designate (DNSaaS)
in a MNAIO build. This service is disabled by default.

Change-Id: I36e10922b6fe8e5cba3cc929e2b91b59507c210d
2019-02-01 13:43:08 -06:00
James Denton e6f12e2069 Add support for OVN in MNAIO deploy
This patch adds support for deploying the ML2/Open Virtual Network (OVN)
plugin for Neutron to an MNAIO deployment. A new var,
osa_enable_networking_ovn, can be set to lay down the appropriate bits.

Change-Id: Ib5bd4e0c20be62ddbf0bff13c91d1918907bf230
2019-01-28 02:14:39 +00:00
James Denton 08edc0c696 Add mnaio_data_disk_suffix var to support NVMe partition naming
NVMe partitions generally show a `p` before the partition number,
causing the existing data disk partitioning script to fail. The
new var support changing the suffix to support alternative naming
schemes. The default remains '1' for backwards compatibility.

Change-Id: I7c0039ee13ba301c152424fc0b327195ec6a4367
2019-01-15 13:09:04 +00:00
Zuul 8ce606a64d Merge "1.modify the http link to https links 2.modify the misspelling world" 2018-12-19 16:16:30 +00:00
Matthew Thode d07df2c513
Chage cpu model to allow for nested virt to work
vmx flag was not passed in to the guest, so test VMs failed to boot on
compute2.  With host-passthrough the cpu flags are unfiltered.

Change-Id: I1a4607ba5bc96c92512a2f4aa43df51f7eef6b27
2018-12-12 12:22:36 -06:00
Jesse Pretorius bd82c6a3e5 MNAIO: Recovery the galera cluster with no gvwstate.dat file
On occasion, a set of saved images may not have a gvwstate.dat file.
Given that the MNAIO tooling is for test purposes only, we can take
the risk of just making one up in order to ensure that the cluster
starts on boot. DO NOT DO THIS IN PRODUCTION!

Change-Id: I1b055ef0d02d77afe03d1a90baa2e6890e986c32
2018-12-12 12:51:45 +00:00
Jesse Pretorius 97f20c5e9d MNAIO: If there is no secondary data disk, use the root disk
In order to allow testing within OpenStack-CI, we need to cater
for the ability to run the tooling without a secondary data disk.

This patch changes the tooling to try the detection, and if there
is no secondary disk it will just use the root disk for /data/images.

Change-Id: I56d76e68b6914b3e12948b022e0e702557684c50
2018-11-28 13:41:02 +00:00
Jesse Pretorius daf758775c MNAIO: Fix warning for guestfish workaround task
This patch resolves the warning about using jinja braces
the conditional for the guestfish workaround task. While
doing so, the task is made idempotent and we also ensure
that the task that follows exits immediately on any errors.

Change-Id: I7ec254a96312e07229b0a5c799d4a98b5d9c8957
2018-11-28 13:34:35 +00:00
Jacob Wagner 6b36fd8825 MNAIO: Add ability to deploy Ceph
This commit enables overriding the default storage options of
cinder/swift to a Ceph backed storage for the multinode all in one
deployments.

We also correct the README and build.sh script to show/use the
current defaults correctly for VM_DISK_SIZE and INFRA_VM_SERVER_RAM.

Change-Id: I9e1f1b09d1bcf224f4afa765c585baf28e6cafa8
2018-11-27 15:51:46 +00:00
MaoyangLiu a9fd3214aa 1.modify the http link to https links
2.modify the misspelling world

Change-Id: Icd92e680cd5f313c8294acd59199948872369503
2018-11-25 04:17:18 +00:00
Dave Wilde 58c7890bfc MNAIO: flat networking fixes
With the switch to systemd-networkd the veth pairs for flat networking
and lbaas aren't created.  This creates veth pairs if the server has the
appropriate server_networks defined.

* Create the veth network files

With this simple Match directive networkd will bring the interface up.

Change-Id: I0ae4375be128594a861c18aa33a98378859dd9d3
2018-11-01 07:56:21 -05:00
Jesse Pretorius 05e235859d MNAIO: Implement branch var for pinning Ansible & Plugins
Due to [1] the task 'Create data cinder-volumes group' is currently
failing when run on a restored image due to the idempotence failure.

In this patch we enable pinning the requirements file and plugins
repo to a different OSA branch, and set it to stable/rocky which is
currently pinned to Ansible 2.5.10 and does not exhibit this issue.

[1] https://github.com/ansible/ansible/issues/47301

Change-Id: Id0f98f3ea0f53173dae800d45f1a4554c8a0c38a
2018-10-24 10:25:05 +01:00
Jesse Pretorius 1f54688f4c MNAIO: Add legacy os-infra_hosts group back
In https://review.openstack.org/611582 we removed
the legacy group as it has been deprecated since
Newton, however it appears to still be used by some
downstream tests, so we add it back, but make it
only get implemented if the associated services
are enabled.

Change-Id: I477a46d606d75d44a1ecd5bcfcb29c8308c65245
2018-10-23 16:27:52 +00:00
Zuul e5ae777701 Merge "MNAIO: Increase default logging_vm_server_ram to 16384" 2018-10-18 21:20:41 +00:00
Dave Wilde a38a19ee01 MNAIO: Increase default logging_vm_server_ram to 16384
The default of 1 GiB isn't sufficient to handle the logging load 
generated on a MNAIO.  This is a workable value and can be adjusted 
down.

Change-Id: I451af0babf9ae7bd8ae58eccef9c908bb7f91f52
2018-10-18 12:06:33 -05:00
Jesse Pretorius d3d505b678 MNAIO: Make cinder/compute/swift hosts conditional
1. If osa_enable_block_storage=false, then there should
   be no cinder hosts deployed, nor any presence of the
   vars related to it in openstack_user_config.

2. If osa_enable_compute=false, then there should be no
   compute hosts deployed, nor any presence of the
   vars related to it in openstack_user_config..

3. If osa_enable_object_storage=false, then there should
   be no swift hosts deployed, nor any presence of the
   vars related to it in openstack_user_config..

Change-Id: Id6858d277c80095024af5d8e04dfc97cc3e3b253
2018-10-18 14:43:19 +01:00
Jesse Pretorius cce2bd3d41 MNAIO: Move the ELK-related comment inside the conditional
The comment is a bit confusing without the rest of the content,
so we move it inside the conditional so that it only appears
if the ELK deployment is enabled.

Change-Id: I9da35b848d6c52a31162361f98c8514d8e1103ea
2018-10-18 13:50:06 +01:00
Jesse Pretorius 052f9306dd MNAIO: Remove lxc_container_backing_store override
The default lxc_container_backing_store for newton onwards
is 'dir' anyway, so this override is pointless.

Change-Id: I931a8dca2186dc51b468ec4fc1fc67859dadb171
2018-10-18 13:48:23 +01:00
Jesse Pretorius 75dbf3da99 MNAIO: Remove glance_default_store override
The glance_default_store variable is automatically set
by OSA's group_vars to 'swift' if any swift hosts are
present, and it falls back to 'file' if no swift is
present. This override therefore interferes with tests
which are not using swift, and it is totally unnecessary.

Change-Id: I5f938788f7998f0ca763d7395dc11c84ba85d2ee
2018-10-18 13:44:42 +01:00
Jesse Pretorius 7b893c3775 MNAIO: Increase default infra_vm_server_ram to 16384
The current default of 8GB simply does not work for a default
deployment of Rocky/Stein without doing a severe amount of
worker tuning.

While we do some work to improve the default number of workers,
we should rather increase the default value for these VM's.

Change-Id: Ic31bd9145e7feb67fa5eacc602c6152ecde1a47c
2018-10-18 13:11:21 +01:00
Jesse Pretorius 4868c22190 MNAIO: Remove legacy os-infra_hosts group
The legacy group 'os-infra_hosts' is not actually part
of the infrastructure - it includes all the openstack
infrastructure groups (keystone, nova, neutron, glance,
heat, swift). This group's use is unnecessary because
all the other groups included are represented with
individual options.

Having this in the osa_enable_infra conditional also
means that if you mean to disable swift/heat, it does
not work and you end up with a broken deployment.

Change-Id: Icd80fd96aad713372b1fe21752799d56ada3dac4
2018-10-18 13:04:12 +01:00
Zuul 55458b60f2 Merge "Add ability to deploy Octavia load balancer service" 2018-10-18 09:47:47 +00:00
Jacob Wagner e1ce3432d0 Add ability to deploy Octavia load balancer service
This commit enables the openstack Octavia load balancing service
if the option is enabled. The Octavia service replaced the legacy
Neutron LBAAS service.

Change-Id: Ib820ec3c4a7f6c9116608140b59332d03cf4c451
2018-10-17 13:51:35 +01:00
Jesse Pretorius 33d22c552e MNAIO: Copy SSH keys into containers if they are present
When starting an imaged environment, the SSH keys on the host do
not match the SSH keys in the containers. In this patch we ensure
that if the 'all_containers' group is present, then the deploy-vms
playbook will wait for them to come up and copy the new keys into
them. It also adds the new public key into the authorized_keys.
This ensures that the whole environment is ready to be used just
as it was before imaging.

We also remove the 'port' argument given to the wait_for_connection
module because the argument is invalid.

Change-Id: Iff0a3327c2031e0dd977e8e403b417e495fee14f
2018-10-17 12:36:21 +01:00
Jesse Pretorius bff190f00f MNAIO: Remove duplicated vm_servers group creation
This play is duplicated, so we remove the second execution
and ensure that the first uses a local connection.

Change-Id: I6162e93c999a792cbcdc42bf605271b999327e08
2018-10-17 12:09:43 +01:00
Jesse Pretorius 2614846180 MNAIO: Remove verbose output for bootstrap
The verbose output is confusing and actually makes troubleshooting
harder.

Change-Id: Iaec20866c82735dbf07592521aceacca998f3f1f
2018-10-17 12:09:43 +01:00
Jesse Pretorius 2de8dbb24a MNAIO: Use the OSA inventory and plugins where possible
There are times when it's useful to run playbooks against the
OSA inventory, but having to do so via infra1 is a bit of a
pain. Rather than do that we add a script which fetches the
OSA inventory file from infra1, and we also bootstrap the OSA
plugins repo into the default ansible plugins path so that it
is possible to run playbooks against the containers in the VM's
from the host without needing to do anything else.

Change-Id: I751af19841ea825d21dd67f4343674b8522b689f
2018-10-17 12:09:43 +01:00
Jesse Pretorius aee8b6d910 MNAIO: Switch to using file-backed VM's only
The MNAIO tooling is a test system, and with that target
we can afford to be opinionated in the implementation
rather than try to cater to every possibility.

Now that the file-backed VM implementation has matured,
we can switch to using it exclusively. This cuts down on
code complexity and allows us to mature the implementation
further with more options without having to cater to two
options.

Change-Id: Ibe04b5676a392301cd79a5d290b77df4c7d9f79a
2018-10-17 12:09:43 +01:00
Zuul 06fca4a2f6 Merge "MNAIO ELK Fixes" 2018-10-17 07:40:22 +00:00
Dave Wilde 07e54ad7ee MNAIO ELK Fixes
* Set the logstash_queue_type as it detection is not fullproof on the 
MNAIO.

* Add the elastic.co repositires to the DontCache stanza for ACNG.

Change-Id: I1a826f9949e3f4b83b2defff6b715518b45ce78c
2018-10-16 16:05:08 -05:00
Jesse Pretorius 2004e601c2 MNAIO: Ensure the aria log path exists
If the log path doesn't exist, we should create it - otherwise
the download command will fail because it cannot create the log.

Change-Id: I8f3d7604da11aae89c83ec3bd5c28b05f9853324
2018-10-14 14:49:26 +01:00