Commit Graph

88 Commits

Author SHA1 Message Date
Matt McEuen 7f8bf5f411 Clean out old kustomize entrypoints
This clears out stale YAML structure in preparation of migrating
fresher entrypoints from airshipctl, and authoring of new ones.

Change-Id: I5a006c7e4461b0cce2766b367e5e8494033f8b36
2020-07-10 16:00:20 -05:00
Dmitry Ukov 185d2bd626 Introduce basic directory structure
Change-Id: I559511e586383793dcbbf969ff025c1fb3a2f14f
2019-10-02 11:02:37 +00:00
Dmitry Ukov d247bb6057 Clean up v1 structure
Change-Id: I12feb1db2ef4ffe58be00f0c290b37e7f184efd6
2019-10-02 09:57:45 +00:00
Kaspars Skels 44d6f90a2d MAAS improvements for DNS & NodePort
Using MAAS IP for DNS allows installation by not requiring
direct internet connectivity for PXE/bootstrap interface.

NodePort usage for genesis bootstrap helps troubleshooting
during bare-metal deployment. The NodePort is unset once the
full-site (maas-scaled) is deployed.

Change-Id: I6cab0b3cfc541d43d738f3dc144bb29d848ab718
2019-09-26 10:25:58 -05:00
Zuul a4f687e272 Merge "Updating seaworthy bonding" 2019-09-20 16:17:41 +00:00
Roy Tang 34babe6a09 Update neutron document in global.
By updating the neutron global document name, it will allow neutron
to be properly replaced at the type and site level as needed.

Change-Id: I2bb734d527aa58fbd0a60252d2630c11f7cd4652
2019-09-19 22:43:41 +00:00
Kaspars Skels 46616f904f Use HWE kernel for Airsloop computes
Change Airsloop to align with Seaworthy deployment using HWE kernel.

Change-Id: Iad86de5d8381e2bdfb1f6dc23930bda50775beaa
2019-09-14 18:05:44 +00:00
Roy Tang 5e2d89256f Updating seaworthy bonding
Reduce bonding from 4 nic to 2.
Rename things for clarity.

Change-Id: I71db565ef39699bfd35d8c4e6fd798b6dafd8536
2019-09-10 22:30:15 +00:00
Zuul 4664740afc Merge "Add airskiff_suse site" 2019-09-10 20:36:24 +00:00
James Gu f3a4cebcb4 Add airskiff_suse site
Added airskiff_suse site that deploys the ucp and openstack containers on openSUSE
images. Also renamed the previous airskiff site repo to airskiff-ubuntu. Added new
gates for airskiff-suse lint and deployment.

Change-Id: I5672e8db556ef02c3d74a598d2772fbebccf6f77
2019-09-10 17:00:27 +00:00
Evgeny L 20ea85df6e Fix airskiff gate and uplift shipyard
Now Shipyard [1] requires `statefulset` to be configured
for airflow endpoints.

This patch fixes both airskiff gates and other sites.

[1] https://review.opendev.org/#/c/671575/

Change-Id: I29edeb27763059b1dd5f99db4740e0913f0dc56d
2019-09-04 19:24:52 +00:00
Kaspars Skels 33bdd46754 Update expired certs for Seaworthy k8s cluster
Change-Id: Ifc22bf4d3011db8e3597cbc16fbba7313d52f319
2019-08-22 09:44:54 -05:00
James Gu e28d0a1313 Add new airskiff type
Create a site type called skiff and point airskiff site to be based on
the new type. This will help to reduce the duplication when creating
airskiff-suse site in subsequent commit.

Change-Id: Ie9cd6d0e572a4556ee6ff5c3d37f20349c2d7de3
2019-08-21 16:20:01 +00:00
Zuul 10f2f3e9bd Merge "Add new seaworthy-virt site" 2019-08-02 20:39:42 +00:00
Michael Beaver 22408cbeb5 Add new seaworthy-virt site
This site is created in order to utilize the multinode development
environment alongside the global and type manifests in Treasure map.

To accomplish this, the new seaworthy-virt site is a copy of the
airship-seaworthy site but with as many overrides and removed
pieces as necessary.

Change-Id: I6d19e1cf019c5d03f42343ab3c72971172879e4d
2019-07-30 17:16:14 +00:00
Chinasubbareddy Mallavarapu 81b5c0c482 [CEPH] Enable rack level failure domains
- uplift ceph charts

- This is to enable rack level failure domains as we are running on
host based failure domains

- updating the site to have one override which will create custom domain
names since current logic uses hostnames to get domain names.

- this lab running on single rack so using site override to create custom failure
domain names.

Change-Id: I2b92055e77dac6eba4fe59694c5291046149a6c4
2019-07-25 15:26:38 +00:00
Alexander Noskov 8a94b9bf58 Uplift all components + fixes for oslo_messaging
Adjusting `statefulset` in oslo_messaging parameter for OpenStack components
Reference CR: https://review.opendev.org/665481

Change-Id: I502736ccee5cfca047adf4f2567de20a268f0cd3
2019-07-19 11:45:49 -05:00
Zuul 2b32cc2c80 Merge "Fix warning when using 3 upstream DNS servers" 2019-07-17 22:00:34 +00:00
Kaspars Skels a9219125fc Fix warning when using 3 upstream DNS servers
Warning: Nameserver limits were exceeded, some nameservers have been omitted,
the applied nameserver line is: 10.96.0.10 8.8.8.8 8.8.4.4

Removing 3rd DNS server entry fixes the issue.

Change-Id: I14fae0d884223050eb3106b4a9cf1adde01def8f
2019-07-17 15:18:46 -05:00
Matt McEuen 16cdf842d2 Incorporate HA PostgreSQL
This change integrates changes related to the new Patroni-enabled
high availability included in the postgresql helm chart.

1. Updates the version of the postgresql chart
2. Adds users/passphrases for the postgresql replication and exporter users
3. Sets the default number of replicas to 3 (except for skiff & sloop)
4. Adds documentation/scripting for upgrading the chart

Co-Authored-By: Evgeniy L <eli@mirantis.com>
Change-Id: I51e63fb2444610cfb144bc587a6a179fa4830809
2019-07-15 19:39:38 +00:00
Evgeny L c357733d71 Single-cluster RabbitMQ for OpenStack
The intention for the patch is to increase the stability of
OpenStack installation:

1. Use a single RabbitMQ cluster for all OpenStack services.
2. Use 2 replicas for RabbitMQ clusters instead of 3; RabbitMQ
   does not implement a quorum mechanism which allows us to have
   even number of nodes, this should provide better performance
   by reducing the number of instances where the data should be
   replicated. This should also reduce the odds of getting
   RabbitMQ partitioning.

Co-authored-by: Drew Walters <andrew.walters@att.com>

Change-Id: Id981e2650efc24a9e67cf87a0abd414a96f40088
2019-07-12 17:33:39 +00:00
Kaspars Skels 6bb6c42b44 Fix compute pki for Airsloop
Change-Id: I2e6773a6bfe52c72cdac09dfb3dfd02aebe13bf5
2019-07-11 17:53:40 -05:00
Alexander Noskov f08a454b45 Uplift k8s API server and fix 'No API token' issue
After enablement of etcd encryption in https://review.opendev.org/628290 for
promenade, bootstrap-armada pod should be run with
'--experimental-encryption-provider-config' service parameter to avoid issue:
'ERROR: No API token found for service account "airship-ucp-ceph-osd-test"'

Change-Id: Ib9bf1fa7333874b2d88db84019b26a2691a7d18a
2019-07-09 15:29:55 +00:00
Alexander Noskov 87b26958a4 Uplift and Separate fluentbit and fluentd charts
fluent-logging chart was splitter into fluentbit and fluentd charts
in the following PS: https://review.opendev.org/642146

Change-Id: Ic72f9fb6293b99395a0acf48064b9c04e312d365
2019-07-01 18:04:41 -05:00
Venkata, Krishna (kv988c) 92ef88f481 [airship]: Remove duplicate values
BaremetalNode/v1.yaml: volume_group is
defined twice in same section in lines 58 and 66.

HostProfile/v1.yaml: volume_group is
defined twice in same section in lines 49 and 57.

SoftwareVersions/v1.yaml: type is defined twice
for dep_check

config/service_accounts.yaml: user_domain_name
defined twice in same section in lines 109 and 114.

config/service_accounts.yaml: user_domain_name
defined twice in same section in lines 111 and 116.

Change-Id: I1597c0afc6b3a9674c0c74692f6575d797bd714d
2019-06-20 17:07:52 -05:00
Zuul 995b16e294 Merge "airskiff: Use Deckhand Ubuntu image" 2019-06-20 16:05:47 +00:00
Alexander Noskov 92c43b00ce Use exact Ubuntu Xenial release.
By specifying exact ubuntu release as a tag for `updater.py` script, it prevents
downloading ubuntu with a higher release, for example, ubuntu bionic.
Changing bionic to xenial for armada chart.

Change-Id: I1864c3f8db2d90ab63d7d923de8f2ac0ecd20e31
2019-06-20 02:14:03 +00:00
Drew Walters 67050096d7 airskiff: Use Deckhand Ubuntu image
The default image tags recently changed for the Deckhand image [0]. This
change moves to use the default tag.

[0] https://review.opendev.org/638301

Change-Id: Ia7198ec579bb68e6fd64e00041ea6db366adf341
2019-06-17 15:56:11 +00:00
Kaspars Skels 3bc31be4b2 Move airship-seaworthy to seaworthy
Change-Id: Ide71456d1484b43ea434a23da858418adf51f23b
2019-06-10 17:41:33 -05:00
Evgeny L 8cf3062dcd [AIAB] Fix glance and heat overrides
Add explicit glance and heat overrides, this fixes problems
when two manifests with identical names are present,
one manifest comes from the type level, another one comes
from the site level, this leads to random manifest being
picked up during service deployment by Armada.

Change-Id: I87f6cce910dcf1f87370ba231077451990b245ee
2019-06-04 21:33:02 +00:00
Evgeny L c88eb575b8 Add Airship-in-a-Bottle site manifests and scripts
Note: all scripts in tools/deployment/aiab directory have been
moved into this repository as is (except a few changes to make
them work), they require a heavy refactoring that will be done
in separate patch-sets.

* Add a virtual single node manifests that are based on a sloop type.
* Use NFS provisioner instead of Ceph.
* Update tools/openstack to be non-seaworthy specific, use a default
  region name and auth url.
* Make type/sloop/config/common-software-config.yaml to be site specific,
  to allow to configure custom region_name.
* Remove max-pods-per-cpu parameter for kubelet, treasuremap needs
  to support a diverse set of environments, without constraints
  on the number of available cores. Max pods configuration parameter
  is still present and helps to mitigate problems when kubernetes
  unexpectedly starts a large number of pods.

Change-Id: I379a50d810b91b989f039dbb7c691f5ceec0cc67
2019-05-24 16:23:07 +00:00
Zuul 0016279ae7 Merge "promenade_api proxy input correction" 2019-05-24 13:41:43 +00:00
Drew Walters 59a1fd8a1c airskiff: Use Ubuntu images
Since support for additional operating systems has been added to some
components, the image tag "latest" is no longer used by their Makefiles.
This commit changes the tags for the aforementioned components to use
the new default tag and updates the job name to reflect the use of
Ubuntu images.

Change-Id: Ia1adf156c4b3798b2400f9c821ac2ba685557591
2019-05-21 21:27:40 +00:00
Evgeny L a4890271fd Airskiff: fix bridge name in a neutron config
Change-Id: Ic05bd54e07a2becc4c071cc69e95d86fbf6e04e5
2019-05-14 21:13:27 +00:00
kranthikirang 9bb7bbe36b promenade_api proxy input correction
Change-Id: I80f4df5458b0c2828b303e732a5d10b66e1aca98
Signed-off-by: kranthikirang <kranthi.guttikonda@att.com>
2019-05-03 15:34:46 +00:00
Zuul 2663c4d116 Merge "Created global layer chart for OpenStack Tempest" 2019-05-02 13:10:16 +00:00
matthew-fuller ec1c7b1a3c Created global layer chart for OpenStack Tempest
Change-Id: I661726e9279cb71839547547481598ce2eddc208
2019-04-30 09:45:30 -07:00
Matt McEuen 376e3882f9 Fix airskiff endpoint catalog
This cleans up the Airskiff endpoints by basing them off of the
sloop version.

Change-Id: I9207315a03469e59b205d74097ac83e56d1a9772
2019-04-28 22:56:21 -05:00
Drew Walters 4e6a60ce1a airskiff: Use global Airship charts
Currently, Airskiff deploys a custom manifest defined in
tools/deployment/airskiff/manifests/airship.yaml to boostrap Airship
components. This exempts Airskiff from the daily version uplift process
and causes a divergence from the global UCP charts. This commit updates
the Airskiff bootstrap process to use the existing UCP charts at the
global layer.

Change-Id: I68dc405fda3cb1dbf5865104b657bdd75812e9bc
2019-04-26 15:33:44 +00:00
Kaspars Skels b54d64f797 Fixes to MAAS HA and follow-up to comments
Change-Id: I571a0e3bc8355e0ac398175373df40334ebcd1af
2019-04-25 13:41:02 -05:00
Kaspars Skels b40b833c94 Remove bonding references from Airsloop networks
Change-Id: Ie96a00a061dec925f70bfd6359c708d482c063bb
2019-04-24 15:54:36 -05:00
Evgeny L ffde6bcbd5 Update links in the docs to refer to opendev
Sync of Airship project to Github has been stopped [0],
refer to opendev.org mirror instead of Github to
make sure the user is always referred to updated
repos.

[0] http://lists.openstack.org/pipermail/openstack-discuss/2019-April/005011.html

Change-Id: I31303af9176e90f13ef63bfea68ad3796710bae5
2019-04-23 13:49:10 +00:00
Zuul d0dc46ed0f Merge "Add metadata proxy shared secret for Nova and Neutron" 2019-04-23 03:43:50 +00:00
Dimitrios Markou 46100f03c7 Integrate support for MAAS HA and VIPs
Change-Id: I1c7f3892a03536d94064da1722751eb6683da451
Signed-off-by: Dimitrios Markou <dimitrios.markou@att.com>
2019-04-22 17:08:20 +00:00
Evgeny 6514b2f77f Add metadata proxy shared secret for Nova and Neutron
Override default "metadata_proxy_shared_secret" parameter.
This secret is used by Neutron to sign instance-id headers
to prevent spoofing when proxying metadata requests.

Change-Id: I771d7f818a18b82d55bf781d71fc95114ac7e78c
2019-04-22 16:59:36 +00:00
Kaspars Skels 06ffeec6b1 Sloop type and Airsloop site
Sloop type/site is a minimalistic approach to Airship with reduced
requirements towards hardware and external dependencies while keeping
all the functional features.

Major differences compared to reference site airship-seaworthy
 - Two bare-metal server setup with 1 control, and 1 compute.
   Most components are scaled to a single replica and doesn't carry
   any HA as there is only a single control plane host.
 - No requirements for DNS/certificates.
   HTTP and internal cluster DNS is used.
 - Ceph set to use the single (root) disk. This generally
   provides minimalistic no-touch ceph deployment.
   No replication of ceph data (single copy).
 - Simplified networking (no bonding).
   Two network interfaces are used by default (flat PXE, and DATA network
   with VLANs for OAM, Calico, Storage, and OpenStack Overlay)
 - Generic hostnames used (airsloop-control-1, airsloop-compute-1) that
   simplifies generation of k8s certificates
 - Usage of standard Ubuntu 16.04 GA kernel (as oppose to HWE)

Change-Id: I4944fcae7d29ed8799d810c93efb0120b6b3a105
2019-04-12 16:11:37 -05:00
Evgeny 0aac1554cc Update docs to clarify certificates requirements
During the initial configuration it's required to
configure a set of valid certificates for ingress.
Make it more explicit so people don't miss this step.

Change-Id: Ie6477f934688467b7d5dfe1cc8191f6acff29a21
2019-02-28 00:07:39 +00:00
Chinasubbareddy Mallavarapu 56a91502a2 Ceph: journal partitions instead of whole disk
This is to represent specific partitions for journals
instead of  whole disk, ceph charts will create journal partitions
and default size is 10GB

Change-Id: I0f032a0d87396fe44f1179b3104ed446cc448d28
2019-02-10 23:41:09 +00:00
Bryan Strassner bbfa8eada7 Update Shipyard Pod Configuration
Updates to use new Shipyard pod configurations, removes node port use.
Requires Shipyard commit a11e962eef5a5aa8f8fc15c4a324dfa6b2465061 or
newer.

Change-Id: Iff5af45d6b4f60c34d18aad821cf9afa4ea67dda
2019-02-05 22:10:49 +00:00
Zuul 3f04ed5b86 Merge "Neutron parameter min_l3_agents_per_router was removed in Ocata" 2019-01-24 02:22:49 +00:00