Commit Graph

533 Commits

Author SHA1 Message Date
Ghanshyam Mann 0a53c4a961 Retire openstack-chef: remove repo content
OpenStack-chef project is retiring
- https://review.opendev.org/c/openstack/governance/+/905279

this commit remove the content of this project repo

Depends-On: https://review.opendev.org/c/openstack/project-config/+/909134
Change-Id: Idb3769e91814eb7703a3a4787f485fab1caa97f8
2024-02-17 20:47:50 -08:00
Lance Albertson 763b9b5e18 Full coverage openstackclient integration testing
This provides full coverage of openstackclient cookbook integration testing.
Also enable multiple_converge when using kitchen to try and catch additional
idempotency issues.

Change-Id: Iaaf06bcbb8206f99c02bd6e89ecf8b8c2bf384e2
Signed-off-by: Lance Albertson <lance@osuosl.org>
2022-06-03 13:53:15 -07:00
Lance Albertson 2cf59c353a Update zuul config to not use the deprecated queue syntax
This is regards to the following email [1] which also references [2] with the
actual fix.

In addition, disable auto discovery as a workaround in setup.py [3]

[1] http://lists.openstack.org/pipermail/openstack-discuss/2022-May/028603.html
[2] https://lists.zuul-ci.org/pipermail/zuul-discuss/2022-May/001801.html
[3] https://review.opendev.org/c/openstack/tripleo-quickstart/+/835192

Change-Id: I93b97525172f26a25e189661fc31ecd80b88395b
Signed-off-by: Lance Albertson <lance@osuosl.org>
2022-05-19 14:54:16 -07:00
Lance Albertson b740947c11 Switch to CentOS Stream 8
Change-Id: I25825814d51c22333c5e1314ef56674558bd1f8b
Signed-off-by: Lance Albertson <lance@osuosl.org>
2022-01-27 15:44:59 -08:00
Lance Albertson 7d2ecf253c CentOS 8 support
This adds support for testing CentOS 8.

- Update documentation
  - Add references to CentOS 8
  - Update genealogy to include latest releases
  - Update minimum Chef requirement
  - Add Bare Metal to list of cookbooks when creating a stable branch
- Include memcached in identity role
- Update InSpec tests for CentOS 8
- Ensure we install the yum package on rpm distros (required by Chef to
  run properly and is missing on the default image)
- Remove yum-epel attributes in integration since it breaks on EL8

Change-Id: Ie648432021325150fdd2fd7ab7f1af10bc69b655
Signed-off-by: Lance Albertson <lance@osuosl.org>
2021-10-22 16:29:33 -07:00
Lance Albertson 442dcab018 Chef 17 support
- Switch to testing Chef/Cinc 17 by default
- Remove testing Chef/Cinc 15 and require >= 16.0
- Update to testing with Chef Workstation 21.10.640
- Remove workaround with berkshelf

Change-Id: I3eb69389f73de86dc06d11ee935028297dbc0aea
Signed-off-by: Lance Albertson <lance@osuosl.org>
2021-10-14 08:25:30 -07:00
Lance Albertson 7a22416324 Remove bind cookbook from Berksfile
The bind cookbook has been migrated to the Sous Chefs and a new release has
finally been done which removes the need to have this in the pointer (which is
now broken).

In addition:

- Disable voting for other issues that need to be addressed
- Add CHEF_PRODUCT_NAME env var to kitchen.yml to allow users of Cinc to use it
  more easily

Change-Id: I2a58f3633f0e5cd2457ebcb09feaa3c848a7513c
Signed-off-by: Lance Albertson <lance@osuosl.org>
2021-10-12 18:05:00 -07:00
Lance Albertson 1f16b43c7d Re-enable voting
Change-Id: I64b0252b97a117e5e862a8e200f7ef085a5e3e1b
Signed-off-by: Lance Albertson <lance@osuosl.org>
2021-07-14 14:56:42 -07:00
Lance Albertson e84e1be514 Disable SELinux for integration testing on RHEL only
We currently don't fully support SELinux so we need to disable it for now until
we get it fixed properly. Make this a variable so that we can change dynamically
later if we need to for testing purposes.

Temporarily disable voting until we get things working properly again.

Change-Id: Ib6dec3f6ea1cbc13d9c82d372b4f65f689adc0bc
Signed-off-by: Lance Albertson <lance@osuosl.org>
2021-07-14 10:59:55 -07:00
Jens Harbott fcd2066b47 Update docs to reference OFTC instead of Freenode
Change-Id: I1bc074bab15fa3aa7ece7651cc6fb7281ff3fc4b
2021-06-03 09:44:49 +02:00
Lance Albertson e4144314cd Update to Chef Workstation 21.2.303
Change-Id: Ifd11f2c53cc9aac82c5c18037c11445d44791549
Signed-off-by: Lance Albertson <lance@osuosl.org>
2021-03-08 15:53:41 -08:00
Lance Albertson 2d4e29c2a4 Pin berkshelf to < 7.2.0 to work around issues with Chef/Cinc 15
This works around a problem that was introducted in berkshelf-7.2.0 for Ruby 3.0
support that now breaks berks with the following error:

  ArgumentError wrong number of arguments (given 3, expected 1..2)

This should be removed after we remove support for Chef/Cinc 15.

Signed-off-by: Lance Albertson <lance@osuosl.org>
Change-Id: Ica4a65a98f3b3b509d1aa8df5f36f62f3677acab
2021-03-04 15:28:35 -08:00
Lance Albertson baf017a2b6 Update to using Chef Workstation 20.9.158
This includes newer cookstyle rules that we should be checking for.

Change-Id: I6f1bedfe30dd3455570b41862e01b0c928f5e565
Signed-off-by: Lance Albertson <lance@osuosl.org>
2020-10-05 20:24:42 -07:00
Lance Albertson 62c86ca3c1 Re-enable voting
Change-Id: I452bf181a5cfaee59b18750df3aaab9923a1de2b
Signed-off-by: Lance Albertson <lance@osuosl.org>
2020-09-23 09:35:05 -07:00
Lance Albertson b70036a70e Re-enable latest Chef 16 builds
This requires a fix in cookbook-openstack-common that will depend on this patch
so jobs need to be disabled.

Change-Id: Ide2fefddcd79ad7ff9bbe748187b4fd4999a857a
Signed-off-by: Lance Albertson <lance@osuosl.org>
2020-09-21 10:50:36 -07:00
Jens Harbott 1a9fc6f4fc Cap chef-client version at 16.4
We are seeing errors with 16.5, cap at 16.4 until we can fix those.

Change-Id: I4bf09483ce7cc560dfe477e9c615e8007764e3ea
2020-09-21 13:00:19 +02:00
Zuul 7b00e778d6 Merge "Add a note about creating a release branch" 2020-09-16 07:51:39 +00:00
Jens Harbott 6535c3427e Add a note about creating a release branch
This content is taken from the Wiki[0] and updated to match the
current state of the kitchen.

[0] https://wiki.openstack.org/wiki/OpenstackChefStablebranchCreateNotes

Change-Id: Iea9b41b99003cab37467e0c786a2b7e5e490c7a6
Signed-off-by: Lance Albertson <lance@osuosl.org>
2020-09-14 09:05:49 -07:00
Lance Albertson b0076369c5 Re-enable voting
Change-Id: I74d9ee7d3739cf1a602c41c7691a4a328523d4d9
Signed-off-by: Lance Albertson <lance@osuosl.org>
2020-09-02 10:16:00 -07:00
Lance Albertson 0e1bbc88fc Chef 16 support
This adds support for testing both Chef/Cinc 15 and Chef/Cinc 16 which
are still supported upstream. For now this disables voting on 16 as we
have some known issues that need to be worked out first.

In addition, this updates to Chef Workstation 20.8.111 which includes
Chef 16 for spec testing. For now, let's only worry about doing unit
testing against Chef 16 and worry about integration testing to catch any
issues with Chef 15.

Also remove installation of the fog-openstack gem as it's now included
in Chef Workstation by default.

Change-Id: I191b14a295bf323ab37f5a97298f9f0594e8843c
Signed-off-by: Lance Albertson <lance@osuosl.org>
2020-08-25 10:24:05 -07:00
Lance Albertson 841565eb25 Re-enable voting
Change-Id: I7742aeedc1895295c42cc56ba0e57678e9edb7d8
2020-06-11 13:59:12 -07:00
Zuul a9e48de68e Merge "Add testing with the community built client" 2020-06-11 20:54:10 +00:00
Zuul 34202a4410 Merge "Start Train development" 2020-06-11 00:33:29 +00:00
Jens Harbott 967ea2bd5e Add testing with the community built client
Create a role for installing a chef-client implementation instead of
having it hardcoded within the pre playbook.

Create additional jobs running with cinc-client.

Change-Id: Ib6c592f684072f60962c1be5fccff035fd4c3459
2020-06-10 09:52:46 +02:00
Lance Albertson 89f4b5c1e7 Start Train development
Changed:
- Temporarily disable voting during development
- Update git URI for bind cookbook to use upstream master
- Renamed .kitchen.yml -> kitchen.yml
- Genealogy updated

Fixed:
- Idempotency with use of apt_update resource
- InSpec tests to work with Train
- Cookstyle

Added:
- Data bag for placement service
- Set deprecations_as_errors to true in kitchen.yml

Removed:
- Unused statsd cookbook in Berksfile
- Unused .rubocop.yml

Deprecated:
- LBaaS recipes and tests. This has been deprecated upstream.

Change-Id: I53a28de6aad000a246ff8f610b64dd5201c03b27
2020-06-08 10:59:07 -07:00
Andreas Jaeger b27b5edcbc Switch to newer openstackdocstheme version
Switch to openstackdocstheme 2.2.1 version. Using
this version will allow especially:
* Linking from HTML to PDF document
* Allow parallel building of documents
* Fix some rendering problems

Update Sphinx version as well.

Disable openstackdocs_auto_name to use 'project' variable as name.

Change pygments_style to 'native' since old theme version always used
'native' and the theme now respects the setting and using 'sphinx' can
lead to some strange rendering.

openstackdocstheme renames some variables, so follow the renames
before the next release removes them. A couple of variables are also
not needed anymore, remove them.

See also
http://lists.openstack.org/pipermail/openstack-discuss/2020-May/014971.html

Change-Id: Ied3bb008208231bd4c9b6c2e86c716eac66267aa
2020-05-31 21:37:43 +02:00
Lance Albertson 81249f67cb Update to Chef Workstation 0.18.3
Change-Id: I125521525d88ee404c0d9d8b6d43249e01291817
2020-05-21 15:19:53 -07:00
Andreas Jaeger 8cb61b9a61 Cleanup py27 support for docs
This repo is now testing only with Python 3, so let's make
a few cleanups:
- Remove python 2.7 stanza from setup.py
- Remove obsolete sections from setup.cfg
- Update requirements, no need for python_version anymore
- Cleanup */source/conf.py to remove now obsolete content.
- Use newer openstackdocstheme version

Change-Id: I5f6aabc271e21fe8edbf2aadd2f78f8bdc407e80
2020-04-11 16:15:29 +02:00
Lance Albertson 8e80dcab4b Re-enable jobs
Change-Id: Ia54e36bcbee9e3688fa4e396de5af5d83632c335
2020-03-27 13:40:17 -07:00
Dr. Jens Harbott 5111603bb5 Start Stein development
- Update references from Rocky to Stein.
- Switch to using chef-workstation
- Exclude integration group from Berksfile. This is to ensure ChefSpec tests
  should always work regardless if we're working on integration related
  cookbooks that don't interact with those tests.
- Temporarily disable voting for integration tests due to cookbook version
  conflicts
- Add tests for openstack-common::etcd and openstack-common::completions
- Update tests for Stein
- Update OVS port to check
- Add tests for lbaas but only for kitchen, not for CI pipeline
- Add suite and tests for integration-test

Change-Id: Id451b08e361acc709879a65d0d92b35640a5dba9
2020-03-23 14:22:28 -07:00
Lance Albertson 1fe9d31295 Update tests for using newer mariadb cookbook
This updates the integration tests for the ops-database cookbook so that
it works properly with the new mariadb cookbook. In addition:

- Enable auto_correct for forwarded_port so we can run more than one
  instance at a time with test-kitchen
- Remove mariadb attributes that are no longer needed
- Temporarily disable voting on centos/ubuntu gates since this will
  require a patch from ops-database and we cannot create a circular
  dependency

Depends-On: https://review.opendev.org/710348
Change-Id: I215a777d255b4b5f9a3481f782a2b7b89f9c3a07
2020-02-27 19:05:50 -08:00
Lance Albertson cbc1b9bcf4 Refactor integration tests
This changes the logic so that we use the Berksfile in the cookbook
we're doing changes in instead of what's included in openstack-chef.
This should allow us to properly deal with cookbook dependencies in a
saner fashion with Gerrit without getting into depends-on hell.

This also required refactoring the Rakefile and roles used in Gerrit and
test-kitchen. Each cookbook now has their own role and test role which
includes specific Tempest configuration settings. This will require
updates in most cookbooks' Berksfile to include missing cookbook
dependencies such as ops-database, ops-messaging and integration-test.

Other major changes includes migrating to using InSpec for integration
testing instead of relying on simple commands included in the Rakefile.
I have replaced most of what was included in _run_basic_queries as
InSpec tests which also improves our coverage overall. Currently the
InSpec coverage is fairly basic and should probably include additional
tests, but in general it covers the following:

I've also added minimal non-voting jobs for both platforms so we can
catch any issue we might have missed downstream.

- Services are enabled and running
- Basic commands return sane output
- Openstack users, services and endpoints are correct

The all suites exclude running Tempest due to the fact that InSpec
doesn't have the ability to change the command timeout beyond 600
seconds [1] which is an issue I've run into. It's recommended to run
tempest manually when using test-kitchen.

NOTE: I haven't made any updates to the multi-node test-kitchen
environment in this patch and will plan on doing that later. I don't
believe this will break anything there.

Other various minor changes include:

- Replaced bare-metal cookbook with block-storage in minimal role
- Print out the command that run_command is going to run to help with
  debugging.
- Use different public_ip so that it doesn't interfere with people using
  10.0.0.0/24 locally (like me!).
- Add forwarded port to access Horizon
- Switch to using Chef 15 with test-kitchen
- Include log files from additional services that we were missing
- Add missing databag for aodh and telemetry_metric
- Include a real rndc key in the databag to assist with testing
- Use OSUOSL for EPEL mirror to work around public mirror issues

[1] https://github.com/inspec/inspec/issues/1675

Depends-On: https://review.opendev.org/703882

Change-Id: Idebc87ebb6acad7d0af222fb9025fefcb9bf5a1e
2020-01-30 10:10:45 -08:00
Lance Albertson e536f52ba2 Fix typo in openstack-bare-metal databag
It used 'openstac-bare-metal' instead of 'openstack-bare-metal'.

Change-Id: If780398073eb2b4a8d8fc865c15179a677d2e42e
2020-01-15 13:20:14 -08:00
Lance Albertson 52970bdd45 Switch to using Chef 15
Change-Id: I3c981bfc19f39d869c5890e159431c50d5c97a5d
2020-01-03 13:49:05 +00:00
Lance Albertson 90b2f96247 Updates for rocky
- Update some documentation
- Migrate all Markdown to RST for better rendering
- Drop obsolete bootstrap.sh script
- Update tox.ini as for building docs only python3 is supported

Change-Id: I40a7b02e0a83b516dd7b3cccdb3ddbece2996890
2019-12-06 09:50:11 -08:00
Zuul 3ca87cff47 Merge "Use python3 packages on Ubuntu" 2019-11-27 10:40:15 +00:00
Zuul c703ab2c0d Merge "tox: Keeping going with docs" 2019-11-22 10:16:11 +00:00
inspurericzhang 6f77318fce Replace git.openstack.org with opendev.org
Change-Id: I899a8d67e81a80a98ca5698ca18aa98cd4eeb6d6
2019-11-19 09:41:44 +08:00
gujin 9daf7e3299 tox: Keeping going with docs
Sphinx 1.8 introduced [1] the '--keep-going' argument which, as its name
suggests, keeps the build running when it encounters non-fatal errors.
This is exceptionally useful in avoiding a continuous edit-build loop
when undertaking large doc reworks where multiple errors may be
introduced.

[1] https://github.com/sphinx-doc/sphinx/commit/e3483e9b045

Change-Id: Id4ba8fdf54276ce53601337b3006728724831084
2019-11-01 14:56:55 +08:00
Zuul d1d3f5d015 Merge "Add a queue spec to our project template" 2019-10-29 10:09:53 +00:00
Jens Harbott 70a3478b80 Add a queue spec to our project template
All cookbook projects should use a shared queue for gating, so that
patches are merged in order and tested together.

Change-Id: I71da5029d7f6ffa9e9067eb1e3c32ef05cc0ab4b
2019-10-29 08:26:16 +00:00
Lance Albertson ecfce0207d Remove deprecate Glance Registry service
The Glance Registry service has been deprecated upstream and needs to be removed
from the run list here for testing.

Needed-By: https://review.opendev.org/690401
Depends-On: https://review.opendev.org/691732
Change-Id: Ib9ef88684bab8ab5f8919646a88f1b2bee1beadf
Signed-off-by: Lance Albertson <lance@osuosl.org>
2019-10-28 12:21:12 -07:00
wangfaxin a766dddc2c Update the community page
- Update the project name
- Update some links

Change-Id: I2eb418130e4a606c962b0d891a9de22192fcfa4a
2019-10-17 12:34:05 +00:00
pengyuesheng 628ab8f73c Blacklist sphinx 2.1.0 (autodoc bug)
See https://github.com/sphinx-doc/sphinx/issues/6440 for upstream details

Change-Id: I07fad7e61f608fd094c75dd628d14ff8d9f7d352
2019-10-10 09:34:18 +08:00
Jens Harbott e093b0cf85 Use python3 packages on Ubuntu
Python2.7 is going EOL soon, let us deploy python3 for Rocky from the
start, so we avoid having to switch later.

Also update documentation.

Depends-On: https://review.opendev.org/682917
Depends-On: https://review.opendev.org/682918
Depends-On: https://review.opendev.org/682919
Depends-On: https://review.opendev.org/682920
Depends-On: https://review.opendev.org/682921
Depends-On: https://review.opendev.org/674452
Depends-On: https://review.opendev.org/682922
Depends-On: https://review.opendev.org/682923
Depends-On: https://review.opendev.org/682924
Change-Id: Iae8a58f4aeb0e7138d0cfc3dc4e58ee995c216b5
2019-09-23 14:03:30 +00:00
Lance Albertson 5280706daa Refactor and update test-kitchen suites
This provides a large collection of updates and refactoring to improve
the development environment for the cookbooks using test-kitchen.

The primary change this provides is the addition of the 'minimal' suite
which replicates what the integration test jobs run in Zuul. This is
useful for testing and debugging issues that might be found during CI
jobs.

- Switch run_list to using roles to better match how the zuul jobs work
- Update to using Ubuntu 18.04 instead of 16.04
- Move all attributes from .kitchen.yml files to environments
- Update multi-node and dokken test-kitchen
- Use MariaDB 10.1 by default as 10.0 has been deprecated upstream for
  ubuntu 18.04. Also use OSUOSL mirror as it's more stable than
  upstream
- Don't disable EPEL on RHEL systems
- Synchronize attributes (within reason) between test-kitchen files
- Update roles run_list
- Create openstack_test cookbook and update /etc/apt/sources.list to
  OSUOSL mirrors to improve stability on Ubuntu

Change-Id: Ie6d7b56a78f7fadbd28e6d27a46446a46c3c5ebd
Signed-off-by: Lance Albertson <lance@osuosl.org>
2019-08-06 10:52:40 +00:00
Lance Albertson d3a307d917 Add CentOS 7 for integration check and gate jobs
I'd really like to re-enable integration tests for CentOS since we use
it quite a bit. This should also hopefully catch any issues that might
be missed.

Change-Id: I2be43a81c5c8d4e36253b740affe7223f7a54acd
Signed-off-by: Lance Albertson <lance@osuosl.org>
2019-07-07 22:14:03 -07:00
Jens Harbott d1d1139f15 Make integration job voting again
After the stack to move to using chef-client for the integration tests
has merged, we can make the integration job voting again.

Change-Id: If906f4e07c2afc6dbbf1784aecbb8f473ca62c86
2019-07-05 09:13:49 +00:00
Lance Albertson 9a1672a072 Install and use Chef Client instead of ChefDK on integration tests
Using the chef-client baked into ChefDK is causing issues with the
fog-openstack gem since it is locked in ChefDK. To work around this and
better mimic how this is used in production, switch the integration
tests to installing chef-client instead of ChefDK.

- Split out pre-run playbooks between delivery and integration (keep
  ChefDK for delivery)
- Install Chef 14 by default
- Install Berkshelf in Chef
- Install cookstyle which is needed in the Rakefile
- Update command paths so that berkshelf is available with Chef and
  ChefDK
- Update ChefDK to 3.2.30 but not higher due to issues with chefspec and
  apache2 [1]
- Upgrade fog-openstack gem to work around extraneous warnings to match
  cookbook-openstackclient
- Remove unneeded pip downgrade

[1] https://github.com/sous-chefs/apache2/issues/588

Change-Id: I0b0c2eb80dc0d831685cc7f69a1186a6148e6258
Signed-off-by: Lance Albertson <lance@osuosl.org>
2019-07-04 11:12:41 +00:00
Zuul 9df3917f9b Merge "Modify tox.ini Replace openstack.org URLs with opendev.org URLs" 2019-05-24 09:06:44 +00:00