This adds support for testing CentOS 8.
- Update documentation
- Add references to CentOS 8
- Update genealogy to include latest releases
- Update minimum Chef requirement
- Add Bare Metal to list of cookbooks when creating a stable branch
- Include memcached in identity role
- Update InSpec tests for CentOS 8
- Ensure we install the yum package on rpm distros (required by Chef to
run properly and is missing on the default image)
- Remove yum-epel attributes in integration since it breaks on EL8
Change-Id: Ie648432021325150fdd2fd7ab7f1af10bc69b655
Signed-off-by: Lance Albertson <lance@osuosl.org>
- Update references from Rocky to Stein.
- Switch to using chef-workstation
- Exclude integration group from Berksfile. This is to ensure ChefSpec tests
should always work regardless if we're working on integration related
cookbooks that don't interact with those tests.
- Temporarily disable voting for integration tests due to cookbook version
conflicts
- Add tests for openstack-common::etcd and openstack-common::completions
- Update tests for Stein
- Update OVS port to check
- Add tests for lbaas but only for kitchen, not for CI pipeline
- Add suite and tests for integration-test
Change-Id: Id451b08e361acc709879a65d0d92b35640a5dba9
This changes the logic so that we use the Berksfile in the cookbook
we're doing changes in instead of what's included in openstack-chef.
This should allow us to properly deal with cookbook dependencies in a
saner fashion with Gerrit without getting into depends-on hell.
This also required refactoring the Rakefile and roles used in Gerrit and
test-kitchen. Each cookbook now has their own role and test role which
includes specific Tempest configuration settings. This will require
updates in most cookbooks' Berksfile to include missing cookbook
dependencies such as ops-database, ops-messaging and integration-test.
Other major changes includes migrating to using InSpec for integration
testing instead of relying on simple commands included in the Rakefile.
I have replaced most of what was included in _run_basic_queries as
InSpec tests which also improves our coverage overall. Currently the
InSpec coverage is fairly basic and should probably include additional
tests, but in general it covers the following:
I've also added minimal non-voting jobs for both platforms so we can
catch any issue we might have missed downstream.
- Services are enabled and running
- Basic commands return sane output
- Openstack users, services and endpoints are correct
The all suites exclude running Tempest due to the fact that InSpec
doesn't have the ability to change the command timeout beyond 600
seconds [1] which is an issue I've run into. It's recommended to run
tempest manually when using test-kitchen.
NOTE: I haven't made any updates to the multi-node test-kitchen
environment in this patch and will plan on doing that later. I don't
believe this will break anything there.
Other various minor changes include:
- Replaced bare-metal cookbook with block-storage in minimal role
- Print out the command that run_command is going to run to help with
debugging.
- Use different public_ip so that it doesn't interfere with people using
10.0.0.0/24 locally (like me!).
- Add forwarded port to access Horizon
- Switch to using Chef 15 with test-kitchen
- Include log files from additional services that we were missing
- Add missing databag for aodh and telemetry_metric
- Include a real rndc key in the databag to assist with testing
- Use OSUOSL for EPEL mirror to work around public mirror issues
[1] https://github.com/inspec/inspec/issues/1675
Depends-On: https://review.opendev.org/703882
Change-Id: Idebc87ebb6acad7d0af222fb9025fefcb9bf5a1e
The Glance Registry service has been deprecated upstream and needs to be removed
from the run list here for testing.
Needed-By: https://review.opendev.org/690401
Depends-On: https://review.opendev.org/691732
Change-Id: Ib9ef88684bab8ab5f8919646a88f1b2bee1beadf
Signed-off-by: Lance Albertson <lance@osuosl.org>
This provides a large collection of updates and refactoring to improve
the development environment for the cookbooks using test-kitchen.
The primary change this provides is the addition of the 'minimal' suite
which replicates what the integration test jobs run in Zuul. This is
useful for testing and debugging issues that might be found during CI
jobs.
- Switch run_list to using roles to better match how the zuul jobs work
- Update to using Ubuntu 18.04 instead of 16.04
- Move all attributes from .kitchen.yml files to environments
- Update multi-node and dokken test-kitchen
- Use MariaDB 10.1 by default as 10.0 has been deprecated upstream for
ubuntu 18.04. Also use OSUOSL mirror as it's more stable than
upstream
- Don't disable EPEL on RHEL systems
- Synchronize attributes (within reason) between test-kitchen files
- Update roles run_list
- Create openstack_test cookbook and update /etc/apt/sources.list to
OSUOSL mirrors to improve stability on Ubuntu
Change-Id: Ie6d7b56a78f7fadbd28e6d27a46446a46c3c5ebd
Signed-off-by: Lance Albertson <lance@osuosl.org>
This change:
- pins poise at known stable releases for Kitchen
- removes deprecated build toolchain cookbook dependency
Change-Id: I6c25a071fa6db1b498adb56500ae5456ecf98781
* cloudwatch has been deprecated since Havana, removed in Queens
* chef pinning is relaxed to major versions
* remove dedicated network node for multinode testing
Change-Id: I397bf5e61d13d217206e07351b0dbb91125c3212
- The minimal role contains a subset of allinone for use in integration. This
allows to execute Tempest at the end of the Chef run.
- Being that chef-provisioning-vagrant is no longer working as of ChefDK 2.x,
the provisioning cookbook serves no functional purpose.
Change-Id: I99a6de49640356c98adadf3237dc68383be06bb4
Implements: blueprint modern-chef
Depends-On: https://review.openstack.org/542612
Depends-On: https://review.openstack.org/542613
- Switched default linter to cookstyle
- Renamed rake tasks to conform with Chef conventions
- Added repo, memcached, libvirtd overrides for testing
- Added Python wrapper recipe
Change-Id: I91d380006d8ca8b81a05c629aff444321ada13e7
- Added etcd recipe to allinone and multinode-controller roles
to make an etcd service available as a base service.
Change-Id: Ibc966d8b4848f5829e4cd1706f55a3dde63d6656
Depends-On: Id2f934a9fc408276cb0a25afc2f65ec5f5c54c15
- changed to a more alive fork of statsd, as att-cloud/statsd has been stale
for years
- renamed multi-node to multinode to be consistent with OpenStack
naming conventions
- introduced network node in the multinode scenario
- bumped mysql2 to 0.4.5 to align with upstream
- removed nova cell setup helper since it is no longer needed
Change-Id: If4d4d45981c8895ca57cba9c34fa1eea4b8871e3
Depends-On: I950605f384405b55737af77bc4224f1e18fee8e1
Depends-On: I4c26aea78220eb20fc4e5e964af93414855df5f6
Depends-On: I3112615cec3dd80c63779d164893b4171773856c
Depends-On: I97b453fc419bfbf01679dadf39a256b1f0f99859
Depends-On: Iba9ba7110dfde7635edc6706ecbbafbdbb161002
Depends-On: Ie1d5f27a9cf8803044568a31e4dae7654b02c9a1
Depends-On: I7c2950270f88cc9d54de593460009c6741913796
Depends-On: I16d6f892f325a80eb3eabd10110177246b63663f
Depends-On: Ie61ae3ca685738fe1de98fc9223d3e39535ce000
Depends-On: I63e6680cec8b66e2ece2d2627c0b413f5d401317
Currently integration tests running on Infra instances are failing
because they are hitting the 8GB memory limit. So we remove all but
the most basic services from being deployed, creating effectively a
minimal-in-one setup.
Change-Id: Ica74ed9a79e7aa6800a9b5e874013df99f6654aa
Depends-On: I9e7b24ba40c9f8303eae1325ced1f5a787466888
- Remove old workaround for oslo-privsep
- Set up nova cells
- Add databags for keystone fernet keys
- Drop ceilometer-{api,collector}
Change-Id: I256b9d4294282ede5235d6d86cf14d48667e9430
Depends-On: I8bc2eb5622b14457ef80cb70bf7a1d60c9fe9793
Depends-On: Ib87e9b5142b835c4be5e07b9d53e39b48b6f605e
Depends-On: I28c27caacc09a3e46eca135a6c4f5a841f4715f9
Depends-On: I77ac294fd8e1cd4e6bc39667ddfdea21c4daed8a
The placement_api recipe is being added to the compute cookbook, so we
add an example data bag for it and include the recipe in the allinone
role that is referenced for integration testing.
Change-Id: Ie75d743a94973b2e9a37e1df8e7a0f691d3358f0
Depends-On: I1d1f1cc7046cb30a91894a0c884bc861d7f3dd95
- adds telemetry to allinone role
- add telemetry-related data bag items
- use database as default store until gnocchi packages work on trusty
- add some basic ceilometer api querys to Rakefile
Change-Id: I87ff3df0dc92b9e9f5c7abc06727b53be521d8c7
Depends-On: If513cb2715d8266845bd6541d12005edef70f11c
Depends-On: I432555c558adfd9db07b27acd15365e333a13dc2
* added orchestration recipes to integration test (allinone role)
* added heat queries back to basic_queries in Rakefile (were removed previously
until refactore)
Change-Id: Ic1a1863343be0d0d21b66a804af18c67ee625ee0
Implements: blueprint cookbook-refactoring
Depends-On: I16a29e28068d106f0edcbe04cb529aabbbed1ac5
* recipes in openstack-network should be splittet to allow more modular
setups
* included _bridge_config_example recipe in allinone role
Change-Id: Iac85ee8790f1e43a1c684fbccf0cf22deffc2f30
Depends-On: I6383575862ba110b3f3b5cba227288dc026fce77
* added new test scenarion allione (and all the needed files for it)
* removed old test scenarios aio-nova and aio-neutron as well as multi-neutron
and multi-node and the related files since they will not work with the
refactored cookbooks
* removed databag items for currently untested service cookbooks
* modified Rakefile to use new test scenarios for local and jenkins integration
testing
* adapted README and docs to fit new test setup and explain the new
attributes/template logic (with TODO)
* adapted Berksfile to use the master apache2 cookbook to comply with the
dependencies in identity and dashboard
* removed image_upload recipe since this is already done in the
integration-test::setup one
* moved recipe integration-test to a different chef_run to allow all services to
be restarted in delayed actions of first run before using them
* removed heat from the testing stack until refactored
* removed tempest unit tests 'run_tests.sh' from integration testing scenarion,
since there is no need to run tempests unit tests in our deployment
Depends-On: I0547182085eed91d05384fdd7734408a839a9a2c
Depends-On: I3262b2e6f792f37c32a446e6567790b82bdd4613
Depends-On: I80ed8a7892b59f7fd582505445a31b0df8d68752
Depends-On: Ia7fd927f42f4a1e484e8f2d34c52b1dc6d0ce6dd
Depends-On: Ifd11f86c576d7dbb709bdd302d41e39e900e1b74
Depends-On: Ida408a025f1a3e6a632108a9a32877026e286116
Depends-On: Idadc97bd7380d6c4f9f6f33d9c6b1215a5f24772
Depends-On: I9ac9eeb29ab27f31394830e4b6f999d5870cc0e4
Depends-On: Ifa5a7f4e1df47a3961976e64f654224864c3dcb4
Depends-On: I9cc1b5cc069987ac83e064322c2291772505ff5f
Implements: blueprint cookbook-refactoring
Change-Id: Icf0921229e9473a842d7ce5706027d56229e11d4
Added a list of possible interfaces for which the
vagrant provisioner will choose the first one that
is available. No more editing the test recipes.
Cleaned up the os selection to hide the
version specific stuff to be consistent with the
environment logic.
Fixed up some file modes.
Forced the chef client config directory as it can search
in bad places in some scenarios.
Change-Id: I38a7a86b58893b912af99fabf04ca9052f914346
Keep flushing out our stack by adding heat into the default mix.
I look into adding a simple heat stack integration test with
another patch.
Fix length of heat auth_encryption_key to 32 chars
Depends-On: Ie8d62b449ec272f5cb7a06acdd54b3437aa57f98
Change-Id: I683aafcb060cdcb80ff7ccd025a5bd228c9b41c7
Use the new server-apache recipe as the default in the
identity role.
Change-Id: Ibac938b516383c82c43d49939c6825049e203920
Implements: blueprint keystone-apache
For testing suite it's nice to have all the clients avaiable.
All in one role is updated to include the clients.
For multi, just add to test recipes to allow for flexibility.
Change-Id: I0b25363e35942e90d48bf008a9967bbe9e0fef64
Bug https://bugs.launchpad.net/ubuntu/+source/ironic/+bug/1429962
in ubuntu repo will cause our repo tests to fail.
To allow progress while this gets fixed, pulling bare-metal
conductor from the os-compute-worker role.
The other bare-metal patches for the cookbook should also get in to
allow clean tests to be run.
Change-Id: I936d90a93141402aac0639576da04fd4e2c8752e
Related-Bug: #1429245
The new testing suite is based upon Chef 12, Chef DK and
Chef Provisioning. It supports all in one and multi node
environments. It will be used as the base for future gate
integration testing. There's is more work to as noted in
the TODO list at the botton of the readme.
Note: to get this thru the existing gate, had to keep the existing
Gemfile. Added a Gemfile-Provisioning for new stuff and updated
readme with some notes on that. When we make the switch to kilo
rake gates, we can decide what type of gates the repo needs. I think
it's ready for rubocop at least and maybe continue with something
like spiecweasel to look at the role and environment syntax.
Added draft bootstrap and test default to rubocop to rakefile to
allow for easy integration with new gate rake jobs.
Change-Id: I187df8b78c4cecfb783ab26a6b66b8e8dd6745bd
The stackforge ceph cookbook was replaced by upstream ceph cookbook,
so remove the roles defined in stackforge ceph cookbook and replace
with upstream ceph cookbook in Berksfile.
Change-Id: I2d12cb6c2c480a37ee1cfeaf5b76f068b6781160
Partial-Bug: #1409943
test-kitchen/chef-zero does not like ruby roles. Converting them to json
makes test-kitchen happy, and doesn't really hurt anything/anyone else.
Change-Id: Id716c5459103ce340dae4ddef05e16c1a37374fd
This patch adds an all-in-one os-telemetry role with all telemetry
service roles, like we have for all other projects.
Change-Id: Ia72d950b5765ba96cf312e888b5f4cc76093766c
Closes-Bug: #1312324
Ghanshyam Mann