Upstream will remove enable_notifications parameter [1],
we need to use notification_driver parameter now.
[1] https://review.openstack.org/#/c/444051/
Change-Id: I95fbb5f104b3d550a87aaaad51418c918fe70c79
We misconfigured local cache for services with change
https://review.openstack.org/#/q/Id1034e22d79c3ea6b25575d9bcf8e8750a02365d
Thus, it becomes extremely slow when a controller is down.
With this commit we revert things back to normal with local memcached
for all openstack services leaving keystone memcached shared for tokens
(this was thoroughly tested previously)
Change-Id: I8f6bbf77d27f3d8976985241deb8a948984862f5
Closes-bug: #1657727
* reduce workers_max default limits of a 16 to the $::os_workers, which is limited by [2, 8] interval.
* reduce workers/pool size/overflow limited by F($::processorcount) to F($::os_workers)
Closes-bug: 1629238
Change-Id: I5cc4d70b902eeaa1c9cf42911606eba13dd84aa2
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
This option is going to be totally removed in puppet-upstream, so
we need to remove it as well. It was deprecated in Newton cycle.
Closes-Bug: #1628509
Change-Id: I39d4716e91944436d0eb017ffb02e14cfdec4e2e
This patch removes creation of sahara templates during Sahara
installation, as it doesn't have any end-user benefits.
Also Sahara templates relies that all Nova flavor already created,
but since I80b63ce1ebca01be61ac0f43d26a2992ecf16678 Nova flavors
will not be automatically created.
Change-Id: Ic32f8f1a9112804bfbf847855e13510e504cc6b5
Closes-bug: #1603939
This patch switches using of our custom providers for managing
sahara templates to upstream puppet-sahara providers.
Closes-bug: #1603939
Change-Id: I444b61bbdda6af2b535a25fffd26b7d7067cb643
This change updates where we calculate the memcache server information
to the globals hiera data and updates all the openstack services to
use the heira memcached_servers key for consistency. Additionally all
api services have been updated to configure the memcached servers for
the keystone_authtoken middleware configuration to improve the
responsiveness of the service.
Change-Id: Id1034e22d79c3ea6b25575d9bcf8e8750a02365d
Closes-Bug: #1597512
nova-network is deprcated since 7.0, so we need
to delete all nova-network related manifests.
Change-Id: I3b1016547de224bbe42b41d946be58ffec5b283f
Closes-Bug: #1590367
DocImpact
* RUN annotation caused duplication for tasks in the old folder
* RUN should only be used if you need non-standard run configuration
* With ROLE annotation there's no need to update all the tests
when you add new astute.yaml fixture for existing role
* Fix manifest variable in broken tests
Change-Id: I7a1c98bdb51590d8d80cee387de35d5581cf1da2
Partial-bug: #1535339
- Update yaml-to-rspec assignments to match with a new set of
fixtures
- Fix errors in rspec tests to make the work properly with up to
date fixtures
Integration tests are disabled because this patch affects noop
rspec tests only.
Fuel-CI: disable
Partial-bug: #1535339
Change-Id: I02a289d2d206a1f4ac3c829503bbae582717cae1
In Mitaka Sahara Dashboard was moved from Horizon and now it is
separated plugin for openstack dashboard
Change-Id: I9b9275c186db9af2fa8c7467e4f7208c5369e9e0
Closes-bug: #1558021
Use custom mappings (#RUN notation) of noop fixtures
for noop integration tests.
Iteration 2: recover mappings as it before the regression
and map all for the tasks w/o mappings.
Closes-bug: #1561890
Change-Id: I6ca3363ea4b2fae1ec73d61122caef6764ba79d1
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
Add posibility to set kombu_compression in OpenStack config files.
This option is disabled by default but its value can be overridden
from hiera. Also some checks were added to prevent from duplication
errors which can come from puppet-openstack patches similar to
https://review.openstack.org/#/c/292309/
Closes-bug: #1546554
Change-Id: I1a835f97c23073d3a450dd58decee2876bee53c9
Refactor osnailyfacter/modular/sahara to be compatible with Puppet Master
Blueprint: fuel-refactor-osnailyfacter-for-puppet-master-compatibility
Change-Id: I9bd3ace37838a1c34cbdc4313f40c6d1a9ffd7a6
hiera deep hash lookup fails if one yaml contains 'key_hash'
and the other is just 'key'. This is fixed by writing keys
without the suffix '_hash'.
Added _hash to some variables where it was inconsistent
among top level modules.
Change-Id: I48ec5711a507115d8b7cc167ae881cac4637622f
Closes-Bug: #1542307
* Use external noop tests library and fixtures
* Corrections and fixes for the spec library to make it work
Partial blueprint: deployment-data-dryrun
Fuel-CI: disable
Change-Id: Ie8d1f80bbee04b9bacb43ba4fa39a423624a8301
* Package-name is no longer needed, because api service is
provided by it's own package.
* Added noop
Change-Id: I6ff151bf06285c6355b38e4b15915e769c547813
Related-Blueprint: granular-task-idempotency
This commit introduces a couple of classes and a function
to allow a user to specify for which load balancing checkers
to wait.
Change-Id: I9548ae440111fb0c2356ccb897318d30a8e264ff
Related-bug: #1533279
This change leverages the os_database_connection function from
openstacklib to generate the connection strings for our services. As
part of this change, we are moving the database connection string
generation to the osnailyfacter modular tasks and updating the
openstack classes to consume a connection string rather than the
seperate host, user, password, database name and database type.
Additionally as part of this change, we are updating the mysql
connection strings to only include read_time=60 if debian based packages
are used. This is due to the fact that python-pymysql, which is used by
Ubuntu packages, does not support the read_timeout option as part of the
connection string.
Change-Id: I45c51a05ba7cf9648b0202cc3c2216d185bd7eda
Closes-Bug: #1526938
Related-Blueprint: deploy-with-uca-packages
Add new hiera configuration key 'external_lb'. If it's set to
true then we should not configure Haproxy LB on controllers and
also we should switch 'haproxy_backend_status' to 'http' provider.
We calculate 'external_lb' during 'globals.pp' task - if we have
no VIPs with 'haproxy' namespace, then it's set to 'true'.
It does not change the default deployment scheme.
Also fixing minor issue with default provider for
'haproxy_backend_status' type.
Closes-bug: #1522749
Change-Id: I5539d04d577465bd410494a6c0b7caff18857878
Since I8b51651adc2634544f510de8838ebaabcd1e7d43 we no longer have
'node_role' key in Hiera. So we should fix all rspec tests that
are using this key.
Change-Id: I1e22e9c94f834563df5b6d7192b690aed7db6dd6
Closes-bug: #1529888
We should run db sync only on primary controllers. Currently
upstream modules have posibility to specify should we run
db sync or don't.
Change-Id: If061c0f1b2706ec4fd88966b8620e5586d98b0b8
Closes-bug: #1330875
Default name for internal Neutron network was changed to 'admin_internal_net',
hence we need also update default for Sahara templates.
Change-Id: I4bcd8156494859a57e207ccedb0e9e562f8e5974
Closes-bug: #1520574
We should have oslo.messaging debug enabled
when OpenStack log debug is set to true.
Make default_log_levels configurable through globals.yaml.
NOTE: sahara::logging class can't be used because of
https://github.com/openstack/puppet-sahara/blob/master/manifests/init.pp#L371
It leads to duplicate declaration of this class. That's why
default_log_levels parameter for sahara::logging is configured
through globals.yaml. After new puppet modules sync with upstream
we will get the same problem for another openstack components.
It will be fixed in the way as it's done for sahara now.
Closes-bug: #1509090
Change-Id: Ia8665eaf526158760a5420e7813c7367cc457c0c
Specify db parameters for Sahara to avoid occasional errors during
cluster spawning.
Change-Id: Ib62dea8654878af2645f08508918bb877f8e6e15
Closes-bug: #1497365
* Refactor old noop tests to support flexible network data
* Repair puppet function helper
* Script to remove old external modules before updating them
* network_config_prepared function to check if network
scheme is already loaded
Change-Id: Ie2e7e2a8a7fbfa32a4172e018acba6e955973425
Closes-Bug: 1486048
Fuel-CI: disable
We need to specify location of ca certificate file, because of
authentication error, during working Sahara with SwiftFS.
Change-Id: I69aca6ed07db2352f43efeee8108c2db9e22f24d
Related-bug: #1487912
* Get rid of old variables in all tasks except globals task:
internal_int
public_int
internal_address
internal_netmask
public_address
public_netmask
storage_address
storage_netmask
* Add comments to globals task about depreciation
Change-Id: I6b0a5d20fe7cd5b718e99d21e3c3ef67a5c71e3d
Closes-bug: #1484199
Switch Sahara to direct provisioning according to mail thread in mos-dev
with topic '[sahara] Sahara continues to use Direct provisioning engine in MOS 7.0'
Change-Id: I740466d183d457d75c204b28f2bef3a75ddf8c98
Related-bug: #1483833
Related-bug: #1483841
Related-bug: #1475274
Related-bug: #1439675
- disable use_stderr option for all components because upstart adds to logs
all output from stderr output of its jobs
- add upstart logs to common fuel logrotate configuration file
- add noop tests
Change-Id: Ifefec5e4c8e3438229018edc7c1aaa53a3a779bd
Upstream patches: https://review.openstack.org/#/q/topic:bug/1482564,n,z
Closes-bug: #1469176
During creating Sahara templates both Keystone backends may be
unnavailable and we need add dependency on both backends.
Additional commit for Idf07556d229d7c656106ac749053bd474e5d5a47
Change-Id: I20d96feadc5efebddf758ff9370c8ec4941eb9e7
Closes-bug: #1479782
During creating Sahara templates Keystone backend may be
unnavailable and it raises errors.
Change-Id: Idf07556d229d7c656106ac749053bd474e5d5a47
Closes-bug: #1479782
Sahara public endpoint should use public ssl hostname instead ip
address. Also auth_uri should use admin url.
Closes-bug: #1479261
Change-Id: I2ac6c29650ca5433fe23b004afa39c7642a122fa
We can run noop tests via 'rake spec'. This will allow us to:
- Make sure that catalog compiles and there are no dependency
cycles in the graph.
- Use RSpec tests to check that needed puppet resources present
in the catalog for specific astute.yaml configuration.
In order to test just execute these commands:
export WORKSPACE=/tmp/fuel_noop_tests
mkdir -p $WORKSPACE
./utils/jenkins/fuel_noop_tests.sh
It iterates over astsute.yaml files and runs rspec tests for puppet
tasks configured in the astute.yaml for the node.
In order to run specific test and/or specific astute.yaml, you can
set appropriate env variables. For example:
export NOOP_TEST="keystone/*"
export NOOP_YAMLS="tests/noop/astute.yaml/novanet_flat.primary-controller.yaml"
./utils/jenkins/fuel_noop_tests.sh
If you also want to store puppet logs in case of errors, please set
PUPPET_LOGS_DIR env variable:
export PUPPET_LOGS_DIR=/tmp/puppet_error_logs
If you want to store all the delcarated File and Package resources,
please set NOOP_SAVE_RESOURCES_DIR env variable:
export NOOP_SAVE_RESOURCES_DIR=/tmp/puppet_resources
Related-bug: #1402738
Implement blueprint deployment-dryrun
Fuel CI temporarily disabled since this change does not affect
MOS deplyoment process, only CI itself.
Fuel-CI: disable
Change-Id: I38b23832d1e8701440aacb300256f513c466c762
Andreas Jaeger