Commit Graph

38 Commits

Author SHA1 Message Date
Dmitriy Rabotyagov e6683eac63 Deprecate os_congress role
Since congress service is no longer maintained since [1], we have no
reason to continue maintenance of the corresponding role

[1] https://review.opendev.org/721733

Depends-On: https://review.opendev.org/742515
Change-Id: I8337db363aa954e615b83f595e1c51987bc90368
2020-07-22 20:18:29 +00:00
Dmitriy Rabotyagov 3e5ffd343e Cleanup after repo_build and pip_install retirement
Change-Id: Idb9c95d9cf8e9b27f432db05f45ac74db173519d
2020-05-12 21:40:45 +03:00
Dmitriy Rabotyagov f5d205732f Replace git.openstack.org with opendev.org
This patch replaces git.openstack.org with opendev.org as redirection
from old path was enabled.
Also we change upper constraints url due to [1]

[1] http://lists.openstack.org/pipermail/openstack-discuss/2019-May/006478.html

Depends-On: https://review.opendev.org/693841/
Change-Id: Id889780e071b3a4cdd6a6ec95f8aa46347e23a4f
2019-11-14 16:58:16 +00:00
Zuul eff97d0113 Merge "Add global override for service bind address" 2019-10-08 14:46:00 +00:00
Jonathan Rosser 6e9309fa0f Add global override for service bind address
Change-Id: Iaba4da4f720be9a463688df4791e4b8490b9d0a8
2019-09-19 10:31:51 +01:00
Jonathan Rosser 2edaf9f06e Allow venv python interpreter to be overridden
Change-Id: I413821cbfd10686ddce8d64d156590de5dff2305
2019-09-11 17:49:30 +01:00
Jesse Pretorius 2d81c4c7bb Update the congress service egg name to openstack_congress
In https://review.openstack.org/608332 the dist name was changed
from 'congress' to 'openstack-congress'. The egg name needs to be
updated or the package will fail to install or be usable.

Depends-On: https://review.openstack.org/648122
Change-Id: If597b15bb8275dab0f4e627267964435585db896
2019-03-27 13:33:30 +00:00
Mohammed Naser fc3fac1e5c Update role for new source build process
The variables barbican_developer_mode and barbican_venv_download
no longer carry any meaning. This review changes glance to
do the equivalent of what developer_mode was all the time,
meaning that it always builds the venv and never requires
the repo server, but it will use a repo server when available.

As part of this, we move the source build out of its own file
because it's now a single task to include the venv build role.
This is just to make it easier to follow the code.

Change-Id: Iab0b3b551aedfbe45016d9e3b0f860a8f783cdce
2019-03-26 17:59:10 -04:00
Jesse Pretorius 455c2b4433 Enable overriding the service setup host python interpreter
In order to enable the service setup host python interpreter to
be changed easily, we make it a variable. This will be useful
when someone sets the service setup host to be the utility
container, because we'll be able to set this var by default.

Change-Id: Id8c2dfe7f3f82e0945d1b4b0027911a692cf1e8b
2018-11-30 15:55:14 +00:00
Jesse Pretorius 504efcbf2b Use a common python build/install role
In order to radically simplify how we prepare the service
venvs, we use a common role to do the wheel builds and the
venv preparation. This makes the process far simpler to
understand, because the role does its own building and
installing. It also reduces the code maintenance burden,
because instead of duplicating the build processes in the
repo_build role and the service role - we only have it all
done in a single place.

We also change the role venv tag var to use the integrated
build's common venv tag so that we can remove the role's
venv tag in group_vars in the integrated build. This reduces
memory consumption and also reduces the duplication.

This is by no means the final stop in the simplification
process, but it is a step forward. The will be work to follow
which:

1. Replaces 'developer mode' with an equivalent mechanism
   that uses the common role and is simpler to understand.
   We will also simplify the provisioning of pip install
   arguments when doing this.
2. Simplifies the installation of optional pip packages.
   Right now it's more complicated than it needs to be due
   to us needing to keep the py_pkgs plugin working in the
   integrated build.

Depends-On: https://review.openstack.org/598957
Change-Id: I4cfe846f9abec47d992faf0c1335a8787c6ca0c4
Implements: blueprint python-build-install-simplification
Signed-off-by: Jesse Pretorius <jesse.pretorius@rackspace.co.uk>
2018-09-03 11:59:07 +00:00
Zuul 76bb5307b7 Merge "Convert role to use a common systemd service role" 2018-08-01 02:42:53 +00:00
Kevin Carter feef273d71
Convert role to use a common systemd service role
This removes the systemd service templates and tasks from this role and
leverages a common systemd service role instead. This change removes a
lot of code duplication across all roles all without sacrificing features
or functionality. The intention of this change is to ensure uniformity and
reduce the maintenance burden on the community when sweeping changes are
needed.

The systemd journal would normally be populated with the standard out of
a service however with the use of uwsgi this is not actually happening
resulting in us only capturing the logs from the uwsgi process instead
of the service itself. This change implements journal logging in the
service config, which is part of OSLO logging.

OSLO logging docs found here: <https://docs.openstack.org/oslo.log/3.28.1/journal.html>

Change-Id: I83d31e3268e34d048aa6632c7999771d49f637a1
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2018-07-31 14:42:30 -05:00
Jesse Pretorius 341ad85ea0 Move MQ vhost/user creation into role
There is no record for why we implement the MQ vhost/user creation
outside of the role in the playbook, when we could do it inside the
role.

Implementing it inside the role allows us to reduce the quantity of
group_vars duplicated from the role, and allows us to better document
the required variables in the role. The delegation can still be done
as it is done in the playbook too.

In this patch we implement two new variables:
- congress_oslomsg_rpc_setup_host
- congress_oslomsg_notify_setup_host

These are used in the role to allow delegation of the MQ vhost/user
setup for each type to any host, but they default to using the first
member of the applicable oslomsg host group.

We also adjust some of the defaults to automatically inherit existing
vars set in group_vars form the integrated build so that we do not
need to do the wiring in the integrated build's group vars. We still
default them in the role too for independent role usage.

Finally, we remove the test mq setup tasks and clean up any unused
or unnecessary variables configured in tests.

Change-Id: I97770819e9421ed27575f3fe181b4420742b0820
2018-07-27 11:44:38 +00:00
Andy Smith 28b50f04e3 Update to use oslo.messaging service for RPC and Notify
This introduces oslo.messaging variables that define the RPC and
Notify transports for the OpenStack services. These parameters replace
the rabbitmq values and are used to generate the messaging
transport_url for the service.

This patch:
* Add oslo.messaging variables for RPC and Notify to defaults
* Add transport_url generation to conf
* Add oslo.messaging to tests inventory and update tests
* Install extra packages for optional drivers

Change-Id: I96d43d5ff04254352980a2c0ba40ed7bb2e9f234
2018-07-26 09:40:24 +00:00
Jesse Pretorius b335e3c672 Execute service setup against a delegated host using Ansible built-in modules
In order to reduce the packages required to pip install on to the hosts,
we allow the service setup to be delegated to a specific host, defaulting
to the deploy host. We also switch as many tasks as possible to using the
built-in Ansible modules which make use of the shade library.

The 'virtualenv' package is now installed appropriately by the openstack_hosts
role, so there's no need to install it any more. The 'httplib2' package is a
legacy Ansible requirement for the get_url/get_uri module which is no longer
needed. The keystone client library is not required any more now that we're
using the upstream modules. As there are no required packages left, the task
to install them is also removed.

With the dependent patches, the openstack_openrc role is now executed once
on the designated host, so it is no longer required as a meta-dependency for
the role.

Depends-On: https://review.openstack.org/579233
Depends-On: https://review.openstack.org/579959
Change-Id: Ie32143ba23b964f9ceda98f00ff9cfa1c7a131d6
2018-07-06 13:49:37 +00:00
Jesse Pretorius 2b4f3a4f0c Move database creation into role
There is no record for why we implement the database creation outside
of the role in the playbook, when we could do it inside the role.

Implementing it inside the role allows us to reduce the quantity of
group_vars duplicated from the role, and allows us to better document
the required variables in the role. The delegation can still be done
as it is done in the playbook too.

In this patch we implement a new variable called 'congress_db_setup_host'
which is used in the role to allow delegation of the database setup
task to any host, but defaults to the first member of the galera_all
host group. We also document the variable 'congress_galera_address' which
has been used for a long time, but never documented. A bunch of unused
variables have also been removed.

Change-Id: Id22bb9c3c3146aee6ccd7462c4a52b0be718ad55
2018-06-28 14:35:27 +01:00
Kevin Carter 980a3fe378
Add packages required for osprofiler
The following packages are required in-order to run osprofiler.
these packages will provide deployers the ability to profile
a service on demand should they choose to enable the profile
functionality.

Change-Id: I351b2ae03b90397e46d46ef80007b02106e9bb96
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2018-06-11 22:57:38 -05:00
Jean-Philippe Evrard 39477ea148 Introduce os_congress role in gerrit
This commit makes possible to contribute to the os_congress role.
It ensures the roles follows the minimum testing, in order to
be improved later with further testing.

The minimum testing is a local API test that's currently not
passing and will be improved by the community.

Co-Authored-By: Taseer Ahmed <taseer94@gmail.com>
Co-Authored-By: Jesse Pretorius <jesse.pretorius@rackspace.co.uk>
Change-Id: Iffe98a040b93b1101fe3339edc84d6197e5a5da7
2018-02-14 10:17:23 +05:00
Taseer Ahmed e2b794a7d9 point congress_conf_dir to /etc/congress
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-10-13 12:57:38 +05:00
Taseer Ahmed c88c62db72 Add congress installation, db setup
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-10-06 21:18:26 +05:00
Taseer Ahmed 1aaf37c68b Redefine variables and endpoint
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-10-06 13:14:39 +05:00
Taseer Ahmed 9d92504044 add congress service port
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-10-05 16:59:12 +05:00
Taseer Ahmed 4d05b16017 Add more variables
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-10-05 10:02:41 +05:00
Taseer Ahmed 803a222155 Correct congress service type
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-10-05 07:49:09 +05:00
Taseer Ahmed 834e2b9d5c add python-keystoneclient package.
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-10-04 22:49:38 +05:00
Taseer Ahmed 8fd727ac7b Add congress galera DB credentials
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-10-02 16:34:54 +05:00
Taseer Ahmed f8e76c7a60 Remove pip mysql package
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-09-30 11:41:41 +05:00
Taseer Ahmed 9a9a12643b Remove duplicate vars
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-09-28 13:18:03 +05:00
Taseer Ahmed 863e8f5576 Add the required python-mysql module
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-09-28 12:03:46 +05:00
Taseer Ahmed 46a5e78d3e Add virtual-env tools.
Required package.

Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-09-28 10:42:53 +05:00
Taseer Ahmed 0b0c6726f9 Add the pip constraints
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-09-27 15:35:54 +05:00
Taseer Ahmed b06884fa9c Use the defacto settings
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-09-27 11:19:52 +05:00
Taseer Ahmed 12c37c07da Verify if pip things work
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-09-26 20:06:49 +05:00
Taseer Ahmed e9f69f0310 Add tox requirement
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-09-26 15:29:34 +05:00
Taseer Ahmed a5c895448a Add posts installation tasks, and follow the standard procedure 2017-09-22 12:46:36 +05:00
Taseer Ahmed 69eb16d9ae Follow the general workflow of PIP 2017-09-21 13:26:57 +05:00
Taseer Ahmed f9ee19e3ea Add default vairables 2017-09-20 16:54:14 +05:00
Taseer Ahmed 84048fcc14 Initialize congress role for OSA
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-09-12 15:53:49 +05:00