Commit Graph

30 Commits

Author SHA1 Message Date
Andreas Jaeger ae84af7fb4 Retire repository
Fuel repositories are all retired in openstack namespace, retire
remaining fuel repos in x namespace since they are unused now.

This change removes all content from the repository and adds the usual
README file to point out that the repository is retired following the
process from
https://docs.openstack.org/infra/manual/drivers.html#retiring-a-project

See also
http://lists.openstack.org/pipermail/openstack-discuss/2019-December/011675.html

A related change is: https://review.opendev.org/699752 .

Change-Id: Ic1a73a0127e813fa5907e0639c47e61b1326add2
2019-12-18 19:36:10 +01:00
Swann Croiset efc75f5302 Create ES templates earlier
The LMA collectors can push logs before the creation of index template
which leads to have the first index with a wrong number_of_replicas and
wrong field indexation settings.

Closes-Bug: #1632590
Change-Id: Id166f6e0aea67b60c5c38cc6a4a69ece4928634e
2016-10-12 10:45:35 +02:00
Roman Babyuk 46bada8ee6 Add support for dynamic scripting
This change is required for the Telemetry plugin that leverages dynamic
scripting.

Change-Id: I330cd17fbd5867b3e3180b4ac6dbfe79dde50f43
2016-09-23 14:37:54 +00:00
Guillaume Thouvenin db94ccbc8c Fix a cycle in graph of tasks
This patch removes a dependency that causes a cycle in the graph of
tasks in MOS 8. The cycle was <custom>-netconfig -> hosts -> cluster ->
virtual_ips -> <custom>-netconfig.

We cannot remove hosts.pp as we tried previously because doing this also
remove a dependency between globals and hosts. So we create the
following dependency: tools -> <custom>-netconfig -> hosts
in place of the former: tools -> netconfig -> hosts

Change-Id: I9a2ec06e3f61942ad33b9a32d9a6034602a51abd
Partial-Bug: #1616391
2016-09-16 08:21:38 +00:00
Swann Croiset 6ca1b2709d Revert "Fix a cycle in graph of tasks"
This reverts commit f581e0e0a9.

Change-Id: I0f0e0e57fa30b1688090bfdefb750ed0c2922881
2016-08-16 07:24:12 +00:00
Guillaume Thouvenin f581e0e0a9 Fix a cycle in graph of tasks
This patch removes a dependency that causes a cycle in the graph of
tasks in MOS 8.
The cycle was <custom>-netconfig -> hosts -> cluster -> virtual_ips ->
<custom>-netconfig

Change-Id: I80f88ebec732c2e95bfa5c271ffb9c35ad0a1827
2016-08-11 17:11:13 +02:00
Simon Pasquier e0130a81d5 Configure the network once the vrouter is up
This change makes sure that the virtual router on the management
network is up and running before configuring the network.

Change-Id: I30063d09d1f7f4e8c5b75beb4d901e174a76f7f1
Closes-Bug: #1583994
2016-08-01 16:25:44 +02:00
Simon Pasquier 9518c68d6d Configure the NTP service
Change-Id: I6397caada2f827d03f2b1f2e2030094b3745eb73
Closes-Bug: #1606919
2016-07-29 14:16:41 +00:00
Simon Pasquier ec96ad2798 Configure the DNS resolver
Change-Id: I3894b46ce4aad55d6bec7b65fa051670b7717c2d
Closes-Bug: #1606736
2016-07-29 08:53:21 +00:00
Simon Pasquier a9059a0f90 Configure the management gateway on the nodes
Without this change, the nodes are configured to use the Fuel node as
their default gateway. Note that the code path is different between MOS
8 and MOS 9 because of this bug fix [1] that hasn't been backported on
MOS 8.

[1] https://bugs.launchpad.net/fuel/+bug/1541309

Change-Id: I80a2fadf8b16b139d07c48a33c52efd33c66935f
Closes-Bug: #1583994
2016-07-29 08:53:10 +00:00
Swann Croiset b77f167342 Fix the deployment order to support MOS 8
Closes-bug: #1599554

Change-Id: Id8b73d15e0ca4fbec63e9bc9049d7206f8ae850b
2016-07-07 12:29:30 +00:00
Guillaume Thouvenin 15d65ae5b7 Enable secure communication over HTTPS for Kibana
This patch configures HAProxy to terminate SSL connection when the
support for SSL/TLS is enabled in StackLight.

DocImpact Add support for TLS
Change-Id: Icdff278875d7daf928fa036ec1e4905205791546
Implements: blueprint support-secure-communication
2016-06-22 10:35:53 +02:00
Swann Croiset 0c696459c9 Upgrade to Kibana 4.5.1 / Elasticsearch 2.3.3
DocImpact Kibana Screenshot and ES upgrade

Fixes-bug: #1545739

Change-Id: I068ec6e6981b9b7729d0041be65760206790f615
2016-06-09 09:48:56 +02:00
Swann Croiset 7337be0933 Adjust task dependencies
Without explicit dependencies, the check_environment_configuration.pp
is executed too late:

...
MODULAR: netconfig/netconfig.pp
fuel-plugin-elasticsearch-kibana: firewall.pp
fuel-plugin-elasticsearch-kibana: cluster.pp
MODULAR: virtual_ips/virtual_ips.pp
MODULAR: virtual_ips/virtual_ips.pp
fuel-plugin-elasticsearch-kibana: cluster-haproxy.pp
fuel-plugin-elasticsearch-kibana: haproxy.pp
fuel-plugin-elasticsearch-kibana: elasticsearch.pp
fuel-plugin-elasticsearch-kibana: check_environment_configuration.pp
...

Change-Id: I5e4381a28add6a21f140e3e201d9a1045a2b365a
2016-05-31 09:28:19 +00:00
Simon Pasquier 9a89537728 Change anchor task to upload_nodes_info
Change-Id: I042cd785a97a9ad2009030e62548c1f042fed178
2016-05-13 14:39:07 +02:00
Simon Pasquier 220046aa12 Fix tasks dependency when using remote backends
Previously the LMA collector had an explicit dependency on the last
Elasticsearch task but this doesn't work when the Elasticsearch/Kibana
plugin isn't deployed in the same environment as the collector plugin.

This change makes sure that the LMA collector plugin's tasks will only
be executed once the Elasticsearch cluster is fully functional by
pinning both plugins to a well-known task (update_hosts in that case).

Partial-Bug: #1573087
Change-Id: I5bbc444eb51da4787b5be5cbe3aa0284ce6e1753
2016-05-11 09:51:19 +00:00
Guillaume Thouvenin aa6137d3c2 Update to task based deployment
MOS 9 comes with a new orchestration engine (so-called v2 or task-based
deployement) which reduces greatly the time necessary to deploy new
environments.

This change adds version to the deployment tasks to be fully compatible
with the v2 engine.

Change-Id: Iea7528712b65ce1430c1d8bcb8386908f485a757
2016-04-14 12:27:19 +00:00
Guillaume Thouvenin f16da6b938 Remove dependency on cluster-haproxy.pp from osnailyfacter
This patch adds a new manifest to replace the one that is used from
osnailyfacter. We cannot use the manifest provided by fuel-library
because it has been rewritten and it is not compatible with our
deployment because it requires specific VIP that are tied to the
management and public VIP addresses of the controllers.

Partial-Bug: #1554521
Change-Id: I2e70a19bc1699c61c9fa130e2f4a852e545b1060
2016-04-11 10:07:18 +02:00
Guillaume Thouvenin 069112a6f2 Fix path for virtual_ips.pp
Change-Id: I14626b0164df6bb7cc6b5a7f51a2250da71e80ec
Closes-Bug: #1556639
2016-03-14 14:31:31 +01:00
Simon Pasquier 61ba49e133 Leverage the local fuel-library modules
This change drops the download of the fuel-library Puppet modules into
the plugin package. Instead the Puppet tasks look for Puppet modules
first in the plugin's path and alternatively in the default
/etc/puppet/module path.

Change-Id: Icf49b48462956fbb57c087e133336738cda70d68
2016-03-09 16:27:43 +01:00
Swann Croiset b3795fdd93 Provision services at post_deployment stage
Fixes-bug: #1542300
Fixes-bug: #1540951

Change-Id: I9566b638b1636ce50b2fbc5733e1698807b71c22
2016-02-09 11:46:38 +01:00
Jenkins af0276ea5b Merge "Re-execute necessary tasks on the deployed nodes" 2016-01-28 10:52:02 +00:00
Simon Pasquier 835eddf24e Re-execute necessary tasks on the deployed nodes
This change makes sure that Pacemaker and HAProxy are reconfigured
on the nodes that are already deployed when the environment is scaled
up. We use the 'update_required' stanza to enforce that the nodes
already deployed are updated in the same run than the new nodes. The
'reexecute_on' stanza doesn't guarantee that.

Change-Id: Id39a6246ee96a693c39898b84092710eb8a97536
Closes-Bug: #1536533
2016-01-25 16:38:54 +01:00
Swann Croiset 9b93b1c131 Configure repositories by specific task
Introduced by I1b83e3bfaebecdb8455d5697e320f24fb4941536
See http://lists.openstack.org/pipermail/openstack-dev/2016-January/084552.html

Change-Id: I8c846c95e80696cce7f0ccb7c1e9d513e562d647
2016-01-21 09:44:42 +01:00
Swann Croiset 3edcf9b670 Set appropriately the Pacemaker option no-quorum-policy
When the cluster does not have quorum (less than 3 Elasticsearch nodes) the
'no-quorum policiy' is set to 'ignore', which allows to continue all resource
management.
If the cluster have quorum (more that 2 nodes), the policy is set to 'stop',
which stops all resources in the affected cluster partition if the cluster
loses quorum to avoid data corruption.

http://clusterlabs.org/doc/en-US/Pacemaker/1.0/html/Pacemaker_Explained/s-cluster-options.html

Change-Id: I3b1ad071e4bf31581f245bbd8de863e6266ffb5b
2016-01-18 09:37:10 +01:00
Swann Croiset f0cebee783 Re-execute cluster configuration on redeployment
This change upgrades the package version to 4.0.0 to use the reexecute_on
option.
All tasks defined in tasks.yaml are moved in deployment_tasks.yaml
to leverage this new feature.
The deployment order with 'priority' cannot be set but the only
requirement this plugin has is to be deployed before lma_collector,
which is always the case as long as lma_collector is deployed at
post_deployment time.

Change-Id: I08259f1646122aed0674610ddaf7a327d31b9a1a
2016-01-18 09:30:00 +01:00
Swann Croiset ab90489df0 Improve cluster deployment
- Add firewall rules for corosync communication
- Use dedicated cluster.pp manifest to allow the deployment of coexistant
  clusters for LMA plugins
- Use primary role property

Implements: blueprint elasticsearch-clustering

Change-Id: Ibf4c1c4e62f214725875869621b40a3ef4c20e53
2016-01-08 11:32:57 +01:00
Swann Croiset 11f4138051 Configure HAProxy for Elasticsearch and Kibana
Change-Id: Ib6176f6ec851f3fcb647faf9d4649f83d7acaffe
2015-12-22 19:55:48 +01:00
Swann Croiset 125a0ad602 Deploy Elasticsearch cluster
Configure a VIP and Corosync/Pacemaker cluster. The plugin must override
Hiera data to set explicitly the corosync node list.

Configure Elasticsearch instances with parameters:

* cluster.name
* unicast discovery

Add firewall rule to allow clustering traffic.

Implements: elasticsearch-clustering

Change-Id: I0636e02113bfdacc776beb20c08cc88308486c29
2015-12-22 19:55:43 +01:00
Swann Croiset fe2e8948af Switch to custom role elasticsearch_kibana
- Use plugin version 3.0.0 and remove compatibility with MOS 6.1
- Leverage common tasks to configure disk and network
- Update README

Change-Id: I7f185de0cfbe3098c9fee2d0f7a792df5b0a95e0
2015-09-09 09:31:07 +02:00