Commit Graph

19 Commits

Author SHA1 Message Date
Antony Messerli ab4919f656 Correct opendev.org urls
Previous commit had some of the urls incorrect

Change-Id: Ia36831ebe55014a0ca58f448f934382bd2b27e68
2019-07-09 16:02:12 -05:00
melissaml 87cbdd6649 Replace git.openstack.org URLs with opendev.org URLs
Change-Id: I790c1876a3e44da8623c74632332f0e453dce1f6
2019-07-09 16:36:22 +00:00
Kevin Carter 8ee8ec0832 Update grafana, use vendored role, and add es lb
The grafana role will now deploy and setup the grafana datasources using
the API as expected. API users will also be created for admin, viewer, editor.

The es config for grafana has been udpated to correct issues where the system
expected a publically accessible lb to handle grafana traffic back to an es
cluster. When the grafana role deploys the traefik lb will now be used within
the grafana deployment to ensure grafana is able to deploy against an es cluster.

Change-Id: Iae3a5c2ab1b98390110d37f33b074156d32bb684
Signed-off-by: Kevin Carter <kevin@cloudnull.com>
2019-02-18 21:20:15 -06:00
Kevin Carter 78221b17d4
Validate the IP addresses when generating a CNF
Before adding IP addresses to the CNF validate the entry is an IP
address using the `ipaddr` filter.

Change-Id: I9151b8118b92991b394c0fa7d81d407439f0f3c1
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2019-01-25 23:00:01 -06:00
Kevin Carter cfa103dab7 Update delegated setup hosts to support IP delegation
The option `skydive_service_setup_host` allows a user to define a
setup host target which could, or could not, be in the provided
inventory. Additionally a setup target host could also be simply
an IP reference. This change ensures that the playbooks and roles
respect the different setup host delegation node types by creating
in memory host entries and gathering facts on the dynamic
information when the target is not in inventory, is not in the
skydive_all group, or simply an IP.

Change-Id: I532abd7171ba9077759640e4bf18b9b517264426
Signed-off-by: Kevin Carter <kevin@cloudnull.com>
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2019-01-24 05:27:56 +00:00
Kevin Carter abd6661b4e
Update conditionals and namespaced options
This change implements namespaced variables and conditionals in needed
services. This will ensure systems running these playbooks are able to
be deployed in isolation without making osa specific assumptions.

Change-Id: Ia20b8514144f0b0bf925d405f06ef2ddc28f1003
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2019-01-23 09:38:40 -06:00
Zuul 5bddc8b840 Merge "Update skydive to use TLS" 2019-01-21 19:55:39 +00:00
Zuul e7a7eba808 Merge "Allow skydive keystone service setup from an alternate host" 2019-01-21 19:24:49 +00:00
Kevin Carter 6b92dba1d5
Update skydive to use TLS
This change implements TLS configurations for skydive. All servers will
get their own certificates signed by the CA as setup on the
`skydive_service_setup_host` node.

> Documentation for TLS configuration can be found here: http://skydive.network/documentation/

Change-Id: I890b4a5d9076b0474ffe5649f9361cb6018c19fe
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2019-01-21 12:43:02 -06:00
Jonathan Rosser 181edc376f Allow skydive keystone service setup from an alternate host
This patch allows a deployer to override the service setup host
and python interpreter path so that the keystone service setup
can be done on a different host, typically the first utility
container in an openstack-ansible deployment.

Overrides can be provided in an integration inventory and an
example would be:

skydive_service_setup_host: "{{ groups['utility_all'][0] }}"
skydive_service_setup_host_python_interpreter: "/openstack/venvs/utility-{{ openstack_release }}/bin/python"

Change-Id: Id4faf605fd1f0de1262ed48166a8801b7e24a528
2019-01-21 12:10:20 -06:00
Jonathan Rosser 3d16aa15d3 Remove stickiness config from traefik backends
This config line prevents the downloaded binary version
of traefik from starting up, which in turn prevents the skydive
binary from starting up correctly.

Change-Id: Ic07a3c6170ff4e0ad60dbdb860eff0f330b677a1
2019-01-21 16:05:59 +00:00
Jonathan Rosser 506463b241 Disable opencontrail build option for skydive
Skydive fails to compile unless WITH_OPENCONTRAIL=false. This
is a known issue on ubuntu hosts from the upstream project.

Change-Id: Ie6d165eb128fbfa1cece7f031b8a2416339641d5
2019-01-21 14:12:48 +00:00
Kevin Carter c430cf433e Update readme and make commands
The readme was updated for correctness.

The make command when building skydive was changed from "install"
to "static" this was done to assist folks building skydive which
"should" allow it to be redistributable.

Change-Id: I01f8f677f1ccf54d8dd29ac8a2eb60c0206319a0
Signed-off-by: Kevin Carter <kevin@cloudnull.com>
2019-01-19 21:31:02 -06:00
Kevin Carter 1fa93b1d8c Add openstack integration to skydive
This change will enable neutron network awareness and set the
auth-backend to to use keystone when `skydive_openstack_enabled` is
set to true. Options have been added to allow users to customize the
deployment, all of which have been documented in the default/main.yml
file.

Change-Id: Iab958c0631c7c396d218d8fb6302db03e5d9a5a6
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
Signed-off-by: Kevin Carter <kevin@cloudnull.com>
2019-01-18 18:21:50 -06:00
Kevin Carter 271ff6a09c Add project directory to overlay inventories
The use of an overlay inventory has now been added to a stand alone
directory which should help deployers understand how this could work
within their environments. Inventory configuration has been updated to
show this working in the various projects that have tests and could
benefit from an overlay inventory.

Change-Id: I1681fce160b43e9127851f06ae05ff5eaabe852f
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2019-01-16 22:25:11 +00:00
Kevin Carter 892d617dc6
Add a default retention policy for skydive indexes
Given the ops tools now have a skydive deployment capability there needs
curator needs to be able to detect the addition of skydive indexes and
build a curator policy accordingly.

This change adds the new retention policy to the overlay inventory
providing a sane default for most environments.

The retention action files have been updated to remove the "-" as an
index separator. This was done because not all indexes use a dash as a
divider.

Change-Id: I5b61720f27da00e0c3b92341355b09ea6c01caba
2019-01-15 17:35:09 -06:00
Kevin Carter 6c553e1495 README cleanup and additional notes about limits
The readme has had a bit of clean-up and lines have been reflowed.

The templates have ben updated to ensure they work with limits and
notes about using limits have been added to the README.

Change-Id: I8d6f5684e02ba63e93b6993be228c7416a911ef7
Signed-off-by: Kevin Carter <kevin@cloudnull.com>
2019-01-15 09:07:19 -06:00
Kevin Carter 37f24f9e7b Improve the documentation for skydive
The documentation has been added to, which should make the deployment
of skydive easier to understand. Additionally an overlay inventory
and examples have been provided showing how skydive can be deployed
as part of an OSA cloud without having to extend or otherwise modify
the openstack-ansible inventory/configuration.

Change-Id: Iccc0d23fa8a6047d1bcae53614c38e5ea0945f82
Signed-off-by: Kevin Carter <kevin@cloudnull.com>
2019-01-14 23:18:22 -06:00
Kevin Carter b23ec9f8d9 Initial commit to add skydive
This commit adds playbooks and roles to the ops tooling setup to
build, deploy, and operate environments with skydive within in
it.

Skydive is a network analyzer which will allow users to explore
their topology in real-time using a defined storage back-end for
captures, alerts, and more.

The initial implementation of skydive deploys agents throughout
the environment and wires them all back to a cluster of analyzers
which leverage elasticsearch for its persistent storage back-end.
Storage back-ends are load balanced from the within the analyzer
nodes using the traefik light-weight reverse proxy. This setup
gives skydive a fully fault tolerant deployment.

Tests have been added to ensure the binary installation process
is validated. While these jobs are non-voting today, they'll be
iterated on and made passing in the subsequent PRs. All jobs are
following the selective pattern which allows these tools to be
gated in the mono-repo without impacting all other tools within
the environment.

Change-Id: Iaa1152566f2b615d67a33dc94ebdbebb1b492a9d
Signed-off-by: Kevin Carter <kevin@cloudnull.com>
2019-01-14 03:03:08 -06:00