Commit Graph

60 Commits

Author SHA1 Message Date
Michal Nasiadka e221ac8f27 Drop elasticsearch, kibana and logstash
Support has been dropped in kolla-ansible, the upgrade path is opensearch.

Change-Id: I6f32aacb4e0b7dd1eb7206e02425b16f5beae4f0
2022-12-06 15:57:51 +01:00
Radosław Piliszek 2daf4331a6 Fix writable rootwrap/privsep config
Fixes a hypothetical security issue related to privilege escalation via
rootwrap/privsep. A potential vulnerable service could previously allow
writes to its rootwrap/privsep config and thus allow for more commands
to be run with root privileges via rootwrap/privsep. For a succesful
attack, this would also require the service to allow to run arbitrary
commands via rootwrap/privsep. Thus far, no such vulnerabilities have
been reported and thus this fix is simply strengthening the container
images against such an issue in the future.

Change-Id: I92c81c77e6a16570a108cde8031f7977930fb02a
Closes-Bug: #1874298
2022-10-10 15:06:05 +00:00
Marcin Juszkiewicz 878b00013b Move to CentOS Stream 9
OpenStack 'zed' requires Python 3.8+ so RHEL 8 family has to go.

This changeset moves to CentOS Stream 9 while move to RockyLinux 9 is
planned as final solution.

CI moved to CentOS Stream 9 nodes.

Depends-on: https://review.opendev.org/c/openstack/kolla-ansible/+/839715

Change-Id: I113b9984294cf8663d3fc0c8840320e1d40ea731
2022-09-27 07:40:06 +00:00
Tim Shearer 1d96a2bbe1 Adjust permissions on _extend_start files.
Explicitly set the permissions on the kolla-toolbox kolla_extend_start
file. Also, since all extend_start files are sourced rather than
executed, the executable bits are now cleared throughout the project.

Change-Id: I5c2deb4a2e33575d57c852089f856a9acc6818d0
2022-04-11 17:22:24 +02:00
Marcin Juszkiewicz 941d021e09 collectd: pcie-errors is x86-64 only now
Change-Id: Iad7e7ebb1fbf4d14f20960d6257345db71d0e214
2022-02-04 20:39:17 +00:00
Michal Nasiadka 405fca90f2 Remove missing collectd packages
Since CentOS Linux 8 repository retirement from
CentOS mirrors - we need to use CentOS Stream 8
version of Opstools repo.

Listed below packages are missing from the repo,
and according to the maintainer dpdk_telemetry is
not going to show up at all (it's basically dead).

The rest of the packages might show up at a later
stage - but it's not a priority for the maintainer.

- collectd-dpdk_telemetry
- collectd-libpod-stats
- collectd-sensubility
- python3-sqlalchemy-collectd

Change-Id: I5f446fc276e245c1e6974ceeb6ff3dccd84ee502
2022-02-03 15:13:59 +00:00
Marcin Juszkiewicz 0506ede84f Drop ppc64le support
We do not test support for ppc64le on CI or other systems.

In previous cycles it was used by TripleO and now they have own way.

Change-Id: Ibd955869a6f9485dfa4d08a8ad2f4b28b7d59c15
2021-05-11 12:45:16 +02:00
pleimer 094a49d41d Add collectd-libpod-stats to image
This patch adds the installation of collectd-libpod-stats as part of the
collectd image. The package is available in the centos-opstools repo.

Collectd-libpod-stats monitors resource usage of running containers on a
host, specifically those managed by the libpod library.

Upstream: https://github.com/pleimer/collectd-libpod-stats

Change-Id: I12efbaae9c0795f29c2f68158127509fd1b543b0
Signed-off-by: pleimer <pfbleimer@gmail.com>
2020-08-05 16:20:33 -04:00
Matthias Runge 8bfa655007 Add collectd-amqp to the collectd image
This allows to write collected data via amqp.

Change-Id: Ieb88fd60d177f19a635ada9366193e57c516f90b
2020-06-18 06:22:58 +00:00
Marcin Juszkiewicz 1dfd937cba CentOS: disable more repos
'messaging-rabbitmq' and 'opstools' are enabled by RDO
delorean-deps.repo file

'influxdb' was also enabled

Depends-On: https://review.opendev.org/728687

Change-Id: Ibb0a7edc9e5632c1b89a7d52601f55a223b49dfb
2020-05-17 11:34:12 +00:00
Radosław Piliszek 6c480c3d89 Cleanup py27 support
Removes and/or replaces all mentions of py27.

Cleans up obsolete requirements and their lower-constraints.

Change-Id: Id43f1bbd6a454832ab8dbf003a058403f6b34b5d
2020-04-17 18:07:29 +02:00
Zuul 2f66efdf5e Merge "Remove support for CentOS 7" 2020-04-15 14:02:57 +00:00
Marcin Juszkiewicz 53443c5c71 Remove support for CentOS 7
With the move to RHEL/CentOS 8 we no longer have Python 2 in our images
so there is no need for checking which Python version (2.x or 3.x) is
used inside of containers.

We also no longer have to support yum as a value for
distro_package_manager.

Partially-Implements: blueprint centos-rhel-8

Change-Id: Ie45cf3465fedddbde7856961527421883ba3d5c9
2020-04-15 09:32:06 +00:00
Zuul cea4bdf0d0 Merge "Add collectd-pmu package for Intel PMU (C8 only)" 2020-04-09 20:38:03 +00:00
Zuul 4ceccfc43e Merge "re-enable collectd-rdt plugin" 2020-04-09 20:38:01 +00:00
Piotr Rabiega 157e0754c8 re-enable collectd-rdt plugin
Change-Id: Id106cb71624e0b0d8393904afd2a62469e6066f1
2020-04-09 12:25:30 +02:00
Piotr Rabiega e2fe8a063a Add collectd-pmu package for Intel PMU (C8 only)
The intel_pmu plugin collects performance counters data
on Intel CPUs using Linux perf interface.

Change-Id: Id1592e20bcc42893a5e9d0dba9f67cf4e896d268
2020-04-09 10:34:46 +02:00
Matthias Runge 2c7835bf24 Exclude pcie_errors on s390x, it fails to build
The collectd pcie-errors plugin fails to build on s390 on
big endian, ppc64le is fine. For those building containers
on s390x, this patch removes a downstream patch.

Change-Id: I71008f690fcb04289451efa819b5e7f6d81cf99f
2020-04-08 16:53:37 +02:00
Piotr Rabiega 36f6e56d66 add dpdk_telemetry and logparser, use centos-release-opstools for C8
Adds collectd-dpdk_telemetry and collectd-logparser packages
to collectd RHEL-based image. dpdk_telemetry plugin collects DPDK
ethernet device metrics via dpdk_telemetry library. Logparser is
plugin for filtering and parsing log messages.

Change-Id: I0c7c94e9fae9d11660f938b8d7d6be0f270c972f
2020-04-03 15:01:17 +02:00
Piotr Rabiega 489a44ca58 Add collectd-pcie-errors package for PCIe Errors
The pcie_errors plugin collects PCI Express errors from Device Status in
Capability structure and from Advanced Error Reporting Extended Capability
where available.

Change-Id: I9c600570dd2166e865878e7c2584a8377a795a43
2020-03-10 12:07:31 +01:00
Matthias Runge 25cf1daf97 Clean up collectd dockerfile
for CentOS 7 and CentOS 8.

Change-Id: I46d567f7ddadf4a40a4af9652248b50b3ac7be80
2020-03-06 16:08:15 +01:00
Christian Berendt 861f55fbfd Add block labels to all Dockerfiles
Change-Id: I9692dda817ef134d647247431565e1b58cf9da41
2020-03-01 17:25:58 +00:00
Piotr Rabiega e6e76ac249 Add collectd-pmu package for Intel PMU (C7 only)
The intel_pmu plugin collects performance counters data
on Intel CPUs using Linux perf interface.

C7 only - C8 packaging still pending.

Change-Id: If5044346a90580c4051d6138a84ce10238807460
2020-02-07 09:31:41 +01:00
Marcin Juszkiewicz 2c2951b59b centos: disable EPEL by default
Our images use 'scsi-target-utils' from EPEL and then can be built
without it. So let's disable this repository right after installing
package from it.

Images can enable EPEL with 'enable_extra_repos' macro.

Also added 'disable_extra_repos' macro as we have some images in a need.

Change-Id: Id70474e7602b531b63fdc11ae690fd9ed33def74
2020-01-02 09:58:58 +01:00
Radosław Piliszek a8abbf34c0 Revert "Move to RDO Train packages"
This reverts commit c78c82c963.

Change-Id: I61c68bf738673a96dd5ba256e40e8532364ff281
2019-11-13 12:08:49 +00:00
Michal Nasiadka c78c82c963 Move to RDO Train packages
Change-Id: I396f929ecc11f87fb83585bedd39be93a605c57b
2019-10-21 12:49:31 +02:00
Martin Magr 057d605d9b Add collectd-sensubility to the image
This patch add installation of collectd-sensubility as part of collectd image.
The package is available in centos-release-opstools repo.

Collectd-sensubility aims provide possibility to switch from Sensu based
availability monitoring solution to monitoring solution based on
collectd with AMQP-1.0 messaging bus.

Upstream is here: https://github.com/paramite/collectd-sensubility
Change-Id: I22a26374ee00e93b4f52ec0c4f1152ca1ad777e6
2019-08-02 09:18:17 +00:00
Mike Bayer 310802d2f6 Add python-sqlalchemy-collectd client
sqlalchemy-collectd was added in
I2bcaa44c184bb24e5caeeb8d204dda627de59c91, however it also must
be installed alongside anywhere that python-sqlalchemy is installed
since it provides an in-process plugin that transmits metrics
to a remote collectd daemon.

Also adds the python3 version of the package to the py3 version of
the collecd/Dockerfile.j2.

Note this is currently an *RPM only* package, and as of this
commit is not yet availble for other packaging systems.

Change-Id: If598da717653a383a2d3b3373c56517f8bca832f
2019-07-01 13:23:29 -04:00
Alex Schultz 78c819d623 Add distro_package_manager configuration
Add configuration to allow the switch between dnf/yum or provide an
alternative package manager.

Change-Id: I913769fcf5875a12b4561958cf7c90b74cd116ea
2019-03-12 18:24:29 +00:00
Alex Schultz 3e5d8e2653 Add python3 packages for RHEL systems
RDO is currently working on python3 support for the next version of
CentOS/RHEL based systems.  This package uses the distro_python3 flag
that was added as part of I4028991bad92c0e8e21066cc4173c06ce5eba393 to
use the python3 specific package names.  This change only adds python3
package names for RHEL systems.

Conflicts-With: https://review.openstack.org/#/c/636457/
Change-Id: Iad6b70b433a0dd1b0f8ae6790fd280594517661a
Related-Blueprint: python3-support
2019-03-12 17:48:18 +00:00
Zuul cea1c1ebd9 Merge "Use base_package_type" 2019-01-18 21:01:55 +00:00
Alex Schultz ae1322ec10 Use base_package_type
This change updates the docker files to use base_package_type instead
of doing specific distro checks for the rhel/deb generic cases. The
base_distro is still available and is used when a specific distro needs
a customization but if the differences are purely rpm vs deb, then the
base_package_type can be used.

Change-Id: I8d720bb185df65a0178061ccf20b1ab2265da2c5
2019-01-17 08:23:41 -07:00
Matthias Runge 584da2532d [collectd] add collectd-rabbitmq-monitoring
to collectd to enable rabbitmq queue monitoring.

Change-Id: Iee7d11828726c3ce4bb72ae1d27c57c5c056c302
2019-01-16 21:21:27 +01:00
Mike Bayer c2397e62d8 Add python2-sqlalchemy-collectd
This allows monitoring of SQLAlchemy connection pool
usage.

Change-Id: I2bcaa44c184bb24e5caeeb8d204dda627de59c91
2019-01-10 13:45:12 -05:00
Matthias Runge d585aa75af [collectd] Add many plugins to collectd dockerfile
The plugin collectd-ceilometer-plugin has been replaced by
collectd-openstack-plugin, which is not packaged yet.

Change-Id: I851f6e6a6d8311351549f1d97ba2257f7a9c7feb
2018-09-10 11:32:39 +02:00
Matthias Runge 48ab94b867 Add collectd-ceilometer-plugin
https://github.com/openstack/collectd-ceilometer-plugin

Change-Id: I5545db119be931f26343dd505bbcbd512bd73e09
2018-08-17 11:05:08 +02:00
Matthias Runge 7bc3069b35 collectd: add collectd-write_kafka
write_kafka support was recently added to centos-opstools
collectd build

Change-Id: Ida94d5ee34ecaa06023100d402e9042562d4cf4a
2018-07-17 15:30:38 +00:00
Matthias Runge 3f8db42f1f collectd: turbostat is x86 only, it fails on Arm64
Change-Id: Icde3d4605200a1d2a8bad00922d726655632b8ca
2018-06-27 14:50:54 +02:00
Matthias Runge 706b70d4bd Service assurance plugins and write_prometheus
This enables to send metrics and events to AMQP 1.0.
write_prometheus provides an exporter to be scraped by
prometheus.

Change-Id: Ibd3bc04f3cedbcf3e029579877f60e90eb7081e1
2018-06-20 11:37:10 +02:00
Matthias Runge 46dbe79678 Add collectd-snmp-agent to collectd Docker
Receives and handles queries from SNMP master agent and returns the data
collected by read plugins. Handles requests only for OIDs specified in
configuration file. To handle SNMP queries the plugin gets data from
collectd and translates requested values from collectd's internal format
to SNMP format.

Change-Id: I97fd12ccee9f546416111e0589f5d770119923af
2018-06-04 09:47:33 +02:00
Matthias Runge ff25634225 Add netlink, smart, and ipmi plugins
This enables additional monitoring.

Change-Id: I4f7a8cbd23d45cbc7bf9993c19161013e53f89f6
2018-05-22 16:47:29 +02:00
Mehdi Abaakouk 31a7792cbb collectd: remove duplicate packages
The collectd-turbotstat is already installed for all arch.

This change removes the duplicates package name.

Change-Id: Iead82aad067353ddd822dfc15f54edfb313b7054
2018-05-22 08:54:56 +02:00
Joe Talerico 9bde747dab Additional packages to Dockefile
Adding the missing packages to the dockerfile

Change-Id: I75981c9691bddcccda6126aa9f4a7fa7257e196e
2018-04-23 09:21:00 -04:00
Zuul 884dd555ac Merge "Install collectd-utils" 2018-01-27 10:39:36 +00:00
Martin Mágr 8994629109 Install collectd-utils
Package collectd-utils is required to get colectdctl tool,
which can be then used in container healthcheck script.

Change-Id: I178809f7419dafc409b4a247dd440c5dcf4426bf
2018-01-26 16:31:40 +01:00
Matthias Runge dbf7bdf504 Add Intel RDT plugin to collectd container
The intel_rdt plugin collects information provided by monitoring
features of Intel Resource Director Technology (Intel(R) RDT) like
Cache Monitoring Technology (CMT), Memory Bandwidth Monitoring (MBM).
These features provide information about utilization of shared resources.

Change-Id: Ia7c9badd6c93ad0de565442ccd9fbf8561003c9f
2018-01-25 13:42:42 +01:00
Zuul 04924d488f Merge "Add collectd-ovs-stats and collectd-ovs-events" 2017-12-29 09:12:32 +00:00
Matthias Runge 14e774b84f Add collectd-gnocchi plugin
in order to be able to use gnocchi as data store for collectd metrics.

Change-Id: Iad404c2c888d2b3b8aed6497224e59f5049ba427
2017-12-11 11:07:56 +01:00
Matthias Runge f0d2f83457 Add collectd-ovs-stats and collectd-ovs-events
to be able to display statistics from ovs
ovs_events can be used to get notified by events generated by
ovs.

Change-Id: Ifb2e4dd30c88e85d368f359be23e30814d26515f
2017-12-11 09:21:24 +01:00
Matthias Runge 3af9151c5a Add more collectd plugins to the container
Since collectd exists in both centos-opstools and also in
EPEL, we disable EPEL for collectd building.

Change-Id: I2428aea0265b1dcd050f63ea3949c112407d5d04
2017-09-19 19:22:15 +02:00