Commit Graph

87 Commits

Author SHA1 Message Date
Michal Wyszkowski abb969502f Nova: fix swtpm and swtpm-tools missing from deb installs
Closes-Bug: 2062572
Change-Id: I456a5b8f66aa88a82fb54938e8df7195d127d9cd
2024-04-22 13:03:38 +02:00
Michal Nasiadka 66e27b3b0a Remove calls to libvirt repo
It does not exist in repos.yaml since [1].

[1]: Id585c7744ba130ad1dfc28138fb0f9e6eeae771d

Change-Id: Ic74eba44fc6e5508976de24cf20a5039f3292731
2024-02-26 13:04:19 +01:00
Pierre Riteau 33c988a6ce Update Ceph repo name for dnf config-manager command
Since change I1bc19f8198da3f9ab2ae2a8864c3349b21b0249e we install the
centos-release-ceph-reef package as a dependency, but some code was
still expecting the quincy package.

Change-Id: I8ebcf815d80f3bead25e0078d69b34e17ad013bd
2023-11-22 10:06:39 +00:00
Rafal Lewandowski 2783fb7107 nova-libvirt: Fix for missing libvirt-daemon-driver-nodedev package
Closes-Bug: #2012821
Change-Id: I989cedce7a9af3882b5510d3479b29150139e861
2023-04-06 13:14:06 +00:00
Marcin Juszkiewicz 8d209901fa nova-libvirt: provide TPM emulation
The goal of the swtpm project is to provide a TPM emulator (TPM 1.2 &
TPM 2) that can be integrated into virtualized environments, such as
virtual machines and containers.

Nova supports it for quite a while:
https://review.opendev.org/c/openstack/nova/+/631363

Change-Id: Ifb7e0f1632805807851720873a70179218bdf372
2022-09-27 10:02:23 +00:00
Marcin Juszkiewicz 878b00013b Move to CentOS Stream 9
OpenStack 'zed' requires Python 3.8+ so RHEL 8 family has to go.

This changeset moves to CentOS Stream 9 while move to RockyLinux 9 is
planned as final solution.

CI moved to CentOS Stream 9 nodes.

Depends-on: https://review.opendev.org/c/openstack/kolla-ansible/+/839715

Change-Id: I113b9984294cf8663d3fc0c8840320e1d40ea731
2022-09-27 07:40:06 +00:00
Tim Shearer 1d96a2bbe1 Adjust permissions on _extend_start files.
Explicitly set the permissions on the kolla-toolbox kolla_extend_start
file. Also, since all extend_start files are sourced rather than
executed, the executable bits are now cleared throughout the project.

Change-Id: I5c2deb4a2e33575d57c852089f856a9acc6818d0
2022-04-11 17:22:24 +02:00
Marcin Juszkiewicz a1510870e8 drop infra_image_prefix
We have one install_type only now so that infra stuff is not needed
anymore.

Change-Id: I60d50ba7699d46d001eaef365fb84b0ce8e9b262
2022-04-11 06:22:21 +00:00
Mark Goddard e1efa9d257 libvirt: add Cyrus SASL packages for DIGEST-MD5
Adds Cyrus SASL packages necessary for the DIGEST-MD5 and SCRAM-SHA-256
mechanisms. These can be used for libvirt SASL authentication.

Change-Id: I13e19ca29eeab40cd08fa3afe2cdf7531867f81b
Partial-Bug: #1964013
2022-03-10 10:59:38 +00:00
Radosław Piliszek 0236bc6d94 Add qemu-img also in nova-libvirt image
This is noop on CentOS (it was installed as a dep already - better
be explicit) but installs qemu-img (and other qemu utils) on
Debian and Ubuntu.

qemu-img may be used by libvirtd to create non-raw images as it
happens, e.g., when Kolla's libvirtd is used by tenks.

Change-Id: Ib79b8486f4d5064e4f249201d28cf5d6541c69ef
2022-02-22 12:20:40 +00:00
Pierre Riteau 8ec8ef3d8a Revert "libvirt: pin edk2-ovmf"
The "internal error: unknown feature amd-sev-es" error in libvirt seen
with the edk2-ovmf package is fixed by a commit in libvirt 7.4.0 [0] to
avoid erroring out on unknown QEMU firmware features.

CentOS Stream 8 was wrongly using the CentOS 8 advanced-virtualization
repository [1] instead of the CentOS Stream 8 one [2]. This is fixed by
centos-release-advanced-virtualization-1.0-3 [3], which should bring
libvirt-7.4.0-1 into our nova-libvirt image.

This reverts commit 1a2c33512b.

[0] 61d95a1073
[1] http://mirror.centos.org/centos/8/virt/x86_64/advanced-virtualization/
[2] http://mirror.centos.org/centos/8-stream/virt/x86_64/advancedvirt-common/
[3] https://koji.mbox.centos.org/koji/buildinfo?buildID=18004

Change-Id: I1f58262109dd27a4c4ee9b60d87010170b5ea7bb
2021-06-18 07:22:35 +02:00
Michał Nasiadka 1a2c33512b libvirt: pin edk2-ovmf
edk2-ovmf introduced a bug [1] and results libvirt/qemu errors
It's going to be fixed in next rebase to libvirt 7.4.0 - but let's pin for now.

[1]: https://bugzilla.redhat.com/show_bug.cgi?id=1961558#c10

Change-Id: I0cb0512ef40c48353d582b1c37a446f251b79ac7
2021-05-25 18:37:55 +02:00
Marcin Juszkiewicz 38fcd184e8 centos: enable repos where needed
With RDO use we did not disabled some repositories. This patch disable
them and enable where needed.

Change-Id: Ia9d537fe9c1ad54789d2bfb4027254fbb3defe7e
2021-04-13 11:21:39 +00:00
Marcin Juszkiewicz fc89e57c1c get rid of traces of CentOS 7 support
Change-Id: I4d20f23a9b26364943bf967908255d82c8f6621b
2021-02-04 17:06:28 +01:00
Marcin Juszkiewicz 84038e337a Debian: use QEMU 5.0 from buster-backports
This will allow us to make sure of all updates.

'qemu-kvm' got dropped in Debian

Change-Id: If09a8188030baa284dd353b1c3f830d78c5091b7
2020-08-24 09:57:54 +02:00
Marcin Juszkiewicz 90adc2b851 introduce 'infra_image_prefix' for infra images
Defaults to 'image_prefix' for now but shows which images gets their
names changed soon.

Change-Id: I0608e8f62f28d6667b4c8753c47553e4cbf75503
2020-07-09 23:31:42 +02:00
Marcin Juszkiewicz 0ca4953269 nova-libvirt: fix after centos 7 removal damage
Removal of CentOS 7 butchered Dockerfile.j2 so UEFI was not installed in
Debian/Ubuntu images.

Change-Id: I13be95df12ed30a366bd7d0e934704bd338781cf
2020-04-16 15:49:59 +02:00
Marcin Juszkiewicz 53443c5c71 Remove support for CentOS 7
With the move to RHEL/CentOS 8 we no longer have Python 2 in our images
so there is no need for checking which Python version (2.x or 3.x) is
used inside of containers.

We also no longer have to support yum as a value for
distro_package_manager.

Partially-Implements: blueprint centos-rhel-8

Change-Id: Ie45cf3465fedddbde7856961527421883ba3d5c9
2020-04-15 09:32:06 +00:00
Marcin Juszkiewicz 245992d37c kibana, nova-libvirt: handle it properly for non-x86
Upstream kibana package contains NodeJS x86-64 binaries so can not be
used directly on non-x86 architectures. I took upstream packages,
removed NodeJS binary from it and added 'nodejs' dependency.

Package is present in my Linaro OBS repository where I keep other
packages needed for aarch64 kolla run. Via APT pinning I mark them as
not wanted so they are not used on any architecture with two exceptions:

1. libvirt - we need fixed version to be able to use ThunderX servers
2. kibana - to be able to run it at all

For x86-64 upstream kibana package is used.

Closes-bug: #1867365

Change-Id: I456402849022100bde1fffdfbf6292b35690f0f2
2020-03-13 18:28:42 +00:00
Marcin Juszkiewicz 1c8c9b42f2 nova-libvirt: use dmidecode and xen-utils on archs which have them
Instead of listing architectures which do not have those packages we
should list those which have. Makes adding s390x easier.

Change-Id: I68aa6f4b7fb1c8d63c84f3436a34399cc9644060
2020-03-05 21:56:08 +00:00
Alfredo Moralejo 0c63129682 Use StorageSIG repos for Ceph in CentOS8
Storage SIG has built Ceph Nautilus and Ganesha for CentOS8 in CentOS
Build System.

Let's switch to use them in kolla.

Change-Id: Id37dca84c4eb918aaf2d3c036ef5387fe75988dd
2020-03-03 16:31:53 +05:30
Christian Berendt 861f55fbfd Add block labels to all Dockerfiles
Change-Id: I9692dda817ef134d647247431565e1b58cf9da41
2020-03-01 17:25:58 +00:00
Zuul d00fa3a6dd Merge "CentOS 8: Use upstream Ceph/master" 2020-01-31 19:26:02 +00:00
Zuul c1d1a65a5b Merge "nova-libvirt: add UEFI packages to support UEFI instances" 2020-01-31 17:57:29 +00:00
chenxing 15b68c15c1 nova-libvirt: add UEFI packages to support UEFI instances
Fix inability to run UEFI-based images/instances by installing UEFI
packages also in nova-libvirt image which is not based on nova-base.

Includes support for C8.
Backport below Train w/o C8.

Closes-Bug: #1814552
Co-authored-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
Co-authored-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
Change-Id: I1d5cd3d9af98444acac5bedd7daeaa6c6673dcd6
2020-01-31 10:19:55 +01:00
Michal Nasiadka 70423f1959 CentOS 8: Use upstream Ceph/master
The only Ceph version that will support CentOS 8 is Octopus.
It will be released end of March 2020 - so for now let's use master.

Change-Id: I5955acb41e7346802d76f4f2b244cbf5c36f5bf2
Partially-Implements: blueprint centos-rhel-8
2020-01-30 10:35:50 +00:00
Mark Goddard 4b4e26262b CentOS 8: Update packages in images
* Some further changes for python2 vs python3 packages
* Allow rabbitmq 3.7.*, since a newer erlang is available
* Switch from qemu-img-ev to qemu-img on CentOS 8
* bridge-utils no longer available on CentOS 8
* libvirt-daemon-driver-lxc no longer available on CentOS 8
* Mark some more images buildable for CentOS 8

Change-Id: Iaf5b68ff6d944ae730ca0b1d5832172c106a6c08
Partially-Implements: blueprint centos-rhel-8
Partially-Implements: blueprint centos-rhel-python-3
2020-01-29 11:41:38 +00:00
Marcin Juszkiewicz cf11cd6f3d Enable repos only when needed
Disable external repositories by default and enable only when needed.

Depends-on: https://review.opendev.org/696480

Implements: blueprint repos-off-by-default

Change-Id: Icf2a8397a8349e0fe849d88d160409fd234480a9
2019-11-29 11:38:06 +01:00
Mark Goddard fa8e174be6 Remove support for OracleLinux
We have agreed to remove support for Oracle Linux.

http://lists.openstack.org/pipermail/openstack-discuss/2019-June/006896.html

Change-Id: I961dfba1aeef2c509ecdaf376dfe6928926ffb39
Depends-On: https://review.opendev.org/682858
2019-09-18 13:42:47 +01:00
Mark Goddard aa59f0db6f Debian/Ubuntu: more python3 packages for binary
backport: Stein

During the switch to Stein UCA, we did not switch all packages to python
3 for Debian/Ubuntu binary images. This change switches some more of
those packages.

Change-Id: I0bff21384d88ea678608392de2db1ba418c96665
Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
2019-06-06 11:06:58 +00:00
Marcin Juszkiewicz 408554475b nova-libvirt: in Debian qemu-kvm is x86 only
This package provides just a wrapper script /usr/bin/kvm which run
qemu-system-x86 in kvm mode for backwards compatibility.

Change-Id: I0cc03a1ab5a79ae49fa7d13ac549e21d3ec5295d
2019-05-06 12:36:59 +02:00
Martin Schuppert 04c5cfb59f Install trousers to get user tss for nova_libvirt
The user tss is wanted by libvirt and comes with the trousers package.
Prior RHEL8 it comes via the gnutls -> trousers dependencies, but there is
no such a dependency in RHEL8, so make sure we have trousers installed.

Change-Id: I9f11ba53d5c6f0a435a62bb462164566c4519d9f
Closes-Bug: #1821309
2019-03-25 09:44:20 +01:00
Zuul a7f0cd9349 Merge "Install qemu-system in nova-libvirt on ubuntu" 2019-03-21 12:47:31 +00:00
Zuul debe417982 Merge "Move to Debian 'buster'" 2019-03-15 19:16:54 +00:00
Mark Goddard cf5b5b69a6 Install qemu-system in nova-libvirt on ubuntu
In https://review.openstack.org/643308 we installed only the x86 qemu
emulator due to an issue in nova when installing all emulators via
qemu-system.

The nova issue should be fixed by https://review.openstack.org/643458,
at which point it should be safe to merge this patch.

Depends-On: https://review.openstack.org/643458
Change-Id: I1c045d85a8473725baf907d7c6ecb780b8f6748d
2019-03-15 11:24:59 +00:00
Mark Goddard cdcd5610e9 Fix lower-constraints and kolla CI jobs
Multiple fixes to fix multiple problems.

1. Bump setuptools requirement to 21.0.0

The 16.0.0 requirement breaks the lower-constraints job on Ubuntu
bionic. We see the following error:

AttributeError: module 'importlib._bootstrap' has no attribute 'SourceFileLoader'

2. ubuntu-binary horizon image needs to use python3 for django
manage.py

3. ubuntu-binary nova-placement-api image needs to use python3 for
apache mod wsgi.

4. nova-libvirt needs exact qemu dependencies due to packaging change

5. OracleLinux repos definition was changed in official image.

6. Fetch InfluxDB gpg key for Ubuntu base image from influx server.

Change-Id: Ic797d41f53a5f146d112619f1683cbfbf3a85dc2
2019-03-15 12:01:25 +01:00
Marcin Juszkiewicz 4d31ca695b Move to Debian 'buster'
Buster is at freeze phase so safe to update and use. Will give us
Python 3 based OpenStack packages (usually release delayed).

Change-Id: I48c2d252a834716f1bcf10b18f2d32fe541e8137
2019-03-14 10:20:27 +00:00
Alex Schultz ae1322ec10 Use base_package_type
This change updates the docker files to use base_package_type instead
of doing specific distro checks for the rhel/deb generic cases. The
base_distro is still available and is used when a specific distro needs
a customization but if the differences are purely rpm vs deb, then the
base_package_type can be used.

Change-Id: I8d720bb185df65a0178061ccf20b1ab2265da2c5
2019-01-17 08:23:41 -07:00
Attila Fazekas a917eb7166 Using qemu-kvm on rhel
qemu-kvm-ev was used with centos,
in case of rhel when you have
access to the virtualisation related channels qemu-kvm pulls
qemu-kvm-rhev which is the recommended one.

qemu-kvm-ev was referenced by devstack long time ago,
but the explicit package install on rhel family today
is qemu-kvm and not qemu-kvm-ev.

I am unsure about the other distros, so just changing rhel.

Change-Id: If6d1e0367730fa80284395be33674a7cd1465389
2018-08-06 10:00:09 +00:00
Martin André 5951977eab Stop using deprecated rpm package names
These packages produce a warning during the installation, we should
switch to their new names, usually to be specific about their use of
python2.

Change-Id: I0a80e822f64222d9a32aabd1fd834bcf794d6320
2018-07-10 16:32:18 +02:00
Zuul 5caa5e30de Merge "Bump Ubuntu base image to 18.04" 2018-06-04 10:39:19 +00:00
Jeffrey Zhang 14374e715d Bump Ubuntu base image to 18.04
Ubuntu 18.04 has been released. We need upgrade to it this cycle.

Changes made in this patch

- Bump ubuntu repo from xenial to bionic. Some repos do not have bionic
  packages, so still using xenial repos.
- Drop mariadb, percona and nfs-ganesha repo, because these packages are
  already provided by Ubuntu official repo.
- Since qdrouterd does not have bionic repo and xenial packages does not
  work on Ubuntu bionic, just add it into ignore image list.
- Use python-rtslib-fb and targetcli-fb rather than python-rtslib
  and targetcli
- use xen-utils package name rather than with package version one.
- Seems unsigned repo won't work on Ubuntu bionic, stop using infra
  mirrored unsigned repo in gate building job.

Needed-By: https://review.openstack.org/568728
Implement blueprint: ubuntu-bionic
Change-Id: I4e3b0ca669cfbf6316bf591f2d8428fa1a0d6182
2018-05-26 00:24:30 +08:00
Marcin Juszkiewicz 996520da9e nova-libvirt: install libpam-systemd from backports
As in d50cc5d5d4 we got hit again:

Change-Id: I49fa406cb394e5d3f831b35eff2b070a1adcc2c4
INFO:kolla.common.utils.nova-libvirt:The following information may help to resolve the situation:
INFO:kolla.common.utils.nova-libvirt:The following packages have unmet dependencies:
INFO:kolla.common.utils.nova-libvirt: libvirt-daemon-system : Depends: policykit-1 but it is not going to be installed
INFO:kolla.common.utils.nova-libvirt:.[91mE: Unable to correct problems, you have held broken packages.
2018-05-14 12:27:11 +02:00
Marcin Juszkiewicz d6207058c6 nova-libvirt: fix build for Debian
Change-Id: Ia0429294b2d99ef225dafb37bb77fae5fe0fe36c
2017-11-24 15:18:39 +00:00
Zuul 3931f2896a Merge "Include required packages for libvirt SASL auth on CentOs/RHEL" 2017-11-21 18:35:17 +00:00
Oliver Walsh 0e32e2d2c6 Include required packages for libvirt SASL auth on CentOs/RHEL
Change-Id: I40fd1c87fd95746ed26de41e501a76c1b83a174a
Related-bug: 1732479
2017-11-17 19:45:38 +00:00
Jeffrey Zhang 8c1c03f160 Install libvirt-clients for nova-libvirt image
libvirt-clients is nice to have, which is helpful for operator.

Change-Id: I892eebf542ee624e275c215809a3f1a9e6ab3135
Closes-Bug: #1720051
2017-10-20 12:59:06 +08:00
Zhangfei Gao 8c1e4e9052 nova-libvirt: add package qemu-efi to support uefi image
On arm64, uefi image is usually used via --property hw_firmware_type=uefi
In order to support this, qemu-efi has to be installed
Ohterwise error reports:
Terminating instance: libvirtError: Failed to open file '/usr/share/AAVMF/AAVMF_VARS.fd': No such file or directory

Change-Id: Ibc1b39e821e84fb9739833be04bdb41db59d2ff5
Signed-off-by: Kevin Zhao <kevin.zhao@linaro.org>
Signed-off-by: Zhangfei Gao <zhangfei.gao@linaro.org>
2017-08-15 09:43:45 +08:00
Zhangfei Gao cdf318193b nova-libvirt: fix no /usr/sbin/libvirtd issue
When testing on arm64, libvirt continue restarts and reports error:
Running command: '/usr/sbin/libvirtd --listen'
/usr/local/bin/kolla_start: line 17: /usr/sbin/libvirtd: No such file or directory

If install package libvirt-daemon, libvirt still report error:
libvirtError: unable to connect to server at '192.168.1.98:16509': Connection refused

Solve the issue via installing packate: libvirt-daemon-system

Change-Id: I7d822c3f18fd7301b79d397c632fe412f4b6f9fd
Signed-off-by: Kevin Zhao <kevin.zhao@linaro.org>
Signed-off-by: Zhangfei Gao <zhangfei.gao@linaro.org>
2017-08-15 09:43:29 +08:00
Jawon Choo 31259fa595 Override image's meta info.
centos based images have wrong label info,
these changes fix own image's name and build-date.

Change-Id: I1d13f8f386c8db12b5fbe5f8ecbbf9e3fbb4ba1c
Closes-Bug: #1680341
2017-05-03 11:08:17 +09:00