* Update charm-glance-simplestreams-sync from branch 'master'
to 8e06469fe46ee825bd44f04403e463899ef3caf2
- Updates for caracal testing support
These updates, on the master branch, are to support testing the caracal
packages and support of the charms for caracal. They do NOT lock the charms
down, and don't change the testing branches to stable branches.
Change-Id: Ieb68946379d497db3ac385513c528b852dba88cd
* Update charm-glance-simplestreams-sync from branch 'master'
to 886fac87ebf4dd02c1aae7ecafa0a85c0eeedfe0
- Improve platform mocking
Patch out charmhelpers.osplatform.get_platform() and
charmhelpers.core.host.lsb_release() globally in the unit tests to
insulate the unit tests from the platform that the unit tests are being
run on.
Change-Id: Ic35061597a52dda749f2e6e3f3d255f831c82a06
* Update charm-glance-simplestreams-sync from branch 'master'
to 536540781ae15c9793120f875a196f1954968d01
- Add support of image format conversion on importing
Optinally enable conversion of images to raw format when uploading
images to Glance. Only supported when "image_conversion" is enabled in
Glance.
This is an equivalent change to the one in simplestreams:
https://git.launchpad.net/simplestreams/commit/?id=cbc0ac9
Closes-Bug: #1889729
Change-Id: Id15fab364c27242347c520b959065c490e4da6b6
* Update charm-glance-simplestreams-sync from branch 'master'
to c6a07458dcb31a3deca2954d692483324ec540e3
- Add 2023.2 Bobcat support
* sync charm-helpers to classic charms
* change openstack-origin/source default to bobcat
* add mantic to metadata series
* align testing with bobcat
* add new bobcat bundles
* add bobcat bundles to tests.yaml
* add bobcat tests to osci.yaml
* update build-on and run-on bases
* drop kinetic
* update charmcraft_channel to 2.x/stable
Change-Id: I6d6ebb956a977dcc68c20aea03f318c0257a4bb7
* Update charm-glance-simplestreams-sync from branch 'master'
to 6faf284248fe998c2404912945722a286a30a773
- Enable jammy-antelope voting and drop kinetic-zed tests
* Voting was turned on for jammy-antelope in the
project-template for charm-functional-jobs in zosci-config
* Voting for jammy-antelope bundles with non-standard names
is turned on in individual charms
* Kinetic-zed bundles/tests are removed
Change-Id: I37c5aff2d71eae71015d1a1986fb73f64b864a94
* Update charm-glance-simplestreams-sync from branch 'master'
to 6d8489d8cc50685b420f5a027f78528a85e8b0d2
- Failed action due to locked file made more verbose
Fixes issue where a failed action due to a locked file returns an exit
status of 0 and shows a status of "complete". The failed action now
returns exit status 2, and the message is more verbose. Added actions
file to handle all actions with symbolic links to said file.
Closes-Bug: #1940965
Change-Id: Ie950efee8d1052d33274b0fe07ff81f343e9f3e6
* Update charm-glance-simplestreams-sync from branch 'master'
to 9304d1543463ce65f1e2fae9cba1cea22184e3c0
- Add juju-exec for juju 3 compatibility
In juju3, juju-run is moved to juju-exec
gsss should be able to handle both
Closes-bug: #1993652
Change-Id: I980306269a68c04735811324f6b826622bc6647c
* Update charm-glance-simplestreams-sync from branch 'master'
to 289671d18ffa4d0319a9a7d67d56a0e291477d03
- Add jammy to default mirror_list config value
Change-Id: Ica89e3d81cd9e222050b38e6718056feef8d5c00
* Update charm-glance-simplestreams-sync from branch 'master'
to 4754aca4209d1d18854b05360953bd5ba33cd668
- Add set_latest_property config to new image
When creating Openstack VMs the user has to specify the image it wants
to use. sstream-mirror-glance adds a date to the image name, so they
always have to recheck which is the current latest image.
This commit adds the `set_latest_property` configuration to include
--set-latest-property to sstream-mirror-glance command line argument.
When --set-latest-property is given sstream-mirror-glance will set the
recently synced image with the `latest=true` property and then remove
the `latest` property from all the os_version/architecture matching
images.
Configure bundles to fetch simplestreams snap from edge channel
Closes-bug: #1933130
Change-Id: Idf78294db7abb8c81d637086e8142782bf1dd36f
Func-Test-PR: https://github.com/openstack-charmers/zaza-openstack-tests/pull/853
* Update charm-glance-simplestreams-sync from branch 'master'
to 712f73b70727183de7362aeb687884e894d23855
- Ensure that kinetic/22.10 is enabled
This patch adds kinetic to the metadata.yaml and ensures
that a run-on base for 22.10 is added in the
charmcraft.yaml
Change-Id: I29535a65b8cbae77223eb651ff935cf9fbb40f1a
* Update charm-glance-simplestreams-sync from branch 'master'
to abbae65b130db25357778893af699a664a8a5b95
- Add Kinetic and Zed support
* sync charm-helpers to classic charms
* change openstack-origin/source default to zed
* align testing with zed
* add new zed bundles
* add zed bundles to tests.yaml
* add zed tests to osci.yaml and .zuul.yaml
* update build-on and run-on bases
* add bindep.txt for py310
* sync tox.ini and requirements.txt for ruamel
* use charmcraft_channel 2.0/stable
* drop reactive plugin overrides
* move interface/layer env vars to charmcraft.yaml
Change-Id: Iff2f3d0e011b47d895136ab7376f0e7d9c3955fb
* Update charm-glance-simplestreams-sync from branch 'master'
to ab9bf0b411623810f48fe3d6ef48206baccbfbc1
- Pin tempest for different python versions
Change-Id: Ieb37203654a707f8c719d8ee44c7e052e92e9d50
* Update charm-glance-simplestreams-sync from branch 'master'
to b20e5c19bce421404eec0e5a02070a7542cd085f
- Merge "Add bindep."
- Add bindep.
Include build dependencies for the python package `lxml`.
The file bindep.txt is managed by zuul-jobs to install deb packages
needed by the project.
Change-Id: I17411e202a5d1ee9179b1b2a8230ce595ce26b5c
* Update charm-glance-simplestreams-sync from branch 'master'
to 5687d74d61a04b4d76a6774858e226ef1aef21ab
- Use yaml.safe_load()
Use safe_load() instead of load() when loading a yaml content, more
details at https://msg.pyyaml.org/load
Closes-Bug: #1979260
Change-Id: I5f96a102be8753eea240cf05e2ca304057101530
* Update charm-glance-simplestreams-sync from branch 'master'
to f8165cebb89739869845c51734f95833aa497286
- Support --visibility option for simplestreams
With the new option, Glance images can be uploaded with
"visibility=shared" for example instead of "public" so those can be
hidden from usual projects by default.
Closes-Bug: #1975663
Change-Id: I1955f3d2a56654c9a683a2b9d36b33c0f0fd63d4
* Update charm-glance-simplestreams-sync from branch 'master'
to c749054e03d91da42858d0d4556d7b4e0c085c68
- Fix compatibility with Jinja2 >= 2.10
The indentfirst parameter of the indent helper was renamed
to first at Jinja2 2.10 - update template to follow this
change.
Change-Id: I4299a72646a602720689b4f3c3075de8c21b0811
* Update charm-glance-simplestreams-sync from branch 'master'
to 91e4aea4511b5d6afa21d18a84ef486097d4f542
- Fix the trailing-slash issue on for product-streams endpoint
ceph-radosgw is now more strict and can't handle non-canonical
paths in http requests; this patch stopes that happening, and ensures
that the endpoint is set without a trailing slash.
Change-Id: I1c2de2aad2f7652906d91865e5e214b403d2a37b
* Update charm-glance-simplestreams-sync from branch 'master'
to de4f9a6a978e0821d4a7a13507d1e93be5ef7f3d
- Updates to enable jammy and finalise charmcraft builds
- Add 22.04 to charmcraft.yaml
- Update metadata to include jammy
- Remove impish from metadata
- Update osci.yaml to include py3.10 default job
- Modify tox.ini to remove py35,py36,py37 tox target and add py310
target.
- ensure that the openstack-origin is yoga
func-test-pr: https://github.com/openstack-charmers/zaza-openstack-tests/pull/745
Change-Id: I118ac221202fb02fc440a21910235fbc645a54c8
* Update charm-glance-simplestreams-sync from branch 'master'
to a8785bc2cf0a8c61a725c59562efdca0c1d8d65b
- Update to classic charms to build using charmcraft in CI
This update is to ensure that the Zuul Canonical CI builds the charm
before functional tests and ensure that that artifact is used for the
functional tests. This is to try to ensure that the charm that gets
landed to the charmhub is the same charm that was tested with.
Change-Id: I2b4ecddd0aa8b7dfcb3cf739a2f52ef93dc7ecf2
* Update charm-glance-simplestreams-sync from branch 'master'
to e80b2b6b2ba9b05f19500d8e6818b94ed4d828c2
- Use unittest.mock instead of mock
The mock third party library was needed for mock support in py2
runtimes. Since we now only support py36 and later, we can use the
standard lib unittest.mock module instead.
Note that https://github.com/openstack/charms.openstack is used during tests
and he need `mock`, unfortunatelly it doesn't declare `mock` in its
requirements so it retrieve mock from other charm project (cross dependency).
So we depend on charms.openstack first and when
Ib1ed5b598a52375e29e247db9ab4786df5b6d142 will be merged then CI
will pass without errors.
Depends-On: Ib1ed5b598a52375e29e247db9ab4786df5b6d142
Change-Id: I57ef29855eefd0f8dc40cc427eb9bfc8796032e3
* Update charm-glance-simplestreams-sync from branch 'master'
to 46221b7519460bd95f1b97a32e0912a654701495
- Merge "Additional test updates"
- Additional test updates
* drop xenial metadata and function tests
* switch to release-specific zosci functional tests
* switch to yoga zosci unit test job
* add py39
Change-Id: I248d0c92e64692127e2a53a8cffc2efe56a8d790
* Update charm-glance-simplestreams-sync from branch 'master'
to bf23ef75b257b0cf1e00c9e7850f8bf10d0378b2
- Add support for juju resources
Simplestreams package is now installed via snap. By having the juju
resources for the snap package, it can benefit in offline environment.
Closes-Bug: 1921832
Change-Id: I5f21ca9faff35427281076e142942c3458e71091
* Update charm-glance-simplestreams-sync from branch 'master'
to 6733e22006750fa0a0dc405278b0446fd4aecac4
- Add use-internal-endpoints as a new config option
Enable the glance-simplestreams-sync charm to be configured to only
use internal endpoints, removing the requirement that the charm
access APIs via the public network.
This introduces a new option use-internal-endpoints, which is in-line
with other openstack charms which can be configured to use the internal
endpoints rather than public endpoints.
This option will only be valid for Keystone v3 API versions, which
should not be problematic as the v2 API has been deprecated for quite
some time now.
Closes-Bug: #1896438
Change-Id: I6d83a5469c34c2add3c1bc4ac5052be6d51ed343
* Update charm-glance-simplestreams-sync from branch 'master'
to d1f8c4ba4cec4324ef9edc91c357672349176dfc
- Remove local apache2 install, rework use_swift
The functionality of use_swift where a local apache2 instance was set up
for metadata was deprecated for removal and this change actually removes
this. However, the option itself can still be used as an indicator
whether Swift is intended to be used for simplestreams metadata or not.
If the usage is explicitly requested, the charm but Swift endpoints are
not yet present, the charm will now will set the unit state to
maintenance in addition to local logging that was done previously.
Swift presence checking is now endpoint-based instead of being
service-based (no use for the case where endpoints are not set up while
the service is in the catalog).
The lack of swift presence is also ignored for the purposes of
generating proxy setting context - if the endpoint is not there there is
not point in trying to generate NO_PROXY rules for it.
This change also makes test bundles use ceph as a storage medium for
glance since out of space errors were encountered during testing as the
glance unit was running out of space for image storage.
Closes-Bug: #1942047
Closes-Bug: #1934563
Closes-Bug: #1938069
Change-Id: I6519b1449806ad19ee4545501bc4631c9f8e535f
* Update charm-glance-simplestreams-sync from branch 'master'
to cf1f8bf725dd27ab68ac2ffdbc79a3e2b3e85bd9
- Merge "Dynamically generate proxy settings for image syncs"
- Dynamically generate proxy settings for image syncs
sstream-mirror-glance has several endpoints it needs to talk to:
* Image mirrors - typically, public Internet endpoints;
* Keystone - typically, a directly reachable endpoint;
* Glance - typically, a directly reachable endpoint;
* Object store (Swift) - typically, a directly reachable endpoint but
sometimes it may be deployed externally and added to the region
catalog in Keystone (in which case it might be accessible via a proxy
only).
While sstream-mirror-glance does not support specifying proxy settings
for individual directions, since we know all of them based on the
Keystone catalog, a list of endpoints to add to NO_PROXY environment
variable can be generated dynamically.
The complication is that image syncs are periodically done via a cron
job so a juju-run invocation is needed to retrieve relevant proxy
settings from model-config at each invocation of the synchronization
script.
Additionally, the charm is long-lived so there may be some environments
that rely on legacy proxy settings. This change accounts for that and
acts both on juju-prefixed (new) and unprefixed (legacy) proxy settings.
Whether to use proxy settings for connections to the object store API
is controlled by a charm option which the script is made to react to.
Proxy settings are ignored for object store connections by default.
Closes-Bug: #1843486
Change-Id: Ib1fc5d2eebf43d5f98bb8ee405a3799802c8b8dc
* Update charm-glance-simplestreams-sync from branch 'master'
to 787a9c5ae9d20fc6d714f010739bcbd765d024db
- Ensure py3 pkgs installed on series-upgrade
On series-upgrade the g-s-s stopped syncing due python packages required
by the sync file (that is run in the context of the unit, rather than
the charm) not being present. I believe they may have been removed
during the series-upgrade when unused packages were removed.
This patch ensures that on both upgrade and series upgrade, all the
packages that are needed are installed.
Change-Id: I8dfa9b0111fa3f204364e2c0833595bf8b219a7c
Closes-Bug: #1934306
* Update charm-glance-simplestreams-sync from branch 'master'
to 8bd1b89b6fd91a9921fd87561a7c8726e02b0fbf
- Forward returncode from sync program
When performing sync from an action, the caller of the action will
be interested in knowing the result of the operation.
Move hirsute-wallaby job to experimental pipeline.
Closes-Bug: #1929668
Change-Id: I20f20f852af7d1e17c6881ab3720b6cc1c16222a
* Update charm-glance-simplestreams-sync from branch 'master'
to 9d5de4d077d05f47f3719587449d1ff99103f9ed
- Test bundles for focal-wallaby and hirsute-wallaby
These are the test bundles (and any associated changes) for
focal-wallaby and hirsute-wallaby support.
Sync libraries.
hisute-wallaby test is disabled (moved to dev) due to [1] as bundle may
reference a reactive charm.
[1] https://github.com/juju-solutions/layer-basic/issues/194
Change-Id: I2a09dc92ae59ed43c87c3c24def1240c117482fd
* Update charm-glance-simplestreams-sync from branch 'master'
to 7dd5035ae1025e6f260b32797d4412d0fa8179ce
- Updates to flip all libraries back to master
This patchset updates all the requirements for charms.openstack,
charm-helpers, charms.ceph, zaza and zaza-openstack-tests back
to master branch.
Change-Id: I99fbbf9010f40b77054192e5718c983449c4c71d
* Update charm-glance-simplestreams-sync from branch 'master'
to f60ec380c8e6545f56802e14d3532d0804be55f6
- 21.04 sync - add 'hirsute' in UBUNTU_RELEASES
The 'hirsute' key in c-h/core/host_factory/ubuntu.py:
UBUNTU_RELEASES had been missed out, and is needed for
hirsute support in many of the charms. This sync is to
add just that key. See also [1]
Note that this sync is only for classic charms.
[1] https://github.com/juju/charm-helpers/pull/598
Change-Id: Idf0fe26c9c284054cbe6c51137c02964503c0c78
* Update charm-glance-simplestreams-sync from branch 'master'
to a40612e033a60caa1645539b890a91486ea731ad
- 21.04 libraries freeze for charms on master branch
* charm-helpers sync for classic charms
* build.lock file for reactive charms
* ensure tox.ini is from release-tools
* ensure requirements.txt files are from release-tools
* On reactive charms:
- ensure stable/21.04 branch for charms.openstack
- ensure stable/21.04 branch for charm-helpers
Change-Id: I41cb22762cad421770ed7f9256ffa9e95d87c8f5
* Update charm-glance-simplestreams-sync from branch 'master'
to 36873ab84af444eab0fdf8b3ec4dd47d8f895c26
- Add hirsute and remove trusty from metadata.yaml
This update adds the new hirsute Ubuntu release (21.04) and
removes trusty support (14.04 which is EOL at 21.04).
Change-Id: I6121fe56f684d7738ef19ce04275d3165e1df506
* Update charm-glance-simplestreams-sync from branch 'master'
to 020cfe208788554f0e0ceecf7577f6259e227845
- Merge "Add new osci.yaml"
- Add new osci.yaml
This change is preparatory to migration Ubuntu OpenStack CI
from Jenkins to Zuul
Change-Id: I16e82e0f295a9c0f6f21e4ff343e2f1afda1d82d
* Update charm-glance-simplestreams-sync from branch 'master'
to a8405ab0b069e7100df45b795ee44e80ff1bd720
- Updates for testing period for 20.01 release
Includes updates to charmhelpers/charms.openstack for cert_utils
and unit-get for the install hook error on Juju 2.9
* charm-helpers sync for classic charms
* rebuild for reactive charms
* ensure tox.ini is from release-tools
* ensure requirements.txt files are from release-tools
* On reactive charms:
- ensure master branch for charms.openstack
- ensure master branch for charm-helpers
* Include fix for local_address() and NoBindingError
Change-Id: Idcc87ea634901f9199307c0b8279c3d18383dae0
* Update charm-glance-simplestreams-sync from branch 'master'
to 9c7c4c47367f94eae79f3cef536ab60e2d9c11d0
- Update location for CA cert
Look for ca cert using new name `vault_juju_ca_cert.crt` and
fallback to the old name `keystone_juju_ca_cert.crt` if needed.
Change-Id: Ifa4f404a0f8283659448c2b8a3d622768d2c4c8f
Closes-Bug: #1912234
* Update charm-glance-simplestreams-sync from branch 'master'
to 5ee94d7d8fb246751b4cdbe8bcd3f82d5399dc52
- Add Groovy to the test gate
Change-Id: Id431d33f0e46eeca8a19fc2441d97f0b1bdf2be0
* Update charm-glance-simplestreams-sync from branch 'master'
- Batch update to land Ubuntu Groovy support into the charms
Cherry-Pick from 09752a1527
Change-Id: Ib02a2087ab89d592e36641b175a3a4b0b8965547
* Update charm-glance-simplestreams-sync from branch 'master'
- Sync libraries & common files prior to freeze
* charm-helpers sync for classic charms
* charms.ceph sync for ceph charms
* rebuild for reactive charms
* sync tox.ini files as needed
* sync requirements.txt files to sync to standard
Change-Id: I599652b5a0c2ec9c0d7d1d31a0d3ead575088c26
* Update charm-glance-simplestreams-sync from branch 'master'
- Add focal-victoria to the test gate
Change-Id: I1a1458e6dc4e012ef29157f23ab2af297948a5ae
Alex Kavanagh