Extend ceph-proxy to implement ceph-mds interface, this allows the
ceph-fs to be related. The testing is made reusing the CephFSTests
testing class.
Usage example:
juju add-relation ceph-proxy:mds ceph-fs:ceph-mds
Co-Authored-By: Felipe Reyes <felipe.reyes@canonical.com>
Closes-Bug: #1922195
Func-Test-PR: https://github.com/openstack-charmers/zaza-openstack-tests/pull/558
Change-Id: I437dbac9fe018eb2d0ffb87052d61a08aa014473
Process requests for radosgw per unit keys. Ideally the charm
would move to using charms.ceph.utils for the get_radosgw_key
method but this does not work atm. I have raised bug #1899643
to cover deduplicating hooks.ceph v charms.ceph.*
Change-Id: I00f5a58f127baa1f7878b0ddb31b4fa009d9651e
Closes-Bug: #1899634
Drop use of local copy of ceph_broker.py in preference to the
centrally maintained copy in charms.ceph.
Change-Id: I89aa0f9fc7d5d2d480ebabc1cb17a86dcbef21bf
This patch adds a focal-ussuri and bionic-ussuri bundles to the tests
for the charm.
Also removes 'admin-token' from the tests, as the keystone charm no
longer accepts the option.
Also, for focal, btrfs-tools has been removed and replaced by
btrfs-progs; thus these are installed on focal instead. See linked Bug.
Closes-Bug: #1871712
Change-Id: Ifc79beebb981571cebc38be6cb6c2748d22816c9
When ceph-proxy is configured prior to being related
to clients, it is possible for the units to go into
a hook error because of an undefined variable. This
change ensures that we do correctly define the unit
before we use it.
Change-Id: Ic6e28783bde4fc342d7c5ef1d733e69a03b702fe
Closes-Bug: #1862487
Currently add-permissions-to-key requests are not being handled by this
charm, so if cinder-ceph or glance is deployed with
restrict-ceph-pools=True, it will not be configured properly. This
patch ports the implementation of the add-permissions-to-key
handling from the ceph-mon charm, and updates other methods required
to properly set up cinder-ceph and glance ceph pools.
Change-Id: If5950af155e10ee4d140300fd7ed5730798b65f0
Closes-bug: #1836408
Also, this change removes the harden decorators as
the required configuration for harden is _not_ present
in the charm config, rendering it useless.
Change-Id: I20c124d9588b8fd6c0e6611725a848eaf892f6af
Closes-Bug: #1812219
In order to support cases where pools and keys are pre-created and
ceph-proxy just proxies this data to client applications this change
introduces support for:
* having custom "admin" users which may not actually have admin
privileges on the target cluster (client.admin is probably occupied by
real admins in this case);
* using cephx keys provided via charm config.
Change-Id: I01014b6986f92bf0ad8147a08afa1d61fdd5c088
Closes-bug: #1793991
charms capable of relating to ceph build the list of monitor hosts
from the ceph-public-address in the relation data or simply using the
private-address field provided by juju.
This patch populates ceph-public-address in the relations with the
list of monitor hosts provided in the configuration, so clients connect
directly to the non juju managed ceph and not to ceph-proxy IP.
Closes-Bug: #1642430
Change-Id: Ib2e3c6a8b0d9fc0b6d729d845a802945b64fc74c
This commit adds some unit testing to the helper libraries
as well as amulet testing for the charm itself
Change-Id: I13ff38655773521592c81bb5a6847a516abd943a
The RADOS gateway on startup will try to initialize a number
of pools in the Ceph cluster; if no OSD's are present at the
point of startup, this operation is re-tried for a period of
5 minutes.
As ceph-radosgw and ceph-mon are typically deployed in LXC
containers, they are up and running before ceph-osd units
are fully operational, resulting in ceph-radosgw units with
no running radosgw process.
By deferring the provision of keys to related ceph-radosgw
units until ceph-osd units are detected, the chance of this
race happening is greatly reduced.
Also add trailing space to ceph.conf as ceph requires that
configuration files end with a newline.
Change-Id: I2a21f021502bde5c688bd3ac4b84ef24a8bdef68
Closes-Bug: 1577519
Closes-Bug: 1578403
radosgw relation was only providing information
when executed by a leader unit. This patch ensures
that the minimum info is provided regardless.
Change-Id: I2f841933f70847fb1bddc94f5ae525f5588021c2
Closes-Bug: 1570823
Juju 2.0 provides support for network spaces, allowing
charm authors to support direct binding of relations and
extra-bindings onto underlying network spaces.
Add public and cluster extra bindings to this charm to
support separation of client facing and cluster network
traffic using Juju network spaces.
Existing network configuration options will still be
preferred over any Juju provided network bindings, ensuring
that upgrades to existing deployments don't break.
Change-Id: If4ce1ef545638130cb7e5f0d77b949d9b2e28090
If the deployemnt environment supports it, and the user would like to,
we can use Juju's Availability Zone information to setup the Ceph
cluster to use Availability Zones as the failure domain instead of
the host.
Change-Id: I4566696750b388918761ded0ed5beb0bf82ff501
Depends-On: Ie25ac1b001db558d6a40fe3eaca014e8f4174241
Add charmhelpers.contrib.hardening and calls to install,
config-changed, upgrade-charm and update-status hooks. Also
add new config option to allow one or more hardening
modules to be applied at runtime.
Change-Id: If3e20565b1917828cb9fa2cf00b93bd13c1db00f
Squashed commit of the following:
commit 9b832d9391f9fea2d1491d01da6101585930fc75
Merge: e2432c4 7b36210
Author: Chris MacNaughton <chmacnaughton@gmail.com>
Date: Mon Mar 21 16:40:54 2016 -0400
Merge branch 'master' of github.com:openstack/charm-ceph into charm-ceph-mon
Change-Id: I42cfe6f1e5887627981f8ce4beff164803cc3957
commit 7b36210bac5bef3bacae2614995e123ef926453f
Author: Chris Holcombe <xfactor973@gmail.com>
Date: Fri Mar 18 15:37:06 2016 -0700
Add ceph-osd to ceph
This change adds ceph-osd back into ceph for amulet testing.
Change-Id: Ice4aaf7739e8c839189313d3f6175a834cf64219
commit e87e0b7bd22fe5ccae2aafcf6bd30f145405e01b
Author: Ryan Beisner <ryan.beisner@canonical.com>
Date: Wed Mar 16 17:33:48 2016 +0000
Update amulet test to include a non-existent osd-devices value
The osd-devices charm config option is a whitelist, and the
charm needs to gracefully handle items in that whitelist which
may not exist.
Change-Id: I5f9c6c1e4519fd671d6d36b415c9c8f763495dad
commit ffce15d52333de4063d04b808cfbca5d890fb996
Merge: fe8bf6e 9614896
Author: Jenkins <jenkins@review.openstack.org>
Date: Wed Mar 16 17:45:25 2016 +0000
Merge "Revert "Make 'blocked' status when node have no storage device""
commit 961489609d85851bd63c6825339a296bdf74e320
Author: Chris Holcombe <xfactor973@gmail.com>
Date: Wed Mar 16 16:55:02 2016 +0000
Revert "Make 'blocked' status when node have no storage device"
This reverts commit fc04dd0fff33639b812627d04645134dd7d4d3de.
Change-Id: I9efbf623fc9aa6096725a15e53df426739ac16ff
commit fe8bf6e4a5cb466a5efc6403c215e7aece2c6b9c
Author: Billy Olsen <billy.olsen@gmail.com>
Date: Tue Mar 15 20:08:20 2016 -0700
Use tox in Makefile targets
Modify the Makefile to point at the appropriate tox targets
so that tox and Make output can be equivalent. This involves
mapping the lint target to the pep8 target and the test target
to the py27 target.
Change-Id: I99761d2fdf120bacff58d0aa5c2e584382c2e72b
commit fc04dd0fff33639b812627d04645134dd7d4d3de
Author: Seyeong Kim <seyeong.kim@canonical.com>
Date: Fri Mar 11 06:07:52 2016 +0000
Make 'blocked' status when node have no storage device
Currently there is an msg for no storage status on
ceph node. But it doesn't make this charm state
'blocked'.
is_storage_fine function has been created to check
storage devices on ceph_hooks.py and using it on
assess_status.
Change-Id: I790fde0280060fa220ee83de2ad2319ac2c77230
Closes-Bug: lp1424510
commit a7c5e85c408ab8446a18cc6761b1d0b292641ea7
Author: Ryan Beisner <ryan.beisner@canonical.com>
Date: Fri Mar 4 14:36:38 2016 +0000
Enable Xenial-Mitaka amulet test target.
Change-Id: I0c386fc0c052cc1ac52c0a30f7a39fa914a61100
commit e80c5097c26ac4eb200a289daa272d5c7ac82539
Author: uoscibot <uosci-testing-bot@ubuntu.com>
Date: Mon Feb 29 10:45:49 2016 +0000
Adapt imports and metadata for github move
commit 391ed288fc763b69f0cd92459f236e7581a5f244
Merge: 78250bd 6228ea2
Author: Edward Hope-Morley <edward.hope-morley@canonical.com>
Date: Thu Feb 25 13:34:27 2016 -0500
[hopem,r=]
Support multiple l3 segments.
Closes-Bug: 1523871
commit 6228ea2a8fa578c3c6b24b59f621e6e1026a7668
Merge: 6159390 78250bd
Author: Edward Hope-Morley <edward.hope-morley@canonical.com>
Date: Thu Feb 25 09:29:46 2016 -0500
sync /next
commit 78250bd65c861adcb321f1c634def29fcfdaa8a9
Author: James Page <james.page@ubuntu.com>
Date: Wed Feb 24 21:53:28 2016 +0000
Add gitreview prior to migration to openstack
commit 61593905939359ba72768ccb8f1a450a571c1d24
Author: Edward Hope-Morley <edward.hope-morley@canonical.com>
Date: Wed Feb 24 15:56:20 2016 -0500
only use fallback for get_public_addr() if networks not provided in config
commit 34841b0aea85b3d5693a5336dbf956a406414474
Merge: 08d1cbc 092368d
Author: James Page <james.page@ubuntu.com>
Date: Wed Feb 24 14:22:20 2016 +0000
Add actions to support configuration of erasure coded pools.
commit 092368d646d4e02b2d2ac08026b6cbf2c94a4042
Merge: de98010 08d1cbc
Author: Chris Holcombe <chris.holcombe@canonical.com>
Date: Tue Feb 23 08:19:56 2016 -0800
Merge upstream
commit 08d1cbcdc943493a556e0187d2b3e6fbe83b69e3
Merge: 2d4ff89 414e519
Author: James Page <james.page@ubuntu.com>
Date: Tue Feb 23 09:49:50 2016 +0000
Fix amulet tests for nova-compute changes.
commit 414e5195c939a99adcaf79e27eb057c07c7f4761
Author: Edward Hope-Morley <edward.hope-morley@canonical.com>
Date: Mon Feb 22 15:21:00 2016 -0500
fix amulet
commit e99e991be21c6d98fc670bcafa30684c0ba4d5e0
Author: Edward Hope-Morley <edward.hope-morley@canonical.com>
Date: Mon Feb 22 12:56:00 2016 -0500
fixup
commit de98010f6f8d81e63d47ac03d33aa40bd870c7ea
Author: Chris Holcombe <chris.holcombe@canonical.com>
Date: Mon Feb 22 08:05:32 2016 -0800
charmhelpers sync
commit 2d4ff89e4bba2e93e08a6dd00bc2367e90b708fe
Merge: f16e3fa f98627c
Author: Liam Young <liam.young@canonical.com>
Date: Mon Feb 22 09:26:38 2016 +0000
[james-page, r=gnuoy] Add configuration option for toggling use of direct io for OSD journals
commit f3803cb60d55154e35ac2294170b27fb348141b3
Author: Chris Holcombe <chris.holcombe@canonical.com>
Date: Fri Feb 19 08:11:18 2016 -0800
Change /usr/bin/python2.7 to /usr/bin/python
commit 612ba454c4263d9bfc672fe168a55c2f01599d70
Merge: c3d20a0 f16e3fa
Author: Chris Holcombe <chris.holcombe@canonical.com>
Date: Thu Feb 18 17:16:55 2016 -0800
Merge upstream and resolve conflicts with actions and actions.yaml
commit c3d20a0eb67918d11585851a7b5df55ce0290392
Author: Chris Holcombe <chris.holcombe@canonical.com>
Date: Thu Feb 18 17:10:56 2016 -0800
Fix up the niggles and provide feedback to the action user as to why something failed
commit ea5cc48ccbb5d6515703bd5c93c13b2147972cd1
Author: Edward Hope-Morley <edward.hope-morley@canonical.com>
Date: Thu Feb 18 17:42:05 2016 +0000
more
commit f58dd864eac130a6bc20b46c1495d7fa34a54894
Author: Edward Hope-Morley <edward.hope-morley@canonical.com>
Date: Thu Feb 18 17:09:52 2016 +0000
restore sanity
commit 32631ccde309040b92ba76ecc12b16bad953f486
Author: Edward Hope-Morley <edward.hope-morley@canonical.com>
Date: Thu Feb 18 11:40:09 2016 +0000
post-review fixes
commit 7ada8f0de65d397648d041fae20ed21b3f38bd15
Author: Edward Hope-Morley <edward.hope-morley@canonical.com>
Date: Thu Feb 18 11:36:46 2016 +0000
post-review fixes
commit f16e3fac5240133c1c7dfd406caacd21b364532a
Merge: a0ffb8b 7709b7d
Author: James Page <james.page@ubuntu.com>
Date: Thu Feb 18 11:02:17 2016 +0000
Add pause/resume cluster health actions
Add actions to pause and resume cluster health monitoring within ceph for all osd devices.
This will ensure that no rebalancing is done whilst maintenance actions are happening within the cluster.
commit a0ffb8bf97c9cf3c19d17090c96f2ea60c89da65
Merge: 65439ba 531b40d
Author: James Page <james.page@ubuntu.com>
Date: Thu Feb 18 10:38:53 2016 +0000
Wait for quorom and query the right unit remote_unit when not in radosgw context
commit 65439ba7dc3acf494c9a8d11e2cdd274d144b485
Merge: 5e77170 afd390b
Author: James Page <james.page@ubuntu.com>
Date: Wed Feb 17 11:28:44 2016 +0000
Update test target definitions; Wait for unit status.
commit 531b40d9b2d216b467cca59d7649ab5bb4577b3d
Author: Liam Young <liam.young@canonical.com>
Date: Wed Feb 17 10:15:37 2016 +0000
Wait for quorom and query the right unit remote_unit when not in radosgw context
commit 5e77170f378be92a3e2e8de3c06dad158b4a14ca
Author: James Page <james.page@ubuntu.com>
Date: Tue Feb 16 06:59:17 2016 +0000
Tidy tox targets
commit 732d8e11cd5058e680a5982bce77648952c8532f
Author: Chris Holcombe <chris.holcombe@canonical.com>
Date: Fri Feb 12 14:17:34 2016 -0800
Used a list as an integer. I meant to use the size of the list
commit afd390b3ed4212883a02ca971e5613246c3ae6a8
Author: Ryan Beisner <ryan.beisner@canonical.com>
Date: Fri Feb 12 21:24:20 2016 +0000
No need to not wait for nonexistent nrpe
commit 9721ce8006720d24b8e4133fbbb8a01d989a71c8
Author: Ryan Beisner <ryan.beisner@canonical.com>
Date: Fri Feb 12 21:02:36 2016 +0000
Disable Xenial test re: pending lp1537155
commit d12e2658f5b5e6c38b98ae986134f83df2e0a380
Author: Ryan Beisner <ryan.beisner@canonical.com>
Date: Fri Feb 12 20:57:08 2016 +0000
Update test target definitions; Wait for unit status.
commit 7709b7d5385757fc6d8fe48fa7646efcdb77564a
Author: Chris MacNaughton <chris.macnaughton@canonical.com>
Date: Fri Feb 12 08:26:13 2016 -0500
rename actions
commit 2c945523486227dd1c58a1c1a76a779d9c131a71
Merge: 5b5e6dc 27d5d4b
Author: James Page <james.page@ubuntu.com>
Date: Fri Feb 12 12:34:20 2016 +0000
Resolve symlinks in get_devices().
commit 7edce1dd489a4718a150f7f38ffd366855e49828
Author: Edward Hope-Morley <edward.hope-morley@canonical.com>
Date: Wed Feb 10 15:20:52 2016 +0000
[hopem,r=]
Support multiple l3 segments.
Closes-Bug: 1523871
commit 27d5d4b8bb0fd61a3910dad1bdf46adc2b476649
Author: Bjorn Tillenius <bjorn@canonical.com>
Date: Tue Feb 2 19:01:53 2016 +0200
Lint.
commit 6980d3a3418ba512e65a79a62b140b238d54a17b
Author: Bjorn Tillenius <bjorn@canonical.com>
Date: Tue Feb 2 17:34:19 2016 +0200
Resolve symlinks in get_devices().
commit f98627c1c163d702ae1142a6153801073d57280c
Merge: 4f0dc6d 5b5e6dc
Author: James Page <james.page@ubuntu.com>
Date: Sat Jan 30 15:45:01 2016 +0100
rebase
commit eaa365a180e8eda88e6ef9f1a6c975a0b780dee5
Author: Chris Holcombe <chris.holcombe@canonical.com>
Date: Fri Jan 22 15:21:45 2016 -0800
Clean up another lint error
commit 477cdc96fbe124509995a02c358c24c64451c9e4
Author: Chris Holcombe <chris.holcombe@canonical.com>
Date: Fri Jan 22 15:04:27 2016 -0800
Patching up the other unit tests to passing status
commit faa7b3ad95ebed02718ff58b3e3203b7d59be709
Author: Chris MacNaughton <chris.macnaughton@canonical.com>
Date: Fri Jan 22 16:42:58 2016 -0500
remove regex
commit 1e3b2f5dd409a02399735aa2aeb5e78d18ea2240
Author: Chris MacNaughton <chris.macnaughton@canonical.com>
Date: Fri Jan 22 16:10:15 2016 -0500
lint fix
commit 620209aeb47900430f039eb2e65bfe00db672e32
Author: Chris MacNaughton <chris.macnaughton@canonical.com>
Date: Fri Jan 22 16:05:15 2016 -0500
use search instead of match
commit 2f47939fa84c43c485042325a925d72797df6480
Author: Chris MacNaughton <chris.macnaughton@canonical.com>
Date: Fri Jan 22 15:16:22 2016 -0500
fix line length
commit f203a5bdfc12a2a99e3695840f16182e037f1df1
Author: Chris MacNaughton <chris.macnaughton@canonical.com>
Date: Fri Jan 22 15:02:10 2016 -0500
modify regex to not care about order
commit 706b272fc91d432921750b3af09689361f4b8bb9
Author: Chris MacNaughton <chris.macnaughton@canonical.com>
Date: Fri Jan 22 14:16:46 2016 -0500
try with sleeping
commit 66d6952a65ceb5c8858f262daf127f96ed03ea81
Merge: e446a77 5b5e6dc
Author: Chris Holcombe <chris.holcombe@canonical.com>
Date: Fri Jan 22 10:46:50 2016 -0800
Merge upstream and resolve conflicts
commit fc714c96f40bac9fb89108cd56962343472f63cf
Author: Chris MacNaughton <chris.macnaughton@canonical.com>
Date: Fri Jan 22 11:10:34 2016 -0500
fix variable name
commit 8cb53237c6588a00d86dcc0a564d18eb7cd751ae
Author: Chris MacNaughton <chris.macnaughton@canonical.com>
Date: Fri Jan 22 10:47:26 2016 -0500
update to use correct(?) commands
commit b762e9842ca335845fe3a442dfdde838e5246b3b
Author: Chris MacNaughton <chris.macnaughton@canonical.com>
Date: Fri Jan 22 08:01:03 2016 -0500
update tests.yaml
commit e446a7731cbe377f30c88bb99083745ba95caa4e
Author: Chris Holcombe <chris.holcombe@canonical.com>
Date: Thu Jan 21 14:19:53 2016 -0800
Clean up lint warnings. Also added a few more mock unit tests
commit 32ff93e8d0166b2346c422cbb9cd53bc4f805256
Author: Chris Holcombe <chris.holcombe@canonical.com>
Date: Thu Jan 21 09:38:47 2016 -0800
Adding a unit test file for ceph_ops
commit 4f0dc6d8b76b8545453293b2c69e2d6a164db10e
Author: James Page <james.page@ubuntu.com>
Date: Mon Jan 18 16:39:49 2016 +0000
Add configuration option for toggling use of direct io for OSD journals
commit 1977cdbde1d0fa7ad57baa07d97f477143d54787
Author: Chris Holcombe <chris.holcombe@canonical.com>
Date: Mon Jan 18 08:07:35 2016 -0800
Add actions to lint. Change actions.yaml to use enum and also change underscores to dashes. Log action_fail in addition to exiting -1. Merge v2 requests with v1 requests since this does not break backwards compatibility. Add unit tests. Modify tox.ini to include actions. .
commit 3f0e16bcc483952e340fa89505011b7a115ff421
Author: Chris MacNaughton <chris.macnaughton@canonical.com>
Date: Fri Jan 15 16:45:00 2016 -0500
fix version
commit c665092be6f9d07f45a0b9baf2e0f128e4ecdc37
Author: Chris MacNaughton <chris.macnaughton@canonical.com>
Date: Fri Jan 15 16:20:27 2016 -0500
updating tests
commit 80de4d7256efbbc6c2ab7cdfcb1ab292668be607
Author: Chris MacNaughton <chris.macnaughton@canonical.com>
Date: Thu Jan 14 13:19:10 2016 -0500
update readme
commit 44365d58785e9ba63179d092b875c2029024aa8b
Author: Chris MacNaughton <chris.macnaughton@canonical.com>
Date: Thu Jan 14 13:17:19 2016 -0500
add pause/resume actions
pause calls:
`ceph osd set noout
ceoh osd set nodown`
resume calls:
`ceph osd unset noout
ceph osd unset nodown`
commit bdd4e69e801e2178532e31216efe7e815b06f864
Author: Chris Holcombe <chris.holcombe@canonical.com>
Date: Tue Dec 15 04:54:21 2015 -0800
Missed a few typos
commit 0158586bde1a1f878c0a046a97510b8b90a95ce9
Author: Chris Holcombe <chris.holcombe@canonical.com>
Date: Tue Dec 15 04:41:22 2015 -0800
lint errors
commit 92ad78733279112bbba8e12d3fb19809ab9d0ff7
Author: Chris Holcombe <chris.holcombe@canonical.com>
Date: Mon Dec 14 17:44:22 2015 -0800
Actions are working and lightly tested. Need to create a more robust, automated test setup
Change-Id: Ia18b19961dab66bb6c19ef7e9c421b2fec60fcc7
This change adds functionality to allow the ceph monitor cluster to
upgrade in a serial rolled fashion. This will use the ceph monitor
cluster itself as a locking mechanism and only allows 1 ceph monitor
at a time to upgrade. If a monitor has been waiting on the previous
server for more than 10 minutes and hasn't seen it finish it will
assume it died during the upgrade and proceed with its own upgrade.
Limitations of this patch: As long as the monitor cluster does not
split brain this should work fine. Also this assumes that NTP
among the ceph cluster is fairly accurate.
Change-Id: I7254261b6206f0ec34a8aa1e94e7b06ae308d8f8
Add the "osd-devices" block-type storage, with
minimum of 0 and no maximum. Volumes assigned to
a unit will be added as OSDs.
Also, add the "osd-journal" block-type storage,
with minimum of 0 and maximum of 1. The osd-journal
storage, if supplied, will be used in favour of
osd-journal configuration if supplied.
For now, handling of osd-journal is static, just
as the configuration method was before. Removing
or adding the journal after deployment is not
currently supported. This is possible with further
changes, but requires stopping Ceph and migrating
the existing journal, and so out of scope here.
Fulvio Galeazzi