Commit Graph

88 Commits

Author SHA1 Message Date
guolimin.lc a806a536b6 Remove redundant "=" to imporve doc format
Change-Id: Ia24a706d93fa0d717978b127d53135e225f05da3
2023-08-09 13:48:53 +08:00
songwenping d7c7217b22 Add name param for start_tls_proxy funtion
Change-Id: Id3f005dc63e0785df2a4cdf2fccd8585ece11d15
2022-04-22 07:20:16 +00:00
Luigi Toscano b8ad624ee5 gate fix: no removed tail_log in devstack, disable grenade
The devstack tail_log function has been deprecated since before Queens
and it has only printed a warning since then. It has been finally
removed from devstack in I7bd440adf2ce8283e3ad3d5d09e6b2b877e2b42e.

The sahara-grenade job is failing and it will continue to fail until
the heat devstack plugin is fixed on all stable branches
(currently broken due to the usage of an older Fedora image which
doesn't exist anymore, see Id869f83a46454897c2fe7a532eebfa2863befe5e),
so disable it.

Change-Id: I921d7bac5963c66e14a6a06b100d624924914f5a
2020-12-04 14:57:55 +01:00
Luigi Toscano 810d94bfbb grenade: start from train, disable heat integration tests
- set the starting point as train (to be adapted in the
  backports of this patch);
- heat tests should have been disabled already here;
  they are really flaky, they takes more time and they should be
  tested by heat.

Change-Id: I5571ac5e578f98465737373598b358aa7dab93e0
2019-10-10 00:51:25 +02:00
Luigi Toscano c7fc57b42a devstack: do not use configure_auth_token_middleware
The devstack function configure_auth_token_middleware is deprecated,
because it specifies an option (signing_dir) which has been removed
a few releases ago.
Use the new configure_keystone_token_middleware function, which does
not use the removed parameter. Remove also all the logic related
to that parameter.

Depends-On: https://review.opendev.org/628651
Change-Id: Ic13d8cfb3aeb425a7ad28ec1b8fc95629fafcc2f
2019-06-30 12:35:26 +02:00
Luigi Toscano 8c941ed187 Replace git.openstack.org URLs with opendev.org URLs
Thorough replacement of git.openstack.org URLs with their opendev.org
counterparts.

Depends-On: https://review.opendev.org/653988
Change-Id: I6c7fffc1a32cb35ff7fe2ba964510b4f32805842
2019-04-20 14:55:03 +02:00
Ian Wienand 617be9032c Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: Ic57069fd0acc405347e263a082ea8ba9915e9d41
2019-03-24 20:36:02 +00:00
Luigi Toscano 8010e24a56 grenade: re-enable, really test rocky->master
So far grenade has been testing a queens->rocky upgrade.

Implement the grenade code required to upgrade to the current
master. The plugin code installs the split plugins, which
need to be listed in the PROJECTS variable in order to be cloned.

Also, don't deploy sahara-all even when deploying rocky
(it was already deprecated back then).

Finally, deploying sahara-api using wsgi has been the default
for a while and for sure when the upgrade starts from rocky
there is no need to disable it.

The grenade test should be stable enough again, so re-enable it
in both the check and the gate queue.

Change-Id: I000aae6c093c32ab1c3505448e2b9ec52b0529a2
2019-03-18 23:37:35 +01:00
Telles Nobrega 55bd5da57f Dynamically loading plugins
Since plugins are not part of Sahara core anymore, loading plugins
like we currently do fails when plugins are not installed.
Currently we check the list of loaded plugins by checking the CONF
file plugins session. To fix that, we are changing to check the list
of loaded plugins on the PluginManager variable loaded_plugins, this
way we can instead of failing to start sahara if a desired plugin
is not installed, we can warn that the plugin was not loaded and
continue the application.

Change-Id: Iaae3a75cd75b06e94bc4492e5dc654a6281fdff4
2019-02-05 11:30:09 -03:00
Telles Nobrega 92686f5a10 Prepare Sahara core for plugin split
On the effort to make Sahara more user and operators friendly
we are splitting the plugins from Sahara core.

The main goal of this change is to facilitate installation,
maintainance and upgrade of plugins. With the plugins outside
the main Sahara code, operators will be able to install a subset
of plugins, as well as upgrade to newer versions of the plugins
without having to wait for a new version of OpenStack to be
released. As well, it aims to facilitate new contributors to
develop and maintain their own plugins.

Sahara Spec: https://specs.openstack.org/openstack/sahara-specs/specs/rocky/plugins-outside-sahara-core.html

Change-Id: I7ed0945fd82e37daaf6b29f947d3dba06db9d158
2019-01-10 22:18:24 -03:00
Telles Nobrega 81d05942e9 Deploying Sahara with unversioned endpoints
One of the tasks we need in order to make APIv2 is deployment with
unversioned endpoints.
This patch makes deployment of unversioned sahara when deployed with devstack

Depends-On: I5066f73aa0ace79d8d5e1431f8d741d0d942d9d5
Change-Id: I06ac6da0c6784680330ae0431c20d3553f95e452
2019-01-02 22:30:19 +00:00
Luigi Toscano 45714289e7 grenade: relevant fixes for master (sahara-api/apache)
- include lib/apache when appropriate;
- use devstack@sahara-eng for sahara-engine;
- do not check for sahara-api, as the stop/start_sahara code should
  take care of it (both for the old case and the wsgi case).

Change-Id: I22bb6d51551b6c2540de09e7f307cef27aba0f23
2018-09-18 11:49:26 +02:00
Luigi Toscano 5a3ae85cc1 Import the legacy grenade sahara job
While it would have been better to directly use a native Zuul v3 job,
the work towards a common grenade job seems to be stalled.
Import the job locally and fix some issues:
- make sure that the heat_tempest_plugin is loaded correctly,
  so that the heat upgrade tests work;
- bump the starting point from stable/ocata (!) to stable/queens;
  it will be changed to stable/rocky when grenade supports it;
  will require additional fixes due to the standalone->uwsgi change.
- import lib/apache so that wsgi deployment works.

Story: 2001686
Task: 24517
Change-Id: Ia8de2b8286287355e8e9d3f702027aa282ed8282
2018-09-03 19:46:18 +02:00
Zuul d700393657 Merge "Adapt to Keystone changes: use member instead of Member" 2018-08-23 17:23:09 +00:00
Luigi Toscano 77a106a85f Adapt to Keystone changes: use member instead of Member
Keystone now provides "member" by default.
It should not be a problem for upgrades when the configuration
is the default one, because Keystone is case-preserving and
Member and member are the considered the same:
https://docs.openstack.org/keystone/latest/admin/identity-case-insensitive.html

Change-Id: I3bd72631d57546dcf8b887833539fe3ccaac4e47
2018-08-08 16:11:49 +02:00
Luigi Toscano 7f5588024d Enable also ambari by default in devstack
It should not impact the usual features of devstack,
but no reason to not enable it.
The old hdp plugin was removed but this one was never added.

Change-Id: Ie93948966b90e286eac401673e6704694bacf249
2018-08-06 16:46:28 +02:00
Luigi Toscano 3ff85aba7b Deploy using wsgi by default
Complete the switch to wsgi and only use it from now on.
The default won't be changed for old branches (i.e. this change
should not be backported).

Story: 2001991
Task: 19622
Change-Id: Ia23083d0ec7c17a84e0bb4bc5db970cbfe57882a
2018-05-10 00:03:09 +02:00
chao liu f580f0e713 use . instead of source.
Code conventions: Use “.” to source script files
When you have to source a script file, for example ,
a credentials file to gain access to user-only or
 admin-only CLI commands, use . instead of source.
See more:
http://docs.openstack.org/contributor-guide/writing-style/code-conventions

Change-Id: Icaf20628e7b7480ee4ca4c85f9c5a3802b817070
2018-01-29 14:18:56 +00:00
Zuul 9c1045deca Merge "Remove use of unsupported TEMPEST_SERVICES variable" 2018-01-23 17:01:09 +00:00
ghanshyam ba6860d237 Remove use of unsupported TEMPEST_SERVICES variable
TEMPEST_SERVICES global variable is not supported
by devstack since long back.
- I380dd20e5ed716a0bdf92aa02c3730359b8136e4
- I9c24705e494689f09a885eb0a640efd50db33fcf

Service availability of tempest known services will be
set by devstack with local check.
- I02be777bf93143d946ccbb8e9eff637bfd1928d4

This commit removes the unused TEMPEST_SERVICES setting
Related-Bug: #1743688

Change-Id: I74575c6c6796f875bd4b5b36ced1563c46fb2e47
2018-01-23 16:51:39 +03:00
Jeremy Freudberg 4ea2a8efdf Stop abusing [keystone_authtoken]
That config section should be private for keystonemiddleware, so deprecate and
discourage its use for trusts creation.

Create a new config section for credentials to create trusts with.

Change-Id: I93b9a9b4c8003463c33439f116b9a72619512b98
2018-01-20 18:56:41 +00:00
zhangxuanyuan eaaa239240 Remove use_neutron from config
Nova network has been fully removed, remove use_neutron config
and related codes.

Change-Id: Ib9d87dd339d637b69fb27315d92228cbc523c8eb
Closes-Bug: #1693891
Implements: bp sahara-remove-nova-network
2017-11-24 23:27:33 +08:00
Zuul ccf6da924c Merge "Policy in code for Sahara" 2017-10-23 18:12:28 +00:00
Telles Nobrega 5d208ed486 Policy in code for Sahara
This patch is part of the community goal to move policies into code.

https://governance.openstack.org/tc/goals/queens/policy-in-code.html

Change-Id: I8f228ca40acc589b9aa41fc1e80a1c0308f179cf
2017-10-23 11:46:31 -03:00
Luigi Toscano af224335ca devstack plugin: set two parameters required by Keystone v3
Namely user_domain_name and project_domain_name in the
keystone_authtoken section, and use the variable provided
by devstack and used internally by other components too.

Change-Id: I569e30699f7b25f948b17ce99a8540b9f4c3c321
2017-10-10 18:31:41 +02:00
Luigi Toscano cfecd605b1 grenade: do not use the removed glance v1 API
glance v1 API has been disabled by default in DevStack before Pike:
https://review.openstack.org/#/c/343129/

Change-Id: Ia76ca3422673eec251b5c6076cf26056e0008a69
2017-09-04 12:49:18 +02:00
Luigi Toscano 5abae32028 Fully switch to keystone authtoken parameters
The old v2 parameters are not set anymore by puppet-sahara:
https://review.openstack.org/#/c/441223/
and trust (which means cluster operations) is broken.

Because puppet-sahara is used by TripleO and Packstack, we consider
this a critical issue.

We now switch to the "new" v3 parameters from keystone_authtoken, as
incentivized by that puppet-sahara change.

We no longer use the custom options admin_user_domain_name and
admin_project_domain_name, as [keystone_authtoken] can provide them.

Note 1: A workaround is needed to access some of the configs in
[keystone_authtoken], as they are considered private for
keystonemiddleware. In sahara-api, it would have been possible to
grab these configs with only a slight bit of magic, as sahara-api
is a keystonemiddleware-enabled WSGI application. However, with
sahara-engine it is not as straightforward, since keystonemiddleware
is not integrated there. Therefore, to access these private configs
we use a very sneaky workaround inspired by [0]. This should be
removed in Queens: we should add a separate, non-private
[clients_keystone] section in sahara.conf. That is the standard way to
grab service user credentials when excluded from access to
[keystone_authtoken]. Unfortunately we could not have done that in Pike
as it was too late to have a new puppet-sahara release.

Note 2: tools/get_auth_token.py was not changed as it probably
requires other changes to work with Identity v3.

[0] Ibbc738ee4c90392af47f1b6d69aee3c8dbbf3c17

Closes-Bug: #1709091
Co-Authored-By: Jeremy Freudberg <jeremyfreudberg@gmail.com>

Change-Id: I930e544b16f0871f5e8dc1a42aae34518ff25bcd
2017-08-09 14:43:21 +00:00
zhuli 067a281632 enable heat during devstack installation
Change-Id: I0693e135f57e979bf61c9f1ce064596a6272d64c
Closes-Bug: #1708839
2017-08-07 09:11:06 +08:00
Vitaly Gridnev 082ec2a9ed remove workaround in grenade
Change-Id: I85c23c42f3f52918a52c2f947e6d354c42c969b6
2017-06-15 12:12:03 +00:00
Vitaly Gridnev ac694a2f7e Fixed grenade job
Several issues are fixed in this commit:

1. Issue with roles of 'sahara_grenade' user (added workaround to the
keystone problem)
2. Redundant services are no longer enabled in settings, correct
branches of plugins (heat, sahara) are enabled now.
3. Since there is an issue with deletion of floatings in master of heat,
so replaced cluster deletion into ocata's branch step. We should
replaced that back once it's fixed in heat.

Change-Id: I40cf381faacc7e6512d0a35e144d705f47fad81f
2017-06-09 11:46:28 +00:00
Jeremy Freudberg b4fb2c404c Use neutronclient for all network operations
Latest novaclient 8.0.0 removed nova-network
related functionality which Sahara depended on for
network operations, even for Neutron.

Now, use neutronclient (and Neutron resources in
Heat) for all network operations.

Additionally, fix devstack coordination backend.

Partially-Implements: bp sahara-remove-nova-network
Closes-Bug: #1692551
Co-Authored-By: Vitaly Gridnev <vgridnev@mirantis.com>
Change-Id: I6b8e12f0d33752e7790c5f40ebe6a3940ff1b0c1
2017-06-07 13:05:16 -04:00
Vitaly Gridnev 6eee9f9220 Add ability to install with Apache in devstack
Change-Id: I9e9bc6edaca948ea4af7868901f76623c8d0d9c5
2017-03-19 12:31:08 +00:00
Vitaly Gridnev c84aa59fa4 Fix logging inside of devstack plugin
Change-Id: Ib0c76ec89708e743bf589a8a438484289da43f5c
2017-03-18 23:42:38 +04:00
Luigi Toscano fbd43c3acf Configure the publicURL instead of adminURL in devstack
A recent change in devstack reduced the number of endpoints configured
by default. See Ided7a65c81b3a0b56f0184847fc82e17c29a771e .

So use publicURL directly as suggested by Sean Dague.

Change-Id: I16ec6100f098f7cb7cddde9f5d41d4aa830e0029
2017-02-21 18:46:06 +01:00
Vitaly Gridnev 7864cc4058 fix creation of endpoints
Change-Id: I0a9bc1df10dc2c5727e186a0c565965663e3c0d5
2016-11-23 13:45:12 +03:00
Jenkins a18c8a897a Merge "Remove enable_notifications option" 2016-11-10 20:36:15 +00:00
OpenStack Proposal Bot a4a3b18f89 Remove enable_notifications option
In the oslo.messaging to enable or disable notifications
uses the 'notification_driver' option. This approach used
in many Openstack projects.

By default the option is empty, that means no notification will be send.
To enable notification needs to set the value with one of supported drivers
(e.g. messagingv2).

Change-Id: Ifdc38d56a4fa3a1755fff72d4bef88937c0170ed
2016-11-09 12:50:43 +00:00
Daniel Gonzalez f254ad73cb Replace 'sudo pip install' with pip_install
Configuration of sahara in devstack behind a proxy fails because the
installation of "tooz[zookeeker]" does not work.

This is because sudo does not preserve environment variables, so pip
does not use the configured proxy. Using 'pip_install' instead of
'sudo pip install' should fix this, since 'pip_install' ensures that
the environment is preserved.

Change-Id: I78d483e86c586846f92bdc7118d495efe7e6df17
Closes-Bug: #1632673
2016-10-12 13:25:50 +02:00
Luigi Toscano cad6b79f9d Fill tempest.conf with Sahara-specific values
Initialize tempest.conf with the set of available plugins.

Change-Id: I1e963fe4110b94c1e4f18134e0a908ff309cd4e5
2016-09-16 18:33:20 +02:00
Michael Ionkin e3c25efef0 Replace old CLI calls in grenade
This patch replaces old CLI calls (sahara) with new ones (openstack
dataprocessing) in grenade.
Also some code refactoring is done.

Change-Id: If818032b3d438cf28f2d939140039db6280409fb
2016-08-19 12:55:00 +03:00
Jenkins 27253b9969 Merge "ability to configure endpoint type for services" 2016-07-06 12:30:02 +00:00
Vitaly Gridnev 27be399fea fixing sahara-engine setup in devstack
when distributed periodics are enabled and zookeeper
as backend is provided, sahara-engine startup fails.
this change is fixing that.

documentation updated with details of how to correctly setup
coordination backend.

Closes-bug: 1597688
Change-Id: Ib1b85dcd4e2b67d1ec9b577d103c689a07b93058
2016-06-30 11:38:12 +00:00
Vitaly Gridnev 890f3416ce ability to configure endpoint type for services
this adds ability to configure endpoint type for
services in devstack by addition of new option for
that.

Closes-bug: 1573868
Change-Id: I9dfa6b636aeb1efb781fa20c674b39a6d2cda01f
2016-06-25 16:17:00 +00:00
Michael Ionkin fba2d67ed9 novaclient.v2.images to glanceclient migration
The novaclient.v2.images module is deprecated and will be removed
after Nova 15.0.0 is released so we need to migrate to glanceclient.

note: glanceclient doesn't have any Image class. It have image json
schema and use it to generate warlock models when creates image
object.

closes-bug: 1573595
Depends-on: I2e13867bed72fd2ae6749491dd5b032c2c08f9f6
Change-Id: Ie0f04c15e6e49e8e7c77f7b7d870a368cdd5c7c7
2016-06-24 15:57:46 +03:00
Vitaly Gridnev b122ffbfff fix grenade from mitaka upgrade
Change-Id: I394efc93fd8943d751ece2f89608ea5b04118213
2016-06-14 10:28:15 +00:00
Jenkins 18aa22e7c5 Merge "Remove hdp 2.0.6 plugin" 2016-06-02 18:16:16 +00:00
Jenkins 712aaf28b1 Merge "remove verbose option in devstack plugin" 2016-05-17 21:50:07 +00:00
Vitaly Gridnev 037ba02ea7 Remove hdp 2.0.6 plugin
Newton release is opened, so we can remove this
plugin from sahara codebase

Implements blueprint: remove-hdp206
Change-Id: I1ebf90e716964151c88de53d127789251bef066b
2016-05-17 23:28:12 +03:00
Vitaly Gridnev 3bc9f05e9d Fix grenade
this commit fixes grenade job

Change-Id: I766d61cd0d8864f07c0cb1963b2efeadaf2a0b56
2016-05-16 17:14:51 +00:00
ZhiQiang Fan 54d464773b remove verbose option in devstack plugin
This option is deprecated in Mitaka and has been removed in Newton,
and its default value is True already. Let's remove it.

Change-Id: I83bff581b39bc416b84f2ffbb8217b41b7ad2058
ref: https://review.openstack.org/#/c/314573/
2016-05-13 20:15:12 +08:00