Commit Graph

96 Commits

Author SHA1 Message Date
hejunli 7f3c2dd0b5 Python3.6/3.7 are deleted in testing runtime
Python3.6 and Python3.7 are no longer supported by zed cycle tests, and Python3.9 was added when Python3.6 and Python3.7 were removed.

Change-Id: Ie3f0da2775b59df8d01e560b4e507cd331948ae7
2022-05-13 18:52:40 +08:00
maaoyu c8a133eab4 setup.cfg: Replace dashes with underscores
Setuptools v54.1.0 introduces a warning that the use of dash-separated
options in 'setup.cfg' will not be supported in a future version [1].
Get ahead of the issue by replacing the dashes with underscores. Without
this, we see 'UserWarning' messages like the following on new enough
versions of setuptools:

  UserWarning: Usage of dash-separated 'description-file' will not be
  supported in future versions. Please use the underscore name
  'description_file' instead

[1] https://github.com/pypa/setuptools/commit/a2e9ae4cb

Change-Id: I118a1237071f206e434997377fb46c02fe11eb08
2021-05-04 10:16:13 +08:00
Ghanshyam Mann 9a69cc52b6 [goal] Deprecate the JSON formatted policy file
As per the community goal of migrating the policy file
the format from JSON to YAML[1], we need to do two things:

1. Change the default value of '[oslo_policy] policy_file''
config option from 'policy.json' to 'policy.yaml' with
upgrade checks.

2. Deprecate the JSON formatted policy file on the project side
via warning in doc and releasenotes.

Also replace policy.json to policy.yaml ref from doc and tests.

[1]https://governance.openstack.org/tc/goals/selected/wallaby/migrate-policy-format-from-json-to-yaml.html

Change-Id: Ib2101f13171940857fe81f64dd9798dfe489743a
2021-03-30 04:02:11 +00:00
wu.chunyang b826f6daac Remove translation sections from setup.cfg
These translation sections are not needed anymore, Babel can
generate translation files without them.

Remove babel.cfg as well, this is the default role and not needed
anymore.

also remove Babel from requirements[1]
[1] http://lists.openstack.org/pipermail/openstack-discuss/2020-April/014227.html

Change-Id: Iead96312102da530a006fc259bab80ad37e55b76
2020-06-21 18:31:40 +08:00
Sean McGinnis e1fda8353b
Add py38 package metadata
Now that we are running the Victoria tests that include a
voting py38, we can now add the Python 3.8 metadata to the
package information to reflect that support.

Change-Id: Ib54733f753031893b150190991779dbc5cdd261d
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2020-05-02 07:48:16 -05:00
Andreas Jaeger 7977b49dda Cleanup Python 2.7 support
OpenStack is dropping the py2.7 support in ussuri cycle.

Make a few cleanups:
- Remove python 2.7 stanza from setup.py
- Add requires on python >= 3.6 to setup.cfg so that pypi and pip
  know about the requirement
- Remove ancient pbr section from setup.cfg
- Update requirements
- Use newer openstackdocstheme and setup storyboard support for it
- Remove Babel as requirement, this is not needed here anymore.

Change-Id: I0fd6fbdcbe788b0dfc2b1e20989b0a19ceec59f5
2020-04-22 08:31:22 +02:00
Ghanshyam Mann 17c3249a27 [ussuri][goal] Drop python 2.7 support and testing
OpenStack is dropping the py2.7 support in ussuri cycle.

sahara is ready with python 3 and ok to drop the
python 2.7 support.

Complete discussion & schedule can be found in
- http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010142.html
- https://etherpad.openstack.org/p/drop-python2-support

Ussuri Communtiy-wide goal:
https://governance.openstack.org/tc/goals/selected/ussuri/drop-py27.html

Other required Sahara changes:
- port the image building job to CentOS 8, and thus Python 3.

Depends-On: https://review.opendev.org/#/c/693631/
Depends-On: https://review.opendev.org/#/c/694699/
Change-Id: I30485a9933d38db76c031c6e760598c4e47123fc
2020-01-14 18:38:26 +01:00
ZhongShengping bc049c9fc2 Update Python 3 test runtimes for Train
This goal is to implement the process set out in the 2018-10-24 Python
Update Process TC resolution[1], for the Train cycle to ensure unit
testing is in place for all of the Tested Runtimes for Train[2].
In practice, this generally means adding unit tests for Python 3.7 and dropping
unit tests for Python 3.5. Using the Zuul template for Train will ensure that
all projects that support Python3 will be tested against the agreed runtime
versions, and make it easier to update them in future.

[1]https://governance.openstack.org/tc/resolutions/20181024-python-update-process.html
[2]https://governance.openstack.org/tc/reference/runtimes/train.html

Change-Id: If66a364be10271882629e0b278c8729172ff47bd
Depends-On: https://review.opendev.org/#/c/641878/
2019-05-09 17:34:24 +08:00
ZhongShengping 7b3588b871 Dropping the py35 testing
All the integration testing has been moved to
Bionic now[1] and py3.5 is not tested runtime for
Train or stable/stein[2].

As per below ML thread, we are good to drop the py35
testing now:
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/005097.html

[1] http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004647.html
[2]
https://governance.openstack.org/tc/reference/runtimes/stein.html
https://governance.openstack.org/tc/reference/runtimes/train.html

Change-Id: I853f7de090387303ce0456e64b47c17d0bb9769b
2019-04-15 08:56:19 +08:00
Telles Nobrega 92686f5a10 Prepare Sahara core for plugin split
On the effort to make Sahara more user and operators friendly
we are splitting the plugins from Sahara core.

The main goal of this change is to facilitate installation,
maintainance and upgrade of plugins. With the plugins outside
the main Sahara code, operators will be able to install a subset
of plugins, as well as upgrade to newer versions of the plugins
without having to wait for a new version of OpenStack to be
released. As well, it aims to facilitate new contributors to
develop and maintain their own plugins.

Sahara Spec: https://specs.openstack.org/openstack/sahara-specs/specs/rocky/plugins-outside-sahara-core.html

Change-Id: I7ed0945fd82e37daaf6b29f947d3dba06db9d158
2019-01-10 22:18:24 -03:00
Luigi Toscano 425c8256b9 Update devel info: mailing list, meeting time
- The new openstack-discuss mailing list is going to replace few
  mailing lists, including openstack-dev.
- There is only one meeting time now (1400UTC).

Change-Id: I14c5d37ae7f59095d00a7b26fa0a0fc23b01a33a
2018-11-21 18:35:53 +01:00
akhiljain23 cc41e8621b Add framework for sahara-status upgrade check
This commit adds the functionality of sahara-status CLI for performing
upgrade checks as part of the Stein cycle upgrade-checkers goal.
It only includes a sample check which must be replaced by real checks in
future.

Change-Id: Idcb8d9eaf689800812cf6087e9c5937058c89ea6
Story: 2003657
Task: 26152
2018-10-19 14:08:44 +00:00
Jeremy Freudberg a449558ac0 S3 data source
* Create S3 data source type for EDP
* Support storing S3 secret key in Castellan
* Unit tests for new data source type
* Document new data source type and related ideas
* Add support of S3 configs into Spark and Oozie workflows
* Hide S3 credentials in job execution info, like for Swift
* Release note

Change-Id: I3ae5b9879b54f81d34bc7cd6a6f754347ce82f33
2018-07-02 14:27:46 -04:00
Nguyen Hai edc7097416 Follow the new PTI for document build
For compliance with the Project Testing Interface as described in:
https://governance.openstack.org/tc/reference/project-testing-interface.html
http://lists.openstack.org/pipermail/openstack-dev/2017-December/125710.html

Remove the '[build_sphinx]' section as described in:
http://lists.openstack.org/pipermail/openstack-dev/2018-March/128594.html

Change-Id: Ia8e8d6b4e23c2737a9e948e7c4b682dca697f6a4
2018-03-27 19:48:02 +09:00
Jeremy Freudberg d05bf66592 S3 job binary and binary retriever
* Create common module for managing S3 job binaries
* Add new dependency on botocore
* Use common S3 library to create S3 job binary type for EDP
* Use common S3 library to create S3 job binary retriever
* Support storing S3 secret key in Castellan
* Document new job binary type (and foreshadow the S3 data source type)
* Unit tests for new code

Change-Id: I6781203d802305446ba1418ed6999186db4dfe9b
Partially-Implements: bp sahara-support-s3
2017-12-28 20:20:37 +00:00
Telles Nobrega 5d208ed486 Policy in code for Sahara
This patch is part of the community goal to move policies into code.

https://governance.openstack.org/tc/goals/queens/policy-in-code.html

Change-Id: I8f228ca40acc589b9aa41fc1e80a1c0308f179cf
2017-10-23 11:46:31 -03:00
Jesse Pretorius 873c4fed83 Add default configuration files to data_files
In order to make it simpler to use the default
configuration files when deploying services
from source, the files are added to pbr's
data_files section so that the files are
included in the built wheels and therefore
deployed with the code. Packaging and deployment
tools can then more easily use the default files
if they wish to.

This pattern is already established with similar
files for neutron, designate and glance as has
been mentioned in the related bug report.

Change-Id: Iae987bdae55b75143f192f9a642cf1ff564c62b6
Closes-Bug: #1718356
2017-09-22 13:54:51 +01:00
chenxing 952800ff0f Update Documention link
Change-Id: I39f0bc1c7b5ef8114f6391058ab4378638b50907
2017-07-13 13:26:47 +00:00
pawnesh.kumar 5bc58f1bc1 Enable warnings as errors for doc building
Treat warnings as errors for doc building - adding Sphinx'
warning-is-errors variable.

Change-Id: I12f9c92e8b8f9245614797e65af1ae48a0714923
2017-07-11 05:29:08 +00:00
Marianne Linhares Monteiro ab2e8fc309 Support Job binary pluggability
Changes to support the job binary abstraction.

Change-Id: If5133f2d35974f0b4ca1776bc9fe39f011575389
Implements: blueprint data-source-plugin
2017-03-18 21:19:02 +00:00
Jenkins e2fc4f8a4a Merge "Support Data Source pluggability" 2017-03-18 21:12:58 +00:00
Marianne Linhares Monteiro 1d8b52ca00 Support Data Source pluggability
Changes to support the data source abstraction.

Change-Id: I62274c08619c8e720231eb6aa0563ac6e12497f1
Implements: blueprint data-source-plugin
2017-03-15 09:06:12 -03:00
Cao Xuan Hoang f0ff85396a Remove support for py34
The gating on python 3.4 is restricted to <= Mitaka. This is due to
the change from Ubuntu Trusty to Xenial, where only python3.5 is
available. There is no need to continue to keep these settings.

Change-Id: Ifbe877705dbd87dea34d2b1974d2ae3ed7cac9a3
2017-02-08 10:34:02 +07:00
Shu Yingya 83a6a28683 Remove entry point of sahara tempest plugin
In patch [1], tempest-like test of sahara client has been removed.
But in setup.cfg, there still is entry point of it. Remove it!

[1]:https://review.openstack.org/#/c/367980/

Change-Id: I802e27b91486baa43286bc949e304448ad1610f1
2016-09-11 23:25:58 +08:00
Jenkins 24bee0ee47 Merge "Add Python 3.5 classifier and venv" 2016-07-25 10:33:38 +00:00
PanFengyun d9bd4980c8 Add Python 3.5 classifier and venv
Now that there is a passing gate job, we can claim support for
Python 3.5 in the classifier. This patch also adds the convenience
py35 venv.

Change-Id: I15a761c0b6d5769b2dba9f521ef96cf43c99e552
2016-07-14 21:49:12 +08:00
Ethan Gafford 4b70223bf2 CLI for Plugin-Declared Image Declaration
Introduces a new libfuestfs-driven CLI for packing of
Sahara images, using the same recipe definition scheme
introduced in the validate-image-spi blueprint.

Documentation and plugin image packing configurability
can and will be provided in separate patches for ease
of review.

Partially-implements: blueprint image-generation-cli
Change-Id: I6788108e3fb6232045fc56937639a6348768a7bc
2016-07-13 14:41:00 -04:00
Vitaly Gridnev 037ba02ea7 Remove hdp 2.0.6 plugin
Newton release is opened, so we can remove this
plugin from sahara codebase

Implements blueprint: remove-hdp206
Change-Id: I1ebf90e716964151c88de53d127789251bef066b
2016-05-17 23:28:12 +03:00
Doug Hellmann 7c41f47ff9 register the config generator default hook with the right name
No config generator hooks should ever be registered with a name that
belongs to another project. In this case, using oslo.middleware.cors
means that *every other project* that loads the middleware gets this
application's defaults when the generator is run on a system with
everything installed (such as a dev box with devstack). Use the name
of the app instead, to ensure that the defaults are only set when this
app's sample config and documentation are being generated.

Change-Id: I6a8c7d44b9db9325003ff2fdb667b0ced7739e96
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2016-03-11 15:30:36 -05:00
Michael Krotscheck 8b4b3abdaf Moved CORS middleware configuration into oslo-config-generator
The default values needed for sahara's implementation of cors
middleware have been moved from paste.ini into the configuration
hooks provided by oslo.config. Furthermore, these values have been
added to the default initialization procedure. This ensures
that if a value remains unset in the configuration file, it will
fallback to using sane defaults. It also ensures that an operator
modifying the configuration will be presented with that same
set of defaults.

Change-Id: Iedcaa002ff3d40cf61168769bc3946f8c6e42b87
Closes-Bug: 1551836
2016-03-03 14:01:09 -08:00
Sergey Reshetnyak 3b43de1dc4 Add support running Sahara as wsgi app
This patch adds support of running sahara-api as wsgi application.
Tested with apache + mod_wsgi web server.

Change-Id: I7355b09ebedd44e51242a252e96ac3a51073b2e6
2016-02-15 14:40:55 +03:00
Sergey Lukjanov c139a3d86e Remove version from setup.cfg
Per [1] we now want to use the git repository for knowing the version instead
of just trying to modify the setup.cfg file.

[1] http://lists.openstack.org/pipermail/openstack-dev/2015-November/080692.html

Change-Id: I790506ea15e67f0cdeaed62b5b87a7d51c589e7b
Depends-On: I001a18895489a56eb55a5eb8c73ab6a3d4b1d4d0
2015-12-03 03:25:23 -08:00
Vitaly Gridnev 76b310414c Drop direct engine support
This change remove support of direct engine in Sahara.
Unit tests related to direct engine were removed.

Implements blueprint: remove-direct-engine

Change-Id: Iba292996dd052a069a98f1024441255a15c0f734
2015-11-19 07:59:23 +00:00
Thierry Carrez 9031e3f76d Open Mitaka development
Bump preversion to mark the start of the Mitaka development branch.
The liberty release branch will be cut from the previous commit.

Change-Id: I2e08186efb1d4f0d280bce11f2c3ac710bfa0a5d
2015-09-25 09:06:36 +02:00
Luigi Toscano 09279d54d5 Adapt python client tests to use Tempest plugin interface
Use the Tempest plugin interface for python client tests (which
are already tempest-based) instead of copying the tests inside
the tempest tree.

Inspired by the same type of change applied to Manila,
see Ie5ed64a6777ed1acf8dd56522c26705ae897596d

Depends-On: I06f1e13207cc6d661c078c4c4cf1ae7974ecf3da
Change-Id: I6073a528413aefd96882179a1eb8bbe715c6417b
2015-09-18 14:13:04 +02:00
Sergey Reshetnyak 3869ed88a0 New version of HDP plugin
Current features:
* Set up Ambari server and Ambari agents from pre-built image
* Support Ambari 2.0 / 2.1
* Password generation for management console

partially implements bp: hdp-22-support

Change-Id: I53084a83cccde52654a42911f449cc8b7d769bea
2015-08-20 13:04:43 +03:00
Sergey Vilgelm 16ae93ea21 Remove openstack.common package
Clean up the unused modules from the openstack.common package

Closes-Bug: #1476407
Change-Id: I5697f761c310dd8e13b7219b2968c3e6f4cfb299
2015-07-20 21:24:22 +00:00
Doug Hellmann c505a8d4d7 Update version for Liberty
Update the version for Liberty, switching from date-based versioning
to pre-versioning using SemVer. See
http://lists.openstack.org/pipermail/openstack-dev/2015-May/065211.html
and
http://lists.openstack.org/pipermail/openstack-dev/2015-June/067082.html
for details.

Change-Id: I6a35fa0dda798fad93b804d00a46af80f08d475c
2015-06-17 21:20:46 +00:00
Jenkins 45045d918f Merge "Open Liberty development" 2015-04-09 10:17:46 +00:00
Thierry Carrez f223fba1e8 Open Liberty development
Bump pre-version in setup.cfg to formally open Liberty development.
Kilo release branch will be cut from the previous commit.

Change-Id: I6fa1e9e45fbaae62f7feb64039565266cbc86788
2015-04-07 14:14:11 +02:00
Sergey Lukjanov 5b35bdffb5 Migrate to oslo.policy lib instead of copy-pasted oslo-incubator
The first official oslo.policy was released and so we're ready to
migrate from the copy-pasted oslo-incubator code to the separated
lib.

Change-Id: I8e404d2b622876389d9b1019ae50f1e1a8cecdf1
2015-04-06 10:13:51 +03:00
Trevor McKay e857447879 Add a CLI tool for managing default templates
This change adds a CLI called sahara-templates to manage default
templates.

Partial-implements: blueprint default-templates
Change-Id: I4f30bd6bc378d90fda41b512c04afe8023d2b4b2
2015-04-01 13:01:46 -04:00
Andrew Lazarev c945a9886b Reorganized heat template generation code
* Extracted heat template generation from
  'utils/openstack/heat.py' to 'service/heat/templates.py'.
  Now heat.py is for heat client only.
* Moved heat template resources from 'resources' to
  'service/heat/resources'
* Separated tests for heat templates and heat client.

Change-Id: I4c7a561f1648f34e71574a556cbc07ed2cf9b173
Closes-Bug: #1373075
2015-02-18 20:56:11 +00:00
Jenkins dffa00279e Merge "Remove log module from common modules" 2015-02-03 09:57:14 +00:00
Vitaly Gridnev a054199961 Remove log module from common modules
Log module was removed from oslo-incubator,
so let's sync with latest oslo-incubator and remove
log module.

Change-Id: Id27ade473ed8597f2741ed0c746fa6b7ef6c7f06
Related-bug: #1412673
2015-02-02 09:30:02 +00:00
ChangBo Guo(gcb) 33b12a36de Drop cli/sahara-rootwrap
It can be automatically generated from console_scripts entry in
setup.cfg. So we don't need maintain it for sahara.

Change-Id: Ibe2a170cc60eb69b44aec43fb61f367e53c47b9f
2015-01-30 14:41:40 +00:00
Andrew Lazarev ff1dcc7446 Added ability to listen HTTPS port
* Added oslo-inclubator 'sslutils' module dependency
* Added config params from sslutils
* Added ability to make SSL port for sahara-api

Implements blueprint: sahara-support-https

Change-Id: I184e39b6a0eb6ad17b51aa408a65a455983bfb0c
2015-01-09 14:43:01 -08:00
Jenkins 1366594bd8 Merge "Cleaned up config generator settings" 2015-01-08 02:07:37 +00:00
Michael McCune d39b6fc6cf Adding Storm entry point to setup.cfg
This change allows the stevedore package to find the Storm plugin when
enabling extensions.

Change-Id: I1748609caff74e073171d5e4a1b76fda9efef1d6
Closes-Bug: 1407120
2015-01-06 16:18:38 -05:00
Andrew Lazarev 7282251ee2 Cleaned up config generator settings
1. Sahara opts are listed once
2. Oslo incubator opts are listed separately
3. Groups are referenced by variables

Still things to improve:
1. opt-group mapping is listed twice now (in reg and in list)
2. registering spread across the project (should be in one place)
3. dependancies are not managed (it should be one place with CONF)

Change-Id: I4b8edf26187b3c23d08f9efbee42086652efea5a
Closes-Bug: #1407834
2015-01-06 12:14:44 -08:00