Commit Graph

37 Commits

Author SHA1 Message Date
songwenping b2df56e8f9 Dropping lower constraints testing
We facing errors related to the new pip resolver, this
topic was discussed on the ML and QA team proposed to
to test lower-constraints [1].

I propose to drop this test because the complexity and recurring pain needed
to maintain that now exceeds the benefits provided by this mechanismes.

[1] http://lists.openstack.org/pipermail/openstack-discuss/2020-December/019390.html

Change-Id: I95a19854bc55d92b63e1a826daf97e8b58711a07
2021-04-25 03:05:32 +00:00
Ghanshyam Mann 7cf2014c2e [goal] Deprecate the JSON formatted policy file
As per the community goal of migrating the policy file
the format from JSON to YAML[1], we need to do two things:

1. Change the default value of '[oslo_policy] policy_file''
config option from 'policy.json' to 'policy.yaml' with
upgrade checks.

2. Deprecate the JSON formatted policy file on the project side
via warning in doc and releasenotes.

Also replace policy.json to policy.yaml ref from doc and tests.

[1]https://governance.openstack.org/tc/goals/selected/wallaby/migrate-policy-format-from-json-to-yaml.html

Change-Id: I3b9aeb3379a76f7e40dab0c46e27f4447a0c3d03
2020-12-22 16:47:46 +07:00
Renat Akhmerov ef162b9efa Fix version of requests in constraints
Change-Id: I5696e74e58ff3594a5c65e51c12652c2a3e62038
2020-12-22 15:12:52 +07:00
wu.shiming b3f609d165 Update doc8 version
doc8 only supports python version less than 3.4

[1] https://pypi.org/project/doc8/0.8.0/

Change-Id: I065a83788bb051c2505ae6ad985b649ecc191f23
2020-12-14 15:27:09 +00:00
Renat Akhmerov 1c44a2b1db Fix constraints
* Due to the recent PIP version update requirements checks are
  now more rigorous. This patch fixes another issue that originally
  started with an incompatibility in the "mistral-lib -> eventlet" and
  the "oslo.service -> eventlet" dependencies, so the version of
  "oslo.service" had to be bumped up. But then it also went on to having
  to bump up versions of "oslo.utils" and "tempest" to avoid conflicts.

Change-Id: Idfc2ae6db344cc788ddf7f0b3883b678af213621
2020-12-14 12:23:08 +07:00
Renat Akhmerov 06a0f33476 Refactor Mistral with Action Providers
* This patch refactors Mistral with the action provider concept
  that is responsible for delivering actions to the system. So
  it takes all the burden of managing action definitions w/o
  having to spread that across multiple subsystems like Engine
  and API and w/o having to assume that action definitions are
  always stored in DB.
* Added LegacyActionProvider  that represents the old way of
  delivering action definitions to the system. It pretty much just
  analyses what entries are configured in the entry point
  "mistral.actions" in setup.cfg and build a collection of
  corresponding Python action classes in memory accessible by names.
* The module mistral/services/actions.py is now renamed to
  adhoc_actions.py because it's effectively responsible only for
  ad-hoc actions (those defined in YAML).
* Added the new entry point in setup.cfg "mistral.action.providers"
  to register action provider classes
* Added the module mistral/services/actions.py that will be a facade
  for action providers. Engine and other subsystems will need to
  work with it.
* Other small code changes.

Depends-On: I13033253d5098655a001135c8702d1b1d13e76d4
Depends-On: Ic9108c9293731b3576081c75f2786e1156ba0ccd
Change-Id: I8e826657acb12bbd705668180f7a3305e1e597e2
2020-09-24 11:10:33 +00:00
Q.hongtao 4bc6162515 Remove six library
Remove six-library Replace the following items with Python 3 style code.
- six.interger_types
- six.itervalues
- six.text_type
- six.string_types
- six.StringIO
- six.next
- six.b
- six.PY3

Change-Id: I299c90d5cbeb41be0132691265b8dcbeae65520e
2020-09-23 10:27:12 +08:00
Q.hongtao ac84e6d8ee Remove translation sections from setup.cfg
These translation sections are not needed anymore,
Babel can generate translation files without them.

Change-Id: I093f9886e74a808cedca0ee6610d51e91c88b1e8
2020-09-19 09:16:20 +08:00
Ghanshyam Mann b55cc013c1 [goal] Migrate testing to ubuntu focal
As per victoria cycle testing runtime and community goal[1]
we need to migrate upstream CI/CD to Ubuntu Focal(20.04).

Fixing:
- bug#1885825
Fix user creation with GRANT in MySQL 8.0(Ubuntu Focal)
Ubuntu Focal (20.04) has mysql 8.0 and with mysql 8.0 there
is no implicit user creation with GRANT. We need to
create the user first before using GRANT command.

Story: #2007865
Task: #40196

Closes-Bug: #1885825

[1] https://governance.openstack.org/tc/goals/selected/victoria/migrate-ci-cd-jobs-to-ubuntu-focal>

Change-Id: Idb053c8b1bfde9870eea80f66e5aef156422a668
2020-09-17 14:46:27 +00:00
Hervé Beraud d0d75be7cb drop mock from lower-constraints
The mock third party library was needed for mock support in py2
runtimes. Since we now only support py36 and later, we don't need it
in lower-constraints.

These changes will help us to drop `mock` from openstack/requirements

Change-Id: I1ee45007d9d4e477d7326e93dff62ca17b217789
2020-06-09 01:22:21 +02:00
Hervé Beraud c4c11c9b85 Cap jsonschema 3.2.0 as the minimal version
Previous versions of jsonschema (<3.2.0) doesn't support python 3.8 [1].
Python 3.8 is part of the victoria supported runtimes [2] so we now force
to use jsonschema version 3.2.0 to avoid issues, remove ambiguity and ensure
that everything works with python 3 in general.

[1] https://github.com/Julian/jsonschema/pull/627
[2] https://governance.openstack.org/tc/reference/runtimes/victoria.html#python-runtimes-for-victoria

Change-Id: I65b1fcff16f7633325a0f42c4ac9ef442f1b352b
2020-05-26 21:52:50 +02:00
Andreas Jaeger 4b52d4d458 Switch to newer openstackdocstheme and reno versions
Switch to openstackdocstheme 2.2.1 and reno 3.1.0 versions. Using
these versions will allow especially:
* Linking from HTML to PDF document
* Allow parallel building of documents
* Fix some rendering problems

Update Sphinx version as well.

Set openstackdocs_pdf_link to link to PDF file. Note that
the link to the published document only works on docs.openstack.org
where the PDF file is placed in the top-level html directory. The
site-preview places the PDF in a pdf directory.

Disable openstackdocs_auto_name to use 'project' variable as name.

Change pygments_style to 'native' since old theme version always used
'native' and the theme now respects the setting and using 'sphinx' can
lead to some strange rendering.

Remove docs requirements from lower-constraints, they are not needed
during install or test but only for docs building.

openstackdocstheme renames some variables, so follow the renames
before the next release removes them. A couple of variables are also
not needed anymore, remove them.

Remove python 3 versioning from lower-constraints and
requirements to pass requirements-check.

See also
http://lists.openstack.org/pipermail/openstack-discuss/2020-May/014971.html

Change-Id: Id478711abb1783422ebb4ee9937d1b7202fdf2f3
2020-05-21 15:50:23 +02:00
Andreas Jaeger 2c99ddc3ef Update hacking for Python3
The repo is Python 3 now, so update hacking to version 3.0 which
supports Python 3.

Update local hacking checks for new flake8.

Remove hacking and friends from lower-constraints, they are not
needed in installations.

Change-Id: Ia4740a1dc343d7a4a303674d9377bc64f6df762b
2020-04-01 20:01:29 +02:00
Renat Akhmerov fe71a0d33a Bump oslo.serialization version to 2.21.1
* Starting version 2.21.1 oslo.serialization adds the parameter
  "fallback" to its "jsonutils.to_primitive" method. We need it
  to address some issue related to JSON serialization.

Change-Id: I1081a44a6f305eb1dfe68a5bad30110385130725
2020-03-31 17:10:29 +07:00
Eyal 5aa1c70452 Fix requirements
Make sure lower constraints supports python37 (async is a reserved word)

Change-Id: Ic706d7a7ecb28d86bff034a2f9227c63705edcae
2020-02-26 10:12:27 +02:00
Eyal 8bdf341af7 Remove OpenStack actions from mistral
Depends-on: https://review.opendev.org/#/c/703296/
Depends-On: https://review.opendev.org/#/c/704280/
Change-Id: Id62fdabe7699e7c3b2977166e253cfc77779e467
2020-02-26 10:12:01 +02:00
Oleg Ovcharuk c1c21d7cdd Disable key sorting in workflow definition
Update to PyYAML 5.1 to be able to turn off key sorting
in workflow definitions. We should not change user's data
until user asks to.

Change-Id: I888008ac8f9c12bd92a9bd72bd7c276a11827847
Closes-Bug: #1815515
Signed-off-by: Oleg Ovcharuk <vgvoleg@gmail.com>
2020-01-21 00:40:26 +03:00
Renat Akhmerov c888a46ccc Fix keycloak authentication
* Implement offline access token validation using Keycloak public key.

Closes-bug: #1857871
Change-Id: I0eecec4b4e64381cac005622b16c6d9e4bed4df6
2020-01-14 15:51:06 +07:00
Eyal 80ff52284e Make sure minimum amqp is 2.5.2
amqp fixed a bug in 2.5.2 that is needed

Depends-On: https://review.opendev.org/#/c/694248/
Closes-bug: #1852058

Change-Id: I7d82be4c9174676539d9ea4132504a47ff6e5e0b
2019-11-14 11:43:40 +00:00
caoyuan 6e89218125 tox: Keeping going with docs
Sphinx 1.8 introduced [1] the '--keep-going' argument which, as its name
suggests, keeps the build running when it encounters non-fatal errors.
This is exceptionally useful in avoiding a continuous edit-build loop
when undertaking large doc reworks where multiple errors may be
introduced.

[1] https://github.com/sphinx-doc/sphinx/commit/e3483e9b045

Change-Id: Ife98c47af59355540fa30d7ca762f857759c1274
2019-10-24 13:20:19 +00:00
Renat Akhmerov 9103b5439d Add the explicit dependency from kombu
* The explicit dependency from kombu forces the right version of
  amqp to be downloaded. Otherwise the "docs" job fails with a
  version conflict because it downloads amqp 2.5.2 but the
  upper constraints allow only 2.5.1. This is rather a workaround
  that unblocks CI until https://review.opendev.org/#/c/681382/
  is merged

Change-Id: I990d125e86943c019dc1b60070cb67c4f75787c0
2019-10-02 16:58:56 +07:00
ali 7e7f1cb92b moved generic util functions from mistral to mistral-lib
Depends-On: I780c270e4b1a184d7d4dcc580d23697ba75edab1
Closes-bug: #1815183
Change-Id: I5a1d402baa3f69c37f9347c8b3d02a83b8f60423
2019-09-13 04:06:27 +00:00
Hongbin Lu 60536f6912 Bump lower constraint of python-zunclient
Projects that depends on python-zunclient should use the latest
version as lower constraint.

Change-Id: I561736d522033dad841fbcbb03645fff880c9df2
2019-09-01 22:38:04 +00:00
Eyal d8a127abe2 Upgrade hacking
Added some pep exclusion to tox
Change in test the import from pep8 to pycodestyle
needed by the new version of hacking

Change-Id: I61fca207f375f3d43241da59d7c9213ac9401a21
2019-08-06 15:49:13 +03:00
Renat Akhmerov 4a9d55a1b0 Retry a DB transaction on "Too many connections" error
* Writing a unit test is very problematic but the fix has been
  tested manually.

Closes-Bug: #1837532

Change-Id: I4fa15994a7359a5f90a0a4671d47b19fe928cf33
2019-07-23 13:22:25 +00:00
Brad P. Crochet b6ebcb3bd0 Use SessionClient for Ironic actions
The HTTPClient for Ironic is deprecated and will be removed in Stein.
Use the SessionClient for Ironic actions instead. Also uses
endpoint_override param instead of endpoint, as that is also
deprecated.

Change-Id: Ida3b502b25887ec9a7b51c4d6497699cc9466f05
2019-07-07 06:10:05 +00:00
John Eckersberg b97b24856f Use eventlet-aware threading events
For the gory details behind this, see:

https://bugzilla.redhat.com/show_bug.cgi?id=1384183

In summary, if you use threading.Event on python2 with eventlet, it
unnecessarily spams system calls to epoll_wait and burns a *lot* of
CPU cycles by constantly context-switching.

I added eventletutils.Event to oslo_utils a while back to
intelligently use the eventlet Event object when eventlet is being
used, and to fall back to the threading one otherwise.  So just use
that and it will do the right thing.

Depends-On: https://review.openstack.org/#/c/558879/
Change-Id: I6ca0d0fc2a2ff393bab502a5f705fb0d63c32c6b
2019-06-17 13:27:55 +02:00
翟小君 6dc981d814 Bump openstackdocstheme to 1.30.0
Some minor updates including fixing issues with the HTML5 output
generated by Sphinx 2.0, inlining the OpenStack logo rather than
referencing it from elsewhere, and adding a new SOURCE_DATE_EPOCH option
for use in reproducible builds in new release openstackdocstheme 1.30.0.
...to pick up many improvements, including the return of table borders.

Change-Id: I22b652e1eb007616e697cb238fcd9e5f010cd693
2019-06-06 14:27:41 +08:00
Hervé Beraud 831162ac0a Constraint networkx to <2.3 for Python 2
NetworkX released 2.3, dropping support for Python 2.

 https://github.com/networkx/networkx/blob/master/doc/news.rst

 Also see I0a9700926c9a0db93e782c853c33f1aaee3d4876

 fixed sphinx requirements also according to global requirements
 
 jsonschema should be uncaped also according to global requirements
 but there are conflicts with zakarclient designateclient and irconicclient
 
 so for now I put it in remark

Change-Id: Iea3dbcfa1f6ddf2c413ede5e73fa076c6edccfdf
2019-05-23 09:10:07 +00:00
Renat Akhmerov 97f4fc2776 Setting the lower version of sphinxcontrib-pecanwsme to 0.10.0
* Sphinx 2.0.0 was released on Mar 28 and sphinxcontrib-pecanwsme
  became incompatible with it. The version 0.10.0 was released
  to fix that.
* See https://review.openstack.org/#/c/649264/

Depends-On: I0378297e099412191a4adc41e53b0eb23f6c43ae
Change-Id: Icb0163f553af690192bfab0e192a32d793db28a9
2019-04-04 05:03:27 +00:00
Brad P. Crochet 0085d08baa Stop using deprecated keystone_authtoken/auth_uri
keystone_authtoken/auth_uri is deprecated [1]. Use www_authenticate_uri
instead.

keystonemiddleware in requirements and lower constraints should be increased
because www_authenticate_uri was introduced in keystonemiddleware 4.18.0.

[1] https://review.openstack.org/#/c/508522/

Change-Id: I99b0ee941d702a28fb4f392d9747d0e2257a42c8
Closes-Bug: #1788174
2019-02-19 10:37:23 +00:00
Jose Castro Leon a2756a34c2 Support Manila actions in Mistral
Adds manila actions into the available list of actions for mistral

Change-Id: Ic0a3c24f72d91a8a87ffcf81db763058bcbf8566
Closes-Bug: #1783291
2018-07-24 15:11:08 +02:00
Brad P. Crochet 9883814cdc Switch to using stestr
When the TC merged I2637dd714cbb6d38ef8b8dc1083e359207118284 we're
supposed to invoke stestr rather than testr so lets do that

Change-Id: Icd303c37d2371d44726d55c947bbc8b9e99f2a1c
2018-05-30 14:46:25 -04:00
Lingxian Kong 4fe4198ac8 Support Qinling actions in Mistral
An example can be found in the task description.

Remove the cap on networkx library according to:
13644d63c6 (diff-d7d5c6fa7118ea10d88f3afeaef4da77)

Depends-On: https://review.openstack.org/#/c/567971/
Change-Id: I168a32b8c73b4b30224ce8f27bcde9cfa2b8d2ad
Story: 2002014
Task: 19654
2018-05-16 21:27:42 +12:00
pengdake 11896ba733 Support actions for zun
Add ZunAction for zun. Zun is an OpenStack Container service. It aims to
provide an API service for running application containers without the
need to manage servers or clusters.

Change-Id: Ibbe4777528b5af6fdb3a6c2ed3345f8f9c804bef
Signed-off-by: pengdake <19921207pq@gmail.com>
2018-04-27 09:52:19 +08:00
Jaewook Oh f25fb43177 Added Vitrage actions into Mistral
Implements: blueprint mistral-vitrage-actions

Change-Id: I11068c1f1a0d7ee6973e7c736ba92c475f7d0902
2018-04-24 22:41:04 +09:00
Doug Hellmann b8db6c6bc4 add lower-constraints job
Create a tox environment for running the unit tests against the lower
bounds of the dependencies.

Create a lower-constraints.txt to be used to enforce the lower bounds
in those tests.

Add openstack-tox-lower-constraints job to the zuul configuration.

Update the lower-bounds for a few dependencies to make the tests pass,
including eventlet and greenlet.

Remove the duplicate dependency on pecan.

See http://lists.openstack.org/pipermail/openstack-dev/2018-March/128352.html
for more details.

Change-Id: I74c7cae0ceccd5aff77d5955c69ca842c598d633
Depends-On: https://review.openstack.org/555034
Depends-On: https://review.openstack.org/555402
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2018-04-18 09:54:55 -04:00