Commit Graph

168 Commits

Author SHA1 Message Date
Takashi Kajinami 5c900d4ab5 Bump hacking
hacking 3.0.x is too old.

Also remove the note about very old pip's behavior.

Change-Id: I6d2d180a9ec80664efae498f86a4d1f734aacfa5
2024-02-02 12:42:02 +00:00
Takashi Kajinami d14b039182 Remove indirect dependency (python-memcached)
The python-memcached library is not imported directly from this module
and can be dropped.

Change-Id: I32f5e373c18011940ed1bb2ae3c2d2d5e77a4d8c
2023-12-28 03:15:15 +00:00
Xing Zhang e0937b1f09
Use processutils to fix TypeError in subprocess
Calling processutils.execute() other than subprocess to
fix bytes-like and str issue in python3.

Closes-bug: #2029392
Change-Id: I16436aa19da2cf53951c9ad27bca14033194651a
2023-08-21 00:09:40 +08:00
OpenStack Release Bot 8049697fc9 Switch to 2023.1 Python3 unit tests and generic template name
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for antelope. Also,
updating the template name to generic one.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I29fcb9afa016b1321b0b4c0118a8d7ffbc00b02e
2023-01-21 09:29:14 +08:00
wanghao 2abee24a02 Add python3.8 requirement
According to the QA's request[1], we should drop the python3.6
support in Zed cycle, and add the requirement to python3.8.

[1]:http://lists.openstack.org/pipermail/openstack-discuss/2022-April/028321.html

Change-Id: I772621f28d723c88e227edd3b540ce133ea3feb2
2022-05-09 09:41:05 +08:00
wanghao db6a6b4908 Update swift client in Zaqar
Change-Id: I5af660388509f716adbe9e2ed9246b8dccdc6fd5
2021-05-18 15:39:31 +08:00
wanghao 8e17ad34fd Update the requirement of oslo db
Change-Id: I97baabf273991f2221e0c97816432eb751b5f48f
2021-03-26 08:57:45 +08:00
Ghanshyam Mann 948e88c268 [goal] Deprecate the JSON formatted policy file
As per the community goal of migrating the policy file
the format from JSON to YAML[1], we need to do two things:

1. Change the default value of '[oslo_policy] policy_file''
config option from 'policy.json' to 'policy.yaml' with
upgrade checks.

2. Deprecate the JSON formatted policy file on the project side
via warning in doc and releasenotes.

Also replace policy.json to policy.yaml ref from doc and tests.

[1]https://governance.openstack.org/tc/goals/selected/wallaby/migrate-policy-format-from-json-to-yaml.html

Change-Id: I595b8c7cad7bb02486c8f0dd29fdc40789fc8e50
2021-02-17 00:58:28 +00:00
wanghao bf086eb753 update lower constraints
Because autobahn 20.7.1 depends on cryptography>=2.7, we
need to update the version of cryptography.

Change-Id: Ib89beed50f5d6e63fe6d75bdd24a4c879bd4834a
2021-01-08 08:45:55 +08:00
melissaml 772db810a0 [Part1] Remove six
We don't need this in a Python 3-only world.
Remove six in follows:
1. zaqar/common/transport/wsgi/helpers.py
2. zaqar/common/urls.py
3. zaqar/common/utils.py
4. zaqar/notification/notifier.py
5. zaqar/notification/tasks/mailto.py

Change-Id: Iae6d4f415b215b9fdf675a0fcf00282fc98d58b7
2020-10-24 15:47:52 +08:00
Zuul bd4e5b62fc Merge "[goal] Migrate testing to ubuntu focal" 2020-09-19 05:41:10 +00:00
Ghanshyam Mann e35f9ad8d3 [goal] Migrate testing to ubuntu focal
As per victoria cycle testing runtime and community goal[1]
we need to migrate upstream CI/CD to Ubuntu Focal(20.04).

Fixing:
- bug#1885825
Fix user creation with GRANT in MySQL 8.0(Ubuntu Focal)
Ubuntu Focal (20.04) has mysql 8.0 and with mysql 8.0 there
is no implicit user creation with GRANT. We need to
create the user first before using GRANT command.

- bug#1886298
Bump the lower constraints for required deps which added python3.8 support
in their later version.

Co-Author: wanghao <sxmatch1986@gmail.com>

Story: #2007865
Task: #40229

Closes-Bug: #1885825

[1] https://governance.openstack.org/tc/goals/selected/victoria/migrate-ci-cd-jobs-to-ubuntu-focal>

Change-Id: Ic15dfe480e4d34c3ba102b65153fab1af787bd67
2020-09-18 11:28:46 -05:00
Zuul 854da437e8 Merge "Cap jsonschema 3.2.0 as the minimal version" 2020-08-27 01:48:50 +00:00
ZijianGuo 8baa824b85 Fix the issue that the function unpackb has no encoding option
Package msgpack has Removed the encoding option. Please refer to [1].

And the default encoding of python3 is 'utf-8', So there is no need to specify
the encoding as 'utf-8'.

[1] https://github.com/msgpack/msgpack-python/pull/380/files

Change-Id: Ibb92e983a79e5c1608f6a603816e1b88283e34c9
Closes-Bug: #1891008
Signed-off-by: ZijianGuo <guozijn@gmail.com>
2020-08-17 11:19:10 +08:00
wanghao e12c65a369 Encrypted Messages in Queue
The queue in Zaqar will support to encrypt
messages before storing them into storage backends,
also could support to decrypt messages when those
are claimed by consumer. This feature will enhance
the security of messaging service.

Implements: blueprint encrypted-messages-in-queue
Signed-off-by: wanghao <sxmatch1986@gmail.com>
Change-Id: Icecfb9a232cfeefc2f9603934696bb2dcd56bc9c
2020-07-23 14:07:54 +08:00
Hervé Beraud bf863c5e3a Cap jsonschema 3.2.0 as the minimal version
Previous versions of jsonschema (<3.2.0) doesn't support python 3.8 [1].
Python 3.8 is part of the victoria supported runtimes [2] so we now force
to use jsonschema version 3.2.0 to avoid issues, remove ambiguity and ensure
that everything works with python 3 in general.

[1] https://github.com/Julian/jsonschema/pull/627
[2] https://governance.openstack.org/tc/reference/runtimes/victoria.html#python-runtimes-for-victoria

Change-Id: Id7e0f5b9c2c54ec0d5f1f7b0cd8199bc60718971
2020-05-26 22:15:51 +02:00
Andreas Jaeger b6e1688b24 Doc cleanups
Switch to newer openstackdocstheme and remove settings that
are default now.

Change-Id: I27895a6fb91ba3be37831a697098718082eec00f
2020-05-13 17:49:28 +08:00
Ghanshyam Mann 22ade4fa77 [ussuri][goal] Drop python 2.7 support and testing
OpenStack is dropping the py2.7 support in ussuri cycle.

Zaqar is ready with python 3 and ok to drop the
python 2.7 support.

Complete discussion & schedule can be found in
- http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010142.html
- https://etherpad.openstack.org/p/drop-python2-support

Ussuri Communtiy-wide goal:
https://governance.openstack.org/tc/goals/selected/ussuri/drop-py27.html

Depends-On: https://review.opendev.org/#/c/693631/

Change-Id: I0fde9d2f16f3cc77be3d4cab482fa0fb7ab9e7fc
2019-12-13 00:22:57 +00:00
Sean McGinnis 1af2c91e41
Unblock gate failures
There are a few issues causing all gate runs to fail that are addressed
in this patch.

Update constraints to match global requirements:

There are a few local requirements that conflict with what is now in
upstream global-requirements. This updates sphinx to match the
constrained versions due to incompatibility with py2 and uncaps
jsonschema.

Update handling for falcon 2.0.0 behavior changes:

The 2.0.0 release of falcon changed the default values for two request
query parsing options that would cause failures due to unexpected
results. This sets those options to their previous defaults to maintain
compatibility across 2.0.0 and pre-2.0.0 versions of the package.
Lower constraint version raised to 1.1.0 where the options were
introduced.

There are additional integration test failures with Falcon 2.0.0 that
were due to changes in the subscription URL path.

Closes-bug: #1830903

Requirements and upper constraints not enforced in some tox targets:

The docs and api-ref tox targets were not setting the right dependencies
or the upper constraints to use for pip installs. Also updates the
constraints to the newer preferred static redirect URL maintained by the
release team.

Co-authored-by: wanghao <sxmatch1986@gmail.com>
Change-Id: I19c5363878c629a04e1be902c865ee7cea92dcd9
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2019-05-29 09:31:18 -05:00
whoami-rajat 37fc134d11 Add zaqar-status upgrade check command framework
This adds basic framework for zaqar-status upgrade
check commands. For now it has only "check_placeholder"
check implemented.
Real checks can be added to this tool in the future.

Change-Id: I855b4b72284df308c3bb250fd3a3f0fc643b4abf
Story: 2003657
Task: 26165
2018-12-12 06:08:06 +00:00
xywang cab8a15a41 Update the lower-constrainsts
The low-constrainsts is totally wrong, it contains
the upper ones. This patch copy the right ones from
openstack/requirements to fix the issue

Change-Id: Ic4f90ffc609d871a918091d93ee14896dc876be9
2018-05-09 06:30:50 +00:00
OpenStack Proposal Bot 5ccf37d9b7 Updated from global requirements
Change-Id: Iea5c11652dee4cd5f5b9c7e4ef9132f09884f7a9
2018-03-28 18:31:15 +00:00
OpenStack Proposal Bot e66ca5c7c9 Updated from global requirements
Change-Id: Id387f5550072f0538e57274bd1408743734302d7
2018-03-14 06:14:17 +00:00
Zuul e4e2e4d185 Merge "msgpack-python has been renamed to msgpack" 2018-01-19 03:59:35 +00:00
OpenStack Proposal Bot df9e5ac0a7 Updated from global requirements
Change-Id: Ia5ffe0e5cf147faf533e13c3f2b93778bfe6c78e
2018-01-16 04:38:49 +00:00
Dirk Mueller 50e4961ff3 msgpack-python has been renamed to msgpack
Change-Id: I528d3eac779a51996323ff88261c1f69ad4a2323
Related-Bug: #1743445
2018-01-15 21:18:12 +01:00
OpenStack Proposal Bot 764bbb97dd Updated from global requirements
Change-Id: I3475399c2bb2b477b07382359f23ed441963f84d
2017-12-23 14:58:27 +00:00
OpenStack Proposal Bot c7cd3ef131 Updated from global requirements
Change-Id: Ibeae699359647d41a77b0af40eb99216cb30353f
2017-12-07 13:53:21 +00:00
OpenStack Proposal Bot 6ccb5affe4 Updated from global requirements
Change-Id: I4d861bd978dbcbf26beb8a9e275947dafa702ac3
2017-12-02 20:43:31 +00:00
OpenStack Proposal Bot 62de6ff103 Updated from global requirements
Change-Id: I3f22c1c1fa177b471da410cfbc433c708a756abf
2017-11-16 11:31:46 +00:00
OpenStack Proposal Bot 618e689950 Updated from global requirements
Change-Id: Ie2f53c445fcae3d3c73fc8f81fa8db082fca0222
2017-11-13 02:09:27 +00:00
OpenStack Proposal Bot 1630b118aa Updated from global requirements
Change-Id: Ie9fcc72865cca7981ea5a71eaa368f7c9e0d441e
2017-11-09 00:40:35 +00:00
OpenStack Proposal Bot eb6f5f2dc7 Updated from global requirements
Change-Id: Ibd42746f1e0366302789eb36ee2720b66d4416ba
2017-10-12 22:07:28 +00:00
OpenStack Proposal Bot 618c2d6605 Updated from global requirements
Change-Id: Ie4ce0724937a3c24ff2b42fbadd64c43696dd3f9
2017-10-09 17:46:51 +00:00
OpenStack Proposal Bot 5c80a20af7 Updated from global requirements
Change-Id: Iedf0b0aad4e2aaddabe4123b08037717e8b25fea
2017-09-21 03:52:57 +00:00
OpenStack Proposal Bot d085bbcd5e Updated from global requirements
Change-Id: I4ff0df4ad12b36a6d280aad79ed373221c46e9ec
2017-07-20 02:21:39 +00:00
OpenStack Proposal Bot 68e58d66dc Updated from global requirements
Change-Id: I33718495852b50521c44a811c0e26fa91db579ce
2017-07-17 22:14:35 +00:00
OpenStack Proposal Bot 68eac5ab64 Updated from global requirements
Change-Id: I060fa16a3765b118c1785079d07238badbf2df43
2017-06-22 21:41:10 +00:00
Jenkins f5a1627953 Merge "Use oslo_db for create_engine" 2017-06-16 09:20:04 +00:00
OpenStack Proposal Bot 896a388a49 Updated from global requirements
Change-Id: I8523b3feebc1920fc00acbead693e58120c2dd20
2017-06-14 00:42:32 +00:00
Mike Bayer 8c374b1e7f Use oslo_db for create_engine
The use of plain SQLAlchemy create_engine in Zaqar bypasses
lots of oslo_db features that are associated with its
version of create_engine, some useful and some critical.

Among favorable behaviors that are added:

* The SQLite PRAGMA FOREIGN KEYS call is abstracted into the
  sqlite_fk flag
* The engine is given a pessimistic "ping" event, which emits
  a "SELECT 1" upon connection checkout which will then recycle
  the connection if the backing database is no longer connected.
  As we are using a connection pool, if the database has been
  restarted, or in the case of MySQL a default timeout of eight
  hours idle has passed, existing pooled connections will be stale.
  Upcoming SQLAlchemy 1.2 includes this feature as a simple flag
  but for now, oslo_db implements the event listener as directed
  by SQLA docs
* The errors raised by the DBAPI, and then wrapped by SQLAlchemy,
  are further sub-classified.  In particular, Zaqar seems to use
  a lot of IntegrityError catches to detect duplicate entry and
  foreign key constraint conditions.  oslo_db parses these out on
  a per-database-basis into individual DBDuplicateEntry,
  DBReferenceError, and other error classes, allowing Zaqar to
  respond specifically to the sub-class of IntegrityError or
  allow it to propagate if the condition is unhandled.
* checks for MySQL SQL_MODE and best practice driver (pymysql)
  will emit warnings if these conditions are not met.
* Gets Zaqar ready for further oslo.db integration and guides
  new features into oslo_db, including a potential "mysql timezone"
  setting

Change-Id: I16c3ed89e006e132bbd0295be1dfd0b561b2037c
Resolves-bug: https://bugs.launchpad.net/tripleo/+bug/1691951
2017-06-12 21:29:11 -04:00
OpenStack Proposal Bot 69f526d6bd Updated from global requirements
Change-Id: Ib5aec18acb0aefaf5fa90e4c662ee6d0d534ffb3
2017-06-02 02:39:35 +00:00
OpenStack Proposal Bot 85b10b90f5 Updated from global requirements
Change-Id: I6b616c93ca77f1bb038961e0bb903cd418c691e6
2017-05-26 17:31:41 +00:00
OpenStack Proposal Bot 2afc370b4c Updated from global requirements
Change-Id: I7f52b65d001b2733fdb01cf5844000fc804ed53e
2017-05-24 03:48:00 +00:00
OpenStack Proposal Bot 56783dc9d8 Updated from global requirements
Change-Id: I00c6df938a31c359c75fd40a90a7bce9d06d1a27
2017-04-13 16:33:02 +00:00
OpenStack Proposal Bot af3b2178d8 Updated from global requirements
Change-Id: Iec73dd7b7b9af6ca807b296d49d8ab15a416bb04
2017-04-07 07:03:16 +00:00
OpenStack Proposal Bot f95ce32456 Updated from global requirements
Change-Id: Id858593bea7c1dc82bb6a8ea3d8d6464c3d00164
2017-03-20 22:54:31 +00:00
Jenkins 0dc086828a Merge "Introduce Guru to Zaqar" 2017-03-13 03:07:59 +00:00
OpenStack Proposal Bot a4844f2540 Updated from global requirements
Change-Id: I918c063140a904c605795046b0f3ee9de0468d4b
2017-03-10 03:40:58 +00:00
wanghao 5118dafc65 Introduce Guru to Zaqar
Guru is a mechanism whereby developers
and system administrators can generate
a report about the state of a running
Zaqar executable.

This report is called a *Guru Meditation Report*

This mechanism will help developer or operator
to fix issues in (production) deployments without
stopping Zaqar service.

Implements: blueprint introduce-guru-to-zaqar
Change-Id: I72885be396be7eb0a9dd8fd564d706a8351b02c6
2017-03-09 11:00:29 +08:00