Run script generate-gitmodules.py to sync with governace repository to
add new repositories and remove retired ones.
Change-Id: Ia42b717ad242958ba4a9689ac814c956f460712f
* Update congress from branch 'master'
- tox: Keeping going with docs
Sphinx 1.8 introduced [1] the '--keep-going' argument which, as its name
suggests, keeps the build running when it encounters non-fatal errors.
This is exceptionally useful in avoiding a continuous edit-build loop
when undertaking large doc reworks where multiple errors may be
introduced.
[1] https://github.com/sphinx-doc/sphinx/commit/e3483e9b045
Change-Id: I0e40eb0e5267d1cdd0ec1195424743310f3c39f8
* Update congress from branch 'master'
- Merge "Update the constraints url"
- Update the constraints url
Change-Id: Iaff0e5346a072908aa8af46005717bdc7bd005a0
* Update congress from branch 'master'
- Merge "Add Release Admin guide Contributing and RESTClient notes link to README"
- Add Release Admin guide Contributing and RESTClient notes link to README
Change-Id: Ief3d927a65e1e1d179c6bfa78c822bfc388529d0
* Update congress from branch 'master'
- Update master for stable/train
Add file to the reno documentation build to show release notes for
stable/train.
Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/train.
Change-Id: I330926727ecf0b41450d5317cafea642a70c1d35
Sem-Ver: feature
* Update congress from branch 'master'
- Merge "Generate PDF documentation"
- Generate PDF documentation
This commit adds a new tox target to build PDF documentation.
It's a part of community goal, see storyboard for more
information.
Change-Id: I58b1fb537c3758bba5a57d3cf7ce4cf10625bd89
Story: 2006076
Task: 34813
* Update congress from branch 'master'
- Merge "Blacklist eventlet 0.23.0, 0.25.0"
- Blacklist eventlet 0.23.0, 0.25.0
Kombu 4.6.4 causes issues with eventlet 0.23.0 and 0.25.0[1].
Due to an upper-constraint version bump, we're seeing failures
on openstack gate.
This patch fixes the issue.
[1] https://review.opendev.org/#/c/678078
Change-Id: Iad5c736e3fc817c0cca1f142dbba71ef7e594cef
* Update congress from branch 'master'
- Merge "Run only smoke tests in ipv6 job"
- Run only smoke tests in ipv6 job
'congress-tempest-ipv6-only' job is to verify
that congress is able to listen and run on IPv6
env. We do not need to run all the tests in this
job. Running only smoke tests should be fine.
This commit define the 'congress-ipv6' tox env which
include smoke test only as of now but it can be extended
to include more IPv6 tests if any.
Change-Id: Idbd4c6ea362487dd93330adddb26abc89387a726
Story: #2005477
Task: #35885
* Update congress from branch 'master'
- Fix: docs failure on gate
Congress docs job is failing on gate due to
non-existence of _static directory which is required
by config generator[1].
[1] https://github.com/openstack/congress/blob/master/doc/source/conf.py#L120-L125
Change-Id: Ia25e677019170bfdfb3a257707a013958d518d1b
* Update congress from branch 'master'
- Merge "Define new 'congress-tempest-ipv6-only' job in gate"
- Define new 'congress-tempest-ipv6-only' job in gate
As part of Train community goal 'Support IPv6-Only Deployments and Testing'[1],
Tempest has defined the base job 'devstack-tempest-ipv6' (adding
in Depends-On patch) which will deploy services on IPv6.
This commit adds the new job 'congress-tempest-ipv6-only'
run on gate which is derived from 'devstack-tempest-ipv6'.
Verification structure will be:
- 'devstack-IPv6' deploy the service on IPv6
- 'devstack-tempest-ipv6' run will verify the IPv6-only setting and listen address
- 'congress-tempest-ipv6-only' will run the tests.
Story: #2005477
Task: #35885
Depends-On: https://review.opendev.org/#/c/671231/
[1] https://governance.openstack.org/tc/goals/train/ipv6-support-and-testing.html
Change-Id: I7f3a6b0b6973b99e535dfd379a5188732529e420
* Update congress from branch 'master'
- Merge "Update api-ref location"
- Update api-ref location
The api documentation is now published on docs.openstack.org instead
of developer.openstack.org. Update all links that are changed to the
new location.
Note that redirects will be set up as well but let's point now to the
new location.
For details, see:
http://lists.openstack.org/pipermail/openstack-discuss/2019-July/007828.html
Change-Id: Ib4c5aff2fe02d9511e38e2e26b4361d81d853263
* Update congress from branch 'master'
- update devstack plugin for ipv6
Set listen address to devstack variable SERVICE_LISTEN_ADDRESS
to override the default 0.0.0.0 (which does not listen to ipv6 addresses).
Change-Id: I1bbc3539a751f7c0c0f54ec046f88a847b4647f9
Story: #2005477
* Update congress from branch 'master'
- Sync Sphinx requirement
1. Sync sphinx dependency with global requirements. It caps python 2 since
sphinx 2.0 no longer supports Python 2.7.
2. Remove unncessary space
Change-Id: I389a0603d8f1a931a787d03eb6eeb6cb57a8388d
* Update congress from branch 'master'
- Merge "update sample output of manual test script"
- update sample output of manual test script
Output somewhat different due to changes to various services in stein.
Change-Id: I6b3f102661763ed1f15f8fbfe63b94ddcc78ccdd
* Update congress from branch 'master'
- Merge "Changes for url transition to OpenDev"
- Changes for url transition to OpenDev
This commit changes openstack.org URL to opendev.org URL
Change-Id: Ic05ddf275a9f71cd3382ee3b4580a6004a1e66fe
* Update congress from branch 'master'
- Merge "Switch python3 versions of test jobs to match Train PTI"
- Switch python3 versions of test jobs to match Train PTI
In Train, we will use python 3.6 and 3.7 for python3 runtime
in our gate jobs [1]. This commit also adds python 3.7.
[1] https://governance.openstack.org/tc/reference/runtimes/train.html
Change-Id: Ib60a6fb08590e5a90244b7d09bece153f6e4a970
* Update congress from branch 'master'
- Merge "Resolve instability in json_ingester test_execute_exec_api_rows"
- Resolve instability in json_ingester test_execute_exec_api_rows
Occassionally the unit test congress.tests.datasources.json_ingester.
test_exec_api.TestExecApiManager.test_execute_exec_api_rows
fails inside eventlet code even though the eventlet call is mocked
out.
This patch adds a new mock path because eventlet.spawn_n
somehow redirects there. Hopefully it resolves the occassional
instability gets.
Sample error:
File "/home/zuul/src/git.openstack.org/openstack/congress/.tox/py27/local/lib/python2.7/site-packages/eventlet/greenpool.py", line 115, in spawn_n
function, args, kwargs, True)
File "/home/zuul/src/git.openstack.org/openstack/congress/.tox/py27/local/lib/python2.7/site-packages/mock/mock.py", line 1062, in __call__
return _mock_self._mock_call(*args, **kwargs)
File "/home/zuul/src/git.openstack.org/openstack/congress/.tox/py27/local/lib/python2.7/site-packages/mock/mock.py", line 1128, in _mock_call
ret_val = effect(*args, **kwargs)
File "congress/tests/datasources/json_ingester/test_exec_api.py", line 27, in mock_spawn_execute
return func(*args, **kwargs)
File "/home/zuul/src/git.openstack.org/openstack/congress/.tox/py27/local/lib/python2.7/site-packages/eventlet/greenpool.py", line 99, in _spawn_n_impl
self._spawn_done(coro)
File "/home/zuul/src/git.openstack.org/openstack/congress/.tox/py27/local/lib/python2.7/site-packages/eventlet/greenpool.py", line 131, in _spawn_done
self.coroutines_running.remove(coro)
KeyError: <greenlet.greenlet object at 0x7fd975681cd0>
Change-Id: I72e11a67cf1cd3ff3fbc574f2d6e91df17d63d9c
* Update congress from branch 'master'
- Merge "Lower psycopg2 dependency to >=2.5.1"
- Lower psycopg2 dependency to >=2.5.1
Because 2.5.1 is the version available on RHEL/CentOS 7.
This is done by replacing the use of psycopg2.sql module.
Change-Id: Ie83ca2b3cd439649878517fa0fbc2a4381ad018d
Closes-Bug: 1823095
* Update congress from branch 'master'
- Fix glance json ingester api path
The /v2/ part previously ommitted. Added here.
Change-Id: I013d3c1e3dfa7f478a228d8d13af86ef37b3771b
* Update congress from branch 'master'
- Add libpq-dev to bindeps.txt and install doc
Because it is needed to install psycopg 2.8.2 on ubuntu. Resolves
dependency install failure on unit tests on ubuntu nodes.
Change-Id: I04e9272e351badc1344235571d6f2c9e79fb6223
Closes-Bug: 1828109
- OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:
http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.htmlhttp://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html
Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
* Update congress from branch 'master'
- Merge "Replace openstack.org git:// URLs with https://"
- Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.
This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.
This update should result in no functional change.
For more information see the thread at
http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html
Change-Id: Iaa9dc9b28c93f17c447b23fbe49d09ed89c869ad
* Update congress from branch 'master'
- fix incorrect sql compose for index create
Change-Id: Ibe166cad630f5eb586a8e8756981fded10eecf33
Closes-Bug: 1823128
* Update congress from branch 'master'
- Remove unnecessary tempest plugins from gate
Resolves a devstack gate error such as:
/opt/stack/devstack/.localrc.auto: line 67:
/opt/stack/telemetry-tempest-plugin: Is a directory
Change-Id: Idb608596724db569e1999a9725bd79cd8262ea8f
* Update congress from branch 'master'
- Update master for stable/stein
Add file to the reno documentation build to show release notes for
stable/stein.
Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/stein.
Change-Id: Ia92f14cdde8a34306bacc85cbad0eacb09a03425
Sem-Ver: feature
* Update congress from branch 'master'
- Merge "[doc only] Doc changes related to json ingester"
- [doc only] Doc changes related to json ingester
User documentation.
Admin documentation.
Release note item.
Change-Id: I7e0be77f4f8e22e6c47a35a214bbef17be3790ad
* Update congress from branch 'master'
- Merge "Completes upgrade check for monasca webhook data source"
- Completes upgrade check for monasca webhook data source
Results in warning (schema change) if a monasca webhook data source
is configured.
Change-Id: I7ccb2f2804f3957bbeb84a700583ae666f2dd0af
* Update congress from branch 'master'
- Merge "Devstack plugin set privileges to json ingester DB"
- Devstack plugin set privileges to json ingester DB
By default, users do not have privileges to access the schema and
data tables created by the ingester.
This patch sets up the default privileges so that users get the
intended read access to all schemas and tables created by JSON
ingesters.
Change-Id: I9de2ca6c19971d38be46829263a3267fe234a42d
Closes-bug: 1821098
* Update congress from branch 'master'
- Merge "Return 503 rather than 500 error when _ds_manager unreachable"
- Return 503 rather than 500 error when _ds_manager unreachable
It can happen that the _ds_manager is temporarily unreachable
due service not ready or network issues. In these cases,
the patch makes sure the API returns 503 http status code
instead of 500, so that the client knows the issue is
temporary.
Change-Id: I8a03a2e0ac84c2395b5ea2015647c5c7d2fed03e
Closes-bug: 1811754
* Update congress from branch 'master'
- Merge "Add python 3.6 to setup.cfg, in line with Stein target"
- Add python 3.6 to setup.cfg, in line with Stein target
Change-Id: Ide943419048aa7ca6e1e78de75f7d2c5968b75c6
* Update congress from branch 'master'
- Merge "Replace fixed endpoint config by dynamic in devstack plugin"
- Replace fixed endpoint config by dynamic in devstack plugin
Some of the fixed endpoint configs caused errors.
Magnum and Zun explicitly call for grabbing the API endpoint from
catalog. Switch all the JSON ingester configs to use API endpoint
from service catalog to avoid incorrect config.
Change-Id: I50d2755317f68928f41d3770e25dfe67ba088969
Closes-bug: 1819556
* Update congress from branch 'master'
- Merge "Fix redundant index, unindexable, wrong isolation in JSON ingester"
- Fix redundant index, unindexable, wrong isolation in JSON ingester
Fixes a bug where json ingester repeatedly creates redundant indexes
each time Congress restarts.
Mitigates a problem where indexing fails when a field exceeds the
postgres indexable limit of 2712 bytes. Indexing is made optional.
Fixes a bug where unexpected behavior occurs when the backend DB
default isolation level is not the expected read_committed. The
isolation level is now set explicitly per connection.
Change-Id: I514aa9b96e4efbffe8880cce775dc2259eca4648
Closes-bug: 1819987
Closes-bug: 1819988
Closes-bug: 1819985
* Update congress from branch 'master'
- Merge "Fix inconsistent OptionJsonEncoder behavior on unknown type"
- Fix inconsistent OptionJsonEncoder behavior on unknown type
Update OptionJsonEncoder to encode an unknown type as the expected
{'type': 'type_name'} rather than as 'type_name', fixing an error
encountered by related code that expects to index into the generated
dict construct.
Also updated congress agent tolerate unknown (custom) types instead
of exiting completely.
This reverts commit 69848285c85c3f4b1fad3896cac346949e815cd5.
Change-Id: Ie18967b1b4191c43e00817d7661cc4b5efd247be
Closes-Bug: 1819248
* Update congress from branch 'master'
- Merge "Use YAML safe_load_all"
- Use YAML safe_load_all
The arbitrarily powerful YAML load_all is not necessary.
Change-Id: I3db0e10d0317ab3bd96a4480308b5661da4691c9
Closes-Bug: 1819211
* Update congress from branch 'master'
- Use YAML safe_load
The arbitrarily powerful YAML load is not necessary.
Change-Id: I8bc27a2b0416191638f3ece4dd0d1b3aae8c63cc
Partial-Bug: 1819211
* Update congress from branch 'master'
- Merge "add python 3.7 unit test job"
- add python 3.7 unit test job
This is a mechanically generated patch to add a unit test job running
under Python 3.7.
See ML discussion here [1] for context.
[1] http://lists.openstack.org/pipermail/openstack-dev/2018-October/135626.html
Change-Id: Ifef26244c9bac016b32b782efccd03504cc0bf8a
Story: #2004073
* Update congress from branch 'master'
- Merge "Allow port in JSON ingester config"
- Allow port in JSON ingester config
Allow config to specify a port to use in making the API calls to
ingest JSON.
Also added additional sample configs: neutron, keystone, monasca.
Change-Id: I7d852742d0943c3857ee4e04d5a0d77b6bafeed7
partially-implements: bp json-data-model
* Update congress from branch 'master'
- Merge "Add created_at field for nova servers table"
- Add created_at field for nova servers table
Depends-On: https://review.openstack.org/#/c/640248/
Change-Id: Ic402a13c9f864a124bba194b9985cd4b69da6bee
* Update congress from branch 'master'
- Merge "Support making unauthenticated APIs requests by JSON ingester"
- Support making unauthenticated APIs requests by JSON ingester
Change-Id: I90ee25aea04559af720f573ff065da0c2b4b20e0
partially-implements: bp json-data-model
* Update congress from branch 'master'
- Merge "Add API header config to JSON ingester"
- Add API header config to JSON ingester
Add the 'api_default_headers' field which specifies a hash/dict
of headers to pass with each API call w.r.t. that JSON ingester.
Main usage is to specify API microversion. For example:
api_default_headers:
X-OpenStack-Nova-API-Version: "2.26"
Change-Id: Ie859e45ea03135aa21196fe19767f28627e76c3b
partially-implements: bp json-data-model
* Update congress from branch 'master'
- Merge "JSON ingester deployment enhancements"
- JSON ingester deployment enhancements
Allows json ingester config YAMLs to use the !ref tag to reference
previously defined reusable structures, which makes deployment much
more convenient.
Allows devstack plugin to optionally enable JSON ingester feature.
Renamed and reorganized the JSON ingester config options.
Adds CI job which sets up JSON ingester.
partially-implements: bp json-data-model
Change-Id: I6391224c99249d16fe943b8f00fe12d1e6b7d8e6
* Update congress from branch 'master'
- Merge "Mock rather than modify DataSourceDriver.TRANSLATORS in unit tests"
- Mock rather than modify DataSourceDriver.TRANSLATORS in unit tests
Direct modification of DataSourceDriver.TRANSLATORS constant for unit testing
causes some unit tests to affect one another. So we instead use contextual
mocking.
Change-Id: I1bea6fd68921410724c8427167966752dbb6e947
* Update congress from branch 'master'
- Merge "JSON ingester API execution feature"
- JSON ingester API execution feature
Operator can define an _exec_api view/table in any schema, including
the columns: endpoint, path, method, body, parameters, headers
(body, parameters, headers may be null).
Each time JSON ingester updates state, Congress will make all the
API requests as specified in these _exec_api views/tables.
The existing action execution semantics is used: execute any new
actions not present as of the last time the execution tables are
checked.
Each JsonIngester instance now keeps a reference to the shared
ExecApiManager instance. Each time a JsonIngester instance updates
state, it tells the ExecApiManager instance to check and execute API
requests.
partially-implements: bp json-data-model
Change-Id: I548b4d097452b2f001efc054780be29eb3a73398