Commit Graph

74 Commits

Author SHA1 Message Date
Nate Johnston bba805af02 Retire the Congress project
Recently the TC has worked on determining the criteria for when an
OpenStack project should be retired.  When there was not a PTL nominee
for the Congress project, that triggered the TC to review the project
health per [1], and the TC has determined [2] that development work on
the project has ceased.  This decision was announced in the
openstack-discuss mailing list in April 2020 [3].

This commit retires the repository per the process for governance
removal in the Victoria cycle as specified in the Mandatory Repository
Retirement resolution [4] and detailed in the infra manual [5].

Should interest in developing Congress as part of OpenStack revive,
please revert this commit to have the project rejoin the list of active
projects.

The community wishes to express our thanks and appreciation to all of
those who have contributed to the Congress project over the years.

[1] https://governance.openstack.org/tc/reference/dropping-projects.html
[2] http://eavesdrop.openstack.org/irclogs/%23openstack-tc/latest.log.html#t2020-04-20T15:36:59
[3] http://lists.openstack.org/pipermail/openstack-discuss/2020-April/014292.html
[4] https://governance.openstack.org/tc/resolutions/20190711-mandatory-repository-retirement.html
[5] https://docs.opendev.org/opendev/infra-manual/latest/drivers.html#retiring-a-project

Change-Id: I21c9ab9820f78cf76adf11c5f0591c60f76372a8
2020-05-28 18:12:16 +02:00
Eric K 5d8d0e7c7e update devstack plugin for ipv6
Set listen address to devstack variable SERVICE_LISTEN_ADDRESS
to override the default 0.0.0.0 (which does not listen to ipv6 addresses).

Change-Id: I1bbc3539a751f7c0c0f54ec046f88a847b4647f9
Story: #2005477
2019-08-07 16:37:15 -07:00
Eric K aa9a76794c Devstack plugin set privileges to json ingester DB
By default, users do not have privileges to access the schema and
data tables created by the ingester.
This patch sets up the default privileges so that users get the
intended read access to all schemas and tables created by JSON
ingesters.

Change-Id: I9de2ca6c19971d38be46829263a3267fe234a42d
Closes-bug: 1821098
2019-03-21 05:18:34 +00:00
Eric K ea1fb9c3ed Replace fixed endpoint config by dynamic in devstack plugin
Some of the fixed endpoint configs caused errors.
Magnum and Zun explicitly call for grabbing the API endpoint from
catalog. Switch all the JSON ingester configs to use API endpoint
from service catalog to avoid incorrect config.

Change-Id: I50d2755317f68928f41d3770e25dfe67ba088969
Closes-bug: 1819556
2019-03-15 13:22:39 -07:00
Eric Kao bd3a30ae90 More sample configs for JSON ingester
glance, heat, magnum, masakari, mistral, tacker, zun.

Change-Id: I7ebb94c08c993d20b57396197409eaf9a72230ba
partially-implements: bp json-data-model
2019-03-07 15:12:58 -08:00
Eric Kao 8788b5b31d Add cinder config to sample JSON ingester configs
Change-Id: Ic867beeb2aaae6cf754bedc02d25c53bbb77e9c5
partially-implements: bp json-data-model
2019-03-06 23:17:38 -08:00
Eric Kao 5da6e463ff JSON ingester deployment enhancements
Allows json ingester config YAMLs to use the !ref tag to reference
previously defined reusable structures, which makes deployment much
more convenient.

Allows devstack plugin to optionally enable JSON ingester feature.

Renamed and reorganized the JSON ingester config options.

Adds CI job which sets up JSON ingester.

partially-implements: bp json-data-model
Change-Id: I6391224c99249d16fe943b8f00fe12d1e6b7d8e6
2019-03-06 08:35:23 -08:00
akhiljain23 fd495c6e2f Add tacker datasource driver
This commit adds Tacker driver and unit tests. Which creates
corresponding datasource on service startup and allows congress
to maintain Tacker's VNF and VNFD data via populating data to tables
vnfs and vnfds respectively. Based on which rules
can be created and actions can be executed on tacker service.

Change-Id: I281e8ff508dd066514694419c5aae6a991ab307c
Partially-Implements: blueprint add-tacker-datasource-driver
2019-02-28 07:27:06 +05:30
Eric K 02f45c003c Enable monasca in py2 tempest CI job
On bionic, there seems to be a kafka bug which causes some failures
on certain versions of JRE [1].
As a result, the JRE install invoked by Congress devstack plugin
causes Monasca devstack plugin to fail. Here we remove the JRE install
from Congress devstack plugin and enable monasca devstack plugin in
the CI job.

Note: Java is used to generate code for Congress, but not currently
required in Congress devstack install.

[1] https://stackoverflow.com/questions/36970622/kafka-unrecognized-vm-option-printgcdatestamps

Change-Id: Ibce028cb5635fe52275968beb5b4305f855ea851
2019-01-21 07:05:33 +00:00
Eric K 608703a644 Enable z3 on ubuntu bionic tempest tests
Previously disabled because the z3 github does not
provide binaries for bionic. However, the binaries
for xenial appear to work fine for testing purpose,
so we enable z3 with some additional logic that
substitutes xenial binary.

Change-Id: If6d775d07ea816157c62b78e3185f1e7f242e20c
2019-01-21 07:04:54 +00:00
zhurong 21f075faac Fix congre command excute error when using python3.6
when test murano python3 in patch [0], murano-congress-devstack
failed when excute congress command, error as below:
2018-12-28 05:33:03.601901 | controller | ++ functions-common:oscwrap:2287 :
out='openstack: '\''congress datasource create neutronv2 neutronv2 --config poll_time=10 --config username=admin
--config tenant_name=admin --config password=secretadmin --config auth_url=http://38.108.68.25/identity'\''
is not an openstack command. See '\''openstack --help'\''.
2018-12-28 05:33:03.601983 | controller | Did you mean one of these?
2018-12-28 05:33:03.602029 | controller |   address scope create
2018-12-28 05:33:03.602057 | controller |   address scope delete
2018-12-28 05:33:03.602082 | controller |   address scope list
2018-12-28 05:33:03.602122 | controller |   address scope set
2018-12-28 05:33:03.602149 | controller |   address scope show'
2018-12-28 05:33:03.604233 | controller | + functions-common:oscwrap:1               :   exit_trap
This patch using setup_dev_lib function from devstack install python-congressclient,
also this patch add a way to install congresscliet from requirements.

[0]: https://review.openstack.org/#/c/624600/

Change-Id: Ifda90653ca515bd5e21e5ed7338ab9fbdacc86ec
2019-01-04 10:38:08 +08:00
ghanshyam 6611df0e2d Set Tempest's service_available setting for congress
Tempest's service_available config option includes all the service
availability which is further used by tests to take decision of skip
or run the test.

For example, [service_available].congress is true then, congress test will run
or if [service_available].congress is false then, all congress related tests either
in telemetry tempest plugin or any other plugins will be skipped.

This commit add the setting of congress service[1] on congress devstack plugin.

Closes-Bug: #1743688
[1] http://git.openstack.org/cgit/openstack/congress-tempest-plugin/tree/congress_tempest_plugin/config.py#n24

Change-Id: I57de34d2b185b8e9838dd288d3673149391f0024
2018-11-27 08:24:37 +00:00
Eric K 993f9b301e workaround: add ending '/' to oslo-messaging transport url
oslo-messaging 9.0.1 requires the ending '/' to properly
use default virtual host '/'. Otherwise, it attempts to connect to
virtual host 'None' and gets refused.

Related-Bug: 1798241

Change-Id: I318a0496f9a71c80674b114b5c6f898cf080c058
2018-10-17 19:13:36 +00:00
Zuul d5424aec5f Merge "enable xtrace in devstack plugin" 2018-09-20 13:23:49 +00:00
Eric K dae3b410f8 enable xtrace in devstack plugin
to aid with diagnosing devstack failures

Change-Id: Ica0dac48f86eaa839ae60971eb1a8b6923bd6ace
2018-08-28 16:23:44 -07:00
Eric K 291a3e7945 add rocky feature flags for tempest testing
Set feature flags for vitrage webhook and monasca webhook to
enable corresponding tempest tests.

Depends-On: https://review.openstack.org/#/c/594747/
Change-Id: I1c1153676b6d99230874a9e76905e5c9a255a49c
2018-08-28 16:22:48 -07:00
Eric K 783842d087 devstack check neutron-qos available
check neutron-qos available before adding neutron_qos data source
to Congress. Avoids the data source update errors arising from
adding the data source when the qos extension is not available.

Release-team: devstack plugin change only

Change-Id: Ie5b10b20f11f109bb7159d43a0f5303508b00f78
2018-08-03 02:40:30 +00:00
Pierre Crégut 8f075371e4 Enable Z3 on the gate
Z3 is now enabled on the gate for non ha jobs.
A compiled version of Z3 is used.

This commit also correct installation paths bugs for Z3 and
adds an uninstall to clean.sh.

Change-Id: I81e515003a3edf443ec1a9f7a35232fc7121207a
2018-07-31 09:04:28 +02:00
Pierre Crégut c5f633dfa2 Z3 engine as an alternative Datalog engine
Basic structure for the integration of Z3 into Congress.
Defines a Z3Theory as an alternative to nonrecursive theories.
Defines a Z3Context for executing Z3Theory content.

Z3 must be installed manually and is not in the requirements
devstack will install Z3 if ENABLE_CONGRESS_Z3 is set.

Limitations:

* No built-ins
* Typechecking does not support sub-typing (will be done later through built-ins).

Partially-implements: blueprint alternative-engine-z3
Change-Id: I87ff439a3ed4a3e83c78c98add7d94275f716a01
2018-07-26 18:15:42 +02:00
Eric K aeb900e7e6 configure monasca service in gate
Updated devstack plugin and zuul config to enable monasca in gate.

Change-Id: I4f73af8e39d9be5d996194824a949e9f54138d2e
2018-04-11 17:17:33 -07:00
Anusha Ramineni 4734d2ab27 Add disable_drivers config option
This commit adds the new option 'disabled_drivers' config option
to support disabling of specific drivers if not needed.

Usage:
disabled_drivers = plexxi, murano

Partially-Implements blueprint enable-drivers-by-default
Change-Id: I008d095d70cd0718f614332bc92b57178e1d3aaa
2018-04-10 13:59:39 +05:30
Zuul 60e94eb5d4 Merge "Configure tempest service_availability correctly" 2018-02-05 12:35:56 +00:00
Zuul 897487ee47 Merge "[Trivialfix]Fix typos in congress" 2018-02-05 06:43:57 +00:00
Anusha Ramineni aa779c5bd4 Configure tempest service_availability correctly
To be able to correctly identify services are enabled or not to
run respective tempest tests, configure the same in devstack plugin
in proper way, instead of deciding the service availability based on
import of plugins.

Closes-Bug: #1743688
Change-Id: I9cbe3f1307b78d0e703069bc6c011b62c0d3c51f
2018-02-05 10:03:26 +05:30
Pierre Crégut 7248108745 Fix serialization of choices and reenable congress-agent.
oslo_config uses OrderedDict for choices in
options types. This serialize it as list of tuples.
Order is  preserved and types are naturally
deserialized back from those tuples.

Congress-agent is reenabled. It can be disabled
in devstack on  the value of ENABLE_CONGRESS_AGENT
(default is True).

Driver will initialize table to empty at first poll not
waiting for an initial response from agents.

Closes-Bug: #1742833
Change-Id: If1423e824fc457bab89f4bcd12be8826c50f5f69
2018-01-26 11:58:08 +01:00
Eric Kao d9f6b258f7 Mistral driver
Mistral driver and unit tests. Allows congress to
create workflows and trigger execution in Mistral.

Also configures mistral for gate integration tests.
Tempest tests in separate patch.

Implements blueprint add-mistral-driver

Change-Id: I79d3b9c2f659302f43164d5eef3b23ddf2f2d056
2018-01-24 09:17:56 -08:00
shangxiaobj c12425cd07 [Trivialfix]Fix typos in congress
Fix all the typos that found in congress.

Change-Id: Ibaccb8041bd25cefd7c37840979c4672838fe11a
2018-01-12 08:38:07 +00:00
Eric K d86f680f09 Update cfgvalidator_driver for oslo.config 5.2
oslo.config 5.2 begins to use a different representation of
choices (OrderedDict). We convert back to simple list to
have consistent output regardless of oslo.config version

unit tests have been failing since the change in upper-constraint
to oslo.config 5.2

Also temporarily disabled cfgvalidator in dsvm gate
while a blocking issue is being resolved, so that critical
queens-3 patches can go in asap.

Related-Bug: #1742833

Change-Id: Ibec47e398686793258eb4c8d9fb056e51cdc1c49
2018-01-11 17:12:40 -08:00
Zuul 75557cfce3 Merge "Devstack integration for configuration file validation" 2018-01-04 21:42:46 +00:00
Valentin Matton bed97f1a72 Devstack integration for configuration file validation
This last part adds the agent to the devstack deployment, a
basic tempest test of the datasource and gives an example of
its use.

Implementation of a datasource that transcribes the content
of configuration files managed by oslo-config in Congress
tables.

The datasource uses a set of agents deployed on the nodes
to access the configuration files.

Change-Id: Ibda41c44e551e6dc8e5895968018c7169c34c9c8
Implements: blueprint configuration-files-validation
Co-Authored-By: Valentin Matton <vmatt.openstack@gmail.com>
Co-Authored-By: Pierre Crégut <pierre.cregut@orange.com>
2017-12-08 13:09:36 +01:00
Zuul 4043745bd4 Merge "Move policy into code" 2017-12-06 20:05:25 +00:00
Lance Bragstad 3ac806a41c Move policy into code
This commit registers default policies in code. For the
Register and Document Policy in Code community goal.

bp policy-and-docs-in-code

Closes-Bug: 1724714

Change-Id: I1eea53adc19247d8b982c3e22184e8a1e2fb875c
2017-12-05 11:36:20 -08:00
Zuul 97d559289c Merge "Enable policy library panel through devstack" 2017-12-04 20:27:48 +00:00
Zuul 60cf91c0b2 Merge "Fix failure in devstack single node deployment of congress" 2017-11-29 01:46:03 +00:00
Anusha Ramineni 89b4d29147 Enable policy library panel through devstack
This commit enables policy library panel to be installed via devstack

Implements blueprint add-policy-library-gui

Change-Id: Iad15e37665c69ff44bec3d37f939f65f335090e9
2017-11-28 10:00:35 +05:30
Anusha Ramineni d187dd6ca4 Fix intermittent gate failure on key file generation
Closes-Bug: #1733268
Change-Id: Ia109e5e6711cb2802050b560cc8e20210bfee8b5
2017-11-20 10:23:56 +05:30
Anusha Ramineni 8ead7a6b37 Fix failure in devstack single node deployment of congress
Devstack seems to fail on single node/single process congress
deployment, with error missing transport_url. This commit fixes
the same by enabling setting of transport_url for single node
deployment as well.

Change-Id: I739db21caa4ab7a445f1f667258de5f2803b63c4
Closes-Bug:#1732851
2017-11-17 12:09:33 +05:30
Anusha Ramineni b72ae35044 Remove ceilometer datasource driver from congress
This commit removes the ceilometer datasource driver support in congress, as
ceilometer API is removed in Queens release.
Reference:https://review.openstack.org/#/c/512286/

Change-Id: Ib7ade0951f8a85102d95a0f01c3d63337f6b2404
Closes-Bug: #1729761
2017-11-07 09:21:33 +05:30
Jenkins 6f52bcc79b Merge "Add diagnostic output for replica test instability" 2017-10-14 00:22:46 +00:00
Eric Kao 77efd73a11 Add diagnostic output for replica test instability
Possible cause of replica test instability is devstack plugin
script exposing key file executes before key files are created.
The theory is consistent with the observation that failures
are much more prevalent under high infra load.

This patch adds output to confirm those situations.

Change-Id: Ib5d4e29109f86a627eb4ab48296eae773053949d
2017-10-13 14:01:13 -07:00
Songming Yan 242f127f5a Add Qos translator in neutron datasource drive.
Parts that require QoS extension placed in a separate driver.
So that the standard neutronv2_driver continues to work
for environments without the QoS extension.

Implements: blueprint add-qos-in-neutron-datasource-driver.

Change-Id: I3554f3c31f419b85ec27e734147fcb6eb2a81bde
2017-10-13 17:56:11 +00:00
Eric Kao 1335688b5f fix gate failure rabbitmq auth rejected and oslo policy mock
Change-Id: Ie867a54207795894090907ef0b2868b4a9bf9990
2017-10-05 13:08:20 -07:00
Songming Yan 27cc6c8560 Fix the problem of devstack fail when install congress
When /etc/congress/ exists. Devstack will fail. Should add "if" when we
create this folder.

Change-Id: Ic64cf90f5f907fd24e499cb3c643077b32b57b1a
2017-08-10 07:28:11 +00:00
Eric Kao 758d8599de fix and re-enable replica HA test
added devstack option $CONGRESS_EXPOSE_ENCRYPTION_KEY_FOR_TEST
which sets congress encryption keys to be readable by all
so that the replica instances launched from a different user
(tempest test user) can access the keys and operate correctly.

release-team: testing-only change

Change-Id: I014a750ae0d39fcc8cc78ca44bd5f59d87bf2226
2017-07-29 11:10:51 -07:00
Anusha Ramineni 378f797984 Enable monitoring panel in devstack
Partially-Implements blueprint enhance-congress-dashboard
Closes-Bug:#1670520

Change-Id: I68cbdb70fdf1a742305d96e9b36e61bce06da25d
2017-07-24 15:31:48 +05:30
Eric Kao c29537054c copy library subdirectories in devstack install
Change-Id: Id1b9768d51f4f71daa2d9242f8e90efde8f57389
2017-07-14 23:22:02 -07:00
Eric Kao cd9aa33451 Automatically load library policy files at start
harness.py loads library policy from disk files to DB

uniqueness constraint added on library policy name.

devstack plugin updated to install library policy files
to default location

updated congress stand-alone install instruction

Partially implements: blueprint policy-library
Closes-Bug: 1693619
Closes-Bug: 1693672

Change-Id: I51097081f6576755751231feb5ed2b0be642d91e
2017-07-06 17:45:19 -07:00
Carlos Goncalves 011e77f28d Extend devstack support to Red Hat-based distros
Congress devstack assumes system is Debian-based. That results in
default-jre package not found under Red Hat-based distros.
JRE package name under other distros may differ, too. Explicitely abort
deployment for untested distros.

Closes-Bug: #1693216
Change-Id: Id25931946da1f97e08bf9aeb5f6b7668bfbf48a1
2017-05-24 15:23:09 +02:00
Anusha Ramineni 3f943dcbec Update devstack plugin to use new repo
Partially-Implements blueprint enhance-congress-dashboard
Depends-On:I485e528b01656a43f5b766bc76b0bc2619a7ed7a
Change-Id: I568063e031c603ebeffce180ec23c829a28c65e6
2017-05-19 03:43:34 +00:00
Anusha Ramineni 8babdb5dc9 Fix gate failures
This commit fixes the issue with gate.
Still issues pending with usage of v2. It comments the following
tests to unblock the gate.

TODO(ramineni): Fix keystonev2 auth, and replace keystone v2 tests with v3
                Fix HA tests to use v3 clients (bug:1689220)

Closes-Bug:#1689221
Change-Id: I66e9ddb4ae6d3819f0b47fab220607cfe8446171
2017-05-08 09:30:18 +05:30