Commit Graph

3487 Commits

Author SHA1 Message Date
Sean McGinnis 7839f35ca3
Retire repo
This patch completes step 2 of the infra project retirement process
found here:

https://docs.opendev.org/opendev/infra-manual/latest/drivers.html#step-2-remove-project-content

Reference:

http://lists.openstack.org/pipermail/openstack-discuss/2020-June/015600.html

Depend-on: https://review.opendev.org/737566

Change-Id: Id3a5477860323547a4e17155061f597a8c96640b
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2020-06-23 10:49:40 -05:00
Zuul 4dc36ed649 Merge "Do not use yaml.load(file)" 2019-08-13 08:00:52 +00:00
Zuul 88977704d6 Merge "Fix pubsub topic encoding" 2019-08-13 06:22:01 +00:00
Zuul 5682d39ade Merge "Blacklist sphinx 2.1.0 (autodoc bug)" 2019-08-13 06:22:00 +00:00
pengyuesheng 913056b31b Blacklist sphinx 2.1.0 (autodoc bug)
See https://github.com/sphinx-doc/sphinx/issues/6440 for upstream details

Change-Id: Id3968215aceb1190e0cc5caa0db08891a1428ef7
2019-08-12 20:54:43 +00:00
Andreas Jaeger 4039bf0909 Update api-ref location
The api documentation is now published on docs.openstack.org instead
of developer.openstack.org. Update all links that are changed to the
new location.

Note that redirects will be set up as well but let's point now to the
new location.

For details, see:
http://lists.openstack.org/pipermail/openstack-discuss/2019-July/007828.html

Change-Id: I5e29862196d4e615d49db8c214c4419239424567
2019-08-12 20:54:32 +00:00
Omer Anson fc38995de3 Fix pubsub topic encoding
Change-Id: Id132b7bfbdb7a51f4de3635fe6af8d102ff5d0cc
2019-08-12 20:54:19 +00:00
Shachar Snapiri c5d4f07a74 Do not use yaml.load(file)
Now a Loader is required, as the default loader is considered unsafe.
See [1] for details.

[1] https://msg.pyyaml.org/load

Change-Id: I08af1afd6df097fab33701db89c656ebfe981b30
2019-08-12 20:53:58 +00:00
Shachar Snapiri a1498f951f Fix DF broken gate
This commit is a squash of 3 different commits required to fix
DragonFlow gate (See below).

Upgrade redis driver

Redis python package API was changed over time, while we did not
change our handling of the code.
In the gate the driver was updated, and the gate tests were broken.
Updated the code in a way that supports both python2 (soon to be
obsoleted) and python3.
Updated the requirements to install new versions of the packages.

Remove testing revision number in test_df_qos_driver

This code tests Neutron behaviour of increasing the revision number.
This is not code that is controlled by Dragonflow. If (when) it fails,
Dragonflow cannot fix it generically.

use payloads for ROUTER_GATEWAY events

This patch switches the code over to the payload style of callbacks [1]
for ROUTER_GATEWAY events for those that are not using them yet.
The unit tests are also updated where needed to account for the
payload style callbacks and publish() method. Finally the patch
normalizes the passing of gateway IPs which are currently referred to
as 'gw_ips' and 'gateway_ips' depending on the event; now all events use
'gateway_ips'.

Depends-On: https://review.opendev.org/#/c/638274/

[1] https://docs.openstack.org/neutron-lib/latest/contributor/callbacks.html

Co-Authored-By: Omer Anson <omer.anson@toganetworks.com>
Co-Authored-By: boden <bodenvmw@gmail.com>

Change-Id: I5cd456028ed8af86c6c512e514eb91cec56ea77c
2019-08-12 23:52:20 +03:00
Zuul 5a39ecae6d Merge "Move failing check jobs to experimental" 2019-06-20 14:47:29 +00:00
Zuul ee805da9e0 Merge "Update CI job configuration link" 2019-06-20 14:47:28 +00:00
Shachar Snapiri c30c0b34a5 Move failing check jobs to experimental
There are currently 4 check jobs that are contantly failing.
These jobs both make the check take longer and waste compute power during build.
I have moved them to experimental, and once we get them to not fail, we can
move them back to their place at the check queue.

Change-Id: I00d80d58ededc0fd4b08ed137addabc97dbec145
2019-06-20 10:17:12 +03:00
Shachar Snapiri 5a815ee71d Update CI job configuration link
In the devstack gate rc files, the link to the dragonflow CI configuration
file was wrong (actually for quite a long time now).
Updated the link to the correct location.

Change-Id: I8d8f507f57ccb72a73f8d2f620995809c23c4d8e
2019-06-19 21:44:25 +03:00
jacky06 624fb58fc0 Sync Sphinx requirement
1. Sync sphinx dependency with global requirements. It caps python 2 since
sphinx 2.0 no longer supports Python 2.7.
2. Remove unncessary "=="

Change-Id: Ic8d4ac21906dd78159375a51fc7514f8d664f22a
2019-06-18 23:37:22 +08:00
caoyuan 9573e43aa4 Replace git.openstack.org URLs with opendev.org URLs
Change-Id: Id34a36ee10fa0f30a20800b10656a85f6f3a5577
2019-06-17 09:11:41 +03:00
zhulingjie 7db3e3b005 Update the home-page for README.rst
Change-Id: I015569ac7cfa778c8eb19f7ae5bd8c5a796d643e
Closes-Bug: #1797775
2019-06-16 10:52:11 +00:00
Shachar Snapiri 8668f4b81e Do not take ovs from git
We no longer use OVS new features, and the minimal version we require is 2.9.1.
Also, on ubuntu, the version that is supplied by apt is 2.9.2, so it
should be sufficient, and we can save hassle and time by NOT recompiling
the ovs ourselves...

Change-Id: I453dc1d38395015c2d24477b592d1a2ec212e43c
2019-06-16 12:30:40 +03:00
Zuul 6d58189a7c Merge "Update vagrant base OS to Ubuntu 18.04LTS" 2019-05-19 19:33:32 +00:00
Shachar Snapiri a9fccaa38c Update DragonFlow tests to run with Python 3
As Python 2.7 will soon reach the end of life, we should switch to
Python 3.
This updates the tests to run with that version.

Change-Id: I1014769881786c62d9d6aabf21ca7858a6deb882
2019-05-16 17:01:59 +03:00
Shachar Snapiri bf968291c5 Update vagrant base OS to Ubuntu 18.04LTS
Replace Ubuntu 16.04LTS with the newer OS for libvirt

Change-Id: I02db28d0e3874c322d62ab0b2a3e16fd66b89901
2019-05-13 22:56:58 +03:00
Shachar Snapiri d622410892 Update the gate hooks to install proper docker package
The way gate_hook.sh tries to find the proper package to install is
sub-optimal, and misses in case there is another package containing the
package name as a substring.
Updating the file to work the same way as in [1].

[1] c27bb1f190

Change-Id: I726f993ef9d593f13abef55fca6cc2c0a2d353c7
2019-05-12 21:34:09 +03:00
Shachar Snapiri c65aaad9d5 Update the tox.ini with '0' concurrency
There is an issue with the ostestr package that it sends a 'None' value
if it is not explicitly specified.
The stestr package does not accept it well, and an exception is thrown.
There is a fix in the pipe [1], but we need to get DragonFlow working.

[1] https://review.opendev.org/#/c/651275/

Change-Id: If9d18965048cc5ac20d351b7172b50d0a1d0f2cc
2019-05-12 21:29:57 +03:00
OpenDev Sysadmins c8adf28b09 OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:27:58 +00:00
Zuul b536dc6231 Merge "Fix docker launch with bash option" 2019-04-17 20:51:32 +00:00
Shachar Snapiri bbd2d93dd4 Fix docker launch with bash option
When launching the docker with the bash option, it should be able to get
any command-line arguments supplied to it.

Change-Id: I7dfb6cf265de81feb1b4ffc60d54b679a2918e97
2019-04-17 13:51:50 +03:00
Boden R cdcd620791 use trunk constants from neutron-lib
The trunk constants live in neutron-lib now. This patch switches over
to them in prep for https://review.openstack.org/#/c/649672/

Change-Id: I072b28a2e7c6466912f5a2f7f3f8e303a70cef8a
2019-04-05 10:21:41 -06:00
Zuul 9d05539831 Merge "Add a packet logger application" 2019-03-28 19:24:33 +00:00
Zuul c4e0ab10ae Merge "Clear registered table handlers on datapath set_up" 2019-03-28 19:24:32 +00:00
Zuul de1606d390 Merge "Defend agains exceptions in application initialisation" 2019-03-28 19:24:14 +00:00
Ian Wienand fcedce07cc Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: Ieb27acc93094ecdaee11649621fc26c453058362
2019-03-24 20:33:30 +00:00
Omer Anson e077ff987d Add a packet logger application
Add an application which logs the data and metadata
of every packet received to the log file.

Change-Id: I665c03c9bdf9f00f9c734ae355336396e15bd27b
Closes-Bug: #1815886
2019-03-21 07:48:16 +00:00
Omer Anson b8fb4de2f6 Clear registered table handlers on datapath set_up
Datapath set_up overwrites old applications with new applications
(usually of the same type). If any of these applications registered
a table handler - upon reconnect, this table handler will already
be registered and that would raise an Exception.

This change clears table handlers of old applications. Only new-type
applications should be affected (legacy-type apps should remain the same).

Change-Id: I356758175e9816d57d2831c34f35df8e69cafbcf
Closes-Bug: #1820533
2019-03-21 07:45:00 +00:00
Omer Anson 65ebe3a52f Defend agains exceptions in application initialisation
Application initialisation code (as found in initialize function)
can raise an exception, which would break entire pipeline set-up.

This fix catches and logs the exception. The application is not
removed - it can continue to work on a best-effort basis.

TrivialFix

Change-Id: I5c2f00578ba5208ab7fed4441e4919cd3d71ae34
2019-03-21 07:44:02 +00:00
Shachar Snapiri 8fd27641b0 Fix broken dragonflow gates
This commit is composed of 4 (four) commits that fix various aspects
that were broken in the gate.

Co-Authored-By: Omer Anson <omer.anson@toganetworks.com>

Bump up the version of libzmq for Ubuntu and Suse

This is required as libzmq1 is no longer supported under these
platforms.

Change-Id: I17c73025856c006926ea6b2444c4fde86726db9d

Install ruby via the operating system

As opposed to installing it from source, success of which is a matter of
chance.

Change-Id: I39f13525d9b1d814c90ac898148b9543ed64cd7e

Cleanup registered apps with os-ken

Otherwise, os-ken complains that the apps are already
instantiated. This might be causing the get failure.

Change-Id: Iad8f76aafe98be443b0efa34e2f9cef8f40a9588

Disable test TestNeighborAdvertiser

It isn't working. Reported in bug 1820977.

Change-Id: Ie1f9c05c3847320ba1892c52182d3e7d856f4957
Related-Bug: #1820977
2019-03-20 14:23:46 +02:00
ghanshyam bc821f0250 Remove usage of tempest test_l3_agent_scheduler
Tempest test 'test_l3_agent_scheduler' is going to be
removed from Tempest  - https://review.openstack.org/#/c/640767/

Same test exist in neutron-tempest-plugin[1], which can be used
if required.

[1] http://git.openstack.org/cgit/openstack/neutron-tempest-plugin/tree/neutron_tempest_plugin/api/admin/test_l3_agent_scheduler.py

Change-Id: I5590e2dcf52ffe53a2b09a91bf3e58503ccdc507
2019-03-07 04:49:41 +00:00
Boden R 980b4a79f1 fix unit tests
With the introduction of [1] into neutron, the revision number of a
created router is now 1 and not 0. The dragonflow code is expecting 0
today and thus 3 unit tests fail due to this.

This patch updates to the tests to expect the revision number to be 1
rather than 0 as per [1].

[1] https://review.openstack.org/#/c/635671/

Change-Id: I8d16fada6972854719d9023dd79915820a73ff3b
2019-02-27 09:16:26 -07:00
Boden R 5bb32a58ae stop using common db mixin
All of the methods of common db mixin are available via neutron-lib
and the mixin will be removed before long.
This patch switches the code over to use neutron-lib's APIs rather
than those of the mixin and stops using common_db_mix for parent
classes.

Change-Id: I13e88997f6043162c5feeaa339820f4efa37ee03
2019-02-11 08:30:09 -07:00
Omer Anson 8976a2cf9e Add exitpoint for legacy classifier app
Classifier app currently sends the packet directly to portsec
app. This is Bad. As described in the bug, metadata stored in
registers can be lost.

This change adds a classifier exitpoint table, and classifier
app sends the packets there. The datapath wiring then sends
the packet to the portsec app (if so configured).

This is important, since sometimes the datapath code allocates different
registers to the same metadata accross different applications, and registers
are moved. Skipping this behaviour causes errors.

Closes-Bug: #1815416
Change-Id: I38f14e8faa45e4ef3740bdbee78bd493f6d602ab
2019-02-11 09:36:38 +02:00
Shachar Snapiri 8f0e67da2e Stop using a hardcoded cirros image name
In the tests we have the cirros image name hard-coded.
This requires us to update it every time the test image is updated.
Instead, now we list the images and take the first one (which is safe enough for
the circumstances).
Anyway, if a specific image is required, it may still be requested in the
'vm_image' argument.

Change-Id: I0aae2a01ca5fd67bd828bb8daf6df466c60acff2
2019-02-06 06:33:32 +00:00
Shachar Snapiri f1788f3ac6 Update cirros image version
The current cirros image version is 0.4.0.
As we have the image name hard-coded, it is required that we update it manually.
See [1] for reference.

[1] https://review.openstack.org/#/c/521825/

Change-Id: I99a49975c5674991d84932ebd2c7ab6599d343ea

Migrate Dragonflow from Ryu to os-ken

This change causes Dragonflow to stop consuming Ryu in favor of os-ken.
os-ken becomes the reference implementation for BGP services and
Dragonflow no longer has a dependency on Ryu.
See [1] for reference in Neutron.

[1] https://review.openstack.org/607008/

Change-Id: Ifbf294f2f586cf765d20cfa60774c45aa735ca62

Force delete of VM on close

There are tests that fail because we are waiting for the VM to complete shutdown
In tests, we do not mind destroying the machine forcefully as there is no reason
to wait for it.

Change-Id: I5f8e4928ceb7b467af891835600cd8096ec88d2b

use payloads for SECURITY_GROUP BEFORE_DELETE events

This patch switches over to the payload style callbacks for
BEFORE_DELETE events of SECURITY_GROUP resources.

Co-Authored-By: Boden R <bodenvmw@gmail.com>
Depends-On: https://review.openstack.org/#/c/597599/
Change-Id: Ie9163ad7baecf85e234e4253160f30015b43166b
2019-02-05 11:31:44 +02:00
Zuul 18710ca010 Merge "Fix the misspelling of "default"" 2019-01-13 18:08:30 +00:00
Zuul 60d8a2484f Merge "Fix the misspelling of "interface"" 2019-01-10 09:26:19 +00:00
lijunjie 42bf362d27 Fix the misspelling of "default"
Change-Id: I3ed83f236b31dba3589306b24a80e044ad7c315f
2019-01-10 17:14:00 +08:00
Shachar Snapiri 2d61e5fcf6 Fix default value syntax for docker script
Default conf source dir in run_dragonflow.sh was with the wrong syntax.
This causes the script to fail.
Fixed the syntax to the correct one.

Change-Id: I334f3161d62df2d1bc692a43c2d6eff740c0c92b
2019-01-09 18:58:05 +02:00
lijunjie 8d9c367780 Fix the misspelling of "interface"
Change-Id: I7d31ec78de5422fbb408bcda215953b4886391c2
2019-01-07 11:05:24 +08:00
Zuul 70e731f8a1 Merge "Set absolute path for docker entrypoint" 2019-01-03 00:56:37 +00:00
Zuul 75fb430b21 Merge "Fix snat documentation formatting" 2019-01-02 08:33:16 +00:00
Shachar Snapiri a56aaea410 Set absolute path for docker entrypoint
In case dragonflow is used as a base image for another docker image, and the
WORKDIR is set to something other than /opt/dragonflow before running the
container, the call to run_dragonflow.sh will fail as the reference is relative
so it will not be found.

Change-Id: If9f25f94520fd74ab14658cf63f43c940da7b2ea
2019-01-02 08:20:42 +02:00
Shachar Snapiri 7af9139a4c Fix snat documentation formatting
Change-Id: I18ba6a8363cc91d8fac90a7c62701b8695129f70
2018-12-30 14:02:14 +00:00
Shachar Snapiri 577cc84245 Allow different conf source path
Setting the CONF_SRC_DIR environment will take the template
dragonflow.ini from that path during install.

Change-Id: I57bf5aeb832e9fc68101e322691cc54cb9e20286
2018-12-30 14:02:07 +00:00