Commit Graph

863 Commits

Author SHA1 Message Date
Ghanshyam Mann 3f2b88fdbd Cleanup the retired repo
This repo is not properly retired. Retired repos can only have two files:
- README.rst
- gitreview

To cleanup the retirement, keeping these two files only in right
format and removing the other remaining files if there is any.
Detail: https://etherpad.opendev.org/p/tc-retirement-cleanup

Change-Id: I55f37021fc4fd16d9a175aa361c8503badd80b68
2020-08-06 08:07:20 -05:00
Amrith Kumar 238d8b4ddb Retire the trove-integration repository
With the EOL of Newton (impending) and the deletion of the legacy
tests[1] and [2], this repository is not required any longer.

[1] https://review.openstack.org/#/c/514916/
[2] https://review.openstack.org/#/c/514918/

Change-Id: I8a6466c318029e6c984c6684e92547dd94ae6488
2017-10-25 10:48:02 -04:00
Flavio Percoco bd3aafabd5 Show team and repo badges on README
This patch adds the team's and repository's badges to the README file.
The motivation behind this is to communicate the project status and
features at first glance.

For more information about this effort, please read this email thread:

http://lists.openstack.org/pipermail/openstack-dev/2016-October/105562.html

To see an example of how this would look like check:

https://gist.github.com/af3bcb242c9e2828ab264ec09beb108e

Change-Id: Ic30c28d25d8fa5fca20fdda8dedf1f92a1e6e2a2
Partial-Bug: 1644851
2016-11-30 13:32:48 +00:00
Amrith Kumar e42be7b1de Update the Signing Key for Percona Debian and Ubuntu Packages
Attempting to build images fails now with an error because of a change
in the signing key for Percona packages.

Quick summary copied from [1]

Percona .deb packages are signed with a key that uses an algorithm now
considered weak. Starting with the next release, Debian and Ubuntu
packages are signed with a new key that uses the much stronger SHA-512
algorithm. All future package release will also contain the new
algorithm.

It’s important that you add the new key before the next release.

See also [2] in trove.

[1] https://www.percona.com/blog/2016/10/13/new-signing-key-for-percona-debian-and-ubuntu-packages/
[2] https://review.openstack.org/#/c/390342/

Change-Id: I4ca5fccf51e51059d4035f7206609c8afa997c94
2016-10-24 10:18:47 -04:00
Amrith Kumar a7ad2f1748 missing yaml
Not sure why this just changed but had to fix this in trovestack as
well.

Change-Id: I3ef0666854df3dfc902a85f876fb0e8881622124
2016-10-24 01:08:53 -04:00
gecong1973 9f92ca853f Change assertTrue(isinstance()) by optimal assert
Some of tests use different method of
assertTrue(isinstance(A, B)) or assertEqual(type(A), B).
The correct way is to use assertIsInstance(A, B) provided
by testtools

Change-Id: Ib303f68d83db760dae045f0416f257c4622fa777
2016-09-30 16:13:59 +08:00
Jenkins 8d48fb0cd9 Merge "Enhance 'redstack clean' regarding modules" 2016-09-27 20:06:00 +00:00
Jenkins d313c7ea26 Merge "Change MongoDB to version 3.2" 2016-09-22 17:59:36 +00:00
Peter Stachowski 865c0aa754 Enhance 'redstack clean' regarding modules
Adds a sql command to make sure the modules are not marked
as having been applied to an instance so that they can be
deleted (otherwise an error may occur if the instance hasn't
gone away yet).

Enhanced the logic to only sleep if objects are found
and to keep trying until the objects are gone (up to 10 times).
This makes runs with nothing to delete faster and negates having
to run the script multiple times if objects delete slower than
expected.

Added a check for server-groups to delete them if they exist.

Fixed security group delete to look for the 'default' name instead
of an id of '1' (which could be incorrect).  Also switched it to
use the OpenStack client, since Nova was reporting a deprecation
warning:

  WARNING: Command secgroup-delete is deprecated and will be removed
           after Nova 15.0.0 is released. Use python-neutronclient or
           python-openstackclient instead.

Unfortunately python-openstackclient has a warning of its own:

  WARNING: openstackclient.common.utils is deprecated and will be
           removed after Jun 2017. Please use osc_lib.utils

Hopefully this warning will go away once the 'openstack' client is
updated.

Change-Id: If429b2d04111a6e8adbb90c001002215a927d1da
2016-09-14 21:10:22 +00:00
Jenkins 6216a4d48f Merge "Replace assertEqual(None, *) with assertIsNone" 2016-09-14 15:29:55 +00:00
Peter Stachowski bca4b2880b Define credentials before use
In creating the flavors, the variable for credentials
is used before it is defined.  Although this doesn't seem
to affect local use, it causes an error in the gate:

ERROR (CommandError): You must provide a username or user ID ...

This has been fixed.

Change-Id: I5e85c537cf53b1557ca4feaa176484beb3788121
2016-09-12 17:38:06 +00:00
jiansong 4c2d8b72e8 Replace assertEqual(None, *) with assertIsNone
From python 2.7 onwards, some new method such as assertIsNone
equivalent to the assertEqual,this will simplify the number of
parameters.

I am looking for all the assert method, which can be updated and
renewed,and changed the place where I think they can change.
These changes should be harmless

refer to [1] for more information

[1]:https://docs.python.org/2.7/library/unittest.html#unittest.TestCase.assertIsNone

Closes-Bug #1618434
Change-Id: I67db37a0f7561c638d5bb8f2ccd894fa07f6109e
2016-09-11 00:21:36 -07:00
Jenkins 26087fd58c Merge "Speed up creation of flavors" 2016-09-11 07:16:05 +00:00
Matt Van Dijk cd435a1254 Change MongoDB to version 3.2
Cleanup and update the mongodb elements to install MongoDB 3.2

Partial-Bug: 1582712
Change-Id: I7575746ac445a875349640ffa91d6d3fb6680cea
2016-09-09 17:52:19 -04:00
Amrith Kumar 5b3b1efe25 Add requirements files for newton
This is to address the upcoming newton branch. Without this, as soon
as we branch, newton builds will fail.

Change-Id: If270c713dea1900ec6332ba531cdc52a20c2f71d
2016-09-09 10:05:41 -04:00
Amrith Kumar 0f36442b03 missing requirements of keystoneclient
The guests are missing a keystone client and therefore won't launch.

Change-Id: I102ecfcc169e0cdce93a2c2ad1404d7a929c8152
Closes-Bug: #1620546
2016-09-06 06:09:52 -04:00
Peter Stachowski a14c5ce2e7 Speed up creation of flavors
When creating the flavors necessary for redstack int-tests
'nova flavor-list' is executed for each flavor.  This adds
over a minute to the kick-start process, even if all the
flavors already exists.

This change caches the list of flavors and passes it into
the add_flavor routine to avoid the overhead of multiple
flavor-list calls.

Change-Id: Ib70efd4eeb6f6808360d9baaac14edd5a6e84934
2016-09-02 15:40:01 +00:00
Peter Stachowski c637e5ffc2 Turn off Neutron until supporting changes land
There are a number of changesets that need to be merged
before Trove can use Neutron successfully.  Since two
of these are in devstack we'll need to wait to see if they
are willing to accept the changes before we can start using
it by default.

See: https://review.openstack.org/#/c/356026
     https://review.openstack.org/#/c/356763
     https://review.openstack.org/#/c/356701

Note that the 2nd changeset (devstack) could be rolled into the
Trove plugin (3rd changeset) by copying the relevant functions
(not ideal, but doable) however the 1st changeset (devstack) is
fairly critical and would be difficult to implement outside
the devstack Neutron l3 plugin.

Also changed the logic for the Neutron client (and others)
such that the code is pulled from git if the project is enabled,
and made sure *_BRANCH and PROJECT_BRANCH were honoured on the plugins.

Change-Id: I764f15514a40926173b6c9194ddbf24c6c1f999a
2016-08-25 19:43:34 +00:00
Matt Van Dijk 405a3b5452 Use Neutron by default
nova-network is being deprecated, and devstack is moving to using
Neutron by default. This patch makes redstack use Neutron by default and
fixed a number of issues related to using Neutron.

Change-Id: If216688ef26b118c6d7598b2e086ba446b03978a
Closes-bug: 1604019
2016-08-18 15:17:15 +00:00
Jenkins d097398b27 Merge "Add "clean" command to redstack" 2016-08-14 06:04:57 +00:00
Amrith Kumar 9e36222ff5 upper-constraints.txt handling in trove-integration
Currently, trove-integration attempts to get an upper-constraints file
into the guest by looking at the tip of the appropriate branch. This
is fine for developer side testing but not ideal for the CI.

This change looks to see whether the CI setting (DEST) is set, and use
that to see whether $DEST/requirements/upper-constraints.txt is a
file, and if yes to both uses that. If not, it attempts to guess based
on the branch name.

This therefore covers both cases, the CI and the developer environment
and should allow for chaining with jobs that attempt to change u-c.

Co-Authored-By: Tony Breeds <tony@bakeyournoodle.com>
Co-Authored-By: Amrith Kumar <amrith@tesora.com>
Closes-Bug: #1610938
Change-Id: I06406051c849c924371f22b9fe1b03ab99e300f2
2016-08-09 22:06:30 -04:00
Doug Shelley 4f6ce5d5ca Add "clean" command to redstack
A long time request has been to add a "redstack clean"
command that would clean out all the trove, nova, cinder
etc resources left around after a failed test run.

This commit adds a "clean" command to redstack. It is a
first cut and hopefully can be evolved by the community
over time.

Change-Id: I5e2e28936161e65e0a4edfa5c4b9d5ffcab6cee8
2016-08-09 17:01:27 +00:00
Jenkins bf6e9296f8 Merge "rename a file for fedora guests" 2016-07-19 22:15:59 +00:00
Peter Stachowski 796d2e8b3d [fix gate] Use upper-constraints on image build
Currently building an image uses requirements but not upper-constraints.
This can cause an issue when libraries change and the image becomes out
of sync with the server code (for example when oslo.context changes).

Trove integration now uses upper-constraints as well when building
images.

Change-Id: Iba5e9976ff9522b7b6fdd523ed78fc6d9b70ea6c
Closes-Bug: #1603506
2016-07-15 18:30:30 +00:00
Amrith Kumar 62708066a0 rename a file for fedora guests
fedora guests don't use upstart. renaming the file because the current
name (20-guest-upstart) while identical to the name for the ubuntu
file is confusing and misleading.

Change-Id: I9818235e0d367c8213ccd1f60c4b26be11dd3735
2016-07-10 13:24:20 -04:00
Victor Stinner a3e609e192 Install PyMySQL on guest
Add PyMySQL (>=0.6.2) dependency. PyMySQL is now the preferred MySQL
client, for example it supports Python 3. See the Trove change
I65e8a8d5dc251a8b00529cdfb1a6ada3d5720f68 for the full rationale.

Use pip dependency rather than the python-pymysql package, because
the package was only added in Ubuntu Wily (15.10) and Fedora 22.

Partially implements: blueprint trove-python3
Change-Id: Id4d013d174ba40a453819f900aaa316a93e59b48
2016-06-28 18:13:21 +02:00
Jenkins e1fad430d4 Merge "Have Trove plugin install dashboard" 2016-06-25 01:00:16 +00:00
Jenkins e9b81be600 Merge "Move the rabbit/rpc options to its own section" 2016-06-24 01:13:19 +00:00
Jenkins 8eca7f3c45 Merge "Add another 'fault' flavor" 2016-06-23 20:58:56 +00:00
Amrith Kumar ff4308b82a Move the rabbit/rpc options to its own section
Using the DEFAULT section for rabbit configuration is deprecated, so
all rabbit related option should be moved to the oslo_messaging_rabbit
section.

Change-Id: Iec072877e9174e136b4f0c1c806d7f9b377a7f2e
2016-06-21 10:46:46 -04:00
Peter Stachowski 426ce72e1d Have Trove plugin install dashboard
This fixes redstack since the Trove plugin now handles installing
the dashboard if Horizon is enabled.

Variables were changed to reflect current names.

Change-Id: I18f68136ebb81bc4b4f8c12062d084a5d8901193
Depends-On: I6586801bff4282e3bbf11e45e4f171fffcab285e
Closes-Bug: 1593806
2016-06-17 18:23:05 +00:00
Morgan Jones 71d1887a99 Support running Mistral under Redstack
Adds support for ENABLE_MISTRAL option to configure Mistral
to run under redstack.

Change-Id: Icddd5b34c30c5774e6b454c24f8373d30ca2da22
2016-06-08 13:03:29 -04:00
Jenkins 075be84738 Merge "Trove image build fails getting percona key" 2016-05-18 14:24:40 +00:00
Peter Stachowski e3ae175d84 Add another 'fault' flavor
Apparently there are two code paths for a failure
creating a Nova instance. One returns immediatesly
and the other takes some time to fail.  The case
where the initial command to Nova succeeds only
to fail later needs another flavor to test it.

A new flavor with not enough disk to install the
Trove image has been created to test this scenarion.

Change-Id: I5d3339e9cbfd6aeb0c3ff6936fefa8dbe9e841f8
2016-05-16 04:20:03 +00:00
Peter Stachowski 519f7ead61 Add 'fault' flavor to test persisting an error msg
In order to test that error messages are now persisted,
a method of guaranteeing that a Trove create command
will fail is needed.  The simplest way to do that is to
attempt to allocate more resources from Nova than it
has available.  To this effect, a 'fault' flavor has
been added.

Also bumped up the disk on mariadb to handle more
operating systems.

Change-Id: I32a5ed229988f047db44183c71f0462fa6f1990d
2016-05-11 21:28:50 +00:00
Amrith Kumar e363325c02 Trove image build fails getting percona key
This fails often in the gate and I ran into it migrating
trove-integration into trove-image-builder.

The most common cause for this is that keys.gnupg.net fails. While
there are multiple servers proxied for this service, sometimes they
fail. In general people have found keyserver.ubuntu.com to be more
reliable.

Change-Id: I97dcb9120c75129d8a0aaed9ddd39b9e5fa7e608
Closes-Bug: #1579094
2016-05-06 11:01:32 -04:00
Jenkins ccc33811cf Merge "Change redstack to use default config values" 2016-05-03 23:52:31 +00:00
Jenkins 2921bfcbad Merge "Add xmltodict to kick-start requirements" 2016-04-23 01:54:59 +00:00
Jenkins d1624aa6e6 Merge "Fix "trove_volume_size" test prop type" 2016-04-22 23:29:23 +00:00
Jenkins df72829d47 Merge "Don't reset HOME in redstack" 2016-04-17 18:26:01 +00:00
Amrith Kumar c8020fff45 Don't reset HOME in redstack
Currently redstack resets HOME as the first thing that it does. It
isn't particlularly apparent why this is required; it may have been
needed in a long ago time when paths to thing were
trove-integrations/scripts relative but they aren't now.

Change-Id: If0f7329ea37f6d92f10b815c7a96eaee97d8b6d4
Closes-Bug: #1552048
2016-04-17 07:56:51 -04:00
Jenkins 233a9b8f42 Merge "Elements for PostgreSQL 9.4 and pg_rewind" 2016-04-16 14:17:56 +00:00
Jenkins a904bd071c Merge "redstack repl is broken" 2016-04-16 13:55:07 +00:00
Petr Malik 3bfaed934b Fix "trove_volume_size" test prop type
'trove_volume_size' test property should be an integer.
Mongodb and Postgresql test configs define it as a string
causing the scenario tests to fail on these datastores.

Also add a large-disk flavors for datastores that require more
space on the root volume (Vertica).

Change-Id: I352580bc4967ba2d7125e26f037ca4bcda31b2b4
2016-04-14 20:52:00 +00:00
Peter Stachowski d2b066baf4 Change redstack to use default config values
The plugin code has been enhanced to allow configuration
of Trove using variables. The default there is to use the
actual config values in the Trove repsoitory. This has
been mirrored here, in that the variables are listed so
that a user/developer can modify them if they wish, but
they do not override the default values anymore.

The proper place to add these variables would be in a
'local' options file, such as options.rc or
~/.redstack.options.rc

Change-Id: I38bc7190f1c112b4ae3cd6614f1d6cb625b3387d
Depends-On: I2c568fdfa05064682f372b996a5aebcdd4e93ef3
2016-04-05 17:42:11 +00:00
Jenkins 4cadf13b30 Merge "Allow redstack to force kvm in devstack" 2016-04-04 10:51:47 +00:00
Amrith Kumar 5bff6f4300 Add requirement files for stable/mitaka
These files are required for image creation in stable/mitaka.

Change-Id: I2b451b9bbde211a5d033992da1cfd2f66a463594
Closes-Bug: #1556518
2016-03-18 11:22:46 -04:00
Jenkins e702dda2b5 Merge "Fix the issue with DB2 install" 2016-03-14 19:28:03 +00:00
mariamj 23f614ce1e Fix the issue with DB2 install
DB2 installation fails because the hostname cannot be
correctly resolved. This was caused by the change in:
 https://review.openstack.org/#/c/272711/.

The change includes adding '127.0.0.1 <hostname>' to the
/etc/hosts file before the actual installation and deleting
this entry from /etc/hosts once the installation is complete.

To make this complete, a change is added to the guest
agent to update the db2 settings for hostname:
https://review.openstack.org/#/c/291820/

Change-Id: Ia9dad59b9b40e7df66f3b1659e529eb32bf91f17
Closes-Bug: #1556159
2016-03-12 23:04:19 +00:00
Amrith Kumar 5317d12638 Fix oslo.context in liberty
Pin oslo.context to 1.0.0 in liberty.

Change-Id: I3904d53024674740aab3b3b864153fc76dbc6a02
Closes-Bug: 1551468
2016-03-11 21:18:08 -05:00