Commit Graph

28 Commits

Author SHA1 Message Date
Goutham Pacha Ravi db3f3b5c99 [victoria][goal] Native Zuulv3 CI jobs
Replace "legacy" style jobs with native zuulv3
ones built within the manila-tempest-plugin
repository. This refactoring is driven by a
community wide goal to stop relying on devstack-gate,
a deprecated component of the OpenDev CI system [1]

Remove in-tree devstack gate hook script portions
that are no longer necessary; and mark the rest as
deprecated, since third party CI could still be
relying on these hooks.

Replace "manila-tempest-dsvm-mysql-generic",
"manila-tempest-dsvm-postgres-generic-singlebackend",
"manila-tempest-dsvm-generic-no-share-servers" and
"manila-tempest-dsvm-scenario" jobs with
"manila-tempest-plugin-generic" which preserves
coverage for the generic driver, while removing
unnecessary duplication/separation. See commit
message in [2] for more details.

Remove older CentOS and HDFS jobs since they
were not being executed.

Remove "custom" image jobs targeting custom
manila-image-element based builds, the jobs
now originate in the manila-image-elements
repository. [3]

The dummy driver job has been split into two parts
for testing DHSS=True and DHSS=False in separate
jobs. Read more about the motivation in the commit
message for the change that created that job [4]

While some name tags such as "postgres" and
"ipv6-only" have been removed from the job
names, the functionality of the job hasn't
been changed.

This change will not be backported. Instead, new
changes akin to this may directly target older
branches of manila.

[1] https://governance.openstack.org/tc/goals/selected/victoria/native-zuulv3-jobs.html
[2] https://review.opendev.org/726291/
[3] d9d2f16360/zuul.d/manila-image-elements-jobs.yaml (L34-L67)
[4] https://review.opendev.org/740534/
Change-Id: I2be6fc12c787c05c7df68297990fcdca96f57c5d
Signed-off-by: Goutham Pacha Ravi <gouthampravi@gmail.com>
2020-07-28 14:55:14 -07:00
Goutham Pacha Ravi 770e57ff31 [ci] Remove explicit compression of log files
Compression is not needed post [1], explicit
compression renders them non-browsable.

This commit applies to legacy style jobs that
will soon be replaced with zuulv3 native jobs;
however, fixing it isn't terrible, and we
can use this fix for stable branches
where zuulv3 native jobs may not come for a
while.

[1] http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011875.html
Co-Authored-By: yatinkarel <ykarel@redhat.com>

Change-Id: Icd4f9dc435a807f6f729e4eb2d4df4b282ec79ac
Signed-off-by: Goutham Pacha Ravi <gouthampravi@gmail.com>
2020-07-27 12:43:59 -07:00
Goutham Pacha Ravi fb26e5211b Fix results capturing for the dummy driver
Tempest moved to running under stestr from
testr [1] and the subunit2html installation
has been altered as well [2].

[1] https://review.openstack.org/#/c/504345/
[2] https://review.openstack.org/#/c/534431/

Change-Id: I615fa6d4362f83f35e40a750bfcb3a96cc193f35
2018-07-11 15:10:33 -07:00
Raissa Sarmento d482b16ca3 Use generic user for both zuul v2 and v3
Zuul v2 uses 'jenkins' as user, but Zuul v3 uses 'zuul'.
Using $USER solves it for both cases.

Change-Id: Ib83267ef75f91fb8f95af312d644ebe19c6307c9
2017-10-13 15:13:16 +01:00
Tom Barron 345021d7ea Remove tempest pin
Change-Id: Ia402fb79e1de5c9925f575d635b9928475095f86
2017-08-04 14:05:10 -04:00
Raissa Sarmento 07fb60155f Update location of dynamic creds in tempest tests
Tempest is migrating their dynamic credentials interface to tempest
lib as part of the effort to create stable interfaces. [0] We will
need to update its location in our code to conform with it.

[0] http://lists.openstack.org/pipermail/openstack-dev/2017-July/119934.html

Depends-On: Id8d60e4d7c22bc72c3e48bc768509ff0cc0c89d5

Change-Id: Iaa6bf908ff5d63cbbfddc7060594818c66ce607c
2017-07-24 12:57:06 +01:00
Tom Barron 39fb6cc23a CI: Update tempest commit
Manila pins the version of tempest it tests on the gate.
Update the pin to tempest verstion to date.

TrivialFix

Change-Id: I7bd51c1c5365ffd4247e46565fe7d3f74b5ef701
2017-06-07 12:14:39 -04:00
Goutham Pacha Ravi 76e569a616 CI: Update tempest commit
Manila pins the version of tempest it tests on the gate.
This is antithetical to the tempest plugin mechanism. So,
our gate breaks when some plugin relies on code from tempest
that is not part of the commit manila pins in the CI.

While we are working towards a permanent fix to this problem,
let's update our pin as a workaround.

Closes-Bug: #1693832

Change-Id: Ide131229efdea5a48dc389449602f2b0abb699f7
2017-05-26 15:35:51 +00:00
Tom Barron 423fd16671 Update to current tempest tag
Change-Id: I8f93ecf12bbe309a4156a2583bd6f57187f36607
2017-04-01 06:17:49 -04:00
Ben Swartzlander 8e791b4e0e Change tempest tag to 15.0.0
Change-Id: Iaf03059a44d08236b6de14e4dc18f2ba459e9707
2017-02-24 15:14:41 -05:00
Tom Barron beda4a88ff Update tempest pin to 15.0.0
Change-Id: I10fa08d4831a59e858c393f86f680f88474c7ea3
2017-02-19 08:13:05 -05:00
Tom Barron 4cfdbea447 Update tempest pin to latest commit ref
Also updated invocation of DynamicCredentialsProvider to supply
necessary parameters.

Change-Id: Ie24bc69402964af3d756c1548aed86cc53c272c4
2017-02-10 15:04:57 +00:00
Valeriy Ponomaryov 8c5ed29ba6 [Devstack] Fix DHSS=False setup for Generic driver
Recent change to devstack [1] broke our DHSS=False CI job running
generic driver that was depending on ip route from host to
private network. So, to avoid this error use floating ip address
for connection to service Nova VMs from host machine.
Also, fix generation of second export location that should be dedicated
for service needs such as mounting share doing host-assisted
migration.

[1] If45e3fc15c050cfbac11b57c1eaf137dd7ed816f

Change-Id: Ieea992293ae02898741c939da15f0dbb4609d8b0
Closes-Bug: #1644523
Closes-Bug: #1646097
2016-12-02 14:33:56 +03:00
Tom Barron 7fded233f3 Update to tempest 12.2.0
Tempest 12.2.0 was recently released and manila tempest plugin runs
just fine with it.

Update tempest in our CI to use tempest at the commit corresponding to
this tag.

Change-Id: Ia00670a5cf0b52a41fa0d3cd9a82cd81f7802155
2016-09-06 22:27:03 +00:00
Valeriy Ponomaryov 7145891ef8 Add dummy driver
Added dummy driver for ease of testing and development of REST APIs
and internal manila interfaces.
It can be enabled as backend in the same way as all other share drivers.
But, it does not provide any resources.

Also, update tempest to be able to work with share-networks when
networks are defined via config and not API.

CI hooks are configured to run tempest twice using both available
driver modes. Where DHSS=True mode uses StandAloneNetworkPlugin as
network backend.

Change-Id: I9053dddfc643cb5a6602f15235b91bbaea727dbd
Implements BluePrint dummy-driver
2016-07-22 17:57:59 +03:00
Marc Koderer 916c1cfa80 Update tempest to newer commit version
Neutron is using tempest plugins too and it's needed newer changes
in tempest we need to update our commit id.

Change-Id: Ic6621fbad9e5ba932643e0c0fb717b71a1fc5808
Closes-bug: #1599429
2016-07-07 19:28:55 +03:00
Valeriy Ponomaryov e2aecad547 [Tempest] Bump tempest version
Fix small incompatibility that left to be done and bump Tempest version
to unblock our CI jobs.

Also, remove temporary fix [1] that was done for unblocking CI.

[1] I44655c83cc5588c5b94d0fad81162dd0c238b5b4

Change-Id: I12e2652638ba26833f9365f06fa84a98ca24765c
2016-06-08 11:53:29 +03:00
vponomaryov 1e58d5c940 Bump Tempest version
Latest Devstack is not compatible with Tempest version
used by Manila after merge of commit [1].
Therefore, bump Tempest's version and fix incompatibilities
with plugin.

[1] I63658b8d8dfa999e0feb79f8f2968f2b32e3ff57

Change-Id: Ib6fb886f8a17ff6419fd75db74f290f821a3d302
2016-05-10 23:33:31 +03:00
Valeriy Ponomaryov 6d2efea25f [Fix CI] Bump Tempest version
We are forced to bump version of Tempest because of regular
introduced incompatibility.
Also, add compatibility fixes to Manila plugin for
latest Tempest version.

Change-Id: I13c838c39d99c008d53e544f54dadee01f36fdf2
Closes-Bug: #1568785
2016-04-11 15:25:45 +03:00
Ben Swartzlander 4368c98b71 Update tempest commit and switch to tempest.lib
tempest_lib was renamed to tempest.lib which causes problems
when running tests because tempest imports plugins from other
projects and crashes.

Closes bug: 1552520

Change-Id: Id7d43dee256856062bd0dadad9c469c1500ee36e
2016-03-02 23:09:00 -05:00
Valeriy Ponomaryov 70871c2479 Bump tempest version
After merge of change [1] to Devstack project Manila Tempest plugin not
compatible anymore with latest Devstack.
So, bump Tempest version to latest and fix compatibility with it.

[1] If66096cde31fedda407e1e6ac6899b196569a454

Change-Id: Idf9a9eabf9c98d090e47207cf89d9e5a5fc0ea97
Closes-Bug: #1539007
2016-01-29 00:24:39 +02:00
Jenkins 30eaf80506 Merge "Change manila_tempest_tests to use credentials_factory" 2015-12-03 02:16:55 +00:00
Sam Wan 69a3d999c2 Change manila_tempest_tests to use credentials_factory
With the merge of 'Factor up config dependent credential classes' in tempest,
(Change-Id: I351f86f0570070105bbf24f2d904e917feea6e57)
helper methods related to credentials have been moved to
common.credentials_factory module.
manila_tempest_tests need to change accordingly.

Change-Id: I9e5c72279638e07f509a4bfe0174b5ad5ee70b45
Closes-Bug: #1519612
2015-12-02 03:56:38 -05:00
Jenkins 56ccb015c8 Merge "Simplify ping usage for service VM check in CI" 2015-12-01 09:44:16 +00:00
Thomas Bechtold 6eb3a2d05b Simplify ping usage for service VM check in CI
Just rely on the return code from "ping" instead of
parsing it's output when checking the service VM during
the CI run.

Change-Id: I20f144687662a0dda5fdfc0293ab578009658c1b
2015-11-27 09:55:38 +01:00
Valeriy Ponomaryov 14d57d158f Add sleep to CI hooks to avoid races
Manila CI hooks for DHSS=False job with the Generic driver wait for
service instance availability and right after it becomes available
returns control to caller. And caller can run tests with creation of
shares immediately. But, in this case, we can face race conditions when
manila-share service requires some time to inform manila-scheduler.
So, add 'sleep 10' operation to be executed after reaching 'available'
state by service instance.It should be enough to overcome races.

Change-Id: Ie4ae231701edaab319c9012e476d1f63e3806499
2015-11-26 17:58:14 +02:00
Valeriy Ponomaryov 037ba11389 Fix import of devstack functions for common CI script
Commit [1] moved common logic for CI hooks to separate file, but it
depends on some devstack functions, that should be "sourced" in this
common file. So, this common file works in manila hooks, because they
import devstack functions separately, but it will not work if some other
scripts use it and do not import devstack functions.

[1] I94514405628ab8337d1f4153e431f064614e3596

Change-Id: I919fea046e556d601a7680ea9bac16c1a9b7343c
Closes-Bug: #1519028
2015-11-23 18:38:55 +02:00
vponomaryov 6b8319e32a Split common logic of CI hooks to separate file
Manila contains CI hooks located in "contrib/ci" dir.
Split common logic to separate file to be able to just "source" it and
then use env vars and bash functions in different CI jobs and projects.

Current change allows to do two things:
 - Reuse env var "MANILA_TEMPEST_COMMIT" in third-party CIs
 - Wait for drivers init in other projects like OpenStack Rally. Where,
   for the moment, one of jobs fails because of absense of "waiting".

Usage:
 $ source %manila%/contrib/ci/common.sh
 $ echo $MANILA_TEMPEST_COMMIT
 $ manila_wait_for_drivers_init "/etc/manila/manila.conf"

Change-Id: I94514405628ab8337d1f4153e431f064614e3596
2015-11-10 11:24:51 +00:00