To compensate for "slow nodes" which cause timeouts on Manila
DSVM jobs on semi-rare occasions, increase the timeouts to
avoid the need to recheck.
Change-Id: I880b9e9cecb05cf32c23ccf3bf70e31d1bcf1827
The v3 migration script can handle these just fine - but if we go ahead
and remove them the output can be predominantely shell rather than
script.
Change-Id: I440851a0149e1cc7f8c5c6e8a4e3e0b94088ee82
Remove special treatment for mitaka in jobs where the repo has now
the stable/mitaka branch retired.
Change-Id: I1af11cf22c145bb96e93485460cca277287c88ca
Apparently we have things called foo-ui and foo-horizon... Missed the
-uis in the last pass and am adding them here.
Change-Id: Iafebfc92017d859cd3062fc4b6fab2986dfc5c98
Manila tests require the manilaclient from master, there for the
manilaclient is cloned in the manila devstack plugin.
Some projects (such as Fuxi, Karbor) depend on manila, and would
like to install the packaged manilaclient.
Align with other python clients - mark it to be cloned from git, and
in the devstack plugin clone it only if it has been marked.
Needed-By: Ia8e726b9358f6901c172a31f638a59eba523e0fa
Change-Id: I94d2f143159b60c4f8693e35fe844bc1e411e580
A few projects used excess '' for node declarations, remove them.
We had 17 'ubuntu-trusty' and 285 ubuntu-trusty,
and 25 'ubuntu-xenial' and 744 ubuntu-xenial.
This changes all node names for consistency, thus making search easier.
Change-Id: I0cf565d1e31ea246f3b9d93bbd8de9980df4c684
When tagging commits, the resulting file that gets uploaded to
tarballs.o.o contains the suffix -refs-tags-<tag> when we just
want -<tag> as the suffix.
Change-Id: I23b6d9702bc5873ff4f2e859fa5e52373a5690c8
These will help as we develop the CephFS NFS backend.
NFS variant is supported post-ocata; native variant
continues to be supported on all branches.
Also, migrate these jobs to use the new local_conf
setup and remove the mitaka only trusty jobs since
stable/mitaka is eol.
Change-Id: I180245d6b5af268fa51bd41446edc1f288b80488
We do not need gerrit-git-prep anymore, zuul-git-prep works on all our
slaves and has the advantage of using zuul-cloner so that the local
cache is used and Depends-On works.
Remove gerrit-git-prep and use zuul-git-prep instead everywhere.
Change-Id: I2f106af58f78fceaf3c497fe43e6f5a002695645
Perform 'git' command only from root dir of appropriate repo,
to avoid influence of git repo where command is executed.
Change-Id: Ia43001d2711964f0c62285f957ec055ea5a53b4c
For the moment, we have jobs that just build images for this
project, but they are not tested for usage with appropriate drivers.
So, add two tempest jobs, that will use built image with proposed
changes to "manila-image-elements" project and use it for manila
'generic' and 'container' (docker) drivers.
Add those jobs only to check pipeline and make them non-voting.
Change-Id: I3698044bbcaa94bddcfa192841520b4d7ea32016
The job seems to be timing out with the default of 30 minutes.
Try doubling the default to see if that's enough. Locally this
build process only takes 25 minutes so I expect 60 to be more
than enough.
Change-Id: Ibc74e71c730cf2ebb5f279aecc31a2cdc331dd5e
Manila-test-image has no real gate jobs to speak of. This change
adds a real test job that runs the build, but as experimental
while we test that it works.
Change-Id: I33ccba3301f2eb46c654fa6fd6d110df3581f35b
Disable tempest for manila grenade job in proper way.
We have not installed it intentionally before and haven't added
to list of enabled services. But it tries to be updated in grenade
job. And after merge of [1] change to grenade project, that update
started failing. So, disable upgrade by specifying appropriate env vars.
[1] Idede322190d57491d4f7e18090aa8c29b5b87353
Change-Id: I1573df1fcd35564d7240efca2ec39304eb54ea60
Closes-Bug: #1650482
This is part of the Trusty to Xenial transition. Because
manila-image-elements only has a master branch just shift the jobs ahead
to run on Xenial.
Change-Id: Ibde70559d20a3387c6f4356bf4450a431eeb0bf6
Recently was added new CI job [1] to manila-ui and manila projects.
But it does not enable python-manilaclient and it is not enabled
by default. It leads to error because manila devstack plugin is
trying to 'clone' its repo in this case and cloninng is prohibited
in OpenStack CI.
[1] I0bc284651263105c5cb14b6f61480f4eb7dcce20
Change-Id: Ic6890e02a5bd2a6de501291b2977a376e8179fe7
For the moment grenade manila job uses default heavy 'generic' driver.
But it is redundant. So, do following:
- Switch that job for usage of lightweight dummy driver
- Disable all redundant services
- Make that job non-voting until we merge all required changes to
manila project according to this change.
Change-Id: I2b698f69a29ef983b13534b2f4d393570be4dac8
And enable them only for Newton+ branch.
Make most of them non-voting until we know for sure they are stable.
Allow three of currently voting jobs on trusty still run for latest
manila branches temporary.
Change-Id: I8af1340f3cb415a7211e13122aea503a2981a1da
After enhancing the job with extra services it has started to
fail consistently due to contradictory description.
Change-Id: Ib1e5a1dbe309148629740ffacab93384d5049ba6
Closes-Bug: 1621081
These jobs are almost identical, so we can cut back
on redundancy by merging them into a template.
Also adding new instances of this template to
have experimental jobs on Xenial. (Once they
prove to be stable, we cut back on variety
and move completely to Xenial.)
Change-Id: I366493c75e07c2414c97781a01769dc052c4bb7e
To be able to run scenario tests on the gate for drivers
tested with minimal-dsvm job nova and neutron have to be
re-enabled in it.
Change-Id: I256d2ac8fd066d17b5dea5c7382e2e34543d993a
Manila project is going to test its APIs using dummy driver
that does not really provide resources and just simulates
share driver behaviour.
For this we need to have separate tempest job, without any other
OpenStack projects, just manila.
Therefore, add such, make it non-voting and experimental until
appropriate feature merged in manila and becomes stable.
Change-Id: Iea5d982c9c147a37c57db0cdab9dc305f4f8fa81
'manila-image-elements' project going to use buildimage project and its
element 'debootstrap'. It requires, on its turn, samenamed system
package, but it is absent in default list of packages.
Therefore, add template 'install-distro-packages' to related CI jobs
to make them read 'other-requirements.txt' file with system packages
that should be installed.
Change-Id: I1cd461efe5bdceeeefb0cbd4b8f8bcf41061307f
Manila uses plugin mechanism for enabling devstack and grenade plugins.
Design of grenade plugin assumes that it enables devstack plugin
using specific versions via its config. But now, CI job enables master
version of devstack plugin. It leads to duplication, manila installation
runs twice and, therefore, fails.
Remove redundant string from grenade job configuration for Manila
project avoiding this duplication.
Also, remove 'DEVSTACK_GATE_TEMPEST=1' env var from job config as
manila's case does not require it. It triggers run of redundant
tests. But enable tempest via "ENABLED_SERVICES" to be able to
trigger tempest run in manila grenade scripts not depending on
'devstack-gate' project scripts in future.
Change-Id: Ib5b7df457101430813db89320dcc3d3f8438f252
To be able to test Manila upgrades 'grenade' job is required.
Add such for Manila project to experimental pipeline.
Make it non-voting until it becomes stable.
Change-Id: I550bcaadacd811464997be7806c9b8d94799e38c
Although a publish job exists for manila-image-elements,
it doesn't upload anything because the filename it was
looking for was not created by the build. This patch
fixes the filename, and also renames tagged versions to
something different so they don't get overwritten.
Change-Id: Icea85a000cb68ae7befecadcca0ba7138fe7c7c2
Manila functional tests don't require most other services, but all of
our jobs use the default set of services, wasting CI resoures. This job
tests how the tests run with very few services enabled. If this
experiment is successful, we will refactor all of the existing manila
gate jobs to use only the services they really need, hopefully cutting
down on job times by up to 50%.
Change-Id: Ia5f5778baf80398e5184efd16dcc978512e1edc9
With change Iff5e96bd80b8f165ccc7d6be09b53208613571eb, we do not need
to pass DEVSTACK_GATE_TIMEOUT anymore to devstack-gate, instead the
value from the build-timeout wrapper is passed.
Remove DEVSTACK_GATE_TIMEOUT for jenkins/jobs/[e-m]*.yaml
Increase timeout for all non-grenade jobs by 5 mins since
Iea866e4cc40e149e598f35e010ec855937bdf9ae will use a 10 minute
buffer and the internal timeout should stay the same. The grenade
jobs already have 10 mins of buffer, so no need
adjust the timeout.
Change-Id: Ied54d602d0cd1b994129f979ec25290e54980426
Add Jenkins job for Manila with CephFSNative as its storage backend
driver.
Set the job as experimental and non-voting for the Manila project
as the CephFSNative driver is still WIP.
Set the job as non-voting for the devstack-plugin-ceph project until
the job is proven to be stable.
Change-Id: Ia3221b735468bd7ab6b2d4dccba75cae76e09dd4
Change [1] started to use comments in multiline command,
and it was done with wrong separation of comments and arguments.
So, arguments are not provided correctly to the devstack hook scripts
and they behave as nothing was provided, after their work finished we
get errors when bash tries to execute 'arguments' as separate commands.
So, fix usage of comments separating them from multiline command.
[1] I521f0419e65e27f22acbc03aaa1f0f997492e8f8
Change-Id: I5c073d38b61b21ec642ee11a28e6b23fe5662159
New driver (LVM) is going to be added to Manila.
So, register job for it adding new var that contains driver name
to configure for Manila. Also, provide several more arguments for devstack
hooks, to remove dependency on job name.
Make new job run only for M+ branches in experimental pipeline
and only as nonvoting until it is merged and becomes stable.
Change-Id: I521f0419e65e27f22acbc03aaa1f0f997492e8f8
* The CI sets up and configures HDFS, and does not use GlusterFS.
* The CI is run on a multi-backend installation due to
82ebbc1ba2
Change-Id: I7983959ae4543ccfa4de40d635ae5bf33c98e859
Between the Icehouse and Juno releases, OpenStack changed its
supported Ubuntu LTS platform from Precise to Trusty. In support of
continuing testing stable/icehouse and prior branches on Precise
while starting to test newer branches on Trusty, a branch-based
decision tree was introduced into our Zuul configuration by way of
complex parameter functions with an ever growing list of regular
expression matches on job names.
Now that Icehouse is EOL (in fact, Juno is too) this simply adds
unnecessary complexity and an attractive nuisance for cargo-cult
copying into new job and job-template definitions which don't even
need it. In preparation to remove the associated parameter
functions, get rid of multiple labels in all jobs and set them to
whatever label Zuul would ultimately select.
This change touches a vast number, possibly a majority, of our jobs
and so manual jenkins-jobs updates on all Jenkins masters will be
needed after this merges, before it's safe to approve the
corresponding Zuul configuration cleanup.
Change-Id: Ic952ee02da2c77fe2ace81c4e2fa87531be6119c
Commit [1] removed all clients from prerequisites and broke by this
action all manila devstack jobs. So, add this in manila devstack job
template explicitly.
[1] Iabf4c0c22413b0d238f3b40822fb7c2ed84c2e0e
Change-Id: I57de6e4b5b20c89f7344d8a1ada44bc14532f767
To run buildimage tox job user should have passwordless sudo
which is disabled in default tox job template. That's why we need
manila specific job template for build image jobs.
Change-Id: Ic720cd9bd71b6a0dc0b9035fd185789f244042b1
Partial-Bug: #1504530
Depends-On: Ia1fef024f9188869a1993604dcfbd09499700515
Monty Taylor