Commit Graph

35 Commits

Author SHA1 Message Date
Monty Taylor 355f7090a6 Remove zuul v2 and jjb content
It's migrated, it can be removed now.

Depends-On: I6a89752d74ed7424267c3af3937ad01fb4bb8f86
Change-Id: Id67d0149b645bd23e460cef65719541f76f0967b
2017-10-24 08:50:05 +02:00
Yolanda Robla 5adf6a3e8d Unset UPPER_CONSTRAINTS_FILE on dib
After setting the UPPER_CONSTRAINTS_FILE, gates started failing
because of side effects, as this var was being taken as part of
the image build. Unset it after requirements have been installed
and before actually running the tests.

Change-Id: I650cf83e2828ce373b8c9e8b3c0cc1c9722b949a
2017-09-25 09:52:30 +02:00
Matthew Thode b31a3dfe89
Use the correct path for upper-constraints
requirements is at /home/jenkins/openstack/requirements let's use it.

Change-Id: I76910392a351d33cc382b3fcc17a6e14d809a8c5
2017-09-22 15:47:16 -05:00
Matthew Thode 82fdd1d6e7
make diskimage-builder use upper-constraints
Testing against uncapped packages can break things sometimes.

Change-Id: Ib2fe5eb604239f398dc2f0f95e894c06e063a3f7
2017-09-21 17:18:19 -05:00
Ian Wienand 625104faf9 diskimage-builder : make mirror repos
Call the contrib script to make the infra mirror repo files.  I don't
want the functional tests calling this themselves -- in theory they
should run anywhere and this is OpenStack CI specific setup.

While we're here, remove the clone and install of dib-utils.  This
hasn't been doing anything since
Ic1e22ba498d2c368da7d72e2e2b70ff34324feb8 when we decided to retire
the project and fold it into diskimage-builder.  The related jobs
aren't actually testing anything.

Change-Id: I45b4b181369032155f8908ee11641d2327586e6f
2017-06-28 14:58:16 +10:00
Ian Wienand 840dea4f11 Add log copier to dib jobs
Add log copier to dib jobs so we can add some other artifacts for
copying.

Change-Id: I2c3c0f4c3993b3f1b88663ce29d8b01bfb1e173c
2017-06-16 12:42:38 +10:00
Ian Wienand 468752a0e0 diskimage-builder: allow specifying python3 virtualenv
Convert the diskimage-builder jobs to be able to make either a python2
or python3 virtualenv for testing.  Convert jobs to specify.  Add a
-nv Xenial python3 jobs for testing.  When these are stable, we will
remove the Xenial python2 jobs and just leave python3.

Change-Id: I787451057eee90a59a94b6821c4665c243a5d7f7
2017-05-09 12:17:18 +10:00
Andreas Jaeger 4a61bc67f5 Change job-suffix to suffix
We have now some rather long job-template names, shorten them with
replacing job-suffix with suffix.

Before this change we had 1500 usages of job-suffix and 700 of just
suffix. This change therefore unifies to one setting.

Note that this does not change any job names at all, they are unchanged,
it changes and shortens only the names of job-templates.

Change-Id: I514df039a848d9f6619bca3adc05dfb84a761fc9
2016-12-08 22:05:01 +01:00
Paul Belanger adc6a55d1a Fix path issue in gate-dib-dsvm-functests
We recently added bindep support to diskimage-builder, in doing so, we
incorrectly looked in the wrong directory for the cloned project.

Change-Id: I960a466351dabae1b75c2f31183fcdb7c43fe173
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-10-31 08:59:48 -04:00
Paul Belanger fadba4dab8 Add bindep support to diskimage-builder
Start using bindep to manage OS dependencies for DIB.

Change-Id: I88c01234de396db0ae35365eb678069ed082e552
Depends-On: I3b599983106b87fec6a4b6348469ed037654810e
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-10-24 07:04:15 +00:00
Gregory Haynes c937f97595 Make dib_cache dir with sudo in dib jobs
We forgot to make this dir as sudo so we fail with permission denied.

Change-Id: Ifbeb5eea8ed72194d86b3bc3b693f7d1c9b592de
2016-06-23 15:23:29 +00:00
Ian Wienand 62da6583a1 Don't use tmpfs for DIB functional tests
We may do things that exceed the space available in a tmpfs, so point
everything at the larger mounted space.

Change-Id: Ie63a66f9c3e77a0e6351f2d058e17a5eb5a2d949
2016-06-23 10:32:55 +10:00
Ian Wienand 53e90a7fee Remove dib-buildimage-debian-ironic post job
I noticed that this job was failing [1].  It was added with
If9363bff535f9d1fc9692767ac9194923030cfe7 , but there doesn't seem to
be anything published for it [2].

This would have to be fixed by pip-installing dib as done with
I5950c772b380cab926fd707cfed25db219a96f62 , but as it seems unused,
let's just remove it.

[1] http://logs.openstack.org/a1/a10a664a2a329ed881cb35faeed7c96c7239d2f4/post/dib-buildimage-debian-ironic/1e307f1/console.html
[2] http://tarballs.openstack.org/diskimage-builder/images/ironic-agent/debian-jessie/

Change-Id: I4ac3b94dcbc7e40e35525adf24a37d423f758116
2016-06-07 11:56:33 +10:00
Matthew Thode f765bc7524
Add non-voting diskimage-builder jobs
This commit allows the definition of non-voting gate jobs by defining
a new job-suffix. 'extras' was added as a new job pre-suffix because
just 'nv' implies we would be testing the same things as the
non-postfixed variant.  This was done to facilitate adding a Gentoo
non-voting gate job, also in this commit.

Change-Id: I08f35397a4cce05b90d88077922dc38ece5c2b55
Depends-On: I0d2768a912b350e1b2cf40d2fd227fdc767b1bcb
Signed-off-by: Matthew Thode <mthode@mthode.org>
2016-03-18 15:21:34 -05:00
Matthew Thode 53bdac832f
fix deactivate as it also needs set +u
This should fix DIB centos tests

Change-Id: I048cda4539c4e8e7b0385edb4e2576b573a0b44e
2016-03-18 14:23:47 -05:00
Gregory Haynes 58bbe38e84 Disable set -u when sourcing dib venv
Sourcing the venv fails when we are set -u.

Change-Id: I8f1c98c2102737c75fd611059c68cccc436fcb64
2016-03-17 19:31:44 +00:00
Andreas Jaeger 8a528b5b24 Fix dib virtualenv setup
activate needs to be sourced to run.

Change-Id: Ic6a122ea15af06f3a2b42e4965743b544817afce
2016-03-17 16:29:32 +01:00
Ian Wienand 861c45db5a Use pip installed dib for functional tests
With the switch to the ubuntu-trusty nodes, we've exposed a flaw in
testing dib from a checkout like this.  Several of the parts have
python dependencies [1] ; e.g.

 | dib-run-parts Thu Mar 17 06:04:57 UTC 2016
 |  Running /tmp/image.2NkOFQBR/hooks/extra-data.d/99-squash-package-install
 | Traceback (most recent call last):
 |   File "... /bin/package-installs-squash", line 23, in <module>
 |     import yaml
 | ImportError: No module named yaml

but we're not installing dib's python dependencies at all but simply
running ./run_tests.sh

So now that the image doesn't come with some of these things, we
break.  The solution is to install dib into a virtualenv and run from
there so that we get all the dependencies.  We already had an
experimental job doing this, so move it to the main job.  The scripts
should be using "#!/usr/bin/env python" so they should pickup the
virtualenv python & consequently have their dependencies.

[1] http://logs.openstack.org/33/293833/1/check/gate-dib-dsvm-functests-ubuntu-trusty/1731239/console.html

Change-Id: I5950c772b380cab926fd707cfed25db219a96f62
2016-03-17 18:31:49 +11:00
Andreas Jaeger c28c95a6ba dib-buildimage-debian-ironic: Use ubuntu-trusty
Use ubuntu-trusty instead of bare-trusty as node.

Change-Id: I2f76143e616e82f19e7d3fc4d313fa6d639d5797
2016-03-09 20:15:08 +01:00
Ian Wienand e5f0619b25 Use pip install of dib for testing
Rather than running from the checkout of the source tree, we should
also be testing the install/distribution part of the package by pip
installing.

This sets up some experimental jobs to make sure this works, with the
idea of converting the main jobs when it does.

Change-Id: I161f58d19e57cdc985d49d8490f57cae2a441732
2016-02-18 15:37:27 +11:00
Julia Kreger 2321ef35f8 Build a Debian simple-init images
In order to to speed CI build times for bifrost, we will
attempt to pre-build the debian guest image that helps us
identify if simple-init is in working order as compared to
bifrost, since the simple-init element which users are
dependent upon resides in the diskimage-builder repository.

As a result of the same job being utilized, the job has been
renamed appropriately.

Additionally, the file upload configuration appeared to be
working incorrectly and this commit updates it in an attempt
to correct the issue.

Change-Id: Ifde8717740f324cb3abe1266efca42bd24d634d3
2015-12-21 20:52:40 -05:00
Jeremy Stanley 0af9b2c178 Get rid of precise||trusty job node declarations
Between the Icehouse and Juno releases, OpenStack changed its
supported Ubuntu LTS platform from Precise to Trusty. In support of
continuing testing stable/icehouse and prior branches on Precise
while starting to test newer branches on Trusty, a branch-based
decision tree was introduced into our Zuul configuration by way of
complex parameter functions with an ever growing list of regular
expression matches on job names.

Now that Icehouse is EOL (in fact, Juno is too) this simply adds
unnecessary complexity and an attractive nuisance for cargo-cult
copying into new job and job-template definitions which don't even
need it. In preparation to remove the associated parameter
functions, get rid of multiple labels in all jobs and set them to
whatever label Zuul would ultimately select.

This change touches a vast number, possibly a majority, of our jobs
and so manual jenkins-jobs updates on all Jenkins masters will be
needed after this merges, before it's safe to approve the
corresponding Zuul configuration cleanup.

Change-Id: Ic952ee02da2c77fe2ace81c4e2fa87531be6119c
2015-12-21 20:52:17 +00:00
Julia Kreger 70a6e96549 Correct typo in diskimage-builder job
The repo name was accidently put into the diskimage-builder
post-build job by accident instead of the actual script name
inside of the repository.

Corrected, which should result in the build job working as
intended.

Change-Id: Ic5cd96ba3290339be3abfa69887d4248d9c988d7
2015-12-17 04:27:56 -05:00
Julia Kreger 15b6ae0bb8 Build a Debian IPA image when DIB changes merge
In order to to speed CI build times for bifrost, we will
attempt to pre-build the IPA image when changes have been
committed to diskimage-builder, as the ironic-agent build
element is with-in the diskimage-builder repository.

Change-Id: If9363bff535f9d1fc9692767ac9194923030cfe7
2015-12-08 10:09:01 -05:00
Gregory Haynes e600bdbac8 Extend the timeout for DIB tests
When performing image boot tests we run up against the 30min default
timeout. We are pretty far in the test run at this point, so extenting
the timeout to 60min should be enough.

Change-Id: I0254e08e2bee35f4db5ec9deb185e328e67a6d5a
2015-07-24 21:06:33 +00:00
Gregory Haynes 2eb3a91114 Remove zuul-cloner workaround for DIB
We added this to work around a bug in zuul-cloner, but the bug is now
fixed.

Change-Id: Ia1332308905f63db24e3af6ca982788270dc7a0e
2015-05-17 09:08:28 +00:00
Jenkins 7c73a564bb Merge "Clone DIB repos with git before zuul-cloner" 2015-05-08 18:04:44 +00:00
Gregory Haynes 186c917afd Clone DIB repos with git before zuul-cloner
Work around a bug causing zuul-cloner to explode when cleaning up the
DIB git repos.

Change-Id: I4c21122f3e1a6c64480c66daf3c69b5a22b9eff1
2015-05-08 17:00:55 +00:00
Gregory Haynes f7a79c7bb6 Use correct path for DIB tests
When we switched to zuul-cloner we missed the prepended openstack/ for
the downloaded repos. Also removing gerrit-git-prep since were using
zuul-cloner for the same functionality.

Change-Id: Ia9e1d943c486986a35c456733c8d4579957a5e50
2015-05-07 23:14:32 +00:00
Gregory Haynes fdff00184a Add DIB tests to dib-utils
We should be running the DIB functional tests for dib-utils changes.

Change-Id: If1480a51f82fdc184226bd30dc707d0267d77f53
2015-05-07 16:30:53 +00:00
Gregory Haynes cb61ed582b Move DIB test dep installation into DIB
We keep chasing after missing deps and dependency installation issues.
Lets handle these issues in the DIB source tree.

Depends-On: I7c8bdaddfe316ae171b34164f99bc3d568eafd92
Change-Id: I7883ad5408a39af858114377d54daad261856bd9
2015-05-01 21:35:56 +00:00
Gregory Haynes bbdecfd619 Install kpartx for DIB tests
diskimage-builder depends on kpartx, install it.

Change-Id: I141df7ca3a08cea6851676fb6c3c6c734c746e13
2015-04-28 16:52:38 +00:00
Gregory Haynes 8f7dbb4909 Add qemu-img to dib functests
Install qemu-img in dib functests as it is a requirement for many of the
dib output formats.

Change-Id: I92299b2f59aa8e7de8995a6294bf6c88bbd4cdc5
2015-04-23 20:19:39 +00:00
Gregory Haynes 435099c985 Fix DIB functest path and copy logs
Were using an incorrect path to the DIB functests runner and we are also
not copying logs.

Change-Id: I315f6f467b3a65c5049030ccdff80052f441dfcf
2015-04-23 05:22:58 +00:00
Gregory Haynes 63140bdd74 Add diskimage-builder functests
In diskimage-builder Ie491e27f00bde54f73af6b47c9696ec04d973b14 we are
adding functional tests. Adding jobs per distro since this a very
distro-dependent operation.

Change-Id: Ic80f44fc07c7ae9b4498417dee38e123fe1c2e71
2015-04-20 23:48:50 +00:00