openstack
/
diskimage-builder
Code Issues Proposed changes

Move image download tests to default skip 

The image download tests have long been too unreliable for the gate.
We need to cache the base images similar to how devstack caches it's
testing images.  Let's move them to non-voting jobs for the time
being.

This means that the gate jobs are now all based on "-minimal" and are
using infra mirrors.  Unfortunately, there is still some unreliability
because we currently have issues with infra mirrors being very slow
after AFS updates, leading to job timeouts.  But we're on the right
path...

Also, I noticed we don't have tests of the "ubuntu" image-download
based tests, which were tacitly being tested by apt-sources before we
moved that to -minimal.  Add simple tests for these.

Change-Id: Ie33ee49656872467ef68d753210032156bb6b2cb
This commit is contained in:
Ian Wienand 2017-06-23 10:58:47 +10:00
parent 559de43694
commit b0e0dd991c
8 changed files with 32 additions and 12 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
diskimage_builder/elements/ubuntu/test-elements/trusty-build-succeeds/README.rst Normal file
View File

@ -0,0 +1 @@
Verify we can build a ubuntu image.

1
diskimage_builder/elements/ubuntu/test-elements/trusty-build-succeeds/element-deps Normal file
View File

@ -0,0 +1 @@
openstack-ci-mirrors

1
diskimage_builder/elements/ubuntu/test-elements/trusty-build-succeeds/environment.d/10-set-distro.bash Normal file
View File

@ -0,0 +1 @@
export DIB_RELEASE=trusty

4
diskimage_builder/elements/ubuntu/test-elements/xenial-build-succeeds/README.rst Normal file
View File

@ -0,0 +1,4 @@
Verify we can build a ubuntu image.
Note this test includes the vm element to test the bootloader install,
and specifies to output a .qcow2

2
diskimage_builder/elements/ubuntu/test-elements/xenial-build-succeeds/element-deps Normal file
View File

@ -0,0 +1,2 @@
openstack-ci-mirrors
vm

1
diskimage_builder/elements/ubuntu/test-elements/xenial-build-succeeds/environment.d/10-set-distro.bash Normal file
View File

@ -0,0 +1 @@
export DIB_RELEASE=xenial

1
diskimage_builder/elements/ubuntu/test-elements/xenial-build-succeeds/test-output-formats Normal file
View File

@ -0,0 +1 @@
tar,qcow2

33
tests/run_functests.sh
View File

@ -26,26 +26,35 @@ export LC_ALL=
# tests are not run by "tox -e func" in the gate.
#
DEFAULT_SKIP_TESTS=(
# we run version pinned test in gate (this just runs latest)
fedora/build-succeeds
## These are part of the "extras-nv" job
# These require "zypper" on the host which is not available on
# all platforms
opensuse-minimal/build-succeeds
opensuse-minimal/opensuse423-build-succeeds
# in non-voting
# non-voting; not used by infra currently
gentoo/build-succeeds
opensuse/build-succeeds
opensuse/opensuse423-build-succeeds
# good to have the test case around - but because of changes
# in testing does not work always.
debian-minimal/testing-build-succeeds
# No longer reasonable to test upstream (lacks a mirror in infra)
# note this is centos6
centos/build-succeeds
# Needs infra mirroring to be stable
# Needs infra mirroring to move to voting job
debian-minimal/stable-build-succeeds
debian-minimal/stable-vm
##
# These download base images which has shown to be very unreliable
# in the gate. Keep them in a -nv job until we can figure out
# better caching for the images
opensuse/build-succeeds
opensuse/opensuse423-build-succeeds
centos7/build-succeeds
debian/build-succeeds
fedora/build-succeeds
ubuntu/trusty-build-succeeds
ubuntu/xenial-build-succeeds
# No longer reasonable to test upstream (lacks a mirror in infra)
# Note this is centos6 and should probably be removed
centos/build-succeeds
# This job is a bit unreliable, even if we get mirroring
debian-minimal/testing-build-succeeds
)
# The default output formats (specified to disk-image-create's "-t"