We want to disable Horizon by default in jobs that don't actually use or
test Horizon. This will save job runtime because it means installing
fewer packages (which takes time) and happier OSC because fewer packages
impacting pkg_resources entrypoint handling.
Change-Id: Ib3fdab05bfa5f91678051db5643a976174f4797e
The Horizon integrated test suite is a lost cause, has
been non-voting for quite some time and is never going
to be fixed and maintained.
Change-Id: Ie7b538757a71ddd7aa9070ae93d3d05d5657bd17
So we can copy test artifacts to the current workspace dir, which name
otherwise needs to be passed into test hook. This is needed because
the job name (and consequently the workspace name) can change
independently from test hooks defined in horizon, and thus cannot be
hardcoded.
Needed-By: I63e45ee89711b429d0d878303aefeec4b159125a
Change-Id: I28d84235fb51a49492ed9c96794ba74f317f66b6
Partial-Bug: #1625253
This is part of the xenialification for >=newton. Have horizon dsvm jobs
and selenium job run on xenial. These all pass when reproduced on
openstack infra xenial instances.
Change-Id: Ib98855661f6b0748aa49754511b4886626da9930
A previous patch for Horizon infra scipts missed passing {testtype}
into post_test_hook, which is required to properly copy various
testing artifacts into the right directory (which now depends on
{testtype}).
Change-Id: I20232ef16ae60a7151e267b506af471ebfed2f7f
Partially-Implements: blueprint test-deprecated-features
Horizon now is interested in having two integration tests: 1) current
2) deprecated panels.
This patch changes the integration job into a job-template and configures
Horizon to use both the current/deprecated jobs. The job-template
passes the 'type' parameter into the pre-test hook so it can differentiate
and configure the test environment appropriately.
Change-Id: I1f2028c18d6d9933a986a9bc47750e1b5fdca708
Partially-Implements: blueprint test-deprecated-features
Use zuul-cloner and set up constraints. This is needed to allow
constraints with venv tox environment.
Change-Id: I445fa38bb1269aed0d82faceedc0a94355d81004
Holding off on openstack-dev/devstack, openstack-dev/grenade,
openstack-dev/pbr and openstack/requirements as their branches aren't
gone quite yet.
Change-Id: I12adc42629da0089b8520a6f06d3f59d9522fc02
This is related to zuulv25, we make sure console-log is the last
publisher to ensure zuul-launcher logs are also uploaded.
Change-Id: I1616b97fad2b97fb9e977ec14543aab4bc673b58
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Right now we have a problem, that our integration tests are failed
often due to build timeout. It happens because we have 60 tests
which require 30-90 sec per one. First of all we would like to
up build timeout to prevent flaky timeout failures. And then
we are planning to use selenium grid and parallel execution
to provide tests scalability.
Change-Id: I28b08cde1e8c8dff2cde0fa4c12d852373d946a9
In an effort to make the overall gate more robust and still
allow Horizon to update their xstatic packages, this patch
adds a repo containing the current horizon tempest scenario
tests in tempest plugin form. The patch also adds a non-voting
check job to allow testing of the plugin.
Without this change, it is possible to break the gate by
updating xstatic packages before Horizon can support the new
version. This sad truth is an offshoot of the difficultly of
supporting the many incompatibilities between versions of
javascript libraries.
Once the new job is verified and added to the horizon gate, the
current horizon scenario tests in openstack/tempest would be
removed.
Needed-By: Ib01a69ffb978708ad7b515d3aaa4b58bc894a167
Change-Id: I1608407a4f8246728c30870fd5e1886c632e7734
We don't use screenshots publisher after merge
patch I124973d9adbaaacf5d3429e6f6684f15de27dc7f.
Also I fixed mistake with double test_reports.
Change-Id: If1a25aaf8d01ac3a66e5546fee43c0ec85d09191
It's a good idea to publish test_reports dir with tree structure.
It will help us to make very flexible test reports without changing
job configuration.
For ex. right now I implemented a patch https://review.openstack.org/#/c/307880/,
that creates separated logs for each fallen test as test folder with browser log,
test log, browser screenshot, and page source. But due to current restrictions
itn's possible to map my reports to jenkins report.
That's why we need this patch.
Change-Id: I124973d9adbaaacf5d3429e6f6684f15de27dc7f
Needed-By: Ie5d972d2a560d4f59666c49dc3bf22fdb48071e8
It affects the behavior of integration tests in Horizon, so it should
reside at the directory where other integration tests scripts are
located.
Needed-By: Ibc549f9ae4eac17d8e92d65afe1c5cee9be6e72e
Change-Id: I1f5dc1220aee39103289a579583095346cce0354
This will allow Horizon team to manage packages in devstack
environment independently from infra. Since the absence of the file
being specified in this variable is handled gracefully by
devstack-gate script (see https://review.openstack.org/#/c/190321), we
can export it first and then add the file being sourced later.
Change-Id: I55dda882785e59f5816175a75b6cbb00d8105c1b
With change Iff5e96bd80b8f165ccc7d6be09b53208613571eb, we do not need
to pass DEVSTACK_GATE_TIMEOUT anymore to devstack-gate, instead the
value from the build-timeout wrapper is passed.
Remove DEVSTACK_GATE_TIMEOUT for jenkins/jobs/[e-m]*.yaml
Increase timeout for all non-grenade jobs by 5 mins since
Iea866e4cc40e149e598f35e010ec855937bdf9ae will use a 10 minute
buffer and the internal timeout should stay the same. The grenade
jobs already have 10 mins of buffer, so no need
adjust the timeout.
Change-Id: Ied54d602d0cd1b994129f979ec25290e54980426
Between the Icehouse and Juno releases, OpenStack changed its
supported Ubuntu LTS platform from Precise to Trusty. In support of
continuing testing stable/icehouse and prior branches on Precise
while starting to test newer branches on Trusty, a branch-based
decision tree was introduced into our Zuul configuration by way of
complex parameter functions with an ever growing list of regular
expression matches on job names.
Now that Icehouse is EOL (in fact, Juno is too) this simply adds
unnecessary complexity and an attractive nuisance for cargo-cult
copying into new job and job-template definitions which don't even
need it. In preparation to remove the associated parameter
functions, get rid of multiple labels in all jobs and set them to
whatever label Zuul would ultimately select.
This change touches a vast number, possibly a majority, of our jobs
and so manual jenkins-jobs updates on all Jenkins masters will be
needed after this merges, before it's safe to approve the
corresponding Zuul configuration cleanup.
Change-Id: Ic952ee02da2c77fe2ace81c4e2fa87531be6119c
With final excision of sahara-dashboard from Horizon (and moving it
into a separate plugin repo, again), Horizon integration tests no
longer need to install Sahara in devstack vm. Hopefully this will make
tests to pass faster.
Change-Id: Ia910003a783ab1fb08144d963a55dc2b0438bf74
Depends-On: I99718970af78feeafc25dbb3aa9639ea2cf401ad
Currently gate-horizon-dsvm-integration job marked UNSTABLE.
Previous patches tried to copy files using Jenkins,
which caused error. This patch copies the files to the workspace so
Jenkins can copy them.
Change-Id: I69fb3865889d89b8f4e397b23e5546b2a6e1095f
In order to copy screenshots after horizon integration tests, we need
to make adjustment to horizon job.
relevant patch in horizon: https://review.openstack.org/#/c/194646/14
Change-Id: I1ac1660ed265c3a77e2a1dfce02ebcbc818bede5
This job hands off management of the X virtual frame buffer to
Horizon. The interaction between the run-selenium.sh xvfb
management and Horizon's (necessary for dev reasons) was causing
the whole thing to not work.
Remove the gate-horizon-selenium job which wasn't running any
tests anyway, and add in a new job gate-horizon-selenium-headless.
The new job name is to ensure we aren't still running the old job
and to not be confused with the selenium job template.
Change-Id: I370880c17210c4a2d203913cdb49de1804ccf709
Co-Authored-By: Joshua Hesketh <josh@nitrotech.org>
Sahara support in devstack has been recently moved in Sahara
repository, as an external plugin. Enable it again, as integration
tests do rely on it.
Change-Id: I85d8f6c474d3217897bf4ef4f0954c142125e436
Django 1.4 is not supported when Liberty will release.
Only versions 1.7 and 1.8 will be supported. Horizon is
working on finalizing 1.8 support. But we don't need
the 1.4 job on master any longer.
Change-Id: I73e1f52465545888f70a6e398511c84f04bb7bf7
Sahara has been removed from global configuration, but it is needed
by some Horizon tests. As there is only one Horizon integration tests
on the gates for now, let's try to enable all tested services.
Change-Id: Ic927723d10bc45d3ec862c4f7d3152890114e39e
Currently, gate-horizon-dsvm-integration job usee Nova Network
instead of Neutron.
Since the integration tests are also planned to test Neutron's
networking features within Horizon it only makes sense that Neutron
will be deployed.
Partially implements blueprint: selenium-integration-testing
Closes-Bug: #1425882
Change-Id: Ib4c4841521ea442b7430b9d24f45743bac491c7d
Stop using run-unittests.sh. It creates confusion when people create
jobs. Instead standardize on run-tox.sh. This means rewriting all the
jobs that use run-unittests.sh to use run-tox.sh.
Note that this depends on the parent change to merge first and have all
our slave images rebuilt prior to merging this change.
Change-Id: Ib81403c25485b120f48080a59f1894dc2130c05f
The Horizon integration tests are based on Selenium and require Firefox
to run. Since the browser is not installed by default on the thin nodes
running devstack, add a new macro to do so.
Change-Id: Ie44c36663f8ad9909cf182f852767029b4523a76
Xvfb isn't installed by default on devstack nodes. Since it's a
requirement for the Horizon integration tests, create a new macro to
install it only for the jobs where it is needed.
Change-Id: I168fe5f1e6253ded89728ee2a69f8cf3197d2000
Trying to run Tox as is results in the following error on Jenkins runs:
py.error.EACCES: [Permission denied]: mkdir('/opt/stack/new/horizon/.tox',)
The tox command should explicitly be run with the stack user.
Change-Id: I1b322b7e5dde7fd89f14447e65b2cf5dfd4ef900
While job templates need double brackets, for a regular job definition
there should only be one. Also, remove statements that only apply to
job templates.
Change-Id: I31348a2b3d7d7a62844553a0ff7a5afa00aa1f49
Closes-Bug: #1379256
This repo was created from filter branching the openstack-infra/
config repo. This process brought a lot of cruft with it in the
form of directories that we no longer need. This patch removes
that cruft so we begin with a tidier repo.
Change-Id: Ibffad1b11c0c5f84eedfb0365369f60c4961a0f3