Commit Graph

46 Commits

Author SHA1 Message Date
Monty Taylor 355f7090a6 Remove zuul v2 and jjb content
It's migrated, it can be removed now.

Depends-On: I6a89752d74ed7424267c3af3937ad01fb4bb8f86
Change-Id: Id67d0149b645bd23e460cef65719541f76f0967b
2017-10-24 08:50:05 +02:00
Clark Boylan 52eb8ecd55 Explicitly enable Horizon in Horizon dsvm job
We want to disable Horizon by default in jobs that don't actually use or
test Horizon. This will save job runtime because it means installing
fewer packages (which takes time) and happier OSC because fewer packages
impacting pkg_resources entrypoint handling.

Change-Id: Ib3fdab05bfa5f91678051db5643a976174f4797e
2017-06-14 09:48:48 -07:00
Richard Jones ebb0ad9b3c Remove Horizon integrated test suite
The Horizon integrated test suite is a lost cause, has
been non-voting for quite some time and is never going
to be fixed and maintained.

Change-Id: Ie7b538757a71ddd7aa9070ae93d3d05d5657bd17
2016-12-14 12:27:46 +11:00
Rob Cresswell f0f5af859c Update Horizons selenium-headless test
Depends-On: I883f885bd424955d39ddcfde5ba396a88cfc041e
Change-Id: Ice036a2d5a61e1e7ed58a9185ffe50ed8f2a3125
2016-12-01 17:42:06 +00:00
Timur Sufiev ef97d2fd98 Do not 'cd' from current workspace dir in horizon test hooks
So we can copy test artifacts to the current workspace dir, which name
otherwise needs to be passed into test hook. This is needed because
the job name (and consequently the workspace name) can change
independently from test hooks defined in horizon, and thus cannot be
hardcoded.

Needed-By: I63e45ee89711b429d0d878303aefeec4b159125a
Change-Id: I28d84235fb51a49492ed9c96794ba74f317f66b6
Partial-Bug: #1625253
2016-09-20 09:35:47 +00:00
Clark Boylan d6958c2c87 Run horizon jobs on xenial
This is part of the xenialification for >=newton. Have horizon dsvm jobs
and selenium job run on xenial. These all pass when reproduced on
openstack infra xenial instances.

Change-Id: Ib98855661f6b0748aa49754511b4886626da9930
2016-09-16 20:17:11 +02:00
Timur Sufiev 9db0d54ce3 A follow-up on 'Splitting current/deprecated integ. test'
A previous patch for Horizon infra scipts missed passing {testtype}
into post_test_hook, which is required to properly copy various
testing artifacts into the right directory (which now depends on
{testtype}).

Change-Id: I20232ef16ae60a7151e267b506af471ebfed2f7f
Partially-Implements: blueprint test-deprecated-features
2016-08-10 11:46:52 +03:00
Jenkins 2b45c3a588 Merge "Splitting current/deprecated integ. test" 2016-08-09 18:34:27 +00:00
Matt Borland 84397fd254 Splitting current/deprecated integ. test
Horizon now is interested in having two integration tests: 1) current
2) deprecated panels.

This patch changes the integration job into a job-template and configures
Horizon to use both the current/deprecated jobs.  The job-template
passes the 'type' parameter into the pre-test hook so it can differentiate
and configure the test environment appropriately.

Change-Id: I1f2028c18d6d9933a986a9bc47750e1b5fdca708
Partially-Implements: blueprint test-deprecated-features
2016-08-05 07:41:11 -06:00
Andreas Jaeger be28f58824 Use zuul-cloner for gate-horizon-selenium-headless
Use zuul-cloner and set up constraints. This is needed to allow
constraints with venv tox environment.

Change-Id: I445fa38bb1269aed0d82faceedc0a94355d81004
2016-08-05 11:03:38 +02:00
Joshua Hesketh e0a3fe6150 Remove kilo jobs
Holding off on openstack-dev/devstack, openstack-dev/grenade,
openstack-dev/pbr and openstack/requirements as their branches aren't
gone quite yet.

Change-Id: I12adc42629da0089b8520a6f06d3f59d9522fc02
2016-06-24 19:56:15 +02:00
Paul Belanger 322d7e5dfb
Ensure console-log is our last publisher
This is related to zuulv25, we make sure console-log is the last
publisher to ensure zuul-launcher logs are also uploaded.

Change-Id: I1616b97fad2b97fb9e977ec14543aab4bc673b58
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-06-16 18:32:16 -05:00
Jenkins 7304d75a0c Merge "Increase horizon integration tests timeout" 2016-05-31 15:14:20 +00:00
David Lyle bcfb75ea34 Update horizon dsvm tempest job
The previous test config was mis-configured. This patch aims to
properly run the tests.

Change-Id: I20d352512ef008028c18b3f00a9ed79ec4b3edad
2016-05-20 15:28:49 -06:00
Sergei Chipiga 4821a28bda Increase horizon integration tests timeout
Right now we have a problem, that our integration tests are failed
often due to build timeout. It happens because we have 60 tests
which require 30-90 sec per one. First of all we would like to
up build timeout to prevent flaky timeout failures. And then
we are planning to use selenium grid and parallel execution
to provide tests scalability.

Change-Id: I28b08cde1e8c8dff2cde0fa4c12d852373d946a9
2016-05-16 14:06:58 +03:00
David Lyle 841accd5a7 Adding tempest-horizon repo and job
In an effort to make the overall gate more robust and still
allow Horizon to update their xstatic packages, this patch
adds a repo containing the current horizon tempest scenario
tests in tempest plugin form. The patch also adds a non-voting
check job to allow testing of the plugin.

Without this change, it is possible to break the gate by
updating xstatic packages before Horizon can support the new
version. This sad truth is an offshoot of the difficultly of
supporting the many incompatibilities between versions of
javascript libraries.

Once the new job is verified and added to the horizon gate, the
current horizon scenario tests in openstack/tempest would be
removed.

Needed-By: Ib01a69ffb978708ad7b515d3aaa4b58bc894a167
Change-Id: I1608407a4f8246728c30870fd5e1886c632e7734
2016-05-05 15:48:06 -06:00
Sergei Chipiga 6f53910ef9 Remove unused screenshots publisher
We don't use screenshots publisher after merge
patch I124973d9adbaaacf5d3429e6f6684f15de27dc7f.
Also I fixed mistake with double test_reports.

Change-Id: If1a25aaf8d01ac3a66e5546fee43c0ec85d09191
2016-04-26 11:56:43 +03:00
Sergei Chipiga 2932ac1663 Publish test_reports dir
It's a good idea to publish test_reports dir with tree structure.
It will help us to make very flexible test reports without changing
job configuration.
For ex. right now I implemented a patch https://review.openstack.org/#/c/307880/,
that creates separated logs for each fallen test as test folder with browser log,
test log, browser screenshot, and page source. But due to current restrictions
itn's possible to map my reports to jenkins report.
That's why we need this patch.

Change-Id: I124973d9adbaaacf5d3429e6f6684f15de27dc7f
Needed-By: Ie5d972d2a560d4f59666c49dc3bf22fdb48071e8
2016-04-21 09:06:09 +00:00
Jenkins b737c7b261 Merge "Switch rest of devstack-trusty to ubuntu-trusty" 2016-03-16 15:39:21 +00:00
Timur Sufiev 30bb814724 Fix the location of devstack_gate_rc script at horizon job
It affects the behavior of integration tests in Horizon, so it should
reside at the directory where other integration tests scripts are
located.

Needed-By: Ibc549f9ae4eac17d8e92d65afe1c5cee9be6e72e
Change-Id: I1f5dc1220aee39103289a579583095346cce0354
2016-03-16 10:04:21 +00:00
Clark Boylan ceda9719f4 Switch rest of devstack-trusty to ubuntu-trusty
Switch all remaining devstack-trusty jobs to ubuntu-trusty to complete
the migration.

Change-Id: I7f94b59f318cab581aa4f194f33acf8ab597fc36
2016-03-14 12:58:43 -07:00
Andreas Jaeger 269250a82e horizon: Use ubuntu-trusty
Convert jobs using bare-trusty to ubuntu-trusty.

Change-Id: Ia0f0f2d94f3a357be53709e9606e40997daf407a
2016-03-08 16:43:29 +01:00
Timur Sufiev ef156ba3fb Specify DEVSTACK_GATE_SETTINGS for Horizon i9n tests job
This will allow Horizon team to manage packages in devstack
environment independently from infra. Since the absence of the file
being specified in this variable is handled gracefully by
devstack-gate script (see https://review.openstack.org/#/c/190321), we
can export it first and then add the file being sourced later.

Change-Id: I55dda882785e59f5816175a75b6cbb00d8105c1b
2016-02-19 13:10:15 +03:00
Andreas Jaeger 7ea5e050b6 Remove DEVSTACK_GATE_TIMEOUT [part 3]
With change Iff5e96bd80b8f165ccc7d6be09b53208613571eb, we do not need
to pass DEVSTACK_GATE_TIMEOUT anymore to devstack-gate, instead the
value from the build-timeout wrapper is passed.

Remove DEVSTACK_GATE_TIMEOUT for jenkins/jobs/[e-m]*.yaml

Increase timeout for all non-grenade jobs by 5 mins since
Iea866e4cc40e149e598f35e010ec855937bdf9ae will use a 10 minute
buffer and the internal timeout should stay the same. The grenade
jobs already have 10 mins of buffer, so no need
adjust the timeout.

Change-Id: Ied54d602d0cd1b994129f979ec25290e54980426
2016-02-07 10:29:24 +01:00
Timur Sufiev 1165748766 Use scripts from horizon repo in integration job test hooks
Change-Id: If73cf6fc32ff567d0232982411c4fb436c0d2b55
Depends-On: Ic2d60df846e876530662046d75c3e56e7841ba30
2016-01-05 10:19:29 +00:00
Jenkins 618b511283 Merge "Don't install sahara in horizon integration tests" 2015-12-31 15:21:31 +00:00
Jeremy Stanley 0af9b2c178 Get rid of precise||trusty job node declarations
Between the Icehouse and Juno releases, OpenStack changed its
supported Ubuntu LTS platform from Precise to Trusty. In support of
continuing testing stable/icehouse and prior branches on Precise
while starting to test newer branches on Trusty, a branch-based
decision tree was introduced into our Zuul configuration by way of
complex parameter functions with an ever growing list of regular
expression matches on job names.

Now that Icehouse is EOL (in fact, Juno is too) this simply adds
unnecessary complexity and an attractive nuisance for cargo-cult
copying into new job and job-template definitions which don't even
need it. In preparation to remove the associated parameter
functions, get rid of multiple labels in all jobs and set them to
whatever label Zuul would ultimately select.

This change touches a vast number, possibly a majority, of our jobs
and so manual jenkins-jobs updates on all Jenkins masters will be
needed after this merges, before it's safe to approve the
corresponding Zuul configuration cleanup.

Change-Id: Ic952ee02da2c77fe2ace81c4e2fa87531be6119c
2015-12-21 20:52:17 +00:00
Timur Sufiev 4e2cfae80a Don't install sahara in horizon integration tests
With final excision of sahara-dashboard from Horizon (and moving it
into a separate plugin repo, again), Horizon integration tests no
longer need to install Sahara in devstack vm. Hopefully this will make
tests to pass faster.

Change-Id: Ia910003a783ab1fb08144d963a55dc2b0438bf74
Depends-On: I99718970af78feeafc25dbb3aa9639ea2cf401ad
2015-12-11 20:11:29 +03:00
Serhii Vasheka c9fb525e34 Last change made all job runs end with success.
We need to save exit status in order to mark failed jobs.

Change-Id: Ia7c91a5197fb7a989385fcbf91d274ee6b0940a3
2015-09-23 14:41:33 +03:00
Serhii Vasheka 27029a1ed3 Alter horizon.yaml to get screenshots copied.
Currently gate-horizon-dsvm-integration job marked UNSTABLE.

Previous patches tried to copy files using Jenkins,
which caused error. This patch copies the files to the workspace so 
Jenkins can copy them.

Change-Id: I69fb3865889d89b8f4e397b23e5546b2a6e1095f
2015-09-23 08:45:15 +00:00
Serhii Vasheka 3d116b9463 Change source target for horizon dsvm gate job
Change-Id: I664fb5b5c1f9847ef0a225a484c16379c57a325e
2015-09-16 14:14:30 +03:00
Serhii Vasheka 17e3a2b6b1 Change screenshots source destination for gate-horizon-dsvm-integration job
Change-Id: I0fd89ede7a3d04ce9b4bd4c8fba0789770048d40
2015-09-01 15:34:50 +03:00
Serhii Vasheka 4cf9db79f7 Add copy-screenshots publisher
In order to copy screenshots after horizon integration tests, we need
to make adjustment to horizon job.
relevant patch in horizon: https://review.openstack.org/#/c/194646/14
Change-Id: I1ac1660ed265c3a77e2a1dfce02ebcbc818bede5
2015-08-27 12:29:25 +03:00
Richard Jones 5a74b58e0d Set up new selenium job for Horizon
This job hands off management of the X virtual frame buffer to
Horizon. The interaction between the run-selenium.sh xvfb
management and Horizon's (necessary for dev reasons) was causing
the whole thing to not work.

Remove the gate-horizon-selenium job which wasn't running any
tests anyway, and add in a new job gate-horizon-selenium-headless.

The new job name is to ensure we aren't still running the old job
and to not be confused with the selenium job template.

Change-Id: I370880c17210c4a2d203913cdb49de1804ccf709
Co-Authored-By: Joshua Hesketh <josh@nitrotech.org>
2015-08-27 05:58:25 +00:00
Jenkins 06664e9c6f Merge "Enable Sahara (as plugin) for horizon integration tests" 2015-07-20 13:20:49 +00:00
Luigi Toscano d00961da25 Enable Sahara (as plugin) for horizon integration tests
Sahara support in devstack has been recently moved in Sahara
repository, as an external plugin. Enable it again, as integration
tests do rely on it.

Change-Id: I85d8f6c474d3217897bf4ef4f0954c142125e436
2015-07-16 19:48:01 +02:00
David Lyle 2c1c2373a4 Removing horizon django 1.4 job
Django 1.4 is not supported when Liberty will release.
Only versions 1.7 and 1.8 will be supported. Horizon is
working on finalizing 1.8 support. But we don't need
the 1.4 job on master any longer.

Change-Id: I73e1f52465545888f70a6e398511c84f04bb7bf7
2015-07-14 09:01:06 -06:00
Luigi Toscano 3ae18ba5ab Enable Sahara for Horizon integration tests
Sahara has been removed from global configuration, but it is needed
by some Horizon tests. As there is only one Horizon integration tests
on the gates for now, let's try to enable all tested services.

Change-Id: Ic927723d10bc45d3ec862c4f7d3152890114e39e
2015-06-17 14:44:56 +02:00
dkorn e3971fddad Use Neutron in Horizon integration tests job
Currently, gate-horizon-dsvm-integration job usee Nova Network
instead of Neutron.
Since the integration tests are also planned to test Neutron's
networking features within Horizon it only makes sense that Neutron
will be deployed.

Partially implements blueprint: selenium-integration-testing
Closes-Bug: #1425882

Change-Id: Ib4c4841521ea442b7430b9d24f45743bac491c7d
2015-02-26 12:19:16 +02:00
Radomir Dopieralski 9645f3fe96 Enable Selenium tests for stackforge/tuskar-ui-extras
As requested, move the selenium job to a template.

Change-Id: I95b870ddd305cb1e6da9138d7c92521abd4c7b97
2015-01-09 14:48:45 +01:00
Clark Boylan 5f549caaa8 Switch to using run-tox.sh everywhere.
Stop using run-unittests.sh. It creates confusion when people create
jobs. Instead standardize on run-tox.sh. This means rewriting all the
jobs that use run-unittests.sh to use run-tox.sh.

Note that this depends on the parent change to merge first and have all
our slave images rebuilt prior to merging this change.

Change-Id: Ib81403c25485b120f48080a59f1894dc2130c05f
2014-12-01 08:36:19 -08:00
Julie Pichon 6458e12e0e Add missing dependency to Horizon integration tests
The Horizon integration tests are based on Selenium and require Firefox
to run. Since the browser is not installed by default on the thin nodes
running devstack, add a new macro to do so.

Change-Id: Ie44c36663f8ad9909cf182f852767029b4523a76
2014-10-24 10:46:15 +01:00
Julie Pichon 23a10447b5 Horizon integration tests require Xvfb
Xvfb isn't installed by default on devstack nodes. Since it's a
requirement for the Horizon integration tests, create a new macro to
install it only for the jobs where it is needed.

Change-Id: I168fe5f1e6253ded89728ee2a69f8cf3197d2000
2014-10-14 15:59:22 +01:00
Julie Pichon 910e91d82d Fix Horizon integration job: permissions
Trying to run Tox as is results in the following error on Jenkins runs:

py.error.EACCES: [Permission denied]: mkdir('/opt/stack/new/horizon/.tox',)

The tox command should explicitly be run with the stack user.

Change-Id: I1b322b7e5dde7fd89f14447e65b2cf5dfd4ef900
2014-10-10 11:25:25 +01:00
Julie Pichon 7abf51b37d Fix Horizon integration job definition
While job templates need double brackets, for a regular job definition
there should only be one. Also, remove statements that only apply to
job templates.

Change-Id: I31348a2b3d7d7a62844553a0ff7a5afa00aa1f49
Closes-Bug: #1379256
2014-10-09 14:48:27 +01:00
Anita Kuno 1d21cd635f Reorganizes project-config
This repo was created from filter branching the openstack-infra/
config repo. This process brought a lot of cruft with it in the
form of directories that we no longer need. This patch removes
that cruft so we begin with a tidier repo.

Change-Id: Ibffad1b11c0c5f84eedfb0365369f60c4961a0f3
2014-09-25 11:41:04 -04:00