Commit Graph

123 Commits

Author SHA1 Message Date
Monty Taylor 355f7090a6 Remove zuul v2 and jjb content
It's migrated, it can be removed now.

Depends-On: I6a89752d74ed7424267c3af3937ad01fb4bb8f86
Change-Id: Id67d0149b645bd23e460cef65719541f76f0967b
2017-10-24 08:50:05 +02:00
Ian Wienand 2df98eeca1 Revert "Pin pip to <8 for openstackci-beaker jobs"
This reverts commit bf25cc9e7b.

The pin of pip/setuptools to such a low version is now causing the
gate jobs to fail to install packages, since it doesn't understand new
environment markers we use.  This probably opens Pandora's box of
issues that we never quite fixed?

Change-Id: Ie3f967d27b03a9594d54e8dd413f61daa65a73f3
2017-10-12 11:29:39 +11:00
Monty Taylor b4fd783219
Remove unmatched single quotes from jenkins jobs
The v3 migration script can handle these just fine - but if we go ahead
and remove them the output can be predominantely shell rather than
script.

Change-Id: I440851a0149e1cc7f8c5c6e8a4e3e0b94088ee82
2017-09-20 09:27:26 -05:00
Ian Wienand e8264a600f Remove/migrate Fedora 25 jobs
Fedora 26 is working with devstack jobs and (with bindep 2.5.0) tox
testing.  We wish to stop Fedora 25 builds to reduce the daily upload
requirements (but also, we try to keep this on the most recent as
quickly as possible).

The bindep fallback tests are removed and the other jobs migrated to
fedora-26 nodes.

Nodes are reduced to 0 in nodepool for build removal

Change-Id: I7bf569c5d7196516c93f8a2b7306596a74eaa0c7
2017-08-23 11:20:02 +10:00
Paul Belanger 983d110ba8 Remove opensuse-422 from jobs
Like we do for fedora, we only want to keep the latest opensuse image
in the gate. After talking with dirk, he is happy enough with
opensuse-423 that we can remove opensuse-422.

Jobs that were depending on opensuse-422 have been upgraded to
opensuse-423.

Change-Id: I921e0507694d4d39e61c4c822fc3235d7e97a128
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-08-09 11:37:04 -04:00
Ian Wienand 37e857c445 Initial Fedora 26 testing
Add a -nv bindep fallback job for Fedora 26

Move the devstack exeperimental f25 test to f26.

Change-Id: Icdccb240850532c4488ccf18f50be4308ff5f000
2017-08-02 14:04:58 +10:00
Dirk Mueller 570d9b724b Add experimental jobs for openSUSE 42.3 testing (bindep, devstack, dib)
In order to transition away from openSUSE 42.2 we'd like to have
experimental jobs to work / test against and fix the remaining
portability issues, if any.

Change-Id: If0500212618b4fa8fd8132261f82cedee74a6b30
2017-07-15 12:14:22 +02:00
Colleen Murphy df817be470 Co-gate spec helper gem with puppet-openstackci
In order to properly test changes in the spec helper gem that may affect
the puppet modules that depend on it, make sure the gem is checked out
from zuul as part of the puppet-openstackci beaker job. This job is run
for all infra modules so it is a reasonable job to co-gate with the
helper gem.

Change-Id: I66279da5f3cadb8a693c18379a2bdcf08edb2f15
Needed-by: I1b9ca7f38920a2c901ae16f6302af9b3a1ab36b6
2017-07-02 07:23:00 +00:00
Paul Belanger 08b5836314
Update periodic-package-stackviz-element job
Use the new package build by gulp, this includes everything we now
need to properly pip install.

Change-Id: Ia9cc6533655c9476b2040ded0914b1fbedeb06aa
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-05-31 13:11:43 -04:00
Paul Belanger eb1c5f1d57
Make bindep-fallback job for opensuse-422 voting
Now that our images have all been updated, we can make this job
voting.

Change-Id: I97cdf050d636cdd24b034edd664bf4bb88b14d64
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-05-26 17:23:36 -04:00
Paul Belanger bbcbabf534
Add opensuse-422 non-voting job for bindep
Now that opensuse DIBs are online, add bindep coverage.

Change-Id: Ia5be0c2e2fc73516b5cb95b10dfc72052d184bda
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-05-24 18:50:49 -04:00
Paul Belanger 3af437c708
Add empty .npmignore file for periodic-package-stackviz-element
We actually want to publish the build folder in our tarball, this
allows jobs to use the final compiled output.

Change-Id: Ia39b9a03619ce8d8cc40fb852f99fb32e3c9a27c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-04-16 19:15:58 -04:00
Paul Belanger 584e613492
Add missing npm run build for stackviz periodic job
Now that tarballs are uploading properly, also include the build
folder. This is the last step before moving this job to the periodic
pipeline.

Change-Id: Ieed33195678d3ffaf30582a47aa5d27b9fee203f
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-04-16 13:05:01 -04:00
Paul Belanger b634523c63
Create periodic-package-stackviz-element job
This is an update to our existing experimental job. Naming based on
existing afs build job we have for centos-7 dibs.

Change-Id: Ic1e0607e87a9b9ccf9abdad77012bc29f758b9bd
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-04-16 10:33:33 -04:00
Jenkins 58bf568c73 Merge "Remove branch-git-prep" 2017-04-07 19:43:42 +00:00
Paul Belanger 04638105ae Remove ubuntu-precise jobs
Ubuntu Precise has served use well! However, it is now EOL. We only
used it for infra jobs so this will not affect any openstack projects.

Change-Id: I20d751bd6528d5c9a9d80f3418f93a1c30e83c68
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-04-07 13:41:07 -04:00
Andreas Jaeger bb75639300 Remove branch-git-prep
Remove branch-git-prep, we can use zuul-cloner everywhere.

Rework zuul-git-branch-prep to follow the logic of
zuul-git-branch-prep-upper-constraints. Note that zuul-git-branch-prep was not
used prior to this patch.

Change occurences of branch-git-prep to zuul-git-branch-prep.

Change-Id: Id938a858a0ff1967b97293405ef41b9b281f407f
2017-04-07 07:45:11 +02:00
Andreas Jaeger acf7572d10 s/gerrit-git-prep/zuul-git-prep/g
We do not need gerrit-git-prep anymore, zuul-git-prep works on all our
slaves and has the advantage of using zuul-cloner so that the local
cache is used and Depends-On works.

Remove gerrit-git-prep and use zuul-git-prep instead everywhere.

Change-Id: I2f106af58f78fceaf3c497fe43e6f5a002695645
2017-04-03 19:36:51 +02:00
Paul Belanger 2469a6595e Fix experimental gate-zuul-nodepool job
We incorrectly assumed zuul-cloner was creating a sub-directory of the
project. It actually clones into the working directory, as a result we
can use the bindep macro from JJB.

Change-Id: I383a2e91c9ee168111a5e63bf61744e55fbcf35c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-02-04 09:53:33 -05:00
Paul Belanger f3d0cb38d0 Run bindep on zuul integration job
We currently don't run install-distro-packages.sh for our experimental
integration job for zuul. As a result, things added to bindep.txt are
not installed.

Change-Id: I19df83a5cabf8bd2c90a1dd54c8ff0e246b6c60b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-02-03 15:05:39 -05:00
James E. Blair 72ee112fcb Fix log path in gate-zuul-nodepool
We can't escape the workspace root.

Change-Id: I6699131212b5f94a8a1bf9362138c524bc8cba96
2017-01-25 13:42:44 -08:00
James E. Blair 1a258f41d5 Clone zuul into workspace in gate-zuul-nodepool
In order to use the run-tox macro, we need zuul to be in the
job workspace.

Change-Id: I59881626625b36d5f93a38277e8aa07cf2e27800
2017-01-24 16:37:10 -08:00
James E. Blair e6c7bc63ed Update gate-zuul-nodepool
This runs the integration tests using the tox macro.  It renames
the test script to a setup script since we no longer expect it to
actually run the tests.

It also collects and publishes the nodepool logs.

Change-Id: I12143ac0841e5fc646448eae4171594579fa0086
2017-01-24 13:44:48 -08:00
Jenkins 45d26f75d1 Merge "Replace fedora-24 jobs with fedora-25" 2017-01-19 08:18:21 +00:00
James E. Blair f4040774ce Add Zuul/Nodepool integration test job
This is an experimental job to test interaction between Nodepool
and Zuulv3.

Change-Id: I59ed8ba44b214c04fb410cbd3ad4648e6cb24425
2017-01-18 13:15:48 -08:00
Paul Belanger 6db5cd3c4f Replace fedora-24 jobs with fedora-25
The majority of these fedora jobs are non-voting. There is no issue
moving the ansible roles and windmill to fedora-25, as I can clean up
issues as they are found.

Change-Id: Ifc2a000858808438b394a1959d7e89700fb41f00
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-01-14 11:49:30 -05:00
Paul Belanger b5fc544b21 Add fedora-25 to bindep / puppet apply jobs
Now that we have launched a fedora-25 node, we need to start gating on
it. Add fedora-25 to bindep and puppet apply to ensure things work as
expected for infra services.

Change-Id: I8142c3b4e5517f197b6fb47c8cc98f3759516a02
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-01-13 14:10:32 -05:00
Ian Wienand 0f6413ed08 Fedora 23 omnibus removal
Remove Fedora 23

 - scalpels appears to be abandonded, remove the experimental job

 - barbican-dogtag job is non-voting and unstable.  Switch it to F24
   (as an intermin, F25 should be online soon).  Fedora is our
   super-unstable cow-catcher job, I will try to get in contact and
   see if we can switch this to CentOS.  This was added with
   I77fa548e4bc96682808d3721bc5528e091871b6a

 - move infra jobs to f24

Change-Id: I6993bb070f9bccb5ccc2c1c065d3da8b7996f1bd
2016-12-16 09:52:16 +01:00
Emilien Macchi 870b6c2ef5 Implement Experimental Infra jobs for Puppet 4 testing
This is a first iteration of creating Puppet 4 jobs in experimental
pipeline for all openstack-infra/puppet-* and
openstack-infra/system-config projects.

The jobs will test syntax and puppet-apply.
Note, the logic to deploy puppet4 on puppet-apply jobs needs to be done.

Change-Id: I576a1e42a4bca78815418a385972fe805a660879
2016-12-14 08:42:39 -05:00
Andreas Jaeger 4a61bc67f5 Change job-suffix to suffix
We have now some rather long job-template names, shorten them with
replacing job-suffix with suffix.

Before this change we had 1500 usages of job-suffix and 700 of just
suffix. This change therefore unifies to one setting.

Note that this does not change any job names at all, they are unchanged,
it changes and shortens only the names of job-templates.

Change-Id: I514df039a848d9f6619bca3adc05dfb84a761fc9
2016-12-08 22:05:01 +01:00
Khai Do d679cf6e01 rename 'tox' macro to 'run-tox'
JJB already has a tox module[1].  Defining a macro with the same name is
confusing and may cause problems when attempting to use this macro
elsewhere. Renaming it to something else should clear things up.

This is the warning from JJB:

$ jenkins-jobs test -o out ../project-config/jenkins/jobs
WARNING:jenkins_jobs.registry:You have a macro ('tox') defined for
'builder' component type that is masking an inbuilt definition

[1] http://docs.openstack.org/infra/jenkins-job-builder/builders.html#builders.tox

Change-Id: I6946229f6e94a5f4c10d6a5fc3b7049adeacacb1
2016-11-15 11:54:16 +01:00
Paul Belanger b108893570 Switch experimental pep8 job to job-template
This gives other projects to ability to add their own experimental job
to test the upcoming pep8 changes.

Change-Id: Ie73fb8f05aeb8947f513b9b58ded00b520caee5e
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-11-08 11:15:53 -05:00
Paul Belanger ff90f78e07 Add experimental-zuul-pep8-ubuntu-xenial job
In an effort to make our bindep dependencies better, we want to
experiment having the pep8 jobs not use our wheel mirrors.  This
ensures that projects are able to be build properly if our wheel
mirror is down or a new python dependency is released by has not been
build by our wheel-build job.

This is patch will be reverted once we confirmed the job works as
expected.

Change-Id: I03be650963e8f0e5630ad658882b0ce6692c4b45
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-10-30 17:13:04 -04:00
James E. Blair 4bf14ffdf5 Stop running compare-xml jobs
This removes the compare-xml jobs from both the project-config
and the jenkins-job-builder projects.  The JJB configuration in
project-config is beginning to include custom JJB components
which are supported only in Zuul v2.5.

For the project-config directory, we install a custom JJB module
to support these extensions and run JJB to validate that we have
a good configuration.

It would be possible to do the same for changes to JJB, but
considering that we are beginning to use custom components while
pinning to a released version of JJB (rather than master), it
seems like the project-config corpus of jobs may be less relevant
now, so perhaps now is a good time to stop.

Change-Id: I7c96b866663ce497b566a20f55c4c715b13c3723
2016-09-27 14:49:13 -07:00
Paul Belanger 09defed4ad
Run bindep for gate-infra-puppet-apply-{node}
This give the ability to install missing OS packages that are needed
to run puppet apply.

Change-Id: I3958cf64080beedcdb5cb7a5b9851e58b52676c6
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-09-16 17:55:16 -04:00
K Jonathan Harker 6976d995d0 Fix puppet-apply and logstash-filter jobs
The cd at the end of the shared builder doesn't affect the following
builder steps. Instead the cd command should occur just before running
the test scripts.

Change-Id: I7ec116e717ee0816cd458d1cdf57cc09509a7531
2016-09-12 17:26:42 -07:00
K Jonathan Harker 01abc0d454 Add integration tests between system-config and logstash-filters
Since this test is very similar to the apply test, refactor some of the
apply test out into reusable steps and consume them in the new job
template.

Change-Id: Iec615e03a7c644b13fa8425e38a70ad12c473879
2016-09-12 14:50:42 -07:00
Paul Belanger 8d693d99dd
Add net-info to openstack-infra jobs
The net-info include extra details about the node that is running,
specifically is the age of our DIB image being launched.  At this info
to openstack-infra jobs so we don't have to look for it in outside
projects.

Change-Id: Ifc0d09f57bb9a10b0d4bb7f18febbc10678f9d60
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-08-07 17:08:47 -04:00
Paul Belanger 1d7399fea4
gate-project-config-layout should use ubuntu-trusty
This was incorrectly upgraded to ubuntu-xenial. We still need to run
this on ubuntu-trusty since zuul.o.o is running on ubuntu-trusty.

Change-Id: I3776d8e89b8394a6c862973d29b6efcd4c08a28c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-07-29 11:57:41 -04:00
Paul Belanger 6f7839ae38
Migrate infra jobs to ubuntu-xenial
This is part of our effort to replace ubuntu-trusty with
ubuntu-xenial.

Change-Id: I1ee7d507dca9879921af825c79d7224ea8859639
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-07-28 11:15:51 -04:00
Paul Belanger 862707dd78
Move gate-project-config-layout to ubuntu-trusty
Now that zuul.o.o is running trusty we should test the layout on
trusty.

Change-Id: Ifa1f8294c5a3fc8088129c4e6bc5d23ccbbdf284
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-07-28 11:12:45 -04:00
Paul Belanger a18de5392a
Add test-results publisher to infra projects
We're currently trying to debug some job failures and need access to
the .tox/*/logs files.  To fix this, we now add test-results publisher
to all tox based infra jobs.

Change-Id: Id2ab952a7b1d34e659916bc38b41be48dd4e34f5
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-07-27 10:39:14 -04:00
Tony Breeds 3afb7a4d20 Remove the check tox env from irc-meetings
Initially we added 'check' as a second venv to run during the ical job.
The motivation here was to avoid using a second node to keep the impact low.

This was problematic as while the check was fine, some of the tools assume
that 'envlist' was in fact a single venv.

Also recently we started running pep8 as a second job with an additional
node.

With that in mind remove the check tox env from the job definition and
in irc-meetings we'll treat pep8 as a more generic linter environment

Change-Id: I7ddfa03606aa750308e2e8c6b9c77e9f226bead1
2016-07-26 13:23:22 -05:00
Joshua Hesketh 7a0b9e406d Update eavesdrop site name
More accurately these publishers are interested in pushing yaml2ical
information and specifically publish to /srv/yaml2ical on eavesdrop.o.o
rather than the wwwroot.

Change-Id: Ic87de4f3c39e19769144095eb809ee7561c117a5
Depends-On: I6262bb839449402c65c7f48a07d8776c1b44a295
2016-07-01 23:03:53 +10:00
Andreas Jaeger e66ce9d5cd Merge gerrit jobs for project-config
Both gate-project-config-projects-yaml and gate-project-config-gerrit
test files in gerrit directory, both check ACLs a swell. Let's merge
those into one job since in most cases both need to be run anyway and
the name projects-yaml might be confused with
jenkins/jobs/projects.yaml.

Note that this one leaves the projects tox environment in so that
testing of this change passes.

Change-Id: I34324643c26d0bcf2d24ce1dc51250ad53f2d48f
2016-06-22 08:18:06 +02:00
Spencer Krum ae7cb06b34 More typos in infra_spec_helper job definition
I shouldn't be allowed near a keyboard.

Change-Id: I8b9e320721da26eda59ced1eea0fe1560926c2a0
2016-06-21 14:45:50 -07:00
Spencer Krum d558864ff4 Infra spec helper is in openstack-infra
Fixes a small error from cargo culting

Change-Id: I7a3529823fa39bd155c5905aa977c20b256b280d
2016-06-21 11:26:09 -07:00
Spencer Krum 70208f19e4 Add infra puppet gem dependency holder repo
This repo (actually a ruby gem) serves as one place to list puppet gem
dependencies. This avoids us having to make 60+ one line changes when we
need to bump or pin a gem.

No repo to import.

Change-Id: I2eaa81a06d061d4ef65a8b717961de446dce9c8a
Needed-By: I2dc35841b13b886753314a31adf0254590279451
2016-06-20 16:39:12 -07:00
Paul Belanger 322d7e5dfb
Ensure console-log is our last publisher
This is related to zuulv25, we make sure console-log is the last
publisher to ensure zuul-launcher logs are also uploaded.

Change-Id: I1616b97fad2b97fb9e977ec14543aab4bc673b58
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-06-16 18:32:16 -05:00
Paul Belanger 4b2fbeb1b1
Convert gate-project-config-layout to ubuntu-precise
We've successfully tested ubuntu-precise in the experimental queue,
lets update gate-project-config-layout to use it.

Change-Id: Ia0e7a6da07cde89f89f6ccca39312e73693c01a1
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-05-06 12:29:39 -04:00