Commit Graph

37 Commits

Author SHA1 Message Date
Monty Taylor 355f7090a6 Remove zuul v2 and jjb content
It's migrated, it can be removed now.

Depends-On: I6a89752d74ed7424267c3af3937ad01fb4bb8f86
Change-Id: Id67d0149b645bd23e460cef65719541f76f0967b
2017-10-24 08:50:05 +02:00
Ian Y. Choi 6b5291a30f Disable Newton translations
Disable all Newton translation sync jobs
including openstack-manuals

Change-Id: I9c69f46de81cab371337dffdf416ebc48c19a801
2017-08-15 06:43:27 +00:00
Ian Y. Choi bb1c6273de Setup translations for Pike
- Add templates for Pike translation
- Set up horizon and plugin projects who currently have
  stable/pike branch listed in https://translate.openstack.org/

Change-Id: I224ffceb49fad380ab894dc2d8b476b8edf76aab
2017-08-11 16:46:49 +00:00
Andreas Jaeger 5b402bf01c Push translated pages to docs-draft
Use docs-draft to publish result from check/gate translation jobs for
manual projects.

Change-Id: I98d8586fa918ac60cd2fea37da303e1728881b56
2017-08-01 19:12:05 +02:00
Andreas Jaeger ac536d8a15 Remove useless '' for nodes
There's no need to quote these entries, remove the '' for consistency
with majority of usage.

Change-Id: I68d23ecd9cf3399a2a5a450ff86e56986851afea
2017-05-01 10:23:41 +02:00
Andreas Jaeger 298dc9b764 Retire mitaka translation sync
openstack-manuals is the only repo that has mitaka translations set up
but the project is since some time read-only in zanata. Thus, remove the
now unneeded job and remove all unused templates.

Change-Id: I513ce52fa3bd31e4a7cf53fc412cc5addcf98a65
2017-04-12 08:57:08 +02:00
Ian Y. Choi f2afa45e72 Setup translations for Ocata
- Add templates for Ocata translation
- Set up horizon and plugin projects who currently have
  stable/ocata branch listed in https://translate.openstack.org/

Change-Id: I1384dc9a6feb891799b72af527e44b22d9dbd376
2017-02-05 20:25:20 +00:00
Andreas Jaeger d50a7d452f Revert "Fix translation proposal jobs"
Zuul-cloner / zuul-merger have been fixed and can be used again.

This reverts commit 759da2b1cf.

Change-Id: I99bf00b046951ed6ea544572c52138f671e78be0
Depends-On: If22d8cfbe591afe4f5516da1eb3b0be98b2de874
2017-01-28 18:10:59 +00:00
Andreas Jaeger 759da2b1cf Fix translation proposal jobs
This is a partial revert of I7787daf025f4f14cf665db0366fa81f54adfa884.
We cannot use zuul-cloner in the periodic job right now since
zuul-cloner will reach out to a zuul-merger (thanks to a passed
environment variable) and that zuul-merger might not have the latest.
This is only hitting us in periodic jobs.

This leads to changes that have directly merge conflicts since they are
based on older jobs.

Use normal git commands for checking out - those go to git.openstack.org
instead to a zuul-merger.

Once zuul-cloner/zuul-merger is fixed, this change can get reverted
again.

Change-Id: I2dfac4c36ace4942840bf05048272fab0a0512ba
2016-10-21 08:24:10 +02:00
Andreas Jaeger 680dc103bc Rework translation job git setup
Since we have zuul-cloner on the proposal node now, we can use it there.

So, remove the constraints-git-prep and
zuul-git-branch-prep-upper-constraints and replace it with the normal
zuul-cloner builders that set up constraints.

The two builders have been used only for translation jobs, we can remove
them completely now.

Change-Id: I7787daf025f4f14cf665db0366fa81f54adfa884
2016-09-16 21:29:17 +02:00
Andreas Jaeger 1fa3007116 Setup translations for Newton
Add templates for Newton translation, set up horizon for it as first
project.

Change-Id: I4b1357aec3ba7090bcbf8d5102cbe9fd3f606a26
2016-09-16 11:34:39 +02:00
Andreas Jaeger 2013557150 Collect more logs for translation jobs
The translation jobs use tox, let's collect their logs to better
understand errors.

Change-Id: Ib8d915c2cf68dfaf5d8fc33027332739985cebca
2016-08-29 20:39:51 +02:00
Jenkins acbe4e3e08 Merge "Use constraints for translation sync" 2016-08-09 08:34:58 +00:00
Andreas Jaeger 33cf3abe48 Use constraints for translation sync
The translation jobs run on the proposal node that does not have
zuul-cloner installed. To allow useage of constraints in venv
environment, setup constraints with manual checkout of requirements
repository.

Change-Id: I080990ecc2c7ea725eae930d8597fb7937bf1f1d
2016-08-08 21:03:24 +02:00
Andreas Jaeger 1204b51199 Move doc team jobs to Xenial
Run all jobs on xenial for the documentation team jobs, for most cases
these are only run on master anyhow - and those few repos with branches
do not need trusty for running.

Change-Id: I337888e74bae983439cbf0f5e047f4f4023bc8ec
2016-07-29 14:56:10 +02:00
Andreas Jaeger aecc6b1d92 Remove liberty translation sync
Translations for liberty are done, remove them from the only project
that still had it - openstack-manuals.

Change-Id: Ieedbd00a06616cf7105567ab93ce505a445bc9d9
2016-07-20 08:22:30 +02:00
Paul Belanger 322d7e5dfb
Ensure console-log is our last publisher
This is related to zuulv25, we make sure console-log is the last
publisher to ensure zuul-launcher logs are also uploaded.

Change-Id: I1616b97fad2b97fb9e977ec14543aab4bc673b58
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-06-16 18:32:16 -05:00
James E. Blair 20576bded0 Clean up proposal slave in a builder
So we can avoid using the jenkins-specific postbuildscript plugin,
move the proposal slave cleanup to a builder.  Run it first so that
it always runs.  Since we're running it first, we can't use it to
clean up our current workspace, so instead, ask it to clean up all
workspaces.

Change-Id: I54a187d643fb76f10cc11411d546c41348b5592e
2016-06-09 09:44:13 -07:00
Andreas Jaeger 24ef9bb2a2 Get translation jobs into healthcheck
Add subunit testr output at end of run of the translation scripts, so
that healthcheck will have information about success/failure of the job.

This is implemented as an exit trap since we abort on every error and
need to provide the failure message.

Also, upload the healthcheck data to logs.openstack.org so that
healthcheck can import it.

This should be a temporary solution until healthcheck can get data from
Zuul about failure/success of job runs using database access.

Change-Id: I74bba9659a9767027e2daa649ec6f38bf822b65a
2016-06-03 17:29:24 +02:00
Andreas Jaeger 5988eab4ac Fix publishing location for translations
We want to publish to
tarballs.openstack.org/translation-source/PROJECT/VERSION . Correctly
construct path for it.

Change-Id: I9802f50cae5dd461f76d8ba016a5f404fe74f4f3
2016-05-05 22:48:16 +02:00
Andreas Jaeger 4a36d40fc3 Translations: Publish pot files to tarballs.o.o
Publish all pot files to
tarballs.openstack.org/translation-source/{name}/VERSION

This way we have always the most recent pot files available for
reviewers and can remove them from the git repositories in a followup.

Change-Id: I3c5e145115206b773466a74d63fad84da17f25e5
2016-04-22 21:19:46 +02:00
Andreas Jaeger a8317f4356 Setup translations for stable/mitaka
Setup translations for all projects that are part of the translation
plan of the i18n team (see https://translate.openstack.org/) and which
will have stable/mitaka branches.

Note that manual projects are not ready for stable/mitaka, so those are
not included.

Change-Id: Ieedd94bc7b5214b2b036971c62406ca52f282082
2016-03-16 20:20:11 +01:00
Andreas Jaeger ec994ecd23 Rename tox-nodb-ENV to tox-ENV
Use again tox-ENV as standard tox job instead of tox-nodb-ENV.
The old tox-ENV job was bare-trusty based and can get removed now.

Change-Id: I837e02dc74c5860235b1a58e9a304fdaec281c2e
2016-03-11 11:46:43 +01:00
Andreas Jaeger 2a3bb92501 Use ubuntu-trusty for checklang
Use tox-nodb macro which uses ubuntu-trusty for checklang.

Change-Id: I7bfdef17463af75a332dbc0f3b33914bb5484290
2016-03-06 09:36:23 +01:00
Andreas Jaeger 4331f670b4 Print the JJB template name in some more jobs
Print JJB template name in more job templates so that it's easy to
identify them.

Change-Id: Ia92e39d0ac8c7655577e8fa4accde5748f30d5f1
2015-11-26 20:09:53 +01:00
Clark Boylan 65fed86ca7 Translate stable/liberty on DOA and Nova
Translation team has said these are the priority projects for liberty
translations to start with them when adding version support. Horizon
will be in a follow up patch as they haven't made a liberty branch yet.

Change-Id: I8049b7ad0a9524c0bfaff6090cf484dccc505836
2015-09-24 12:41:14 -07:00
Clark Boylan 624832c5fa Make translation pushes to gerrit branch aware
To support multiple translation versions in Zanata we need to make the
reverse push into Gerrit branch aware as well. Do this by setting up the
existing propose translation jobs to accept a branch parameter which
tells them which version to pull from Zanata and where to push into
Gerrit.

This will add a new periodic jenkins job for each release/branch.

Change-Id: Ia206bfaa7dd6eaad6aa1f6e5ddbbbf9cdadf8db0
2015-09-23 10:35:01 -07:00
Andreas Jaeger 4dc0ca560e Merge translation proposal scripts
Merge
jenkins/scripts/propose_translation_update_django_openstack_auth.sh,
jenkins/scripts/propose_translation_update_horizon.sh, and
jenkins/scripts/propose_translation_update_manuals.sh into
jenkins/scripts/propose_translation_update.sh.

Update Jenkins and Zuul files, we can use now the same job
in all cases.

Change-Id: Idb9e8534dfc0454d75fe186e1a4a454832c8fdae
2015-09-22 20:07:52 +02:00
Andreas Jaeger 1c6307887d Merge upstream_translation scripts
Merge upstream_translation_update_manuals.sh,
upstream_translation_horizon.sh, and
upstream_translation_django_openstack_auth.sh into
upstream_translation_update.sh.

Adjust job definition for these projects so that the new scripts
get used.

Adjust layout.yaml for change, remove now obsolete condition.

Change-Id: I54d560398daa67af8effeb794fce11e53affa1a6
2015-09-21 20:56:59 +02:00
Clark Boylan bf7485c846 Remove special Zanata suffix from jobs
Now that we are switched to zanata we don't need two sets of job names
to keep the transifex vs zanata split straight in JJB and Zuul. Just
condense down to translation-jobs.

Change-Id: Ic512b2f58a1c9a084f4e25fdf4761fd0c4e6ff0a
2015-09-21 09:59:19 -07:00
Steve Kowalik ad48d9ab5a Remove non-Zanata propose jobs
Now that we have switched all projects to pulling translations from
Zanata, as a first step, destroy all the jobs and their related job
groups that are no longer used.

Change-Id: I616dba7a8e81dfefeaa246ec5a80c1fdb47a2208
2015-09-16 15:50:52 +10:00
Jenkins 57f9400395 Merge "Fix typo in job template name propose-translation-update-zanta" 2015-09-09 06:03:33 +00:00
Matt Riedemann c4f59a96a9 Fix typo in job template name propose-translation-update-zanta
s/zanta/zanata/

Change-Id: I3d8e878a29430db4bd456842993bab6ca95169f2
2015-09-08 11:05:33 -07:00
Steve Kowalik f54eb1ed69 Redo function that pulls translations from Zanata
The existing function pull_from_zanata would only work for the simple
Python project case of pulling translations from Zanata -- with only
locales directory and trivial rules to apply, with no real hope of
working for Horizon or OpenStack Manuals, given the current
functionality of the Zanata CLI utility.

Rewrite it to download every translation from Zanata and perform some
checks by hand if we keep the file or remove it. This also required
refactoring a large portion of cleanup_po_files so both functions could
leverage the same code.  OpenStack Manuals treats downloaded
translations sufficiently different that a similar function was required.

This also adds full support for Horizon and OpenStack Manuals projects,
including jobs, as well as new job templates to make it easier to
transition projects to pulling from Zanata. Adding -zanata jobs for the
Python projects and django_openstack_auth is not required, they are
already present.

Change-Id: I5b9f2eca7f099c56057fc5d09b4bbfe5ea5c596d
2015-09-08 17:10:45 +00:00
Steve Kowalik 3ca25f7204 Add support for pulling translations from Zanata
To help move to Zanata, we should pull down translations from
the server. Add a function that should behave the same way as
the existing Transifex function, as well as changing two existing
scripts to call it based on a command-line parameter. Add two new
jobs with a -zanata suffix so we can switch projects one at a time.

This change deals with all of the Python projects and
django_openstack_auth. Horizon and OpenStack manuals will be dealt with
in a future patch.

Change-Id: I8003ac37aeb89d59ceeba2e75eed2f8100b82367
2015-08-06 18:12:50 +10:00
Andreas Jaeger 8f1e1dd5bc Cleanup proposal slave workspaces once a day after builds
To avoid cruft in the long living proposal node which leads to a full
disk, regularly cleanup some parts.

Create a new macro to build up the repository workspace and have
it cleanup at most once a day.

Use the macro in all translation jobs.

Change-Id: I0f78bb21c4f15ae3974150eb83e5144a469a0554
2015-06-25 14:34:47 +02:00
Anita Kuno 1d21cd635f Reorganizes project-config
This repo was created from filter branching the openstack-infra/
config repo. This process brought a lot of cruft with it in the
form of directories that we no longer need. This patch removes
that cruft so we begin with a tidier repo.

Change-Id: Ibffad1b11c0c5f84eedfb0365369f60c4961a0f3
2014-09-25 11:41:04 -04:00