Commit Graph

50 Commits

Author SHA1 Message Date
Sagi Shnaidman 8c6db50589 Remove unnecessary code from toci_* scripts
Detect and remove unnecessary code from toci_* scripts
Simplify tripleo-upgrades roles installation with ZUUL_BRANCH

Change-Id: Ie230aa0640e41a33e10e6656b69e1db4a6819127
2018-06-25 14:56:07 +03:00
Emilien Macchi 3a8922988f Remove old undercloud-container bits
The bash code isn't used anymore, we now use TripleO Quickstart to test
a containerized undercloud.

Change-Id: I024631f9b31a651ace2ca3b3b5840749afbe2606
2018-03-05 22:20:47 +01:00
yatin 5bf07a20c2 Add bits to support stable/queens
Add missing bits to support stable/queens branch in TripleO;
Some adjustments might be done later but this is a first iteration.

Change-Id: I4a369389fbecf6890a75ffaaf695f391cd6b7e2d
Closes-Bug: #1750311
2018-02-20 19:55:12 +05:30
Sagi Shnaidman 0ec3a9c25d Use CENTOS_MIRROR from provided mirror_info.sh file
Don't construct CENTOS_MIRROR env var because we have it in the
file mirror_info.sh which is provided from nodepool.
Remove EPEL_MIRROR because it's not used anywhere.

Change-Id: I40fe8f6b2be1864b27bbe369e7da988fa7f1a0bb
2018-02-12 16:48:22 +02:00
Sagi Shnaidman 39409e3754 Send logs size to grahite site
Send logs size to track it in graphite server

Change-Id: Iaee3b4cdaed9f04fc7ff56f79c306856caf02c4e
2018-01-07 21:53:24 +00:00
Sagi Shnaidman 962205603d Set ubound to debug level and dump cache
Debug unbound DNS queries in job for investigation of
DNS failures.
Dump unbound DNS cache server cache..

Depends-On: Ia76ac9b20d6b8402060b71e11e00e515bc74077d
Related-Bug: #1730931

Change-Id: Ic8b9e33067141366655fad1b99dee1adb40dfba3
2017-11-20 14:11:16 +02:00
Juan Antonio Osorio Robles 50aa92c0b9 TLS everywhere: Only generate ssh key if it's not there
The TLS everywhere gate is broken since zuul now generates the ssh key,
so the generation command fails. This makes it optional.

Change-Id: I19cec9f8cf0e4f369e09747d6949a10fcb5aea26
2017-10-23 09:47:22 +03:00
Ben Nemec fd99e98bdc Support pike->master undercloud upgrades
The master undercloud-upgrade job was still setting the starting
branch to ocata, which results in us testing master patches with
pike repos.  This is causing a lot of bogus undercloud-upgrade
failures.

Change-Id: I6ccb832b52a476b5fa659a9a8f09e38ae41d324b
Closes-Bug: 1723447
2017-10-15 06:52:45 +00:00
Sagi Shnaidman 49a6109cbd Fix TripleO CI jobs
Fix TripleO CI jobs to be compatible with Zuul v3

Change-Id: Ibf6e7290528d072443bf7fa0ad22938e861538c6
2017-10-09 11:45:53 +03:00
Emilien Macchi 97f53309c6 Preparing TripleO CI to test upgrades to Queens
Update the code to test upgrades between stable/ocata and stable/pike,
and stable/pike to master (queens).

Change-Id: I61afed141d611b4b6b5ad40b3d48e9ea2346d1e2
2017-08-31 21:26:50 +00:00
Steve Baker dcb02ccca7 Don't use docker-network.yaml env
All this network config does is create br-ex, which is now done in
docker/services/neutron-ovs-agent.yaml regardless of what network
config is used.

Change-Id: Ieb91ac7d7a799e303c3050f340c89103f2aeab55
Related-Bug: #1691403
Depends-On: Ie425148b0ad0f38e149c5fa0a97d98ec35d0a5bb
2017-08-30 04:43:25 +00:00
Alex Schultz bcd6e1268f Revert "Installs openssh packages that try to workaround sshd start problem"
This reverts commit 6e8e27488d.

Change-Id: Ia2a3badaff703e607eca73d926dfb2b366aae7b5
2017-08-15 17:33:59 -06:00
Jenkins 6860a9967c Merge "Use prepare command to build container images env file" 2017-08-14 03:59:18 +00:00
Steve Baker bc60d9f933 Use prepare command to build container images env file
This change replaces the manually maintained
docker-centos-tripleoupstream.yaml with an equivalent file generated
by running "openstack overcloud container image prepare". Note that
the file containers-default-parameters.yaml is already generated with
this command thanks to I6a5796428c224584359b2a434d7fc80878d5f038.

Change-Id: Ie6dfd97526569753382e1f006abd8e9be7843dd1
Partial-Bug: #1696598
2017-08-06 20:53:50 +00:00
Steven Hardy 821d84f34c Replace references to deprecated controllerExtraConfig
This should be ControllerExtraConfig, since the current parameter name
has been deprecated for some time, and is inconsistent with all other
roles.

Since mitaka is now EOL this also removes references to the
worker-config-mitaka-and-below environment.

Change-Id: I0f07b3abbe290ed7f740a6f4915e16be39e3a4c6
2017-08-04 23:05:55 +00:00
Emilien Macchi 6cf056cc68 Add bits to support stable/pike
Add missing bits to support stable/pike branch in TripleO;
Some adjustments might be done later but this is a first iteration.

Change-Id: I408a6b116b611b67b67f98e1bf7bc533ce22435c
2017-08-03 06:23:37 -07:00
Jenkins 7ff9cd7f12 Merge "Conditional nodepool logic" 2017-07-25 11:03:21 +00:00
James Slagle 7c5acb6fdb Conditional nodepool logic
Make the logic around reading the generated nodepool files conditional
based on the presence of /etc/nodepool/provider. When using these
scripts outside of nodepool, these files are likely not present, so this
code should handle that case gracefully.

For tripleo.sh --setup-nodepool-files, remove the generation of
/etc/nodepool/provider so that the conditional is not unintentionally
triggered.

Change-Id: I13d78d371b3157a151a7ef861cfa7a293a39f2a2
2017-07-05 14:53:52 -04:00
Dan Prince d7d20c1820 Add a new docker centos Heat environment
We are unsetting the t-h-t default params for containers in
Ice7b57c25248634240a6dd6e14e6d411e7806326. As part of that
we need to specify a new environment file explicitly
for tripleo-ci to continue using tripleoupstream containers.

Co-Authored-By: Ian Main <imain@redhat.com>

Change-Id: I4438d50f105000cbe38e017f1657d3ec6244c378
Depends-On: I125137ba45f608cf84ea0a7146edd744a549d23b
2017-06-30 14:54:41 -04:00
Juan Antonio Osorio Robles d006a7a7f5 Reenable telemetry for fakeha-caserver job
Depends-On: I15e67c7c04142cff01704e2590d3b2a6a949cc06
Change-Id: I64517a8ab809f31bbeffa633c07855f827d10b1d
2017-06-27 14:54:38 +03:00
Juan Antonio Osorio Robles 2aff47d36d Disable telemetry from fakeha-caserver job
I've been unable to figure out what's the issue, so I'm disabling
this temporarily to get the job passing and the rest of the services
tested. This will be re-enabled later.

Change-Id: Id244f05cd9ba5f1dbecdd0ea7477ee713a3c5d25
2017-06-20 15:08:25 +00:00
Ben Nemec 37b84a6307 Fix ceph configuration in nonha job too
I didn't fix this previously because I didn't think we were still
running it.  Turns out we are in some cases, so we might as well
make it work.

Change-Id: I24bd4405672731430c637e3b45ee77643828cb7f
2017-06-05 20:14:54 +00:00
Jenkins ffebca7922 Merge "Disable telemetry on non-OOQ OVB HA & nonHA jobs" 2017-06-05 13:53:58 +00:00
Sagi Shnaidman 4b01de93c7 Disable telemetry on non-OOQ OVB HA & nonHA jobs
When periodic jobs still use old non-OOOQ code, we need to disable
there telemetry as we did for updates job and OOOQ based ones.
Closed-Bug: #1695760

Change-Id: I9fa9daf582b39236021cdf52b356b19ccaf6f552
2017-06-04 20:51:41 +00:00
Ben Nemec 4a881bcd16 Allow 1 ceph osd for updates job
Change Ie9bdd9b16bcb9f11107ece614b010e87d3ae98a9 disallowed a
single osd by default, but for some reason the ci job did not
catch the fact that this breaks our updates job configuration (I
suspect ceph didn't get restarted after the config change was
applied).

This change just adds an environment that will allow a single osd
again, which should unblock the updates job.

Change-Id: I2da488400898e3cef6a7cc819abb8df27aad5d67
Closes-Bug: 1694847
2017-06-02 19:44:23 +00:00
Emilien Macchi 5ee54ae448 Uninstall certifi/requests/urllib3 pip installation
requests-2.16.5 has added urllib3 package as dependency. Requests is
being installed using pip as dependency for git-review in DIB.

This parch removes urllib in node preparation for puppet jobs as it
will be installed as requirement for requests rpm package.

This patch should be a workaround until git-review is removed from
nodepool images.
See comments on https://review.openstack.org/#/c/468823.

Change-Id: Ia839cac125e2a749fc9ce40894e5900237ec3ae1
2017-05-29 17:28:30 +02:00
Emilien Macchi 1dafd0dcb7 Disable Telemetry on ovb-updates jobs
Disabling Telemetry on ovb-updates jobs to save memory, on Ocata and
Pike CIs.

Keep coverage for Newton since we didn't have scenario001 in place yet.

Change-Id: I5b0320ce369b86ce8fb70da6ecb3f39596f43b95
Related-Bug: #1693174
Depends-On: Idefe9f0de47c5b0f29b7326642d697ed179e2eb8
2017-05-29 11:25:13 +02:00
Sagi Shnaidman 7548af6a7c Fix CI python-urllib3 install failure
Fix CI failure of python urllib3 installation

Change-Id: Ibee99c44d950c8cf5b15e0e02e7a23727433bb46
2017-05-29 02:54:03 +03:00
Steven Hardy 36f86a2c98 Do newton compatible bootstrap for multinode upgrades
Prior to https://review.openstack.org/#/c/464667/ we were mixing
versions/releases for environment files.  Now we're not CI is
broken because deployed-server-bootstrap-environment-centos.yaml
doesn't exist on stable/newton t-h-t, so this reverts to using
the older bootstrap approach on that branch.

Change-Id: I3551456664daf89d01f98bde85d7fb22a01d4a03
Closes-Bug: #1691758
2017-05-18 17:25:57 +01:00
Steven Hardy 87722b14c7 Ensure consistent path for multinode upgrade job
Some changes in t-h-t recently mean we've got to support multinode
scenario environments that reference j2 rendered files, but this
only works when the environment is contained within the --templates
tree.  So we copy the environment under test to the "new" tree
during an upgrade test, and ensure all paths reference the new
location.

Change-Id: I0288c2b470606d990281f6c37071b632a2d0d423
Closes-Bug: #1687908
2017-05-17 11:46:58 +00:00
James Slagle e9d3995097 Add support for $DO_BOOTSTRAP_SUBNODES
Add a new environment variable $DO_BOOTSTRAP_SUBNODES that can be used
to control whether or not the subnodes are bootstrapped. It defaults to
1, and can be set to 0 to stop the bootstrap from running. This can save
a lot of time when iteratively running locally and the subnodes have
already been bootstrapped.

Change-Id: I4b21d6d30ab9d7babd3810ab558ec43378ad808e
2017-05-15 09:46:12 -04:00
James Slagle bb430f3011 Support running toci_gate_test-oooq.sh locally
These are various improvements to tripleo-ci (squashed into a single
commit to save CI resources) that enable running the tripleo-ci entry
point script which is now toci_gate_test-oooq.sh locally in a standalone
environment of vm's not spawned by nodepool.

This is useful to developers trying to reproduce CI locally for
development and testing.

The changes are:
- Default $REMAINING_TIME in common_vars.bash
- Don't hardcode the jenkins user everywhere
- Improved initial package handling:
    Before blindly yum installing the packages needed by these scripts in a
    few spots, check if the packages are already installed with just the rpm
    command. This can end up saving a decent amount of time when iterating
    on running these scripts locally. Also installs wget.
- Reinstall python-requests
    When locally running toci_gate_test.sh, python-requests needs to be
    reinstalled since toci_gate_test.sh removes the python module as it
    was pip installed on the infra provided image. Also updates the
    logic to handle the python-requests -> python2-requests transition.

Change-Id: I48cd1e5f53b86455992b83248d57f5338c29a7ca
2017-05-10 21:38:45 +00:00
Jenkins 7050f811a6 Merge "Deploy FreeIPA-backed LDAP domain for keystone in fakeha-caserver job" 2017-05-10 08:19:17 +00:00
Juan Antonio Osorio Robles 4c50a9f2da Deploy FreeIPA-backed LDAP domain for keystone in fakeha-caserver job
This deploys an extra domain whose LDAP server is the FreeIPA node.

Co-Authored-By: Rob Crittenden <rcritten@redhat.com>
Change-Id: I9d64bda89c5551335ea85c3170d1e74c9b7fed6c
2017-05-08 17:59:51 +03:00
Carlos Camacho bb997040e1 Fix path for the multinode job when running the major upgrade.
This submission fixes the environment path when running the
major upgrade.

We have two multinodes jobs, one running a major upgrade and
other not doing it.

Currently we make no distinction building the MULTINODE_ENV_PATH
depending if an upgrade will run.

This submission moves the conditional already used for the upgrades
scenarios to build the MULTINODE_ENV_PATH also for the multinode upgrades
job.

The current deployment builds the paths like:
-e /usr/share/openstack-tripleo-heat-templates/ci/environments/multinode.yaml
--templates /opt/stack/new/ocata//usr/share/openstack-tripleo-heat-templates

And after applying it:
-e /opt/stack/new/ocata/usr/share/openstack-tripleo-heat-templates/ci/environments/multinode.yaml
--templates /opt/stack/new/ocata//usr/share/openstack-tripleo-heat-templates

Closes-Bug:1687908
Change-Id: If88f403c85b79bd896a24c7816486709bd67706f
2017-05-05 15:45:07 -04:00
Sagi Shnaidman d04632d71b Fix repos for promotion jobs
Fix stable branch jobs to use consistent repos instead of current
in promotion job.
Fix master jobs not to use current-tripleo repo in promotion.

Change-Id: I72c448a5257afa0aa2a7d166e52cd11d0e03582c
2017-04-28 09:04:34 -04:00
Ben Nemec f7e5df8661 Update fakeha net-iso configuration
We added the storage-mgmt network to the ipv4 ci net-iso templates
to support hyperconverged ceph, but this means that all jobs using
the ipv4 templates need to be using the custom
network-isolation-absolute.yaml as well.  This one was missed in
the original patch.

Change-Id: I7f78d43ea60f3d8e9ea5819aadf94fc28695b638
2017-04-20 17:12:15 +00:00
Jenkins c7b8618603 Merge "Update OVB containers job to use infra docker proxy" 2017-04-19 17:22:09 +00:00
Jenkins 11cb5663a9 Merge "Use custom network-isolation-absolute.yaml in ipv4 net-iso jobs" 2017-04-19 16:46:26 +00:00
Dan Prince f7dcf181da Update OVB containers job to use infra docker proxy
This patch configures the undercloud.conf for the OVB containers
job to make use of an in-rack HTTP docker registry proxy.

Change-Id: I88db874e1f5790b5ae1b153b8e6b1475d90d6ace
Depends-On: I09761ac70454e7f3fe35d0ffe32b1edb0ca217f3
2017-04-18 12:18:02 -04:00
Dan Prince 46f333b059 Drop extra UNDERCLOUD_SSL=0 from undercloud block
This is getting set twice. Lets remove the first instance so
that the second one setting it to UNDERCLOUD_SSL=1 is more clear.

Change-Id: I12a0bc1fe738b70471bb4cf458f764a32b40dc98
2017-04-17 10:04:33 -04:00
Juan Antonio Osorio Robles 2af4c1271c Remove installation of moreutils and replace ts
epel is no longer available.

Change-Id: If6affd68edafec683db0be2f5695455e907ad311
Closes-Bug: 1682488
2017-04-13 22:01:52 +00:00
Jenkins b221ac3264 Merge "Use shorter timeout for update step" 2017-03-31 02:24:02 +00:00
Ben Nemec c0acf09f0d Use custom network-isolation-absolute.yaml in ipv4 net-iso jobs
The follow-up patch adds the storage-mgmt network to the compute
node, so we can no longer use the shipped network-isolation.yaml.
This change makes use of the generated network-isolation env with
absolute paths pointing at /usr/share/openstack-tripleo-heat-templates

Change-Id: I46b3c0a0fa2653a7e74929130bec29d900edaf6d
2017-03-30 16:57:41 -05:00
Jenkins 9d731fec81 Merge "Fix typo in cloud number" 2017-03-30 18:23:42 +00:00
Ben Nemec 3cb26f1c2f Use shorter timeout for update step
The update step should take less time than the create step, and if
we use the full create timeout then we will run past the gate
timeout and get killed with no logs.  Based on the current graphite
metrics, all successful jobs are finishing update in under 45
minutes so that should be safe value.

Change-Id: I0e9761c81b95fdf85c4f57daedb630a6e0cb9db2
Closes-Bug: 1674770
2017-03-28 13:59:52 +00:00
Sagi Shnaidman 08f8d766d5 Fix typo in cloud number
If we are on rh1 cloud, let's source rh1.env file.

Change-Id: Ife88b4d0b920dae6e2830748c91dbccfd55a17eb
2017-03-27 23:08:11 +03:00
Sagi Shnaidman 5a58c9a231 Stop deployment before jobs end
Stop deployment if it exceeds maximum timeout so that logs
could be collected.

Change-Id: Ia4e1ef2a10987b06406b343353066ea9d76f8e28
Related-Bug: #1649742
2017-03-27 20:58:48 +03:00
Emilien Macchi f8ee060fdb Switch trunk/cbs/buildlogs to use https
There is a permanent redirection from http to https in buildlogs, cbs
and trunk repos that might create issues when the redirection fails for
some reasons.
Let's use https directly.

Change-Id: If36d006d76cc712c582cde2265f41f4243b12622
2017-03-23 15:38:45 +00:00
Gabriele Cerami ab7914d28d Quickstart transition: replace toci_gate_test.sh
This change modifies the way CI jobs are handled.
Current toci_gate_test.sh is renamed to toci_gate_test-orig.sh, and its
content will not be changed. toci_gate_test-oooq.sh is added, with
toci_gate_test.sh modified to be a link to it.
This new script will drive jobs to be launched using quickstart, it will
work initially as additional layer with backwards compatibility to old
script that will run jobs with tripleo.sh.
The old set of playbooks specific to toci is copied (not moved) from the
experimental scripts, and the toci-quickstart dir, containing
configurations for quickstart specific to tripleo ci is added.
Script toci_quickstart.sh will be the new single runner for every job
which configuration is assembled through toci_gate_test-oooq.sh script
To transition a job to quickstart, the only thing needed is to change
the job name to contain "featureset" keyword.
Make sure that the correspondent featureset file and nodes configuration
exist.

Change-Id: Ieb181db13e63e046bffc2c65120c2c24177488c5
2017-03-13 21:00:17 +01:00