requests-2.16.5 has added urllib3 package as dependency. Requests is
being installed using pip as dependency for git-review in DIB.
This parch removes urllib in node preparation for puppet jobs as it
will be installed as requirement for requests rpm package.
This patch should be a workaround until git-review is removed from
nodepool images.
See comments on https://review.openstack.org/#/c/468823.
Change-Id: Ia839cac125e2a749fc9ce40894e5900237ec3ae1
We shouldn't be using packages from any of these, and they can cause
package conflicts with the delorean repos we do want to use.
For some reason centos-release-* also matches the base centos-release
package, so we need to explicitly match only packages where the
following characters are a-z.
Change-Id: I928a0efc9d75e584889967e262155e576452632d
Closes-Bug: 1685814
rh1 cloud anyway doesn't accept uplaoding from other cloud nodes,
so removing this redundant part.
Change-Id: I85ebcbd5a67883a34b1b56e5f0fe267371b39e2a
Adding the dummy interface for the br-ctlplane bridge is only needed for
the mitaka branch where the net_config_override feature is not present.
Adding the guard and also a check if the interface has already been
previously added in case running locally.
Change-Id: I88e40470c1490745a4b69870c94f0a5f31dd89cb
We should stop the dstat process that was previously started in
toci_gate_test.sh, so that processes aren't left running from tripleo-ci
jobs.
Change-Id: I200fe5f99d371fdde3b20518ffd10197680d46dd
Add a new environment variable $DO_BOOTSTRAP_SUBNODES that can be used
to control whether or not the subnodes are bootstrapped. It defaults to
1, and can be set to 0 to stop the bootstrap from running. This can save
a lot of time when iteratively running locally and the subnodes have
already been bootstrapped.
Change-Id: I4b21d6d30ab9d7babd3810ab558ec43378ad808e
These are various improvements to tripleo-ci (squashed into a single
commit to save CI resources) that enable running the tripleo-ci entry
point script which is now toci_gate_test-oooq.sh locally in a standalone
environment of vm's not spawned by nodepool.
This is useful to developers trying to reproduce CI locally for
development and testing.
The changes are:
- Default $REMAINING_TIME in common_vars.bash
- Don't hardcode the jenkins user everywhere
- Improved initial package handling:
Before blindly yum installing the packages needed by these scripts in a
few spots, check if the packages are already installed with just the rpm
command. This can end up saving a decent amount of time when iterating
on running these scripts locally. Also installs wget.
- Reinstall python-requests
When locally running toci_gate_test.sh, python-requests needs to be
reinstalled since toci_gate_test.sh removes the python module as it
was pip installed on the infra provided image. Also updates the
logic to handle the python-requests -> python2-requests transition.
Change-Id: I48cd1e5f53b86455992b83248d57f5338c29a7ca
Currently, tripleo-ci scrips clean up repos removing rdo-release
rpm, but https://review.openstack.org/#/c/453325 moved base image to
use centos openstack release rpm instead of rdo-release.
This patch removes all centos-release-openstack packages in addition
to rdo-release. Note that yum returns 0 even if no matching packages
are found so this should be ok.
Change-Id: I825038eeb134590fe9bb68697a193e5c6626f991
Closes-Bug: #1685418
When running CI scripts locally it fails because REMAINING_TIME is
propagated by infra before the job starts. This patch sets it to
some default value if it wasn't set before.
Change-Id: I0050046db17e50ddd17a7115e46c4684afa87b2f
Stop deployment if it exceeds maximum timeout so that logs
could be collected.
Change-Id: Ia4e1ef2a10987b06406b343353066ea9d76f8e28
Related-Bug: #1649742
OpenStack Infra provides images with rdo-release and puppet packages,
which is something we don't want in TripleO CI because we already have
our own packages from local mirror, depending of the version of
OpenStack that we want to test.
This patch makes consistent the cleanup on both OVB & multinode jobs to
remove puppet & rdo-release packages.
Closes-Bug: #1670015
Change-Id: I5f6b6be6f07dfd7d27189547db9daf1594db8c85
Right now, most metrics are recorded the same regardless of branch,
and some ignore the job type as well. Since many of the metrics
can vary significantly depending on those details (mitaka jobs take
far less time than master, for example), let's separate out the
metrics more.
This change adds a .release.jobtype specifier to most of the
metrics. The notable exception is the testenv wait time because
that is not release-specific. Also, the image metrics do not
actually need to be split based on job type since they don't vary,
but for consistency with the other overcloud metrics I did anyway.
With this change we do not lose the ability to look at broader
aggregate numbers either. We can still combine these newly
separated metrics back together in the Graphite UI.
Change-Id: I1df58f3a0c44708728e6ea1d705a6e8bf49ef330
Implement the major upgrade from Newton to Ocata based on multinode.
Currently we will start with the very basic use case, just few services
in the controller.
Co-Authored-By: Steven Hardy <shardy@redhat.com>
Co-Authored-By: James Slagle <jslagle@redhat.com>
Depends-On: I45991b60a151abf3c5e4d05a3aa7246b2d25ac5a
Change-Id: Id2e0d7bbb76734e84dac6a192c213ea246ec6e6a
The interface referenced should be --multinode-setup, and although
this appears to work, it's confusing when you grep for the actual
command and don't find it so would be good to fix
Change-Id: I2d709d8fa2d7aa0057b34b4dc38318091f68a4e4
Now that instack-undercloud has branched for newton, we should be testing
upgrades from mitaka to newton for patches proposed against the newton branch
of instack-undercloud.
For patches proposed against the master branch, we should be testing upgrades
from newton to master.
Closes-Bug: #1624448
Change-Id: I73f172a9427c3ac4cdd85c31b64db90be09cb76a
When we do tempreverts now, we need to ensure we signal to delorean
that it needs to rebuild the affected package.
Change-Id: I3e36398091357fadc6ff0f4e1eef5d673d3041f1
When we deploy with SSL we do so via haproxy. So just as we do for
the undercloud services IP, we need to add that one to the no_proxy
list.
Change-Id: If158033663878e621c8683c7754b87c227550c75
The metrics from a failed job are likely bogus anyway and just
create noise in the Graphite data. Let's only store the runtimes
from successful jobs.
Because we do some funny business in the trap, we need to first
store the previous exit value and pass it along to postci.
Otherwise by the time we get to postci the exit value we care
about is long gone.
Change-Id: I55db493ce5a1cdc38185d1f805adf4e89e5cbb9c
Not all cloud providers (osic and ovh in particular) spawn instances
with an eth0 and eth1, so don't assume an eth1 exists when finding it's
ip address to add to $no_proxy.
This recently started failing when we merged:
I2b84b3dfae60bbe7d6a76259b1d718b7dda08739
which added set -o pipefail to toci_instack_osinfra.sh and passed CI
when it ran on a different provider (rax).
Change-Id: I601a5e09eafbc1f03d7913ca6ffc060e3d774a44
Closes-Bug: #1609357
Currently we always build from source, but the latest master is now
available via delorean-current since o-p-m was broken into per-module
packages.
This should reduce the time taken to install everything from source,
and also provide a better path wnen upgrading as a simple
openstack undercloud install or yum update will update to the latest
puppet modules (currently failures happen if you forget to run via
tripleo.sh because the puppet modules aren't upgraded but things
that depend on the puppet modules are).
Also disable usage of the overcloud image cache as I have no idea what
will happen if we mix an image with puppet modules deployed from source
with ci scripts trying to install packaged modules.
Change-Id: Ie4cae6b884b2e539545371b9f716903b8fe5cf1f
Closes-Bug: #1597438
The boostrap-overcloud-full.sh script is broken out into its own
function in tripleo.sh as it is often useful to run just the networking
part of the multinode setup separate from the subnode bootstrapping.
The script also creates a lot of output, and has to be run for each
subnode. This change redirects all that output to a logfile so it is
not as verbose in the jenkins console. Since a pipe is used to redirect
to a logfile, toci_instack_osinfra.sh now also enables the pipefail
option.
Change-Id: I2b84b3dfae60bbe7d6a76259b1d718b7dda08739
This got coppied from toci_instack.sh, which ran on the undercloud
which was a seperate node to the ci slave, that is no longer the case
stop starting dstat twice on the ci slave.
Change-Id: I6e8ff2c3ea5e0b3b39f9a1023942ec0ab39e3099
Temporarily remove epel-release, and don't enable epel via tripleo.sh.
Also remove nodejs and nodejs-devel. This is a quick fix for:
https://bugs.launchpad.net/tripleo/+bug/1606685
We have a CI dependency on EPEL too with moreutils, so that needs
to be installed before we remove epel. Since everything is running
on the Jenkins slave that should be okay for now.
The proper fix will be to remove epel more completely going forward:
https://review.openstack.org/347499https://review.openstack.org/347513
Co-Authored-By: Ben Nemec <bnemec@redhat.com>
Change-Id: I91eff35586547dd278e8a32668f06efb840fc8c6
Partial-Bug: #1606685
The previous ssh command was not creating deploy.env properly due to
misquoting, causing all DIB* related variables to not be set during the
bootstrap-overcloud-full.sh script. Just use scp instead.
Change-Id: I1951704a7184b7662d7a60c7ae4c8fa8eac0b3f6
Closes-Bug: #1605596
Rename toci_instack_multinode.sh to toci_instack_osinfra.sh and
edit the script to run multi-node actions only on nodes that contains
something in /etc/nodepool/sub_nodes.
Change-Id: I096b815f244360484a9df0f6f30f6af77a306159
Sagi Shnaidman