Commit Graph

339 Commits

Author SHA1 Message Date
Ronelle Landy 65d2358303 Remove vexxhost DNS servers setup
With the change to OVN, the vexxhost servers
are no longer correct. Replacing with outside
nameservers.

Change-Id: I9fef5ee3cdda2f1714411867dc10b2cb946bc439
2023-08-23 18:30:33 -04:00
Zuul 1ffa53d9e3 Merge "Add update_containers: false for mixed rhel component jobs" 2023-01-18 16:03:00 +00:00
Marios Andreou 596e5350dd Add update_containers: false for mixed rhel component jobs
In the mixed rhel component job the rhel8 container update
prep fails due to yum update with the rhel9 undercloud repos
causing related-bug.

This disables yum update for rhel8 content in this job

Related-Bug: https://bugzilla.redhat.com/show_bug.cgi?id=2154179

Change-Id: I3a9ac11e7a3c3e5d3e32ec47b06dfca76e31a727
2023-01-16 13:53:48 +00:00
Amol Kahat 25042c4cba
Remove trunk.registry from tripleo-ci repo
trunk.registry.rdoproject.org going to decomission
soon. This patch remove trunk.registry from
tripleo-ci repo.

This patch also removes Dockerfile_rhui.j2 template,
which is used internally. No need to keep it in the
upstream.

Signed-off-by: Amol Kahat <amolkahat@gmail.com>
Change-Id: I11bc7cc37af6271fac7c651c8598a741cf0af783
2023-01-10 12:44:54 +05:30
Marios Andreou 818212fdbd Adjust collection for container-image-prepare-compute
The compute container image prepare output file is added in [1] and
named tripleo-container-image-prepare-compute.log

[1] https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/867967

Change-Id: I1261d36d9a82bb4f9c6caf7c310ef5b406d86ba3
2022-12-16 10:38:18 +00:00
Zuul 2066a2baa2 Merge "Remove pingtest from tripleo" 2022-11-21 22:27:16 +00:00
Marios Andreou 91d4f8eb7e Remove workspace from artcl_exclude_list to keep hash_info.sh
We kept the match to collect hash_info at [1] but we added
the entire directory to the exclude list in [2]. This
should let us collect hash_info.sh needed for debug (currently
for mixed OS jobs).

[1] 56e6bc85ad/toci-quickstart/config/collect-logs.yml (L43)
[2] 8f527522f7

Change-Id: I587f3c96d54321aa8dc7d46e10e9b4a016b7be33
2022-11-09 13:21:24 +02:00
Jiri Podivin b714381cff Removing outdated link and comment
The linked script was removed in 0977f8502d
some time ago, as part of a general refactoring effort.

Signed-off-by: Jiri Podivin <jpodivin@redhat.com>
Change-Id: I655fdc3d28debe07f529a26df24cdcefb88dfdc8
2022-11-01 08:39:24 +01:00
Chandan Kumar (raukadah) bbd65abc43 Add tripleo-external-compute-deployment-pipeline job template
In order to test compute deployment via tripleo-ansible
standalone tripleo-ansible roles.

It adds the following job to test that:
- Bootstrap first node and deploy standalone
- Generate 99 standalone vars and copy it to second node
- Bootstrap second node and install packages
- Copy 99 standalone vars to tripleo-inventory
- Deploy compute serices.

Regarding this job:
- parents from container multinode base
- Set bridge_address_offset to 4 to get different
  br-ex ips for controller and compute otherwise
  ssh connectivity gets lost.

The logs related to this job can found:
- tripleo_standalone_vars in /home/zuul/99-standalone-vars
- deployment logs in /home/zuul/deploy_compute.log.

All the patches can be found under this topic:
https://review.opendev.org/q/topic:standalone-roles-testing

Depends-On: https://review.opendev.org/c/openstack/tripleo-ansible/+/840509/
Depends-On: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/862160
Depends-On: https://review.opendev.org/c/openstack/tripleo-quickstart/+/861748

Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
Change-Id: Ie3adc3cd8d2216aa4284b5cde19dfc04b0605225
2022-10-22 06:30:29 +05:30
Arx Cruz 4db10e39a4 Remove pingtest from tripleo
Ping test is no longer being used in the last 5 years and was replaced
by tempest. However there are still pieces of code being executed, and
replacing some files, for example the testrepository.subunit file that
tempest generate and it is being used by the ci logging scrapper to
collect data about tempest.

Change-Id: Ia2b18f88652f144d5b593c5d209a9acf2d0374c8
2022-10-05 11:51:33 +02:00
Zuul 1c068d0978 Merge "Collect config files of login messages" 2022-10-04 10:15:51 +00:00
Ronelle Landy b4858ba2ab Switching to local nameservers on vexxhost
vexxhost defaults were pointing to OpenDNS only.
This patch adds the local nameservers so they
are used as forwarders in IPA jobs.

Change-Id: I1a9ea3b356a96e7608830f32097d24f5658d87c8
Related-Bug: #1990086
2022-09-20 11:13:51 +00:00
Yamato Tanaka f7105279ae Collect config files of login messages
Collecting the following files in order to check whether tripleo changes
these files properly.

  - /etc/issue
  - /etc/issue.net
  - /etc/motd

Change-Id: Iabc457a36d78af27021c5c07903ae8816ccd6eef
2022-09-08 10:22:38 +09:00
Sandeep Yadav 343f868941 Override Nameserver for vexxhost cloud
We are hitting slow dns resolution for the jobs running in vexxhoxt
cloud because 127.0.0.1 is first entry in resolv.conf but the image
we use don't have unbound service installed. Unbound service is
present in Upstream images, details in related bug.

With this patch, overriding Nameserver values used in Vexxhost cloud.

Related-Bug: #1983718
Change-Id: Ie95ed0e6b67afc28d124b2cf91fe67b57f18e654
2022-08-26 13:32:05 +05:30
Zuul 78a0506b67 Merge "Collect config files of auditd" 2022-08-08 13:36:45 +00:00
Takashi Kajinami 5a52587417 Collect config files of auditd
Change-Id: I150243dbcaccc8a61685b40683538eb78ac8ba01
2022-08-08 07:13:52 +00:00
Chandan Kumar (raukadah) 4e348fd9eb Add cloud config for IBM cloud
It contains config for standalone, multinode and OVB jobs.

Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
Change-Id: Ia3461036a0672d201d0ed5c9932475c5d42a8761
2022-07-25 15:08:21 +05:30
Cédric Jeanneret 5ce9abbafa Collect nftables configuration
In order to properly debug nftables issues, getting the generated raw
content may be useful.
This is a complement of Icba6b51ba5480091adcd2e010c9e34c049216c22

Change-Id: I854a3c6ef6595e091bab182458815bbebd75e6da
2022-07-08 08:15:16 +02:00
Chandan Kumar (raukadah) 8f527522f7 [Collect-logs]Exclude git, tmp and unwanted rpm files.
We have started seeing a lot of POST_FAILURES while pushing
the logs to log server.

It might be related to huge amount of files getting pushed to
log server.
This patch adds new few more excludes to avoid pushing opendev
git files, /tmp and unwanted rpm files.

Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
Change-Id: I8b80aee5dcda2d129bfb25a842cca11970a58423
2022-06-27 20:35:56 +05:30
frenzyfriday f04acdafa1 Changing container registry in testenv to quay
Changing container registry in testenv to quay so that periodic and check/gate jobs pull from quay instead of trunk.registry.rdoproject
We are doing this only for master, wallaby c9, wallabyc8 and train c8 at the moment

testproj: https://review.rdoproject.org/r/c/testproject/+/42265
Change-Id: Iaa1b172335e662457fb94410093d20892df7327b
2022-05-23 17:19:58 +00:00
frenzyfriday 939fda2275 Changing container registry in testenv to quay
Testproject: https://review.rdoproject.org/r/c/testproject/+/42265
containers-prepare-parameter:
- https://logserver.rdoproject.org/65/42265/2/check/periodic-tripleo-ci-centos-9-undercloud-upgrade-master/006e730/logs/undercloud/home/zuul/containers-prepare-parameter.yaml.txt.gz
- https://logserver.rdoproject.org/65/42265/2/check/periodic-tripleo-ci-centos-9-containers-multinode-master/453bc8d/logs/undercloud/home/zuul/containers-prepare-parameter.yaml.txt.gz

Change-Id: I4b2a0e1e78d07362df194402c426fabaf81ac4dc
2022-05-05 14:55:56 +02:00
Jose Luis Franco Arza 35655ceca7 Collect logs for the tripleo-upgrade directory when existing.
Change-Id: I234861ff8822c47e0b08fb7fb729573b3d6eb16e
2022-01-12 12:55:49 +00:00
Bogdan Dobrelya 2bae18e0db Add missing libvirt and nova logs for CI jobs
TripleO CI overrides artcl_collect_list for the logs collection role.
Add missing entries to also collect libvirt/qemu instances logs and
nova console logs.

Change-Id: I9e27cd461c980c5c923154bd29c3bf5d6c9f5c80
Closes-bug: #1951942
Signed-off-by: Bogdan Dobrelya <bdobreli@redhat.com>
2021-11-29 12:51:09 +01:00
Jiri Podivin f782162894 Adding VF directories into the log collection list
The validation framework is now active participant
within the CI, including the component jobs.
Therefore we need to collect full set of information
produced by it, in order to diagnose potential issues if they arise.

Signed-off-by: Jiri Podivin <jpodivin@redhat.com>
Change-Id: If9053ea64ef6f58294b244143dc62aba4e5b5835
2021-11-11 10:14:57 +01:00
Douglas Viroel f0dec96d5f Set ironic power state timeout to 180 in ovb jobs
This patch sets undercloud_ironic_power_state_change_timeout to
180 for all ovb jobs. See LP #1947403 for more info.

Related-Bug: #1947403
Depends-On: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/815540
Change-Id: I76057481a53bc1541ff4abe80ccf5f8361317c4e
Signed-off-by: Douglas Viroel <dviroel@redhat.com>
2021-11-01 18:10:08 -03:00
Chandan Kumar (raukadah) 994175ccda Use ansible_user_dir path in artg_repos_dir
Currently artg_repos_dir path points to
/home/zuul/src/opendev.org/openstack.

On EL9, we have /home/zuul and /home/zuul-worker dir
exists and default user is zuul-worker.

artg_repos_dir is looking for clonned repos in /home/zuul path but repos
are clonned in /home/zuul-worker, leading to failure.

More info about issue is here:
https://review.rdoproject.org/r/c/testproject/+/35229/23#message-265a04d5718b866a2ecf508af68df2e4159af457

Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
Change-Id: Iea958e037ab63896def82608bc2ce2ba0d30948c
2021-10-20 10:58:40 +05:30
Andre Aranha ae89a31043 Switching the DNS forwarder to openDNS
Featureset039 keeps failing on "Checking DNS forwarders, please
wait ..."; It seems to be an issue with the default DNS forwarder.
This patch will change the currentDNS forwarder (1.1.1.1; 1.0.0.1)
to openDNS (208.67.222.222; 208.67.220.220)

Change-Id: I80d9d233f2f916436e12f355e658165a231dcb21
2021-10-15 12:51:22 +00:00
Sandeep Yadav abbdcfad5b Replace extra-args with workers_args
We have assigned extra-args in multiple featureset files[1].
Using extra-args here override the value we defines in featureset
files.

Example: If we compare periodic job deploy command[2] vs
check job[3] deploy command for same job
scenario007-multinode-oooq-container - we are not passing
environments/services/neutron-ovs.yaml because we overriden
the extra_args from featureset file[4].

[1] https://codesearch.opendev.org/?q=extra_args&i=nope&literal=nope&files=&excludeFiles=&repos=openstack/tripleo-quickstart
[2] https://e5dbd9d96734c74a1cf0-391ca9f25982feff002f89e6b05bcdaa.ssl.cf2.rackcdn.com/810256/3/check/tripleo-ci-centos-8-scenario007-multinode-oooq-container/7bc4f34/logs/undercloud/home/zuul/overcloud-deploy.sh
[3] https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario007-multinode-oooq-container-master/75482de/logs/undercloud/home/zuul/overcloud-deploy.sh.txt.gz
[4] https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset030.yml#L38-L45

Related-Bug: #1943579

Depends-On: https://review.opendev.org/c/openstack/tripleo-quickstart/+/811188

Change-Id: I71e9a33ff63b004a948852ea4385d1b1ecbd4527
2021-09-27 16:00:07 +00:00
yatinkarel b2d8bb4dba Add missing standalone-psi.yml
Needed for standalone jobs running in psi cloud.

Change-Id: Ifceb6a4c48a1adf223d307d69819b88d1be5e199
2021-08-02 05:02:05 +00:00
Ronelle Landy 96b59a5505 Remove dns server that has sporadic issues
38.102.83.187 is timing out. This server is not needed.
There are two others that are reliable.

Change-Id: I87b1770596ef9dcd01fd94707e94d6b117a06bf4
Closes-Bug: #1931444
2021-06-09 09:34:18 -04:00
Wes Hayutin 300915c394 ensure undercloud|standalone-install-.tar is not collected
TOOO BIG

Depends-On: https://review.opendev.org/c/openstack/tripleo-quickstart/+/789787
Change-Id: I06456543eb599a261ab8248df31de18e1ca044fc
2021-05-05 12:31:19 +00:00
Zuul a92f3c4065 Merge "Add ~/overcloud-deploy to collect logs config" 2021-04-08 09:09:45 +00:00
James Slagle 0e29f203df Collect ~/tripleo-deploy
In Idded7faba1ff6c811b94503c559029aeeaca6a06, we are changing the
default output path used by "openstack tripleo deploy", and by
extension, "openstack undercloud install|upgrade" to
~/tripleo-deploy/<stack>.

This patch adds the new output path to the configuration to make sure
these files are collected in job output.

Partial-Bug: #1921975
Signed-off-by: James Slagle <jslagle@redhat.com>
Change-Id: I1dfc220b23bfb06dace1157511393ee12c722c84
2021-03-31 07:29:35 -04:00
James Slagle e513456c82 Add ~/overcloud-deploy to collect logs config
We are moving the consistent working dir to be
~/overcloud-deploy/<stack> instead of ~/overcloud-deploy-<stack>, so
that all deploys will be under a single directory and easier to manage.

Signed-off-by: James Slagle <jslagle@redhat.com>
Depends-On: I189bd751066cfaebd951d92d8371250aac5b4e9b
Change-Id: Ied759d6ee4c752ae69ffbef54a6e92d4970ea033
2021-03-24 21:18:58 -04:00
Zuul 69407cc2f6 Merge "Add ansible-generated to collect logs list" 2021-03-09 20:48:33 +00:00
Zuul ebc442ee55 Merge "Collect default working-dir" 2021-03-08 14:39:46 +00:00
James Slagle bdc56343ac Collect default working-dir
With change I0d803f695c725c58ef2e6b655753b6c8248d1b2f
we use a different working_dir which defaults to
$HOME/overcloud-deploy-<stack> to store all files. Let's
collect it for ease of troubleshooting of CI jobs.

Change-Id: I384d15f819f8f5f5654ea8d98a67cdaaec1cff2e
2021-03-08 12:54:00 +05:30
Carlos Goncalves f06cafb8c6 Add ansible-generated to collect logs list
TripleO services like FRR, Designate and OVN clustered databases store
Ansible-generated configuration files in directory
/var/lib/config-data/ansible-generated.

Change-Id: I08267cf94eab63d223f1509906c0b23fb3652b6e
2021-03-07 09:25:35 +01:00
Arx Cruz e0f47848c1 Remove tempest variables from testenv files
Some variables like tempestmail_log_server and tempest_track_resources
are no longer required because it belongs to validate-tempest role, that
is deprecated now. Other variables like tempest_test_image_path and
tempest_tempest_conf_overrides should be used only when required. In the
case of these testenv, this is overriding what is in tempest.yml task in
tripleo-quickstart-extras, making it hard to change cirros image.
Removing here will have no impact, and all common tempest variables
should indeed be centralized in tempest.yml task.

Change-Id: I66da92fcabf204ab9ed3653132ee5221c220c5a0
2021-03-03 10:10:35 +01:00
Sorin Sbarnea a3c9dc40e4 Fixed yamlint violations
Change-Id: I7468ef9929cd6a7c0969bcd6befb320bfd671097
2021-02-10 15:24:59 +00:00
Sagi Shnaidman 2e7c74d0d4 Collect /etc/cni/ for podman networks
Change-Id: I18868e853843d8602faa00a8faad8587462db08b
2021-01-18 22:19:54 +02:00
Wes Hayutin 40d2edaaa3 env override, turn off doc creation
doc creation is meant for ci.centos/ internal
only

Related-Bug: #1908054
Change-Id: I9e85d38f6f27296609e886710dac738d2f985c1b
2020-12-14 08:46:41 -07:00
Ronelle Landy 796d29dcec Collect /etc/passwd for jobs running tempest
This review add /etc/passwd to the list of files
added to the logs. This wil aid in debugging tempest
failures.

Change-Id: Id189986e7f89c9f44a201eaef8cda48bb78d38e5
Related-Bug: #1907474
2020-12-10 21:02:50 +00:00
Marios Andreou b120a5e6e0 Remove the registry_ip_address variable from content providers
We should never use registry_ip_address var instead relying on
registry_ip_address_branch to avoid related-bug.

This removes registry_ip_address from returned zuul data and
updates the last few references to it.

For the install-built-repo pre-run play we can't rely on
release to determine the right ip_address_branch. This re-uses
logic from the build-containers role after moving it to its own
tasks file to prevent duplication.

Change-Id: Id594d301d18bc33753e56ef3b7519e36a396cd82
Related-Bug: 1904565
2020-12-03 12:37:59 +02:00
Nicolas Hicher 10d3fbc91d Add psi cloud configuration
Add psi cloud configuration for ovb and multinode jobs

Change-Id: I8ccd550e158df179c21d8c9d45251e253de90c3b
2020-11-27 13:33:25 +05:30
Bogdan Dobrelya 9dcc7313fc Do not collect redundant or not much useful logs
Do not collect the following paths (via overrides for [0] provided
locally in this repo as well):
  - overlay*
  - root
  - console*primary.log
  - anaconda*

since the former would increase the size of collected logs by ~35M,
while beeing mostly useless. And the others contain redundant
things or junk. That is given the fixes [0] for collect-logs applied.

[0] https://review.opendev.org/759663

Change-Id: Ic3b31c33c869ea0ef1ba26d39e6942bddaeb0da4
Required-by: https://review.opendev.org/759663
Related-bug: #1901508
Signed-off-by: Bogdan Dobrelya <bdobreli@redhat.com>
2020-10-29 12:35:13 +01:00
Wes Hayutin 47fca912e4 add netstat logs to log collection
Change-Id: I0a01dac781ce51ed99bbc02b7e6db3c4b4e0fe99
2020-10-26 19:28:19 +00:00
Marios Andreou 25c780d2d9 Adds upgrade jobs to content provider pipelines
Adds the standalone undercloud and overcloud upgrade jobs
and the overcloud update job for the content provider pipelines
including -ussuri and -train variants where applicable.

Needs depends-on for setting the right provider registry used
during deployment and upgrade.

Depends-On: https://review.opendev.org/753708
Depends-On: https://review.opendev.org/755472
Change-Id: I74265c7a1f63cdf4f1e9ef9e483915408ed7eb44
2020-10-26 01:11:27 +00:00
Chandan Kumar (raukadah) 0feb5c3c74 Added CentOS-7 queens/train content provider job
* Collect the logs of container workspace
* tripleo-ansible will be automatically installed by
  python-tripleoclient package.
* Set tripleo_common_path for packages.
* Make sure docker service is running and docker user
  and group exists
* Added insecure registeries
* serve quickstart-centos repos on http server
* set container_cli_opts only when use_buildah is used.


Depends-On: https://review.opendev.org/#/c/752419/

Change-Id: Ia3c09a33ca92ed68cbaa3baf5f37ad61751a8a89
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
2020-10-20 01:43:53 +00:00
yatinkarel 9f9509f072 Honour build_container_images and provider/consumer jobs
https://review.opendev.org/#/c/752685 changed all
jobs to use trunk.registry.rdoproject.org registry
for all rdo third party jobs but in RDO we run jobs
that build/deploy containers so we have to use
the local registry that is setup in jobs instead of relying on
external registeries.

This patch ensures correct registeries are used.

Change-Id: I9245d4c89e63ec71a102240e9ceaad18b5b14878
2020-10-07 11:17:03 +05:30