Commit Graph

66 Commits

Author SHA1 Message Date
Takashi Kajinami 9b5697ff17 Restore tests disabled because of libvirt bug
It seems the latest libvirt in Ubuntu is no longer affected by
the known problem with device handlings. This re-enables some test
cases which were previously disabled because of the problem.

Change-Id: I538462414f0a9b634d4d216230ed04b49cf71c40
2024-03-12 00:35:18 +09:00
Zuul 98bf27eec1 Merge "Ensure ca_file is set for core services" 2023-12-20 12:37:56 +00:00
Zuul 7b4db13222 Merge "Remove redundant usage of is_ssl_enabled_service" 2023-12-20 12:21:25 +00:00
Takashi Kajinami 46a6d5fa4b Remove references to Neutron LBaaS tests
... because these tests are already removed.

Depends-on: https://review.opendev.org/c/openstack/heat-tempest-plugin/+/896184
Change-Id: I34f75971fec826032377c47bf7b4e7a380522b8f
2023-12-17 00:37:49 +00:00
Takashi Kajinami 6d13e93a37 Enable new defaults and scope checks by default
Based on the agreed steps to implement the SRBAC community goal, this
enables the new policy defaults and scope checks by default.

Change-Id: I315893150549d1174c3270c37c031e6a519f9a28
2023-10-24 13:18:40 +09:00
Takashi Kajinami 4421498cd3 Add devstack plugin option to enforce new defaults and scope
This is a prep work to enforce new default policy rules and scope
checking, and allows users to enable/disable the enforcement by setting
the single knob.

Change-Id: I8248f825a90b50fe874224c7ee06a1de299f1feb
2023-10-24 13:17:57 +09:00
Takashi Kajinami 397657f667 Upgrade flavor for Fedora VM
Since we bumped Fedora version used in CI from 36 to 37, we've
seen timeout during boot process more frequently, which results
in job failure. This increases core and ram assigned to Fedora
VMs, to reduce failure rate.

To avoid consuming too much resources, this limits concurrency
of test runner.

Change-Id: I12e8ee0861629fd42a6bd03ec8705751da12ff61
2023-09-21 04:02:06 +00:00
Takashi Kajinami 0e51506419 Bump Fedora image used in CI
Fedora 36 is already EOLed so we should use more recent version.

Because guest enters to emergency shell when Fedora 38 (latest at
the time of writing) is used, we select Fedora 37 for now.

Change-Id: Ie0876080c771fb124d4dd36f803fbfd3b108e240
2023-09-07 21:20:31 +09:00
Takashi Kajinami 528bc75ef0 Add non-voting CentOS 9 Stream job
This introduces non-voting CentOS 9 Stream functional jobs, to restore
some tests which were disabled because of the known libvirt bug. Though
the bug also affects CentOS 9 Stream, we observe much low failure rate
in CentOS 9 Stream so we can restore these test cases in CentOS 9
Stream. The job is kept non-voting until it is proven to be stable
after a while.

Change-Id: I37211aa941be1892ad0ddf0694a758972a0aebba
2023-06-20 10:19:02 +09:00
Takashi Kajinami add8d16284 Skip basic scenario test
This test is very frequently failing now. The test case creates a stack
with an instance but the stack can't be deleted within timeout because
of the known libvirt bug in Ubuntu Jammy. Because the release deadline
is already over, we'll disable this test so that we can merge some
changes now. We'll revisit this (and the other test cases we disabled)
later.

Related-Bug: #1998274
Story: 2010631
Task: 47589
Change-Id: I87c4b1e7a911fd78e327393b1af200667e89c999
2023-03-06 10:32:36 +09:00
Takashi Kajinami b452ea7089 Skip test_stack_update_with_replacing_userdata
This test case is frequently failing because of a known libvirt issue
in Ubuntu Jammy. We already disabled one functional test case, but will
disable this test case as well, to reduce failure rate of CI runs and
unblock gate.

The existing skip for a different test case[1] is re-implemented using
the proper configuration knob.

This also fixes tox.ini to adapt to new tox 4.0.
 - Update how passenv is defined because space-separated list is no
   longer allowed. Also the values are not case sensitive.
 - skipdist=True breaks installation so is removed.

[1] https://review.opendev.org/c/openstack/heat/+/866545

Co-Authored-By: Rabi Mishra <ramishra@redhat.com>
Related-Bug: #1998274
Story: 2010487
Task: 47056
Change-Id: I915dc83ccde6b6b8497642857292f9974fd84e98
2022-12-23 13:26:52 +09:00
Brendan Shephard 7787140214 Remove CloudWatch cleanup tasks
This change removes the cloud watch cleanup tasks
as part of general housecleaning.

Change-Id: Id8f678dfd504ff27d6fdb86011129d353a31f3cf
2022-07-21 23:34:28 +00:00
Matthias Runge 78244c5f0f Use f36 instead of f33 for testing
F33 is unsupported for a while. We should not use it for any testing.

Change-Id: I7d1017bcd7147329c4e187336daee1a1ae280fa9
2022-05-31 10:35:53 +02:00
Takashi Kajinami 964e15d68f Ensure ca_file is set for core services
When tls-proxy is enabled, devstack enables SSL for the core services
(Cinder, Glance, Keystone, Nova, Neutron and Swift). This change
ensures that the ca_file parameter is properly defined in clients_*
section for these options, so that requests to these services pick up
the CA certificate.

Change-Id: Ib6278d95d1ce31dc86aa8784a621227e17dc0fe7
2022-01-19 18:10:26 +09:00
Takashi Kajinami 25c007636f Remove redundant usage of is_ssl_enabled_service
The is_ssl_enabled_service function is kept for backword compatibility,
and now returns the same value as `is_service_enabled tls-proxy`
since [1] was merged.

[1] f3b2f4c85307b14f115a020f5eaf6c92026b55b4

Change-Id: I5a3311121e56a7cfaefb73be39d3f60809bafb06
2021-11-23 16:07:37 +00:00
rabi f5da6d210e Fix broken devstack plugin
This devstack plugin seems broken with devstack secure rbac changes
to use OS_CLOUD.

Change-Id: I9f0d3d97e4cc7d5ed6858eca9c042fedb14139d1
2021-11-19 14:17:55 +00:00
Ian Wienand bf9186a37e Fallback to upstream for Fedora image
OpenDev infra only keep around the latest two Fedora releases in their
mirrors.  Probe for the image from the local test mirror, but if not
found, fallback to upstream.  This will be much less reliable, but can
avoid gate breakage until new images can be used.

Also, use endpoint_type when creating keystoneclient

Keystone admin endpoint has been removed from devstack with[1].
This would use the public endpoint by default.

Change-Id: I96ab14871ee8c5d5b83cc0cd4abc840ef0218ca8
2021-11-12 15:32:19 +05:30
Zuul fc056ef70a Merge "Remove deprecated tail_log function" 2021-03-11 21:19:21 +00:00
Matthias Runge 6a9c35d898 Move testing to Fedora 33
Now that the gate is unblocked, we can also test F33 for gating purposes
here.

Change-Id: Ie1c9075623d85b27aaf1ac67a3063e219726bc6f
2021-01-19 16:38:43 +00:00
Matthias Runge 61e53c4eca Replace Fedora test image with F32
Fedora 31 was retired and the image is gone from mirrors.
heat-cfntools have been dropped from fedora images, disable
the test till that's resolved.

Also makes grenade job non-voting, till this is backported
to stable/victoria.

Change-Id: Id869f83a46454897c2fe7a532eebfa2863befe5e
2020-12-04 12:18:59 +05:30
Eyal 960428ca78 Remove deprecated tail_log function
This function has been deprecated for a long time, let's finally
remove it. It is only generating a warning anyway.

Change-Id: I0f69076ef7c288c113f4e7739c7e12fcfb11d91d
2020-11-24 09:15:50 +02:00
Rabi Mishra 9efbec6cd9 Stop testing ceilometer and aodh
Ceilometer uses gnocchi as the default backend. Also we use
gnocchi based aodh alarms in tests.

gnocchi seems unmaintained with last commit a year or so ago and
does not look like the openstack telemetry team is involved in
that project.

It's better to disable the services and tests in heat to avoid
broken gate like last time, where we fixed it by banning latest
pecan release[1] that does not work with python-gnocchiclient.

[1] https://review.opendev.org/#/c/746261/

Change-Id: Id2ffdf6b9d342e800bab4a94ec46742228361ee8
2020-09-14 13:09:09 +00:00
Rabi Mishra f18a676792 Use Fedora 31 for tests
Change-Id: Ia45e957bb24f5596a5ef16271f71ba8b77df9e42
2020-05-12 11:28:31 +05:30
Cédric Ollivier a3be28bed7 Reduce Heat engine workers
It conforms with API_WORKERS default calculation to avoid too much
processes consuming the memory.

Change-Id: If2b483711668715047662a286cb0f0e3b52bbdac
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2020-04-15 11:25:21 +02:00
ricolin c61170e4e8 Update Fedora image ref for test jobs
Fedora-Cloud-Base-29-1.2.x86_64 is removed from openstack local mirror.
Update to use Fedora-Cloud-Base-30-1.2.x86_64 for test jobs.

Change-Id: Id3026a115e3a044b3dc00030fd6d82549dc189b6
2020-02-24 16:00:19 +00:00
Rabi Mishra a32cadd637 Remove image upload dependency on g-reg
It's not enabled by default[1] in devstack, is
deprecated and not needed for glance v2.

[1] https://review.opendev.org/#/c/702709/

Change-Id: I01514d8639e7604cca9846e05904ebe062393550
2020-01-17 21:41:05 +05:30
ricolin c8d1a9f901 Migrate functional test jobs to zuul v3
Something are introduced in this patch:
* As devstack-gate/devstack-vm-gate-wrap.sh is not really zuul v3
native, we move all configs in to `devstack/lib/heat` and .zuul.yaml.

* Remove extra configs process in devstack. Like setup tempest(which
is well covered by tempest itself.) or overlapping heat test configs setup.
Use tempest config for all heat_integration tests. Also remove
heat_integrationtests/common/configs since they're no longer required.

* copy post.yaml for grenade jobs. As we migrate to zuul v3 for
functional tests but not grenade (not yet), the post.yaml should exists
under grenade dir. since it's only required by grenade jobs.

* Use post.yaml in functional tests for cleanup test environments.

Story: #2007056
Task: #37908

Depends-On: https://review.opendev.org/701105
Change-Id: I4f531161a7222e2c2a21f8d483f9c2a1d91dc38d
2020-01-07 09:38:04 +08:00
Zuul e80ce9e0f6 Merge "Drop creating extra endpoints in devstack" 2019-12-05 06:21:36 +00:00
Zuul 0e6b8c6c13 Merge "Do not re-clone heat in devstack plugin" 2019-09-27 10:10:12 +00:00
Jens Harbott 45fd0ec9bb Drop creating extra endpoints in devstack
We don't need admin or internal endpoints in a normal devstack setup,
other basic projects are also only creating the public endpoint now.

Change-Id: I9bd6007509214c7a7ed7f7f4e391b609da4408a5
2019-08-19 10:33:49 +00:00
zhurong 47a3004de4 Change HOST_IP to SERVICE_HOST
HOST_IP is only for ipv4,
SERVICE_HOST can fit for ipv4 and ipv6.
IPV6 log can check here:
http://logs.openstack.org/51/673751/1/check/murano-tempest-api-ipv6-only/f947d0e/job-output.txt.gz#_2019-07-31_08_54_25_077300

Change-Id: I7574a273e1c0511c56370b2203694dc52d963afc
2019-08-01 08:53:27 +08:00
Pavlo Shchelokovskyy af7588600d Do not re-clone heat in devstack plugin
devstack already clones the source from the repo/ref provided to
enable_plugin function.
Having to re-clone heat effectively requires to also set HEAT_BRANCH
separately which is unnecessary repetition and make it less obvious
how to deploy Devstack+Heat from stable branches locally w/o Zuul Cloner
with RECLONE=true.

Change-Id: I91b5048efa4606e86094e0a458e320216f66ce3e
2019-05-31 14:11:45 +00:00
ghanshyam 98723966ce Set Tempest's service_availability setting for Heat
Tempest's service_availability config option includes all the service
availability which is further used by tests to take decision of skip
or run the test.

For example, [service_availability].heat is true then, heat test will run
or if [service_availability].heat is false then, all the heat related tests either
in heat tempest plugin or any other plugins will be skipped.

Currently this setting for heat service[1] is in devstack lib/tempest
which is being removed by - https://review.openstack.org/#/c/619973/

For better maintenance, we are moving all tempest non-owned service setting
to service devstack plugin side.

This commit add the setting of heat service on ceilometer devstack plugin.

Related-Bug: #1743688
[1] d6b253502a/heat_tempest_plugin/config.py (L15)

Depends-On: https://review.openstack.org/#/c/619990/
Change-Id: I5013ce8be1a4fb5219ea89a63add812558191025
Needed-By: https://review.openstack.org/#/c/619973/
2018-11-26 10:03:01 +00:00
Zuul b3bcf36909 Merge "Remove unused policy cp in devstack" 2018-02-01 06:35:53 +00:00
Zuul 1c7ff8f4e6 Merge "Remove use of auth cache directory" 2018-01-27 03:22:45 +00:00
ricolin 3e71efe059 Remove unused policy cp in devstack
We won't have policy.json file by default anymore, so we don't need
this `cp` command.

Implements: bp policy-in-code

Change-Id: I84c99e38c34dc41cc33126291563ea90038ce107
2017-12-28 16:23:01 +08:00
ricolin f2bc379242 [policy in code] part 6(cfn, cloudwatch)
Add cloudformation and cloudwatch policy in code rules.
Remove policy.json. We don't keep any default policy rules in
policy.json from now. Still they can create policy.json file and
add any rules they try to override.
Partially-Implements: bp policy-in-code

Change-Id: I610115dc1974b2182ce673bb086a1da15b022de3
2017-12-13 10:58:47 +08:00
rabi f2b4c983d3 Remove cloudwatch service from devstack plugin
Change-Id: Ie18d80e8faaec984b127ab3abeeb66d6a3aa1b6c
2017-10-25 11:50:15 +05:30
Vlad Gridin cbb754d265 Remove use of auth cache directory
Change-Id: Ie573f27d47e7e88cde27712a12aa8b40b5afda8b
Closes-Bug: #1720988
2017-10-09 16:34:18 +02:00
Matthew Treinish 6b22300c8f Don't remove uwsgi config files on stop
Removing the uwsgi config files on stop breaks upgrades when using
uwsgi, so let's not do that. Keeping the file deletes in cleanup
makes sense and those calls remain.

Change-Id: I603754c3f5ed5d2f143cf789df96018ec99ad692
2017-09-02 19:00:25 -04:00
rabi 48622d46f4 Fix devstack plugin for multinode deployment issues
- Call create_heat_accounts irrespective of whether keystone
is enabled or not.
- Use hardcoded auth_encryption_key

Change-Id: I03fab7f986ec2a9703044f4bff31d477e2e7fe6a
2017-08-04 17:10:03 +05:30
rabi bcd8c814b7 Add httpd documentation and sample configs
This adds uwsgi sample configs and documentation for
deploying api services with httpd.

This moves the existing mod_wsgi sample configs from devtsack
folder as they are not specific to devstack.

Change-Id: I91fd64d9deba3371b62c00ba8b01a7aca21b2393
2017-07-07 11:00:06 +05:30
rabi 645c58b12f Revert "Revert "Enable heat to use uwsgi with devstack""
This reverts commit 73ff2f16c4.

Change-Id: I11200efe50db94d62cef474c248d78e9a3aa1673
2017-07-07 11:00:04 +05:30
Mehdi Abaakouk (sileht) 73ff2f16c4 Revert "Enable heat to use uwsgi with devstack"
It looks like heat is not ready to work inside a prefix.

Telemetry gate is broken since this change. The signal urls generated by heat are wrong and doesn't have the url prefix.

http://logs.openstack.org/44/468844/28/check/gate-telemetry-dsvm-integration-ceilometer-ubuntu-xenial/519194e/logs/screen-aodh-notifier.txt.gz#_Jun_07_08_45_46_995420

This reverts commit c74db66934.

Change-Id: I4cbff7c947defbe10777d63a975e0971732a0c6a
2017-06-07 11:36:11 +00:00
rabi c74db66934 Enable heat to use uwsgi with devstack
This change ensures that api services deployed with apache+uwsgi
by default with devstack. User can still deploy apache+mod_wsgi
by setting WSGI_MODE=mod_wsgi in local.conf.

Using HEAT_USE_APACHE=False or HEAT_USE_MOD_WSGI=False
(for backward compatibility) would deploy the services
without apache.

Change-Id: Ia5e28e2987b4aeab6c049a3bde3a956204ddc5d9
Depends-On: I3b77aafc6104119503363e5db36b0379964daba5
2017-06-05 05:49:22 +00:00
rabi a5838a8c21 Use common function for logging with devstack
Now that sevices run with systemd at the gate, use the common
function to make it compatible(i.e colorized_logging).

Change-Id: Ieb65618c1bcda3f56201ba3d3c49f6ef1c02c650
2017-05-05 08:51:43 +05:30
Jenkins 954b3bf901 Merge "Tail correct log files with devstack" 2017-03-15 02:28:44 +00:00
Jenkins ee366aa79d Merge "Remove leftover install_heat_other" 2017-02-08 14:54:04 +00:00
rabi 320959bbfd Tail correct log files with devstack
We recently changed devstack to use httpd+mod_wsgi as the
default and split the access logs. However, we don't seem
to tail the correct log files.

Change-Id: I3aaefc92e6dbf4721b6a979fc72835abe9b54f14
Closes-Bug: #1661495
2017-02-03 10:49:02 +05:30
rabi 6ef5fa9adc Make API services with apache the default
Run api services with httpd+mod_wsgi in devstack.
This also skips sighup tests conditionally.

Change-Id: I6631f1fecb906ae0c4bb96a2f868117eff045aa0
Closes-Bug: #1656617
2017-01-15 11:53:25 +05:30