Commit Graph

74 Commits

Author SHA1 Message Date
Michal Nasiadka fa5aa8f625 Drop k8s_fedora_ironic_v1 driver
Change-Id: Ic7114e5923b74a4202a043388701826b4e47326e
2024-02-05 08:14:56 +00:00
Michal Nasiadka 5c0c27807a Drop k8s_coreos_v1 driver
Change-Id: I64884677cf05c59c64988dfbee9bf22e97a3466b
2024-02-05 07:04:05 +00:00
Michal Nasiadka bc79012f46 Drop Swarm support
Label validator function has been left behind, although it's not
checking for anything right now - might be useful in future.

Change-Id: I74c744dc957d73aef7556aff00837611dadbada7
2024-01-24 13:20:21 +13:00
guilhermesteinmuller 6e8657912c Drop Mesos code
The coe mesos has not been maintained for quite some
time and hasn't got much attention from the community
in general. As discussed in the mailing list [1] we
are dropping for now.

[1] http://lists.openstack.org/pipermail/openstack-discuss/2021-December/026230.html

Co-Authored-By: jake.yip@ardc.edu.au

Change-Id: Ie7de9a37bfad6214f52d0605409e74d62a51df47
2023-03-07 14:02:05 +11:00
Ghanshyam Mann 3b7a33eb64 [goal] Deprecate the JSON formatted policy file
As per the community goal of migrating the policy file
the format from JSON to YAML[1], we need to do two things:

1. Change the default value of '[oslo_policy] policy_file''
config option from 'policy.json' to 'policy.yaml' with
upgrade checks.

2. Deprecate the JSON formatted policy file on the project side
via warning in doc and releasenotes.

Also replace policy.json to policy.yaml ref from doc.

[1]https://governance.openstack.org/tc/goals/selected/wallaby/migrate-policy-format-from-json-to-yaml.html

Change-Id: Icfd9e2a75d8fdfb24cbd1c850f498aadee91f543
2021-03-08 15:11:01 +00:00
Bharat Kunwar 76502dd57d [ci] Use magnum-tempest-plugin-tests-api
This commit drops magnum-functional-api (which uses legacy-dsvm-base due
to be removed in the V cycle) in favour of
magnum-tempest-plugin-tests-api defined in the magnum-tempest-plugins
repo (which uses the new devstack-tempest job recommended for running
Tempest tests in Zuul v3) for API Tempest tests.

Story: 2007561
Task: 39443

Depends-On: https://review.opendev.org/#/c/721077/

Change-Id: I91446f8773ecec1286c9913c3fff688bd8d9a087
2020-04-21 19:52:32 +00:00
Bharat Kunwar 9fedb8fe43 [ci] Use Fedora CoreOS image for devstack plugin
Story: 2007561
Task: 39478

Depends-on: https://review.opendev.org/#/c/721213/

Change-Id: I05caa60fd0180e20003f876fd439b6f421e50ff3
2020-04-21 19:52:14 +00:00
Zuul 36e64fad69 Merge "functional: bump flavor specs" 2018-12-14 22:30:12 +00:00
Mohammed Naser 844e4db2a9 functional: stop using concurrency of 1 for api tests
There is no need for API tests to be running with concurrency of
one, we can drop that and speed up the API test suite by using
all of our cores.

Change-Id: Ideb379ba7032e83bde852198fc66ccd623ae1424
2018-12-12 09:45:57 +00:00
Mohammed Naser 98fcd79430 functional: bump flavor specs
We have VMs with 8 cores and 8GB of memory, this patch makes better
use of them by adding more cores (which shouldn't have much of a
negative impact) as CPU is not fully used during test runs.

This should hopefully improve performance of the functional tests.

Change-Id: Ib79a8c83758628286c68e941024de5bc2741b088
2018-12-09 00:35:33 -05:00
Erik Olof Gunnar Andersson 718cb9c9b4 Add support for www_authentication_uri
We do currently not support www_authentication_uri at all, which
is the new standard, as auth_uri has long been deprecated.

* Make sure we support both auth_uri and www_authenticate_uri.
* Switched to www_authenticate_uri for devstack.
* Fixed a bug where a bad exception would be thrown if auth_uri
  was not set.
  
Story: 2004271
Task: 27819

Change-Id: Ibc932d35f3d6ba2ac7ffb6193aa37bd4a3d4422e
2018-11-06 17:13:10 +00:00
Julia Kreger 547f9309a1 Minor fixes to re-align with Ironic
Ironic has evolved and a few items were no longer correct
in the contributed scripts for use with ironic.

Additionally a database workaround was fixed, and as such
commented out.

Change-Id: I105791985973e8348d43d41982ac7ba3e0cf970c
2018-10-23 09:34:51 -07:00
yatin 553316e40f Fix: functional CI Jobs
After [1] jobs are return false(SUCCESS) status due
to wrong EXIT_CODE.
After [2] kubernetes client is updated to v4.0.0 and
no longer contains ConfiugrationObject so we need create
instance of Configuration class.

Also don't use local to create variable as local
 can only be used in a function.

[1] https://review.openstack.org/#/c/526618/
[2] https://review.openstack.org/#/c/528406

Change-Id: Ida5aac40b234a358b2a13b2e51a41d0242031ebb
2018-01-11 12:50:25 +00:00
Chandan Kumar 53fa3accea Remove intree magnum tempest plugin
* It removes magnum tempest plugin reference in favour of using
  newly magnum-tempest-plugin.
* We removed tempest tests resides under functional.api.v1.test-*
  files as they are tempest tests and keeping the rest as they are
  used by functional tests.

Depends-On: Ibdddd26da9cfb0d08c2977660320b2c052d7261b
Change-Id: Ida2fa1ef5880ebead787e3b27ac7ebf5aa498f62
2017-12-14 15:48:47 +05:30
yatin 0b49f38069 Migrate to Zuul v3
Change-Id: I0d5d6a9038c9a150a74df955bccb3f9ed263b736
2017-10-10 14:29:04 +00:00
Spyros Trigazis 4fb91cc109 tests: Use swarm-mode for api tests
* Swarm-mode is the fastest cluster to deploy since it doesn't
  require to pull anything from outside.
* Add the output nodes for swarm-mode too.
* Disable copy logs (I think a better practice is to copy logs
  on demand).
* Don't run test_create_list_sign_delete_clusters, because it is
  very unstable on the CI.

Partially-Implements: blueprint swarm-mode-support

2nd commit message:

Update to Fedora Atomic 26

This patch moves the current master to test against Fedora Atomic 26,
in addition, it switches to downloading from Fedora mirrors.

2nd-Change-Id: I9a97c0eb78b2c9d10e8be1501babb19e73ee70c1

3rd commit message:

Set default iptables FORWARD policy to ACCEPT

With the release of Docker 1.13 which is available in Fedora
Atomic 26, it no longer sets the policy of the FORWARD chain
to ACCEPT[1].  Therefore, CNI networking such as Flannel will
cease to work.

This patch sets the policy to ACCEPT so that traffic can work
once again for deployments which are based on Docker versions
which are newer than 1.13

[1]: https://github.com/moby/moby/pull/28257

3rd-Change-Id: I1457602748619f38f87542fc01a2996ee80e58b7
Closes-Bug: #1708454

Co-Authored-By: Mohammed Naser <mnaser@vexxhost.com>
Change-Id: I86d4dcc94fff622be4ee2acc8dd60ed81bc5d433
2017-08-21 05:30:09 +00:00
Spyros Trigazis 1aa638903c CI: multinode job with larger flavors
Set cluster node flavors to:
* ram: 3750
* disk: 20
* vcpus: 2

Change-Id: I1eb2487e16866fa1ae26943dbeca0380eb10e947
2017-05-09 15:41:50 +00:00
yatin 530d225fcd Fix keystone auth_uri and auth_url
Post [1] we cannot use auth_uri/auth_url containing :5000, :35357.

Update keystone auth_uri and auth_url in magnum.conf to connect
with keystone using /identity/v3 and /identity_admin/v3.

[1] https://review.openstack.org/#/c/456344/

Change-Id: I5d69e7454cf8a5e8c92ff23b6c932184d82e8a98

devstack: Allow access to ports 80 and 443

So far, we were allowing access to port 5000 for keystone.
When devstack siwtched to uwsgi we couldn't access keystone
anymore.

Co-Authored-By: Spyros Trigazis <strigazi@gmail.com>
Change-Id: I4d3d482889fd9f6119ceec81757abac9d1251a97
2017-04-27 04:22:55 +00:00
Spyros Trigazis 2910809fab ci: Rename ssh key
For multinode jobs a key with the default name id_rsa already
exists. Add a key for magnum named id_rsa_magnum.

Co-Authored-By: yatinkarel <yatin.karel@nectechnologies.in>
Change-Id: I343e27a6e7311d7d0033bc089293f945c3af2ef8
2017-03-27 17:40:49 +02:00
trilliams 3a9e8cfb40 Glance v1 is deprecated and removed in devstack [1]
With this patch we will use glance v2 api's for interacting
with glance.

[1] I7f962a07317cdad917ee896d79e49ee18938d074

Closes-Bug: 1672535

Change-Id: Iedc25b55ad2751e14d3794b1cb80f724f1a735c4
2017-03-14 16:51:08 +05:30
Mathieu Velten 287f794013 CI: Increase master-flavor size
One limitation that we might be facing when try to run large
containers like hyperkube is is the size of the master node
flavor. Increase the master flavor memory to 1024 mb.

Change-Id: Ie095d8de290343dc995fbcd88445509cc36579bc
2017-01-11 16:38:26 +01:00
prameswar 5cd4ade6ef used openstack cli in magnum devstack plugin
Currently magnum CI tests(magnum/tests/contrib/post_test_hook.sh) uses
python clients(nova,neutron, glance) for openstack operations.
We should start using openstack client instead.

Closes-Bug: #1653875

Change-Id: I00aab79ccf3e267be77115a8847d72c8f6e32075
2017-01-07 04:58:49 +00:00
Jenkins 6db2ab0568 Merge "functional: don't create flavors if ironic testing" 2016-12-07 18:51:51 +00:00
Eli Qiao 2aebf8a66e functional: don't create flavors if ironic testing
For ironic driver functional testing on gate only a flavor named
"baremetal" is required which is already created by ironic devstack. So,
creation of flavors "m1.small" and "s1.small" should be skipped for
ironic driver functional testing.

Change-Id: Ia8643f9c041f91dcb08ab8b6011be7be1fdf0311
2016-12-06 07:16:22 +00:00
Spyros Trigazis 1f81a4e5df Use keystone v3 for functional tests
* Update functional_creds.conf.sample
* and functional_creds.conf in post_gate_hook
* Update python_client_base to use keystone v3 credentials
* Get magnum_url from magnum.conf

Closes-Bug: #1474152
Change-Id: If1ce6e77396857fef68c5c288f0b1c7fecb0b4d4
2016-12-05 15:21:09 +01:00
maliki 07f9e027d5 Add insecure option in functional tests for SSL endpoints
This patch fixes the issue when functional tests are run
against a deployment that has https based endpoints.
The insecure option is not being passed when initiating
magnumclient or keystoneclient as a result we get SSL
error.

Change-Id: I35525917b96b64e57c984924c72b3c696949f67f
Closes-Bug: #1640341
2016-11-09 21:49:11 -08:00
Hongbin Lu 31d04e312d Update name of ubuntu-mesos image
Update the gate and docs to use "ubuntu-mesos-latest" instead of
"ubuntu-14.04.3-mesos-0.25.0.qcow2". The intent is to make the
image upgrade easier (by using a static image name). In fedorapeople,
a soft link was created from "ubuntu-mesos-latest.qcow2" to
"ubuntu-14.04.3-mesos-0.25.0.qcow2"

Change-Id: I544773d184e5436843595dbfd9ab118b99870281
2016-09-21 14:14:31 -05:00
Jaycen Grant 729c2d0ab4 Rename Bay DB, Object, and internal usage to Cluster
This is patch 3 of 3 to change the internal usage of the terms
Bay and BayModel.  This patch updates Bay to Cluster in DB and
Object as well as all the usages.  No functionality should be
changed by this patch, just naming and db updates.

Change-Id: Ife04b0f944ded03ca932d70e09e6766d09cf5d9f
Implements: blueprint rename-bay-to-cluster
2016-09-08 13:01:12 -07:00
Thomas Bechtold 52224c5c09 Simplify test_create_list_sign_delete_clusters() tempest test
The test needs a valid CSR which was created in the devstack post_test_hook
in a static way (always the same CSR).
This commit simplifies the process and just adds the CSR to the test itself
so that the CSR string can be used to check the CSR. That way there is no need
to provide a file with the CSR content and point the tempest configuration
via the "csr_location" parameter to that file.
So the "csr_location" parameter is now deprecated for removal.
Also remove the unused "invalid.csr" which was also created in the
post_test_hook.

Change-Id: I907130576cfb59267643b4639681331acfcfa07f
2016-08-22 10:56:43 +02:00
OTSUKA, Yuanying 83e0d8d32b Add functional test for k8s ironic
This patch adds functional test for k8s ironic, and modify
utility scripts for gate jobs.

Partial-Implements: blueprint magnum-baremetal-full-support
Change-Id: I8d68711af9d90e4a52901765e7daf97bc2851125
Co-Authored-By: Spyros Trigazis <strigazi@gmail.com>
Co-Authored-By: OTSUKA, Yuanying <yuanying@fraction.jp>
2016-08-09 11:30:04 +02:00
Hongbin Lu c52e5bea06 Add tox test for k8s coreos bay
* Add a CoreOS test class TestCoreosKubernetesAPIs
* Add a CoreOS test environment in tox.ini
* Create a base class BaseK8sTest and move OS-agnostic k8s testing
  code to that class.
* Increase the disk size from 8G to 10G for m1.magnum and s1.magnum,
  since CoreOS image requires more disk space to boot.
* Set os-distro property for CoreOS image.

Partial-Bug: #1546101
Change-Id: Ie56a9442ecebe05f39c7669bc950f5a6ca11df33
2016-05-09 02:36:26 +00:00
Dane LeBlanc 9712370357 Functional tests should support DNS nameserver config
The Magnum functional tests currently use a DNS server setting of
8.8.8.8 when configuring nodes in a cluster. In some environments,
this DNS server setting doesn't work. When this is the case, and
functional tests are run locally, bay creation times out and the
functional tests fail.

This patch enhances the functional tests to allow configuration of
DNS nameserver to be used in baymodels that are created in
functional tests.

Change-Id: I958d199565ae5741dd6f4b8764e51ea16a8d505b
Closes-Bug: #1570543
2016-04-15 11:39:36 -04:00
Corey O'Brien 32f917c8d7 Switch to Atomic 23
Change the devstack image to the default Atomic 23 image.
Update templates not to rely on interface naming because the names
changed between Atomic 21 and Atomic 23 images.
Add a functional test to validate minion node registration.
Update docs to refer to a generic Atomic image.

Co-Authored-By: Hongbin Lu <hongbin.lu@huawei.com>

Implements: blueprint atomic23
Change-Id: Id67244e3f452b3c7c3c46fdabcca3a5c141a76c0
2016-04-02 18:17:42 -04:00
Yolanda Robla 2471fa66c6 Allow to parameterize image name in tests
Add the ability to pass an image name using an env
var, to provide more flexibility on image testing.

Change-Id: Iddb2ab3efb5746a070e147ccc2180915c788c5c2
2016-03-21 22:24:21 +01:00
Eli Qiao 9862c2571d Functional: Remove unused log copying
This isn't logs directory in ../ anymore.

Change-Id: I439cbfaf40bc956293de3b5abf506763a630b5a9
2016-03-15 10:44:39 +08:00
Deeksha c171aa12b6 Rename flavor name used in gate tests
A better description than magnum2 would be helpful as
we are creating a smaller vm.
So renamed m1.magnum2 to s1.magnum to indicate its a slave flavor.

Change-Id: Ibd74931e0b5b2ac98dc960b31aa2b64a721200ea
Closes-Bug: #1543338
2016-03-12 11:18:59 +05:30
Kai Qiang Wu(Kennan) 4a99d9277c Fix the jenkins run script
We need to source related to get global defined var for
requirements. and need related -H, details can be checked
in bug, it has related error message, and clear to understood.

Change-Id: Id5c71c524ae4b942026b8c670bb33a3c807227d9
Closes-Bug: #1551100
2016-03-01 02:23:24 +00:00
dimtruck 7d524491c8 Copy logs on test failure
This patch will copy logs from nova servers to local environment
on test failures.
Don't delete bays until teardown so log gathering will work.
Give functional test types a common base.

Added timeout to docker ps; else, the command would time out,
failing to run the rest of the tests.

Closes-Bug: 1542390
Change-Id: I016ed8fe311bede407f57b7982126c4b77749bec
Co-Authored-By: Corey O'Brien <coreypobrien@gmail.com>
2016-02-29 10:25:10 -06:00
dimtruck 6ccda1ad10 Add magnum certificate api tests
This patch will add cert API test for signing and showing
certificates.

The tests for certificates are integrated into test_bay
tests in order to reuse an already existing bay for
cert testing.  As a side effect, this patch also
combines update bay test with create, list, and delete
to minimize the time spent waiting on bay create.

Implements: blueprint magnum-tempest

Change-Id: Ifbb4c779376fa401ca2538aba5097f7af8b4973e
2016-02-12 09:47:41 -06:00
Hongbin Lu dca02f1d98 Reduce memory consumption of gate tests
Recently, the gate jobs took too long to complete (between 2 to 8
hours). The reason is jenkins slave agent die during the test, which
cause the CI to re-start the whole test in a new VM.

The failure mainly occurred at magnum-api pipeline, but also occurred
at other pipelines. In term of distribution of test nodes, this
failure mainly occurred at OVH nodes, in which there is no dedicated
swap device. As a result, at OVH nodes, local disk is used for swap
when memory is over-consuming. It looks this leads to resource
starvation, which cause the failure.

This patch attempted to reduce the memory consumption of the gate
tests. In the api test, the number of worker nodes was reduced from
2 to 1. In all tests (api/k8s/swarm/mesos), the memory of worker node
was reduced from 1G to 512M.

Closes-Bug: #1542386
Change-Id: If7822d07f95ebc935a8763b92f038f10cf07b5ca
2016-02-09 14:05:19 -05:00
dimtruck ff3ec16ca7 Use keystone v2.0 in gates
There was a recent patch to devstack that defaults all services
to use keystone v3.  We are still on keystone v2 in our gates so
we need to explicitly update back to v2.0

Closes-Bug: 1539764

Change-Id: I1fbe128f64e543973bd47f0ca2e5535453ad9186
2016-01-29 15:03:46 -06:00
dimtruck 5dc3211b71 Swithc to using dynamic credentials in tempest tests
Switch to using DynamicCredentialProvider, which
provides a unique non-admin user per test case, making
it possible to functional test in parallel.

Change-Id: I6bb5d493bb01d0dd2b4cd092f87f111b13b1fe02
2016-01-05 16:35:20 -06:00
dimtruck 51ed8c4633 (Quick-Fix) Adds back tempest identity back to gate
Please merge this only if patch 263557 doesn't work.
This patch reverts back necessary changes from
https://review.openstack.org/#/c/256164 to temporarily
unblock the gate.  Once the dynamic credentials patch
is completed, this patch can be reverted.

Change-Id: I79450810b7e43ba6fe150d3acbd998675d675593
2016-01-05 18:14:03 +08:00
Eli Qiao 69a4f5345e Functional: Add mesos functional bay creation basic testing frame work
This patch adds functional testing case for mesos bay creation testing.

1. Add gate_hook.sh to set MAGNUM_GUEST_IMAGE_URL to use ubuntu image
2. Modify post_test_hook to use ubuntu image when doing functional
testing
3. Add new tox env entry to do mesos functional testing.

Partially implements: blueprint mesos-functional-testing
Change-Id: I8ee53de4d34aa79d037901e599fc6409a7de2e72
2016-01-02 10:18:28 +08:00
dimtruck 63de8e5540 Migration to utilize tempest plugin
This is a migration step to utilize tempest plugin
system instead of directly calling functional api tests.

This is the approach used by a number of other projects as well
as an approved process by openstack-qa.

The difference in execution is that we will need to execute tempest's
tox instead of our own:

tox -eall-plugin magnum.tests.functional.api.v1 --  --concurrency=1

Implements: blueprint magnum-tempest
Change-Id: Ic3eadae7fb5d88b776f9ded9589ef25279a2e1be
2015-12-22 22:53:35 -06:00
Jenkins 6f2cfe9bc2 Merge "Gate: Attempt to fix a memory allocation error" 2015-12-22 02:10:50 +00:00
Hongbin Lu 958e63341a Gate: Attempt to fix a memory allocation error
This random error is due to the different swap space at different
test hosts. In particular, there is a provider who provides VMs with
0 swap space, while other providers provide VMs with 8G swap space.
As a result, Magnum jobs failed at VMs with 0 swap space.

This commit reduces memory consumption of Magnum jobs by reducing the
bay node flavor from 2G to 1G. I consider this as a temporary fix.
A permanent fix should be from infra side to make the swap space
consistent across test nodes.

Partial-Bug: #1521237
Change-Id: Ia043fab1f7665f7299e4094634e02c42b43dcce1
2015-12-21 09:56:20 -05:00
Hongbin Lu 9afd7790cf Gate: Fixed an empty service catalog error
After python-novaclient upgrade from 2.X to 3.X, the gate started
failing with the error below:

nova keypair-add --pub-key /home/jenkins/.ssh/id_rsa.pub default
ERROR (EmptyCatalog): The service catalog is empty.

This commit temporarily works around it by unseting OS_AUTH_TYPE
variable.

See: https://bugs.launchpad.net/python-keystoneclient/+bug/1519624

Change-Id: Ie194c5b4e3555572eba61767621e53b0b06b9ece
Closes-Bug: #1528059
2015-12-20 17:41:41 -05:00
Hongbin Lu 035a07fe4d Record diagnostic info from bay nodes
In functional tests, copy logs from bay nodes to host before the
tests tear down. The bay node logs could be helpful for
trouble-shooting.

Change-Id: I102d2ce37c2253c743719e4ccf978c23a92a3a3f
2015-11-23 17:14:21 -05:00
Jenkins cc6ec5b06e Merge "Save functional testing files after testing done." 2015-11-16 03:08:47 +00:00