Commit Graph

131 Commits

Author SHA1 Message Date
Michal Nasiadka ed699b0c9a Drop k8s_fedora_atomic_v1 driver
Change-Id: I3551ae244ecf99f67a9b142c964c020a5fae70a3
2024-02-27 16:35:35 +00:00
Michal Nasiadka fa5aa8f625 Drop k8s_fedora_ironic_v1 driver
Change-Id: Ic7114e5923b74a4202a043388701826b4e47326e
2024-02-05 08:14:56 +00:00
Michal Nasiadka 5c0c27807a Drop k8s_coreos_v1 driver
Change-Id: I64884677cf05c59c64988dfbee9bf22e97a3466b
2024-02-05 07:04:05 +00:00
Michal Nasiadka bc79012f46 Drop Swarm support
Label validator function has been left behind, although it's not
checking for anything right now - might be useful in future.

Change-Id: I74c744dc957d73aef7556aff00837611dadbada7
2024-01-24 13:20:21 +13:00
guilhermesteinmuller 6e8657912c Drop Mesos code
The coe mesos has not been maintained for quite some
time and hasn't got much attention from the community
in general. As discussed in the mailing list [1] we
are dropping for now.

[1] http://lists.openstack.org/pipermail/openstack-discuss/2021-December/026230.html

Co-Authored-By: jake.yip@ardc.edu.au

Change-Id: Ie7de9a37bfad6214f52d0605409e74d62a51df47
2023-03-07 14:02:05 +11:00
Spyros c1c9942f8b fcos-k8s: Update to v1.22
* change rbac.authorization.k8s.io/v1beta1 to v1
  * update metrics-server
* change storage.k8s.io/v1beta1 to v1
* drop kubelet-https
* update to FCOS 35

story: 2009828
task: 44416

Signed-off-by: Spyros <strigazi@gmail.com>
Change-Id: I24b89366a4a8e8bc4c90f6a85ef6de2ac77dae1d
2022-02-03 13:59:32 +00:00
Ghanshyam Mann 3b7a33eb64 [goal] Deprecate the JSON formatted policy file
As per the community goal of migrating the policy file
the format from JSON to YAML[1], we need to do two things:

1. Change the default value of '[oslo_policy] policy_file''
config option from 'policy.json' to 'policy.yaml' with
upgrade checks.

2. Deprecate the JSON formatted policy file on the project side
via warning in doc and releasenotes.

Also replace policy.json to policy.yaml ref from doc.

[1]https://governance.openstack.org/tc/goals/selected/wallaby/migrate-policy-format-from-json-to-yaml.html

Change-Id: Icfd9e2a75d8fdfb24cbd1c850f498aadee91f543
2021-03-08 15:11:01 +00:00
Bharat Kunwar 76502dd57d [ci] Use magnum-tempest-plugin-tests-api
This commit drops magnum-functional-api (which uses legacy-dsvm-base due
to be removed in the V cycle) in favour of
magnum-tempest-plugin-tests-api defined in the magnum-tempest-plugins
repo (which uses the new devstack-tempest job recommended for running
Tempest tests in Zuul v3) for API Tempest tests.

Story: 2007561
Task: 39443

Depends-On: https://review.opendev.org/#/c/721077/

Change-Id: I91446f8773ecec1286c9913c3fff688bd8d9a087
2020-04-21 19:52:32 +00:00
Bharat Kunwar 9fedb8fe43 [ci] Use Fedora CoreOS image for devstack plugin
Story: 2007561
Task: 39478

Depends-on: https://review.opendev.org/#/c/721213/

Change-Id: I05caa60fd0180e20003f876fd439b6f421e50ff3
2020-04-21 19:52:14 +00:00
Feilong Wang 703de97cd4 Using Fedora Atomic 29 as default image
Fedora Atomic 27 has end of life for a while, it's time to replace it
with Fedora Atomic 29 now.

Task: 36356
Story: 2006441

Change-Id: Iab131745854b0b908be17bd17c7510cd54dde1f5
2019-08-24 09:37:35 +12:00
Ian Wienand ae6933ffce Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: Ie288c147a3cbdd19abd257bf14972c316db6d67c
2019-03-24 20:34:05 +00:00
Jim Bach 6c61a1a949 k8s_fedora: Use external kubernetes/cloud-provider-openstack
* Use the external cloud-provider [0]
* Label master nodes
* Make the script the deploys the cloud-provider and clusterroles
  for the apiserver a SoftwareDeployment
* Rename kube_openstack_config to cloud-config,
  for cinder to workm the kubelet expects the cloud config name only
  like this. Keep a copy of kube_openstack_config for backwards
  compatibility.

Change-Id: Ife5558f1db4e581b64cc4a8ffead151f7b405702
Task: 22361
Story: 2002652
Co-Authored-By: Spyros Trigazis <spyridon.trigazis@cern.ch>
2018-12-19 10:56:47 +01:00
Zuul 36e64fad69 Merge "functional: bump flavor specs" 2018-12-14 22:30:12 +00:00
Mohammed Naser 844e4db2a9 functional: stop using concurrency of 1 for api tests
There is no need for API tests to be running with concurrency of
one, we can drop that and speed up the API test suite by using
all of our cores.

Change-Id: Ideb379ba7032e83bde852198fc66ccd623ae1424
2018-12-12 09:45:57 +00:00
Mohammed Naser 98fcd79430 functional: bump flavor specs
We have VMs with 8 cores and 8GB of memory, this patch makes better
use of them by adding more cores (which shouldn't have much of a
negative impact) as CPU is not fully used during test runs.

This should hopefully improve performance of the functional tests.

Change-Id: Ib79a8c83758628286c68e941024de5bc2741b088
2018-12-09 00:35:33 -05:00
Mohammed Naser d16479709a functional: bump atomic version to latest
This patch brings the Fedora Atomic version used in gating to
the latest one which includes some improvements alongside a newer
version of Docker (which seems to run things better overall).

Change-Id: Iad0a1f57b29aec9a0cdb2a104fdaa5970133cfb4
2018-12-08 22:16:42 -05:00
Erik Olof Gunnar Andersson 718cb9c9b4 Add support for www_authentication_uri
We do currently not support www_authentication_uri at all, which
is the new standard, as auth_uri has long been deprecated.

* Make sure we support both auth_uri and www_authenticate_uri.
* Switched to www_authenticate_uri for devstack.
* Fixed a bug where a bad exception would be thrown if auth_uri
  was not set.
  
Story: 2004271
Task: 27819

Change-Id: Ibc932d35f3d6ba2ac7ffb6193aa37bd4a3d4422e
2018-11-06 17:13:10 +00:00
Julia Kreger 547f9309a1 Minor fixes to re-align with Ironic
Ironic has evolved and a few items were no longer correct
in the contributed scripts for use with ironic.

Additionally a database workaround was fixed, and as such
commented out.

Change-Id: I105791985973e8348d43d41982ac7ba3e0cf970c
2018-10-23 09:34:51 -07:00
Spyros Trigazis d95ba4d1ff Run etcd and flanneld in a system container
In Fedora Atomic 27 etcd and flanneld are removed from the base image.
Install them as a system containers.

* update docker-storage configuration
* add etcd and flannel tags as labels

Change-Id: I2103c7c3d50f4b68ddc11abff72bc9e3f22839f3
Closes-Bug: #1735381
2018-02-22 12:30:27 +00:00
yatin 553316e40f Fix: functional CI Jobs
After [1] jobs are return false(SUCCESS) status due
to wrong EXIT_CODE.
After [2] kubernetes client is updated to v4.0.0 and
no longer contains ConfiugrationObject so we need create
instance of Configuration class.

Also don't use local to create variable as local
 can only be used in a function.

[1] https://review.openstack.org/#/c/526618/
[2] https://review.openstack.org/#/c/528406

Change-Id: Ida5aac40b234a358b2a13b2e51a41d0242031ebb
2018-01-11 12:50:25 +00:00
Zuul 3a5997eef2 Merge "Remove intree magnum tempest plugin" 2017-12-27 05:20:52 +00:00
Spyros Trigazis 273405cb5a Leverage heat-container-agent for monitoring
Use the heat-container-agent from a system container.
It means that the docker daemon can be started later.

Pass as a software deployment with the heat-agent the following
software-configurations:
* prometheus-monitoring
** pin prometheus to v1.8.2 since its config is not 2.0.0
   compatible

Add heat-container-agent container image.

Implements: blueprint heat-agent
Related-Bug: #1680900
Change-Id: I084b7fe51eddb7b36c74f9fe76cda37e8b48f646
2017-12-17 16:35:50 +00:00
Chandan Kumar 53fa3accea Remove intree magnum tempest plugin
* It removes magnum tempest plugin reference in favour of using
  newly magnum-tempest-plugin.
* We removed tempest tests resides under functional.api.v1.test-*
  files as they are tempest tests and keeping the rest as they are
  used by functional tests.

Depends-On: Ibdddd26da9cfb0d08c2977660320b2c052d7261b
Change-Id: Ida2fa1ef5880ebead787e3b27ac7ebf5aa498f62
2017-12-14 15:48:47 +05:30
yatin 0b49f38069 Migrate to Zuul v3
Change-Id: I0d5d6a9038c9a150a74df955bccb3f9ed263b736
2017-10-10 14:29:04 +00:00
Mathieu Velten d003e80a3a Launch k8s scheduler & controller-manager as system containers
Following up of https://review.openstack.org/#/c/487357

Depends-On: I22918c0b06ca34d96ee68ac43fabcd5c0b281950
Implements: blueprint run-kube-as-container

Change-Id: I9a7d00cddb456b885b6de28cfb3d33d2e16cc348
2017-08-22 14:01:43 +02:00
Spyros Trigazis 4fb91cc109 tests: Use swarm-mode for api tests
* Swarm-mode is the fastest cluster to deploy since it doesn't
  require to pull anything from outside.
* Add the output nodes for swarm-mode too.
* Disable copy logs (I think a better practice is to copy logs
  on demand).
* Don't run test_create_list_sign_delete_clusters, because it is
  very unstable on the CI.

Partially-Implements: blueprint swarm-mode-support

2nd commit message:

Update to Fedora Atomic 26

This patch moves the current master to test against Fedora Atomic 26,
in addition, it switches to downloading from Fedora mirrors.

2nd-Change-Id: I9a97c0eb78b2c9d10e8be1501babb19e73ee70c1

3rd commit message:

Set default iptables FORWARD policy to ACCEPT

With the release of Docker 1.13 which is available in Fedora
Atomic 26, it no longer sets the policy of the FORWARD chain
to ACCEPT[1].  Therefore, CNI networking such as Flannel will
cease to work.

This patch sets the policy to ACCEPT so that traffic can work
once again for deployments which are based on Docker versions
which are newer than 1.13

[1]: https://github.com/moby/moby/pull/28257

3rd-Change-Id: I1457602748619f38f87542fc01a2996ee80e58b7
Closes-Bug: #1708454

Co-Authored-By: Mohammed Naser <mnaser@vexxhost.com>
Change-Id: I86d4dcc94fff622be4ee2acc8dd60ed81bc5d433
2017-08-21 05:30:09 +00:00
yatin 8623776813 Copy service configurations also
This will help in verification of configuration and
troubleshooting ci failures

Change-Id: I81484c507781a8c96f95bc19f7afc591bc01827b
2017-08-16 09:50:07 +00:00
Jenkins a64e8ec4f8 Merge "[Fix ironic gate] Use IP_VERSION=4 in devstack local.conf" 2017-07-19 12:10:26 +00:00
Spyros Trigazis b4386f83ad Add swarm-mode driver
* add swarm-mode config
* remove etcd, flannel, discovery_url, swift_registry
* add swarm-mode COE obj
* add functional test, create cluster, create/remove
  service and delete cluster.

Co-Authored-By: ArchiFleKs <kevin.lefevre@osones.io>
Implements: blueprint swarm-mode-support
Change-Id: Iba177be167cb3a3866441d5f42670171f26c5a86
2017-07-18 10:47:23 +02:00
yatin 4b9e8db8a5 [Fix ironic gate] Use IP_VERSION=4 in devstack local.conf
Ironic to work with magnum, requires devstack to be
configured with IP_VERSION=4.

Change-Id: I263373db15bff77405d7509e0d1f94316c4f0cfd
2017-07-17 06:58:37 +00:00
Jenkins e1c9e15e3d Merge "ci: Remove *_ssh ironic drivers" 2017-07-14 15:50:19 +00:00
Yasemin Demiral bd46372093 Use 'sudo' to access /etc/sysconfig/heat-params
The patch https://review.openstack.org/#/c/437048/ changed the
permission of /etc/sysconfig/heat-params to 600, so non-file owners
would require use of 'sudo' in order to access the file. This patch
fixes it

Closes-Bug: #1704076
Change-Id: I8bb4a12deb92fa5035bbbb8fc6ce4736ed99ea78
2017-07-13 13:27:20 +03:00
Spyros Trigazis 4fdee1f6c4 ci: Remove *_ssh ironic drivers
Mitaka branch is EOLed. The Ironic team is going to proceed with
removal of SSH-based power and management drivers for virtualized
HW which were deprecated back in newton release.

http://lists.openstack.org/pipermail/openstack-dev/2017-July/119284.html

Change-Id: I7351573a20f3835f481ab1973b6439d8ca2b8f60
2017-07-06 11:04:16 +02:00
Jenkins 8ac9ce828a Merge "Ignore: Try pxe_ipmitool since vbmc is used" 2017-05-20 19:20:35 +00:00
yatin ecded75c32 Ignore: Try pxe_ipmitool since vbmc is used
k8s-ironic jobs are failing since long, pxe_ssh is deprecated,
so try pxe_ipmitool.

Change-Id: I48ba8ba4d10a616eb7b482e48ed4a83c3d0acf09
2017-05-19 17:15:17 +05:30
yatin 34efcdfcaf Use 'virt_type=kvm' in devstack vm if supported
If the devstack vm supports nested virtualization we should
use it.
This can done using by setting: DEVSTACK_GATE_LIBVIRT_TYPE=kvm.
This will increase the performance in gate jobs.

Change-Id: I2439de036dfec2ada3c92c2d4b71c73b5f41a518
2017-05-17 21:37:20 +05:30
Spyros Trigazis 1aa638903c CI: multinode job with larger flavors
Set cluster node flavors to:
* ram: 3750
* disk: 20
* vcpus: 2

Change-Id: I1eb2487e16866fa1ae26943dbeca0380eb10e947
2017-05-09 15:41:50 +00:00
yatin 530d225fcd Fix keystone auth_uri and auth_url
Post [1] we cannot use auth_uri/auth_url containing :5000, :35357.

Update keystone auth_uri and auth_url in magnum.conf to connect
with keystone using /identity/v3 and /identity_admin/v3.

[1] https://review.openstack.org/#/c/456344/

Change-Id: I5d69e7454cf8a5e8c92ff23b6c932184d82e8a98

devstack: Allow access to ports 80 and 443

So far, we were allowing access to port 5000 for keystone.
When devstack siwtched to uwsgi we couldn't access keystone
anymore.

Co-Authored-By: Spyros Trigazis <strigazi@gmail.com>
Change-Id: I4d3d482889fd9f6119ceec81757abac9d1251a97
2017-04-27 04:22:55 +00:00
Jenkins de8567d054 Merge "Update Fedora images" 2017-04-12 11:00:39 +00:00
Spyros Trigazis 2b83962cad Fix gate: Revert mesos image to ocata
Revert the ubuntu-mesos to ocata to unblock the mesos job.

Change-Id: I145e0e15dc93923b93144682839e8fa9d24772db
2017-04-06 18:24:21 +02:00
Spyros Trigazis c5a4a18104 Update Fedora images
New release of Fedora Atomic [1].
The new release of Fedora Ironic includes the same
packages.

Main changes:
Kubernetes 1.5.3
etcd 3.1.3
Plus several fixes and version bumps.

Add :Z when mounting certs in the swarm containers to set
selinux labels properly.

[1] http://www.projectatomic.io/blog/2017/03/fedora_atomic_mar28/

Closes-Bug: #1677664

Change-Id: I2539ae83401db5b34716ebd4bbdfbe288f5c768b
2017-04-03 08:52:12 +02:00
Spyros Trigazis 2910809fab ci: Rename ssh key
For multinode jobs a key with the default name id_rsa already
exists. Add a key for magnum named id_rsa_magnum.

Co-Authored-By: yatinkarel <yatin.karel@nectechnologies.in>
Change-Id: I343e27a6e7311d7d0033bc089293f945c3af2ef8
2017-03-27 17:40:49 +02:00
trilliams 3a9e8cfb40 Glance v1 is deprecated and removed in devstack [1]
With this patch we will use glance v2 api's for interacting
with glance.

[1] I7f962a07317cdad917ee896d79e49ee18938d074

Closes-Bug: 1672535

Change-Id: Iedc25b55ad2751e14d3794b1cb80f724f1a735c4
2017-03-14 16:51:08 +05:30
yatinkarel bfa10bf202 Fix: mesos gate tests
Recent change in Infra [1] makes use of local.conf instead of
localrc. Use DEVSTACK_LOCAL_CONFIG to pass the MAGNUM_IMAGE_URL.

[1] https://review.openstack.org/#/c/326585/

Change-Id: I0426cd0aba64a3f4cc595a0919320adbbc86d5f0
2017-02-24 09:55:30 -05:00
Jenkins f7386549dc Merge "[k8s] Get logs of controller-manager and scheduler" 2017-02-10 09:35:49 +00:00
Spyros Trigazis 0d58cf4dbe [mesos] Use latest build for mesos image
After changes in the heat-agents [1] the auth calls of the nodes
to heat were failing. The mesos image that was used was missing
chnage [1].

Update to ubuntu-mesos daily builds.

[1] https://review.openstack.org/#/c/397232/1

Closes-Bug: #1662280
Change-Id: I06ab3f7a92f06a7eddf297c5ecd2bf2e35f3728b
2017-02-06 19:00:21 +01:00
Spyros Trigazis d4effea503 [k8s] Get logs of controller-manager and scheduler
Get the pod logs for controller-manager and scheduler.

The current copy logs from journalctl because controller-manager
and scheduler used to be managed by systemd.

Change-Id: I1e4e5a810f838cc59d4a4aaa4fc4478541872b0b
2017-01-30 15:06:58 +01:00
Spyros Trigazis d2532a3af2 Upgrade to Fedora 25
Atomic image contains:
kubernetes-1.5.2-2.fc25.x86_64
docker-1.12.6-5.git037a2f5.fc25.x86_64
flannel-0.5.5-8.fc25.x86_64
etcd-3.0.15-1.fc25.x86_64

The ironic image contains exactly the same packages.

* For this upgrade the upstream image is used, which is
  uploaded here [1].
* Minor changes for flannel and docker-storage-setup
  were needed.
* The image will be built in the CI and uploaded to
  tarballs.openstack.org as soon as possible.
* Ironic image [2].

Notes:
* docker-storage-setup config changes were needed because in
  the previous images it was disabled and it was started by us.
* We can have selinux enables in containers since the images
  have kernel 4.9.x.

[1] https://fedorapeople.org/groups/magnum/fedora-atomic-25-latest.qcow2
[2] https://fedorapeople.org/groups/magnum/fedora-25-kubernetes-ironic.tar.gz

Change-Id: Iac6e30c530821a49a5c3978e335e0b1d56a576e0
2017-01-26 15:40:34 +01:00
Mathieu Velten 287f794013 CI: Increase master-flavor size
One limitation that we might be facing when try to run large
containers like hyperkube is is the size of the master node
flavor. Increase the master flavor memory to 1024 mb.

Change-Id: Ie095d8de290343dc995fbcd88445509cc36579bc
2017-01-11 16:38:26 +01:00
prameswar 5cd4ade6ef used openstack cli in magnum devstack plugin
Currently magnum CI tests(magnum/tests/contrib/post_test_hook.sh) uses
python clients(nova,neutron, glance) for openstack operations.
We should start using openstack client instead.

Closes-Bug: #1653875

Change-Id: I00aab79ccf3e267be77115a8847d72c8f6e32075
2017-01-07 04:58:49 +00:00