Commit Graph

68 Commits

Author SHA1 Message Date
jh629g 4b3bfbd550 Retire Ranger from OSH-Addons
Ranger is beginning the process
of retirement in openstack, and
will be removed from OSH as a
result.

Change-Id: I4844964c4edbde935de47dad3f689ffa89671ccc
2021-06-29 10:57:08 -05:00
jh629g c7816d8397 Complete removal of SSH data in Ranger
Ranger has not used SSH since the
project finished conversions to
python 3.6. The data below is to be
removed, barring user_home and
retry_limit as they are values
which have been co-opted by other
parts of the ranger/ranger-agent
codebase.

Change-Id: If7cd18ddd6f266d58a10bfabd202f9daa4a518bf
2021-01-28 19:17:40 +00:00
jh629g c814dd5dc6 Update Ranger Null Values
Further null values found by helm v3
in openstack-helm-deployments must
be turned into empty strings instead

Change-Id: I83be4bbfd87add83a72f655e8b326250ef6383c9
2021-01-14 22:41:47 +00:00
jh629g 5d237b4a87 Update Source for Ranger-Agent
Source was set as openstack-helm
rather than openstack-helm-addons,
which is the location that ranger-agent
charts live. This should correct an
issue currently being experienced
in openstack-helm-deployments patchset:
https://review.opendev.org/764492

Change-Id: I0217fde2ee0741b6b40462e30cffc99583d6c2dc
2020-12-10 08:29:02 -06:00
Chi Lo fc9b28b3e2 Removed hooks from annotations
The add-region job/pod does not need to tie with the post-install
or post-upgrade hooks. In addition, hook-delete-policy is not needed
since this resource is not created by a hook. Job deletion prior to
upgrade is already being taken care of in values.yaml.

Change-Id: Ib22cce350e82986d0f51c7bca2be0ee5a01c36a9
2020-10-09 14:50:47 +00:00
Chi Lo 7963190677 Reduce resource creation wait time
Change-Id: I8ea7a520e7261fc83afc94bde215f5e6b083c7f6
2020-09-30 17:30:26 +00:00
Andrii Ostapenko b6a94835a3
Change helm-toolkit dependency version to ">= 0.1.0"
Since we introduced chart version check in gates, requirements are not
satisfied with strict check of 0.1.0

Change-Id: I6e0a3b301392e82231a2081859ca4d380a0138d8
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-09-29 13:12:55 -05:00
KHIYANI, RAHUL (rk0850) 5e993fbb20 Add headers to nginx ingress containers
Added X-XSS-Protection header to nginx ingress containers
Enable X-Frame-Options DENY header in nginx

Also Fix chart lint errors

Change-Id: I2b696fffd13518aa9f423f6d8624a279726c60ca
2020-09-24 16:22:39 -05:00
Zuul 237915c779 Merge "Fix chart lint errors" 2020-09-16 22:58:24 +00:00
okozachenko 0945d57d27 Fix chart lint errors
Change-Id: Ifda0b64f7319f0885568a8848ee809af7b581014
2020-09-16 21:07:10 +03:00
Chi Lo 743f15efbc Create region retries when Ranger server not available
Change-Id: Ice06d39e465fa70593920d5bf7b18d1a427dadbf
2020-09-15 22:18:07 +00:00
Chi Lo 7e211a6366 Enable TLS for Ranger Agent services call to Openstack Services
This patch enables TLS for Ranger Agent services so that internal
call from Ranger Agent services pods to Openstack services such as
keystone, heat, and mariadb utilizes TLS.

Change-Id: I8a548ff435e8b87783a50c5ce82b5931a3d76a22
2020-08-06 23:24:52 +00:00
Andrii Ostapenko 815deeaa2e Enable templates linting
- braces
- brackets
- colons
- commas
- comments
- hyphens
- indentation
- key-duplicates

with corresponding code changes.

Also disable document-(start|end) rule.

* Unrestrict octal values rule since benefits of file modes readability
  exceed possible issues with yaml 1.2 adoption in future k8s versions.
  These issues will be addressed when/if they occur.

Depends-On: https://review.opendev.org/739600
Change-Id: Ide884ed541898db2ba21a863aff0cea9ec3f75dd
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-13 17:28:42 +00:00
DODDA, PRATEEK REDDY 1e7cf7b447 Add missing security context to Ranger-Agent pods/containers
This updates the ranger-agent chart to include the pod
security context on the pod template.

This also adds the container security context to set
readOnlyRootFilesystem flag to true

Depends-On: https://review.opendev.org/740119/

Change-Id: I9fe5d96958805ae9634521604845411d904d8458
2020-07-08 23:55:17 +00:00
diwakar thyagaraj 6dc8ecaa2d [FIX] Fix ranger add-region pod.
Change-Id: I34f8869f2548521468c33a1b99f5bef259ac8117
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-06-26 21:25:33 +00:00
diwakar thyagaraj 5545e6ccda [Fix] Enable Apparmor to missing ranger-agent completed job.
Change-Id: I5b3b0b15eca56816695efe11219f61b05069256f
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-06-26 16:14:53 +00:00
diwakar thyagaraj 7b762a8e23 [FIX] Fix ranger-agent test pod
1)Update ranger-agent SHA to support bionic Images.
 2)Added heat deploy script for ranger deployment.
 3)Created seperate Jobs for ranger and mini-mirror apparmor.

Change-Id: Icecae5bd8f751508ef0417c8cc1a5e3959d44119
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-06-24 15:38:22 +00:00
dt241s@att.com 768722b1cf Enable Apparmor to Components in Addons
1)Added Apparmor Script andimoved apparmor configurations
to values-overrides to enable optional experimental Jobs.

2)Added Apparmor to mini-mirror,ranger,ranger-agent
 and sonobuy Components.

3)Moved apparmot
Change-Id: I9772d8425aa3d46e1fb0e1a6962ea999e77a6655
2020-06-17 19:30:06 +00:00
Zuul ce635602ea Merge "Enable yamllint rules" 2020-06-05 04:10:32 +00:00
Chi Lo 811e28419d Fix typo for location information
Change-Id: If7854028463b555b212a03d670e163eae2184a99
2020-06-04 10:49:42 -07:00
Chi Lo b1450140f1 Retreive Location information from new environment variables
Change-Id: Ifb075af88489ef85e45de001a495723f5443ad94
2020-06-04 16:13:03 +00:00
Andrii Ostapenko 4254e9a3ef Enable yamllint rules
- comments-indentation
- document-end
- document-start
- empty-lines
- new-line-at-end-of-file
- new-lines
- octal-values

Change-Id: I9cf4b60ee920b092c56cc54f331b6130955f93b8
2020-06-01 09:33:01 -05:00
Andrii Ostapenko c47a2b63c2 Enable yamllint checks
- brackets
- braces
- colon
- commas
- comments
- key-duplicates

with corresponding code adjustment.

Also removes x flag from yamls for ranger and ranger-agent charts.

Change-Id: I156b991ba6e17b6f9e1f128295362c0675afd8cc
2020-05-21 10:46:13 -05:00
Zuul 67c2dc7bfa Merge "Remove OSH Authors copyright" 2020-03-20 04:44:49 +00:00
Chi Lo ae112cb50b Use OS_REGION_NAME rendered in from secret
Change-Id: I3c4b9724c51a6bcd26f56ba38ef73f03538b7b8a
2020-03-13 09:11:38 -07:00
Chi Lo f098b84f68 Added labels to Ranger and Ranger-agent deployment files
Change-Id: Ifee84fc8a91a87fb5f0fc599bfacd6bd293ea676
2020-03-12 14:33:02 -07:00
Zuul fb32426e98 Merge "Enable Docker default AppArmor profile to Ranger-Agent" 2020-03-11 20:29:14 +00:00
Prateek Dodda dfb5f4e51f Enable Docker default AppArmor profile to Ranger-Agent
This adds default Apparmor profile to Ranger-Agent.

Change-Id: I795910892b7a331871e67ca3462929e3a93fd226
2020-03-11 12:38:42 -05:00
Chi Lo 0037691f53 Create a new job to call Ranger RMS service
This patch creates a new job which will call Ranger RMS service
post deployment.  The service call request Ranger to create a
region for the deployed site.

Change-Id: I03398453f579de5d2da5cf188b4779be527c3f5f
2020-03-11 09:32:09 -07:00
Gage Hugo 09b6e52c32 Remove OSH Authors copyright
The current copyright refers to a non-existent group
"openstack helm authors" with often out-of-date references that
are confusing when adding a new file to the repo.

This change removes all references to this copyright by the
non-existent group and any blank lines underneath.

Change-Id: I631ae4345f18fee70b380867ba8b33af5e3b3254
2020-03-02 14:01:56 -06:00
Chi Lo 771599d718 Add services dependency to ranger and ranger-agent helm test
Change-Id: Iaf049c4fe4b86aea31cba896015b73c495c71d0a
2020-03-02 17:10:26 +00:00
Chi Lo a56c788fa3 Made correction for url patch
This patch makes a correction to the url path used when making a
requests api call to ranger-agent-api pod.

Change-Id: I7b5db2dbbfade6ffec3bdb7e288bfa2197b57a65
2020-02-06 13:42:09 -08:00
Chi Lo cb8c4a9f07 Refactored ranger-agent-test pod
This patch refactor ranger-agent-test pod to use python
module. It also fixes incompatible issue with the old
script that failed pod test with updated ranger-agent pod.

Change-Id: Ied86a3d137d6cff206eecbff5c33b7c0d50f90fb
2020-01-29 10:10:45 -08:00
Zuul fef8b29c70 Merge "Remove ssh configurations" 2020-01-17 19:26:51 +00:00
hosingh000 80b8ec444a Remove ssh configurations
Newer versions (2.x) of Ranger is removing git repo support When
Older versions (1.x) still using it, this patch is to attempt to flag to
not use repo in case not supported repo and do cleanup

Change-Id: I36c36faa0be1f9e9ea4e5479e219dc14c205d853
2020-01-16 17:09:16 +00:00
hosingh000 7339119eb5 Supporting multipart request to allow file object
cgi  module was having issue https://bugs.python.org/issue27777
due to use of tempfile.TemporaryFile("wb") ranger_agent_api needed
readOnlyRootFilesystem: false

Change-Id: Ia010627c931ed2765ea7d95e183e69ade5ab8f25
2020-01-13 23:19:51 +00:00
Zuul b32b02211e Merge "Specify rabbitmq exchange for Ranger-agent queues" 2019-11-12 17:42:03 +00:00
Steve Wilkerson d6309100d7 Update kubernetes-entrypoint image reference
This updates the kubernetes-entrypoint image reference to consume
the publicly available kubernetes-entrypoint image that is built
and maintained under the airshipit namespace, as the stackanetes
image is no longer actively maintained

Depends-On: https://review.opendev.org/688435

Change-Id: I7f48605f08f574822179d51cd645ded07714d9c3
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2019-11-11 07:34:30 +00:00
Chi Lo 38883b84c7 Specify rabbitmq exchange for Ranger-agent queues
Change-Id: I97465614c7f6136220b9dfe65ab5de16988f2d7e
2019-11-08 16:13:05 +00:00
Chi Lo 1cfa370650 Remove host networking configurtion for Ranger-agent pods
Change-Id: Iedb14492240ac5e6d7a3f46c63b54791417ee128
2019-10-28 17:31:55 +00:00
Zuul a61c3476ea Merge "Enable rabbit HA queues for Ranger-agent pods" 2019-10-21 22:42:09 +00:00
Steve Wilkerson 78d1e49e1e Ranger/Ranger-Agent: Fix deployment api versions
This updates the kubernetes api version for the ranger and
ranger agent deployment templates to apps/v1

Change-Id: I9a75de99441ad7c0bc7068e720686a3f96e92870
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2019-10-18 08:40:14 -05:00
Chi Lo 759acc5fb4 Enable rabbit HA queues for Ranger-agent pods
Change-Id: I25214b0174549c66fc4de01a5703d557cce314ad
2019-10-13 14:55:27 -07:00
Chi Lo 3b9adc2bf0 Health probe for Ranger-agent pods
Health probe for Ranger-agent pods is used for both liveness
and readiness probe.

ranger-agent-api and ranger-agent-engine pods:
- Sends an RPC call with a known method to pod's listener
  queue. Probe is successful if call returns with no error. If
  listener is not reachable or fails to respond in time, returns
  failure to probe.
- Check if the rpc socket status on ranger-agent pods to rabbitmq
  are in established state.

ranger-agent-api pod:
- Launch a call to pod's open interface. Probe is successful if call
  returns; otherwise failure if response has error or timed out.

Change-Id: I7a22fd50d47e58df19b413ed65ab528e2d78d609
2019-10-11 16:12:28 -07:00
stewie925 71fdc5fdb7 Include retry logic for checking status
Change-Id: Ic6a46403a5430e91759fb6f254aaa39925f6c533
2019-10-01 14:26:59 +00:00
hosingh000 8564e335b9 Change Ranger-agent helm test to invoke internal service address
Change-Id: I638cba69632d8088cc63830a7471d08bae6ed6ef
2019-09-17 14:15:21 -05:00
Chi Lo 700f9dfcf3 Use htk function to directly hit RabbitMQ servers
This PS updates the charts to use the htk function
to allow oslo.messaging clients and servers to directly hit their
backends rather than using either DNS or K8S svc based routing.

Change-Id: I389de832740a59c0594e907177c8c2172a83958a
2019-09-06 17:55:08 -07:00
hosingh000 336594600b ResiliencyTesting: ranger-agent helm test failing
- Test is failing when repo changed and test template not exist
- Parameterizing expected status on basis provided template
- Parameterizing to pass region to request for specific site

Change-Id: I0d6cc27222c4b5eb36a91b8e5194e41701bb4820
2019-09-06 13:42:41 -05:00
SANDEEP REDDY THUMMA b6fa5da91c Ranger-Agent: Add pod/container security context
This updates the Ranger-Agent chart to include the pod
security context on the pod template

when I set to true for rangen-agent engine it going to crashloopbackoff

Change-Id: I69f99d651a7d60f27c75f1718e894c84bcfea366
2019-06-05 16:53:01 +00:00
Jean-Philippe Evrard 87f30975b9 Point to OSH-images images
We now have a process for OSH-images image building,
using Zuul, so we should point the images by default to those
images, instead of pointing to stale images.

Without this, the osh-images build process is completely not
in use (and completely opaque to deployers), and updating the
osh-images process or patching its code has no impact on OSH-addons.

This should fix it.

Change-Id: I23d69b56e6de4f0f76d6031b301e81a294ddcc50
2019-05-13 11:20:51 +02:00