Commit Graph

86 Commits

Author SHA1 Message Date
Andreas Jaeger 24120d7b66 Retire repository
Fuel (from openstack namespace) and fuel-ccp (in x namespace)
repositories are unused and ready to retire.

This change removes all content from the repository and adds the usual
README file to point out that the repository is retired following the
process from
https://docs.openstack.org/infra/manual/drivers.html#retiring-a-project

See also
http://lists.openstack.org/pipermail/openstack-discuss/2019-December/011647.html

Depends-On: https://review.opendev.org/699362
Change-Id: Ibd0360edc1781ea748a1ef28877c215bb4c726c7
2019-12-18 09:38:32 +01:00
Peter Razumovsky 43ba2ac7b9 Add fuel-ccp-elasticsearch to defaults repos
Since elasticsearch has separate repo, need to add
it to defaults, in case of related fuel-ccp-stacklight in
defaults.

Change-Id: Ic39eb474f42b25e55772cb95edd362e4be5623c3
2017-03-15 11:04:12 +00:00
Jenkins 92b827ba0b Merge "Initial AppController integration" 2017-03-06 15:16:10 +00:00
Andrey Pavlov ddf451199c Initial AppController integration
Change-Id: Ic3dc48a93f2cc1a4d3ff3e513b5cfcc545289c6b
2017-03-06 16:28:43 +04:00
Andrey Pavlov e8ce334a9d Store sensitive configs in secret
* secret_configs config group added
* global secret creation added

Change-Id: Ie6a9833cdf73b076e24204d47e5898dfb24de43e
2017-03-06 07:00:03 +00:00
Andrey Pavlov ccaadd5e0b Configs overrides for custom services
"configs" section added to "services" group.

services:
  some_service:
    service_def: ads
    configs:
      asd: dsa

If you are mapping some service to some another service,
configs will be inherited as well.

Change-Id: Id64c0bf816a639c0b3dee96e5a72fcf964f9f731
2017-03-02 15:41:10 +00:00
Andrey Pavlov 9942c0e978 Adding service-per-service support
New config section introduced:

services:
  keystone-db:
    service_def: mariadb
  keystone:
    service_def: keystone
    mapping:
      database: keystone-db

Defined services can be used in topology definition.
In this example keystone-db service will be created from mariadb
definition and keystone will use it instead of mariadb.

Change-Id: I274826648390b844d240b7ae545c40264f662452
2017-03-02 15:41:03 +00:00
Sergey Kraynev 696adcf1d9 Add ability for recursive merge dicts for AttrDict
This patch adds ability to merge nested dicts if they are passed as a
paramater for "_merge" method of AttrDict class.
Also corresponding tests are added.

Change-Id: I7d18f69d4dc076c178552ae886af6df2932abc27
2017-02-17 08:23:07 +00:00
Sergey Kraynev 4e21fddd47 Add support for TLS
- Update address function to use "tls" config option and set scheme to 'https'.
  Also we check, that service is in list of services, which support TLS.
- Add nginx repo to defaults, because it will be used as a proxy
  service.
- Add Runtime error with suggestion to use extra options on cleanup,
  when 'tls' is enabled.

Current patch requires patch in fuel-ccp-nginx repository.

Change-Id: I65002b7ff9cfa2faf9d5bce470334aae95334d00
Depends-On: I0660cc3ca2723bc06871b61f859adfed42c0d807
2017-02-15 18:53:38 +00:00
Proskurin Kirill b7520afcda Enable Galera as a default DB
Additionaly I have to updates all topology and docs to address
this change. And yes, I propose to deploy 3 rabbitmq too.

Change-Id: I9db9fcb7a5f78312dabc23ed2ff56cb0a9748f4d
2017-02-13 15:59:08 +00:00
Jenkins 3b1cd60dc1 Merge "Extension AttrDict" 2017-02-09 11:31:14 +00:00
Mikhail 2788592cb8 Extension AttrDict
Add implementation for some function in AttrDict
in order to avoid recourse to AttrDict._dict

In tests we use dict, but in fact should use _yaml.AttrDict

Change-Id: Ie99f3b05bd65f195f2f81191bff67cbacef1b816
2017-02-09 11:57:45 +04:00
Sergey Reshetnyak 0f9c0b5e7c Allow to specify remote docker engine for building
Change-Id: I1ab0129e646861d35edb16a78a7e81e00d714b27
2017-02-03 08:56:25 +00:00
Sergey Reshetnyak 966ae060d0 Allow to specify k8s credentials in config
Change-Id: I483f43fbdb2c5e91edc2e0592530da01765c24b5
2017-01-16 16:36:51 +03:00
Jenkins ee8587f66a Merge "Fixing source_dir configuration" 2017-01-13 09:09:13 +00:00
Andrey Pavlov 13024df57f Fixing source_dir configuration
It was not possible to configure source_dir to use
local repositories during build. This configuration
change didn't pass validation because it was deep merged
with default configs.

Change-Id: I3d1f8769fa12dc22b1d7f02a3e84c7b5ecebd521
2017-01-11 10:41:49 +00:00
Bartosz Kupidura 0fa8be6bb1 Add fuel-ccp-grafana to default repos
Change-Id: I89540f8dd656dd930c8b4d999aa195a295592ba4
Depends-on: If56406c42ec9b9a6dde4c3fb2c9159128edc2e00
2017-01-10 11:56:30 +01:00
Jenkins 3a6a575d10 Merge "Make imagePullPolicy configurable" 2016-12-28 01:51:21 +00:00
Sergey Kraynev 5ae1d9c8c8 Fix wrong time of insecure option
Also add default False.

Change-Id: Idd3fd7f626de0e091bd22b3acd64279086991b9b
2016-12-19 08:36:07 +00:00
Andrey Pavlov a44fbb0fea Remove hardcoded entrypoint repo name
* entrypoint_repo_name config option added

Change-Id: Icf1384755978fe202ff827657bc85bcbe8d76630
2016-12-13 19:32:26 +03:00
Yuriy Taraday 6f25340851 Make imagePullPolicy configurable
'Always' is not the best option as it adds round-trip to registry for
every node even if image has already been pulled. Keeping default to be
the same as in Kubernetes would make it conmfortable to use 'latest' tag
during development and proper versioned tag for production-like
environments.

Change-Id: Ifa628e00959bae062bb5bb7e95e071af8babee32
2016-12-03 22:38:14 +03:00
Jenkins b3f64b119d Merge "Adding cluster_domain config option" 2016-11-29 08:57:10 +00:00
Andrey Pavlov facf0f6282 Adding ability to specify custom config files
Example:

    files:
      keystone-conf: /tmp/keystone

In that case source file will be taken not from
`content` path, but from path defined in files config.

Change-Id: If2e71887adca9148f98b555ef8d6033211fe6375
2016-11-23 12:01:34 +00:00
Andrey Pavlov 3f797388bf Adding cluster_domain config option
This option will be used in `address` function and will be
added to internal urls, so that default address will be
changed: service.ccp -> service.ccp.cluster.local

Change-Id: Iaa7e1172120506e284a0ae7b3c4539af411c8535
2016-11-22 21:36:00 +00:00
Artur Zarzycki 43af0ab8d3 Fix nested url validation
Change-Id: I719abc0175b5b24779c1b2139a811032d4e0293a
2016-11-14 16:12:47 +01:00
Sergey Reshetnyak a1db480a04 Make log level modules configurable
Change-Id: I6da854968baf73022c0b16e4dcc49f6c7c4e1394
2016-11-11 15:40:36 +03:00
Jenkins 3934f41f26 Merge "Add dockerfiles validation" 2016-11-08 10:32:33 +00:00
Jenkins cce5e616f3 Merge "Fix 'replicas' section missing in default CONF" 2016-11-07 11:59:32 +00:00
Kirill Bespalov 3c99c03da3 Fix 'replicas' section missing in default CONF
Change-Id: I4676bc69a2f1eb3611a3a3d05f753fa505926f80
2016-11-01 19:35:37 +03:00
Yuriy Taraday 35a9378c6c Add dockerfiles validation
The validation takes 2 steps:
a) render Dockerfile.j2's;
b) verify that all images have parents except ones that are listed in
   base_images config parameter.

This validation ignores list of components because we have repos without
services (debian-base, openstack-base).

Change-Id: I0fd9fb0382b860f04e12993e350c7c23fbcdfda7
2016-11-01 15:47:17 +03:00
Yuriy Taraday 48b1e51430 Add 'url' section to config, pass it down to Dockerfile.j2
Change-Id: Ib43889dcec99c515b9932de381cf3ef25fbc7ff9
2016-10-26 10:13:08 +02:00
Jenkins 8b45b177f6 Merge "Add ceph repo" 2016-10-19 11:02:32 +00:00
Andrey Pavlov 1402f45914 Redefine __str__ for AttrDict
This will allow us to use config dict as a jinja variable
during rendering

Change-Id: I8bbf127ce9aaae3032743a949c1e69a09e273836
2016-10-19 08:56:09 +00:00
Jenkins e1a311a2fa Merge "Allow to tune image spec for every image" 2016-10-18 16:05:15 +00:00
Yuriy Taraday 2742f4bfc2 Allow to tune image spec for every image
This requires changes in all component repos to replace FROM line to

  FROM {{ image_spec('someimage') }}

Change-Id: I18281bdb41e91cd5c9160055f1617d7ee9d3b548
2016-10-18 14:09:57 +03:00
Jenkins 088bc16121 Merge "Replace runtime sources verification with jsonschema validation" 2016-10-17 17:45:38 +00:00
Yuriy Taraday f6e436de03 Add unwrapping for lists of AttrDicts
It allows 'repository.repos' config to pass validation

Change-Id: Id9332330b169075756a0f529d2b88318d2955dd7
2016-10-17 11:03:47 +03:00
Yuriy Taraday 3b24a8039c Replace runtime sources verification with jsonschema validation
Change-Id: I3d17336d26ed14970c6d9f96c10b65468da12f1f
2016-10-14 16:21:17 +03:00
Proskurin Kirill 8ac41634aa Add ceph repo
Change-Id: Ibe92f4c7189bba672d18197e16aa3fd4f30e302c
2016-10-14 11:40:39 +03:00
Yuriy Taraday 855fda0ef3 Change repositories list in config
Allow use to add arbitrary repository to the list.

Change-Id: I7895a9a66d4499aabcd5eb9bd037e5b2bc1fa83c
2016-10-11 17:16:33 +03:00
Yuriy Taraday 7d818d2827 Add deep merging when loading component configs
Change-Id: I05428668fefcb62462eccef945e2acc8efa784ff
2016-10-05 18:06:36 +03:00
Jenkins b03eb42261 Merge "Add 'ccp config dump' command" 2016-10-05 09:00:44 +00:00
Jenkins f2e6caed68 Merge "Remove adhoc calls to get_global_parameters" 2016-10-05 09:00:28 +00:00
Dmitriy Ukhlov b1fd7b49ed Removes --deploy-config cli option
Closes-bug: #1618864

Change-Id: I44dd700ac7d7621328a537f484d0bcaa2746b05e
2016-09-29 15:28:55 +03:00
Yuriy Taraday a2fb1c0b27 Add 'ccp config dump' command
This command dumps current config with all default vaules omitted from
original config

Change-Id: I4fda39903330452780c898be0cfae1c249e5f527
2016-09-28 21:52:54 +03:00
Yuriy Taraday f34b2a909b Remove adhoc calls to get_global_parameters
Replace them with storing data from components centrally in global CONF
and using it all over the place.

This allows to centrally control how configs are handled, i.e. if we
decide to not use defaults anymore, we can just remove
load_component_defaults from cli module.

Change-Id: Id58bb43a7a9cbb367719ba59484bf3121ec68379
2016-09-27 19:33:55 +03:00
Sergey Lukjanov 141bea0455 Add .get to AttrDict as we using it and it fails
Change-Id: I86102deff23251e4e2f30b3090f8d82a9f357dde
Example: specify sources in ccp.yaml config and ccp will fail.
2016-09-22 20:17:10 -07:00
Proskurin Kirill 28c017d8bf Change default git url from review to git at openstack.org
Change-Id: I406b0d480d8968bc3195f96d6d971180736f2627
2016-09-22 14:27:22 +03:00
Sergey Lukjanov b552b0f91e Add primitive support for specifying replicas
It's a minimal support for specifying number of replicas for
services in the ccp config file. It's badly needed to simplify
testing on scale and testing of the running services in HA.
It's not breaking any kind of backward compatibility, you're
now able to specify it:

    replicas:
        keystone: 3
        nova-api: 42

Corresponding verifications was added into the process of
building topology as it's implicitly part of it.

Additionally, there is a very small tests refactoring plus
few new tests for replicas verification.

Change-Id: Ia7e032fd3d2090cf42b05dfb96d0f0808d1399d6
2016-09-19 21:39:02 -07:00
Yuriy Taraday 8c15db503d Switch to cliff
Added all commands and basic app for cliff, removed all
legacy/compatibility stuff around CLI.

Config file CLI argument and logging will be fixed in separate commit.

Change-Id: Ib52b4c139c2ac9ea5afa073febcd764edced1464
2016-09-19 15:41:32 -07:00