Commit Graph

132 Commits

Author SHA1 Message Date
Jedrzej Nowak 7325a9371d Minimal solar VM packer template
Alpine linux as a base, vbox and libvirt

Change-Id: Iaa37b1ae02b4b0d22fc01fbeff5c6ce96e0b2699
2016-05-05 15:30:41 +02:00
Łukasz Oleś d5e5e5b421 Use master branch of solar-resources
Change-Id: I05ffef536fabb7ddf360930725501652e12b4454
2016-04-28 16:16:10 +02:00
Jenkins 26fcbeb0a5 Merge "Add vbox/qemu packer build for centos7" 2016-03-17 10:38:51 +00:00
Bogdan Dobrelya 542a359af2 Add vbox/qemu packer build for centos7
Rename the cloud_archive task to uca/rdo tasks for ubuntu/centos
Rename the worker_upstrart task to the worker
Rework the OSTYPE env var to "when: ansible_os_family"

TODO
* PXE (PREPROVISIONED=false) to be working for centos as well
* pygraphviz for centos7, see also https://bugs.launchpad.net/fuel/+bug/1510884
* fix ubuntu only compatible examples, for example riak cluster deploy

Closes-bug: 1553988

Change-Id: Iab130c3c79b3db99deb14ea50572c073532f4694
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
2016-03-16 11:41:15 +01:00
Jenkins 4c5875f985 Merge "Implement better and more solar specific pool for PG" 2016-03-15 16:26:13 +00:00
Jedrzej Nowak 8add0260f2 Implement better and more solar specific pool for PG
Supported parameters
- pool_size how big is the pool
- pool_overflow how many overflow connections should be allowed

Change-Id: Iba92eb94754ef7314bc3d4bf0e413e7d61e027f8
2016-03-07 17:10:25 +01:00
Bogdan Dobrelya 4575b7b2f7 Separate vagrantfile for the docker provider
Change-Id: I828751cb631930099770c301b0ec2df802fcbf52
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
2016-03-02 13:37:19 +01:00
Bogdan Dobrelya 467d84c620 Add centos7 docker support
* Separate OSTYPE specific tasks/files.
* Keep only common tasks and files in the
playbooks dir.

TODO pxe case to be working for centos as well
note, the cmtools.sh installs ansible 2.0.1.0
  in centos7, while we have 2.0.0.2 for ubuntu trusty
note, the base.yaml installs python-keystoneclient
  1:1.3.0-1.el7 from kilo-2 (no juno for centos7),
  while for ubuntu we have one from juno
note, there is no pygraphviz for centos7, see also
  https://bugs.launchpad.net/fuel/+bug/1510884

Closes-bug: #1548851

Change-Id: Icec5637f9242104322d1104725f9f132d1ca16f0
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
2016-03-02 11:16:23 +01:00
Bogdan Dobrelya e1e304c4f9 Add packer build for docker container
* Add docker Ubuntu Trusty packer template.
* Rework cmtools to install ansible and puppet
* Add support for Vagrant provider docker.
* Containers will share the host system docker daemon
  and images in the storage, so may be run nested.
* Ensure the rsyslogd and sshd is running in containers.
* Also ensure the /var/log/solar dir, which is required for docker.
* W/a Solar-hardcoded and vbox specific ssh key paths
  for docker case.
* Update FAQ and docs

Depends-on: I881d362968a10d816cbd368cb185900dfaa0b3bc
Partial-bug: #1547587

Note, vagrant does not support vm.network and exec based
provisioning for docker, so there are workarounds.

Change-Id: Idf91bd6ed2fb90601f517064705df7721aeae3fb
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
2016-03-02 11:16:23 +01:00
Bogdan Dobrelya 58683af802 Fix riak container nested docker mounts
Fix docker mounts to allow the riak docker container
to be started nested.
Also note about nested containers in the docs.

Related-bug: #1548851
Related-bug: #1547587

Change-Id: I2fb448ac439b717eae1c3deee2cd067ac8b4f0c7
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
2016-03-02 10:30:20 +01:00
Bogdan Dobrelya 4aa47c1348 Describe how to create/use the builder container
Closes-bug: #1551269

Change-Id: I9b155bcbc6e96034f5f55ba2f8add89abdeabc5b
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
2016-03-01 12:47:38 +01:00
Maciej Kwiek f8f8c0d622 Change sudo to become in bootstrap playbooks
As we are using ansible 2.0, we should move from sudo to become to
avoid deprecation.

Change-Id: I7a99df005dcdcd12e9a2afdeb0c908fe2069cc57
Related-bug: 1547430
2016-02-22 10:17:16 +01:00
Jenkins c39c2bc130 Merge "Some speedups after adding PG" 2016-02-18 21:42:19 +00:00
Łukasz Oleś bf5117508c Some speedups after adding PG
- ansible is running only once now
- more dynamic waiting for postgress

Change-Id: I9951312680aa2a80af201166f203bc9112cfcfb3
Partial-bug: #1546205
2016-02-18 18:36:31 +01:00
Jedrzej Nowak 300798c8f2 Use psycogreen for PG backend
Change-Id: Ia2037cf26614cb4091a5c57a94a3c3a0af0ed70c
Closes-bug: #1546976
2016-02-18 13:02:09 +01:00
Jedrzej Nowak e7d7be55bd PG support in Vagrant and in test env
Changes included:
- non standard docker image (alpine-postgres)
- new setting in vagrant-settings.yaml_defaults (solar_db_backend)
- multidb logic in playbooks (databases.yaml)
- possibility to set backend by SOLAR_DB_BACKEND in jenkins run.sh
- packer images version 0.3.0.pre0 (pre builded docker image)

Change-Id: Id48236aa778597ed787f8455ec4d4c869d0ef1cf
Closes-bug: #1546205
2016-02-16 17:53:32 +01:00
Jenkins f319f97eef Merge "Support postgresql in dblayer" 2016-02-16 09:12:59 +00:00
Jedrzej Nowak 3881dc9750 Support postgresql in dblayer
Change-Id: I7131273d137c0d42991a0cbd17dd9bc2dbf04d5c
Closes-bug: #1545659
2016-02-15 18:13:25 +01:00
Jedrzej Nowak 637afa23df Use openstack/solar-resources not Mirantis one
Change-Id: I0ace8937a171c63288d09dc07a94af284c96e6a4
Closes-bug: #1545630
2016-02-15 12:01:42 +01:00
Jenkins 7d870be293 Merge "Set versions in vagrantfile and playbook for 0.2.0" 2016-02-12 15:26:06 +00:00
Jedrzej Nowak e1b07a16f4 Set versions in vagrantfile and playbook for 0.2.0
Change-Id: I23cd4999d7ff46c8c28de3ffe4e648a23a8f6803
2016-02-12 16:08:57 +01:00
Łukasz Oleś 0b7e2c9b0e Increase disk size
Now Riak is installed always and takes about 500MB. We need this space
for openstack example.

Change-Id: Ieee618499a9520c043e16b03d8e1036698ebe672
2016-02-12 12:24:26 +01:00
Jenkins 7d8b62e044 Merge "Change owner only if we are not in vagrant env" 2016-02-08 12:33:35 +00:00
Łukasz Oleś 713303df8f Change owner only if we are not in vagrant env
Change-Id: I737c382ea9bdb86753dcdcffc74362e6e59c5dc2
Closes-bug: 1541436
2016-02-08 13:11:43 +01:00
Łukasz Oleś b74f1e225b Small cleanups
- remove docker compose
- clean some ansible playbooks
Related-bug: #1533609

Change-Id: I58159bdfced03f313abc3a1dea0c5bdabd1108c8
2016-02-08 10:29:47 +01:00
Łukasz Oleś f4da49538b Allow to set headless mode via env variable
When building image via jenkins job we can not use any windows.
Related-bug: #1533609

Change-Id: I8622ab4b26908bfaccbdad3527444cf8335a6c1d
2016-02-05 10:23:27 +01:00
Łukasz Oleś 2d8231f75a Ip addressess fixes
- disable host key checking for 10.*.*.* everywhere
- connect to riak on localhost instead of hardcoded 10.0.0.2

Change-Id: Idfb675e5fca10ab6ddb2e3907c0693789ec17425
Related-bug: #1533609
2016-02-04 11:34:08 +00:00
Jenkins ecd6bb0842 Merge "Ansible 2.0 support in ansible handlers" 2016-02-04 09:57:24 +00:00
Łukasz Oleś 77b8e6200a Disable host key checking for whole 10.0.0.0 net
On jenkins nodes may get IP addresse from the whole network.

Change-Id: Ieb8cdf991d6e8d167be0b745bb44c3cd7ebd2d1f
2016-02-02 22:10:53 +01:00
Łukasz Oleś e5392eeb1b Set correct user for /vagrant/solar-resources dir
Change-Id: I9be7c849f99bc8f1fedb26f44a5680d41c9e8ca1
2016-02-02 21:12:31 +01:00
Jedrzej Nowak 038c46c3e7 Ansible 2.0 support in ansible handlers
All ansible handlers are now using ansible process
instead of python API

Change-Id: I14c06830e52610b41a1c5776a6d6cb8af1651478
Closes-bug: #1534145
2016-02-02 18:06:00 +01:00
Łukasz Oleś a0518cb943 Preinstall more stuff on an image
- preinstall solar pytthon requirements
- download riak image

It speedups test and provision time making image little bigger.

Related-bug: #1533609

Change-Id: I52247bc400b992f42014d13faf148fa909b41bb0
2016-02-02 14:55:58 +01:00
Dmitry Shulyak 4f050093ba Add upstart config for solar-worker
In order to make GID and UID configurable those values will be
souorced from /etc/default/solar-worker during pre-script and script
stanzas in upstart

Change-Id: I6b23e4fb176043533522a68e448fb635324fa4d2
2016-01-26 12:39:49 +02:00
Jenkins 3cf4ae3a1e Merge "Fixing concurrency problems in history counter" 2016-01-20 13:13:09 +00:00
Jedrzej Nowak 72362bb803 Fixing concurrency problems in history counter
- riak datatype for both riak modes
- old behaviour for sql with transaction

Change-Id: Ie89629e1cf8f02c8af532f4d5b53dced7059c3fc
2016-01-19 18:16:22 +01:00
Łukasz Oleś e3e916f6dd Hardcode ansible version. We are not ready for 2.0
Change-Id: I15cf545cf9220addfc2feec3faf96aa24afdf6cc
2016-01-18 21:38:21 +01:00
Łukasz Oleś aea48b733e Remove ansible.cfg, we use .ssh/config now
Change-Id: I257bd0c7050516746ff77b8ef09dc169b945deae
2016-01-18 18:44:54 +01:00
Dmitry Shulyak 6cc4690ff2 Remove redis and celery container, use init script for celery
- Removed all packages and container related to redis
- docker-compose will start only riak container
- add init script isntallation for solar-celery
- cleanedup some of the commented code in bootstrap scripts
- disable host key verification for vagrant user

Change-Id: I9b10d07fe6ab527bc029518da407c5165f9b3d22
2016-01-13 17:28:47 +02:00
Jedrzej Nowak 026c44445c Removed wrong git option from solar-resources clone
Change-Id: I5b01aa48af4b06c54f2f90ed069d7d7906c4101c
2016-01-13 14:26:16 +01:00
Jedrzej Nowak 4060b36fed Moved examples, resources and templates
new location is https://github.com/Mirantis/solar-resources,
later will be changed to openstack one.
- vagrant stuff assumes that solar-resources is cloned into /vagrant/solar-resources
- adjusted docker compose file
- added solar-resources to .gitignore

Change-Id: If2fea99145395606e6c15c9adbc127ecff4823f9
2016-01-13 13:33:02 +01:00
Łukasz Oleś c75fddf7d5 Set vagrant as a owner of /var/lib/solar/repositories
Change-Id: Ie99a7e22ecf1d4245cbefcdbcfc5a62f562d40bd
2016-01-12 13:43:47 +01:00
Łukasz Oleś 421d0ac06e Reduce image size and keep qemu image
Qemu image may be used with fuel-devops for tests

Change-Id: I7cdaed0ee127012fea74e3fa38e470cfdb87d10c
2016-01-07 10:35:31 +01:00
Łukasz Oleś 2ef0a7a36c Install sshpass. Required for testing on Jenkins
Change-Id: I576e16f589e4c662396fa5bb297bf8c5cc95918c
2016-01-05 18:43:27 +01:00
Łukasz Oleś b4975246f7 Move bootstrap commands to ansible playbook
It will be easier to configure image outside of Vagrant env.

Change-Id: Icf0427a774afe5e6ee084e06219074a6e9d79abf
2015-12-31 15:58:46 +01:00
Jedrzej Nowak 2d891d67c7 Put PYTHONWARNINGS in .bashrc before others
Change-Id: Ie942532bcfe4ba91dd288a633a26d5b03c87d9cd
2015-12-21 22:52:00 +01:00
Jenkins 122208cf0d Merge "Do not remove the kernel src for packer build" 2015-12-21 19:35:29 +00:00
Jenkins 5532f75162 Merge "Fix playbooks after recent changes:" 2015-12-21 19:35:21 +00:00
Jedrzej Nowak 594dde3114 Repository support for VR
VR structure changed to match repository one
Link templates dir to repositories

Change-Id: I18ba43ed4502b753127d6eca5dc01f84205312a9
2015-12-21 19:23:30 +01:00
Łukasz Oleś d9e17b4468 Fix playbooks after recent changes:
- create dir if it doesn't exist
- set env for new config paths. Defaults from config.py were removed

Change-Id: I580def8813595ffe18160f44894acf458f0d655a
2015-12-21 17:59:34 +01:00
Bogdan Dobrelya f875ac705d Do not remove the kernel src for packer build
These required to build vboxguest kernel module

Closes-bug: #1528151

Change-Id: I4229ffe137d770dd18c5225af6872d0243d2116d
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
2015-12-21 14:21:15 +01:00