Commit Graph

798 Commits

Author SHA1 Message Date
Andreas Jaeger 4788fcfba6 Retire repository
Fuel (from openstack namespace) and fuel-ccp (in x namespace)
repositories are unused and ready to retire.

This change removes all content from the repository and adds the usual
README file to point out that the repository is retired following the
process from
https://docs.openstack.org/infra/manual/drivers.html#retiring-a-project

See also
http://lists.openstack.org/pipermail/openstack-discuss/2019-December/011647.html

Depends-On: https://review.opendev.org/699362
Change-Id: Ie9a69d85ea5ceae2bbe8b3598edcfa4d06ed5221
2019-12-18 09:40:09 +01:00
OpenDev Sysadmins 9b02c799f9 OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:40:15 +00:00
Zuul 8ecc5d0a0f Merge "fix tox python3 overrides" 2018-09-25 05:55:52 +00:00
Dennis Dmitriev 10f4ac744e Add CLI option '--skip-sync' to skip time-sync on specified nodes
The option '--skip-sync' can be used with CLI commands 'time-sync'
and 'revert-resume'.

Change-Id: I44ab39de5a46756f1174f6832ab3ea0badc987dc
2018-09-14 12:24:24 +03:00
Dennis Dmitriev dba9bd0b15 Allow to disable printing expected runtime errors in SSHAuth
When users on a node are not prepared yet, it is expected
to get wrong authorization exception like this:

ssh_client.py:147 -- Connection using stored authentication info failed!
Traceback (most recent call last):
...
BadAuthenticationType: ('Bad authentication type', [u'publickey']) (allowed_types=[u'publickey'])

- new parameter to SSHClient 'verbose' allows to disable printing
  such errors during waiting for ssh access.

Change-Id: I665d5dca3c064e5445863870bfb97d12cf2a4905
2018-06-14 16:40:28 +00:00
Dennis Dmitriev 69e893e581 Fix copypasted var name in Environment.snapshot()
Change-Id: Ifa28133aae78792a72ede8f0d6d3f09999a2eeb4
2018-06-14 18:32:16 +03:00
huang.zhiping 58e49ad2b8 fix tox python3 overrides
We want to default to running all tox environments under python 3, so
set the basepython value in each environment.

We do not want to specify a minor version number, because we do not
want to have to update the file every time we upgrade python.

We do not want to set the override once in testenv, because that
breaks the more specific versions used in default environments like
py35 and py36.

Change-Id: Ieea99ee85a01061eed68d45fc62f24dbffb98076
2018-06-09 00:45:59 +08:00
Dmitry Tyzhnenko 25d4cc6731 Add virtual bmc
Change-Id: I8cdc2038e6d2f837d2996619b4b051e13d2c00b2
2018-05-15 16:36:04 +03:00
Dennis Dmitriev e4eaa9a7e2 Restrict libvirt-python version not higher than 4.0.x
Change-Id: Iee9403c2c5e7cf71633240bac77eb375633a3101
2018-04-25 21:10:35 +03:00
Vladimir Khlyunev b8c6fe45a1 Restrict libvirt-python 4.1.0
This version contains bug that prevents its installation
https://bugs.launchpad.net/openstack-requirements/+bug/1753539

Change-Id: I8d0fd2bac7217192362215c0cc33b9be673911a7
2018-03-07 08:25:01 +00:00
Dennis Dmitriev cce44f4784
Avoid race condition using parallel fuel-devops env manipulations
If multiple processes are creating/erasing different fuel-devops
environments at the same time, there can be race condition during
libvirt object creation/deletion like:
'bridge virbr3 already exists' and others.

This patch allows to use a lock file to avoid such situation:
export DEVOPS_LOCK_FILE=/run/lock/devops_lock

If the environment variable DEVOPS_LOCK_FILE is not set, then
the lock file is not used (backward compatibility to avoid any
errors caused by using the lock file by default).

Change-Id: Id28f442959594aa5d6bb5c1d15e4f0880653070d
2018-02-25 14:55:46 +02:00
Dennis Dmitriev 0bd5ce25be
Add 'has_videocard' libvirt node attribute
- if 'has_videocard' == True, add <video> device to the
  libvirt node. Default: True

Allows to disable videocard for libvirt VMs if necessary

Change-Id: I7a14557016526b6fd1a49b8ef05fb7d111800503
2017-12-15 22:52:31 +02:00
Dmitry Tyzhnenko c39a2a996b Add shared backing storage
If user has already defined volume in pool it can be used as
    backing storage for node disk.

        - name: system
          capacity: !os_env NODE_VOLUME_SIZE, 150
          shared_backing_store_name: !os_env IMAGE_NAME
          format: qcow2

Change-Id: Ib1ec1daf74d9bd2c78288cc507e4b32c7233ef3d
2017-12-11 16:10:27 +02:00
Alex Schultz 6847377d9a Ensure networks are running before starting node
If you create an environment and want to start a node prior to running
the admin setup action, it will fail because the networks are not
currently started.  This change makes sure the networks are started
before starting the node via the node-start shell command.

Change-Id: I336ea88950e9239d02d3c72c49b3d17eb264e6c3
2017-12-08 19:30:46 +00:00
Dennis Dmitriev 750d443537
Generate a coverage report at the root of the project
Zuul coverage job expects the report in a fixed place:
http://git.openstack.org/cgit/openstack-infra/zuul-jobs/\
tree/roles/fetch-coverage-output/defaults/main.yaml

Change-Id: I3e6f06be69410db44eef4ac66275d1046af27082
2017-12-08 19:11:50 +02:00
luke.li e115ef4bd4 Update "indentify" to "identify" in docs
Change-Id: I5e9c2c1317861c16261460fe414cf5a591476c4c
2017-09-20 15:42:20 +08:00
Vladimir Khlyunev 3ac4e8fc7b Add cleanup action
We can use fuel-devops for deletion of outdated environment.
Usage:
  dos.py show-old 3d
  dos.py erase-old 3d
where "3d" is time-to-live interval. All envs older than
given interval will be erased.

Last char of interval is multiplier, could be:
 - s: seconds
 - m: minutes
 - h: hours
 - d: days

erase-old operation is interactive but it could be
disabled via "--force-cleanup" arg.

list-old command supports --timestamps arg. Note that devops uses
UTC timestamps!

Change-Id: Ic1a744996495296e22ae0fdef9752dba8790aac8
2017-09-04 15:11:41 +04:00
Dennis Dmitriev 887368db3b escape spaces in any type of path for mkdir/rm
Change-Id: Ic8757f31bb21850faaae2fc90809f0fed0df98e0
2017-08-30 20:46:58 +00:00
Jenkins e2a7b8c811 Merge "Add dict wrapper" 2017-08-30 12:11:16 +00:00
Dennis Dmitriev 9998c3b49a Minor change to SSH/Subprocess commands logging
Change-Id: If27e761130d8bc469c9b1fd2bb6b80ebedf85669
2017-08-30 13:09:03 +03:00
Oleksii Butenko 8e7d469595 Add dict wrapper
Dict wrapper is used for string format method using
postponed keys resolving.
With this class, format will not fail in case if key not found,
and leaves the unknown key in the string 'as is'.
This behaviour is required as a workaround for strings with
bash-like variables like ${SOMEVAR} to not fail the format because
of 'unknown key: SOMEVAR'.
Returning the 'format' instead of 'replace' is required to use
the escaping of the '{{' '}}' in the string to get '{' '}'.

Change-Id: I1c2bbb083a544eb366c7b00eb1002cc4da652c33
2017-08-29 15:30:21 +03:00
Dennis Dmitriev c64ea944d9 Allow to upload and remove directories with spaces in the path
Change-Id: If1d8ce48ed14ee93596012d95c7c63587cefb112
2017-08-29 00:07:48 +03:00
Dennis Dmitriev df292ddb54 Add context manager methods to subprocess_runner
Change-Id: I77d934fbf018e173bcd919ccabb245ad98e232e6
2017-08-28 17:04:51 +03:00
Jenkins 503c35d08c Merge "Make logging more readable" 2017-08-18 13:51:26 +00:00
Taylor May e67743b22c Set VNC keypress rate for outputting kernel_cmd
Change-Id: I2806626e2c3ace8d3644a9ff4df36caf54295dc5
Closes-Bug: #1699631
2017-08-16 12:47:15 +00:00
Alexey Zvyagintsev 272fab15b3 Make logging more readable
Replace formatting templates for commands from  `"{!r}"` to `u"{!s}"`
for better representation of commands with more than one line.

Change-Id: I76a29757d4faffff321cfa3df7e39190acbb406b
Co-Authored-By: Fedor Zhadaev <fzhadaev@mirantis.com>
2017-08-14 14:00:54 +04:00
Taylor May a693436f60 Allow setting the fuel master's FQDN and DNS settings from environment variables
Change-Id: Ifd63b6459be7e7cf2f6896f390ed7fc0f0b7bf78
2017-07-26 23:11:23 -05:00
Dennis Dmitriev 88a5d02b3d Fix for slave-ip-list: skip l2 network devices not attached to node
Change-Id: Ifbea974145cf494e9cb8cc6d40beb096b421064a
2017-07-18 16:14:34 +03:00
Dennis Dmitriev c4bc6364eb Add new option 'show-resources' to dos.py
Show total and per-node maximum vcpu, memory and storage capacity
usage, if defined.
It will help to plan the CI hardware usage mode carefully.

Example:

  $ dos.py show-resources test-environment-name

Change-Id: I1bb891ef394d74b06e07c667fc88139377c8c96f
2017-07-13 16:30:01 +03:00
Artem Panchenko d8067269ba Do not resume environment after revert
Change-Id: I3615b75195e97f74c2e8f660a6602e7b2211c1f3
2017-06-15 19:32:29 +03:00
Vladimir Khlyunev 3cb41214b5 Ignore BadHostKeyException while trying ssh keys
New version of paramiko uses BadHostKeyException as error when smth wrong
with keys from known_hosts and current public key.

Change-Id: I3ea9a1953b4e6daf33265600681c85cd2cd28828
Closes-bug:1697690
2017-06-14 12:24:38 +00:00
azvyagintsev 65d348c750 Fix logging
Change-Id: I78d11cc4c75a17744fb2818cbd1c7f36e86ae13b
2017-06-02 17:27:26 +03:00
Jenkins 6d25971d4c Merge "Bash variable workaround" 2017-06-02 04:35:13 +00:00
azvyagintsev ee1164d49a Bash variable workaround
For test, use meta with example:

  write_files:
   - path: /test
     content: |
        export TVAR1=111
        export TVAR2=222
        echo TVAR1=${TVAR1} > /test
        echo TVAR2=$TVAR2 >> /test
        echo date=$(date) >> /test
        echo "${TVAR3:-defffaaaul}" >> /test
        # Jinja-like style still not work :(
        echo {{ REPOSITORY_SUITE }} >> /test

Change-Id: If1fde6b7d561e3e457e305505872fa114195ad63
2017-06-01 12:19:27 +03:00
Dennis Dmitriev 5d68ed0fa3 Enable time-sync for non-Fuel-based environments
Change-Id: I705ce3bd474bd12971713f06e3a892a2f04c3fef
2017-05-27 12:44:02 +00:00
Dennis Dmitriev 266437f8c9 [doc] Add libssl-dev package to python eggs build requirements
Change-Id: Id7a3ecc6d8638666ffe03623ba9c6f39a4707987
2017-05-27 12:23:33 +00:00
Dennis Dmitriev 1e65c771a0 Remove py34 from unit tests, use sphinx 1.4.9 for docs
Change-Id: I64599de35cae3d2eab655d13dd6c49ed23536aa7
2017-05-27 15:05:17 +03:00
Dennis Dmitriev 8fb07e2cc1 Bump to version 3.0.5
Ntp fixes

Change-Id: I225be57f3790f36009bbb41d8e732bd9c210a893
2017-03-30 21:19:51 +03:00
Dennis Dmitriev 6d4b22107e Fix 'ntpd -gq' false-positive exit code 0
Command 'ntpd -gq' is finished with exit code 0 even if
"no servers found" appeared.

Change-Id: Ib45afe7fccca91b402c8f370ede8f963e550921f
Related-Bug: #1656020
2017-03-30 11:17:52 +00:00
Stanislaw Bogatkin 4da6c0c111 Remove requirement to have strong reachability to remote server
If remote server was selected as reference, it can be used as time
source, so there are no big problem if it flaps.

Change-Id: I01fa7acde7c9cd97245e8b2bf8ca31f3c62d6479
Related-Bug: #1656020
2017-03-30 09:40:28 +00:00
Vladimir Khlyunev 236a605026 Bump version to 3.0.4
Change-Id: Id62923ba6c239eedb2611f6c18d061ab331a4ae8
2017-03-27 13:08:38 +04:00
Jenkins b3b52fca92 Merge "Use lxml in xmlgenerator" 2017-03-24 10:46:10 +00:00
Alexey Stepanov 2f200cc211 Use lxml in xmlgenerator
Return code from fork.
lxml is faster and allowed in global requirements.

Change-Id: Ibeb3b2c92064ce87d6acf491f79342ba2a3de507
2017-03-22 17:47:12 +03:00
Dmitry Belyaninov 81f2e6e263 Allow usb boot mode
Add usb to the iso_bus choices list
Closes-Bug: 1674972

Change-Id: I33291dbe9b1179a482a1da4554fe36e801e1f3f0
2017-03-22 12:57:03 +01:00
Dennis Dmitriev 6514c6d046 Fix doc for md5->trust postgres access level
Change-Id: Ic34128ff461741ee06dabdd4bffed53a8f7083ce
2017-03-17 14:06:58 +02:00
Jenkins 7a5f97b9a9 Merge "Rework wait and wait_pass methods" 2017-03-09 14:22:09 +00:00
Jenkins 89e58fcc5c Merge "Example for libvirt networks based on existing bridges (docstring)" 2017-03-09 14:19:49 +00:00
Jenkins cf8d034d88 Merge "Add ironic pool when IRONIC_ENABLED" 2017-03-09 12:02:44 +00:00
Vasyl Saienko 1a477ca8e5 Add ironic pool when IRONIC_ENABLED
When ironic is enabled add 'ironic' network to networks_pools.

Change-Id: I3e8aac1c230a0baba98a37683d9e09a755c147a8
Closes-Bug: #1670830
2017-03-07 23:14:15 +02:00
Dennis Dmitriev cbcfcf5dab Example for libvirt networks based on existing bridges (docstring)
Change-Id: I40f839e74a8d366841c3a3a5f66f91639e8b43f8
2017-03-07 13:27:47 +02:00