Commit Graph

81 Commits

Author SHA1 Message Date
Andreas Jaeger 96a651dd10 Retire repository
Fuel (from openstack namespace) and fuel-ccp (in x namespace)
repositories are unused and ready to retire.

This change removes all content from the repository and adds the usual
README file to point out that the repository is retired following the
process from
https://docs.openstack.org/infra/manual/drivers.html#retiring-a-project

See also
http://lists.openstack.org/pipermail/openstack-discuss/2019-December/011647.html

Depends-On: https://review.opendev.org/699362
Change-Id: I9227181bae1ac7c39f1dd714d31e9d23e8dbc969
2019-12-18 09:51:59 +01:00
Maksim Malchuk 6485241a5c Disable audio totally
Since VirtualBox 5.1 released on 2016-07-12 the audio setting enabled
by default which can be an issue on some hardware because audio not
supported in the Fuel.

Change-Id: I19dfd0cb44d034e41e3b061f2107476907b78363
Closes-Bug: #1624303
Signed-off-by: Maksim Malchuk <mmalchuk@mirantis.com>
2016-09-21 14:45:34 +03:00
Maksim Malchuk 16c48fc045 Correctly support all NetworkManager versions
This change adds support of the all versions of the nmcli command.

Change-Id: Icc5f93d052c451116b23c2922fe18e23e3f72746
Closes-Bug: #1617453
Signed-off-by: Maksim Malchuk <mmalchuk@mirantis.com>
2016-09-01 00:22:11 +03:00
Serhiy Ovsianikov cc86e3997f Additional verification of network interface settings
In some cases, VBoxManage utility can't assign network interface parameters
on the first try. This commit adds additional checks of network interface
settings and re-assigns the network settings if the first attempt was
unsuccessful.

Change-Id: If8a24ec44257b47e221477c46e93e3f62e63a07d
Closes-Bug: #1535742
2016-05-26 17:59:39 +03:00
Vasiliy Pleshakov 904eec20f8 Add ssh public key to Fuel master node
This commit adds an ability to use ssh public key authentication for
the Fuel master node by uploading your ssh public key to it. The path
to the public key file can be provided in the 'config.sh' file.

Closes-Bug: #1579123
Change-Id: I93560126940457518fc4385c0518ab00c0cac01a
2016-05-12 13:18:01 +03:00
Maksim Malchuk 7dd1a24416 Ignore SSH errors
This commit adds the new parameter to the wait_for_exec_in_bootstrap
function for always return success when this parameter non-empty.
This functionality will be used in the last step of the installation
when we need to wait when Fuel master node installation ends.

Change-Id: I399000821a4a9aeed4d359da8d0e723ea1642c88
Closes-Bug: #1569537
Signed-off-by: Maksim Malchuk <mmalchuk@mirantis.com>
2016-04-13 19:03:55 +03:00
Maksim Malchuk c865e7b2e2 Disable user-defined ssh_config configurations
Using the user-defined ssh_config configurations bring more problems
instead of enchancements.

Change-Id: Icfd720e8d691b72a52e78e531eaf5aea9cdfb12a
Closes-Bug: #1569032
Signed-off-by: Maksim Malchuk <mmalchuk@mirantis.com>
2016-04-11 23:29:29 +03:00
Igor Kalnitsky 80e86854be Fix public network routing from slaves
Since we assign public gateway address on master node, all public
traffic goes through it. Unfortunately, it doesn't reach destination due
to rejecting rule in FORWARD chain:

    ACCEPT              all  --  10.20.0.0/24         anywhere
    ACCEPT              all  --  anywhere             anywhere
    REJECT              all  --  anywhere             anywhere
    ext-filter-forward  all  --  anywhere             anywhere

The commit fixes that problem by inserting (-I), not appending (-A)
ext-filter-forward entry. In that case that rule will have higher
priority and won't break routing.

    ACCEPT              all  --  10.20.0.0/24         anywhere
    ACCEPT              all  --  anywhere             anywhere
    ext-filter-forward  all  --  anywhere             anywhere
    REJECT              all  --  anywhere             anywhere

Change-Id: I7887f08a175fa0ce06654dc1fc18ab412cb296f5
Closes-Bug: #1566968
2016-04-07 10:05:53 +00:00
Dmitry Bilunov 3b40e0c284 Move iptables rules to user-defined chains
Firewall rules should be managed by Puppet, which will purge current
firewall ruleset and replace it by the one provided by a corresponding
manifest.

We need to move rules introduced by product.sh to separate user-defined
chains which are not purged by Puppet so they will be retained after the
manifest gets applied.

Change-Id: I57e9f58c6bad32b23b179499f0514edf5357bd31
Partial-Bug: #1524750
2016-03-31 12:13:47 +03:00
Maksim Malchuk bbad3cd2fb Don't use IPv6 DNS servers for the Fuel
Fuel don't support IPv6 yet, so we shouldn't use IPv6 DNS servers
from the local /etc/resolv.conf.

Change-Id: Ia6ec6bf0bf3c100c591f82cd9b8785a00e93f016
Closes-Bug: #1553568
2016-03-09 20:42:03 +00:00
Maksim Malchuk 74374b316c Add checks for the file 'dumpkeys.cache'
This commit adds check for the file 'dumpkeys.cache' because it
should be exist in the main directory and in some cases it can't
be recreated. Also, this commit contains some enchancements for
all other checks and for the functions/*.sh modules.

Change-Id: Iaa55921709e0575e924af042f4322b759847d097
Closes-Bug: #1547019
2016-02-27 15:47:32 +03:00
Maksim Malchuk b48c7f5293 VirtualBox network fixes and the dockerless mode support
This commit include changes:

 * using the VirtualBox scripts the Fuel master node now always
   booted with kernel option 'wait_for_external_config=yes' to
   provide the same deployment functionality as in the 'fuel-qa'.

 * settings for the kernel command line moved to the top config
   file, because the settings wich could be edited should be placed
   there.

 * because of configuration task moved to the correct place there
   is no need to parse 'bootstrap_admin_node.log' and always follow
   the changes in the 'fuel-library', so all parsing logic removed
   from the scripts. This also simplifies networking changes and
   there is no need to patch the files on the fly and restart
   docker containers if they used.

 * variable 'vm_master_nat_gateway' removed from the 'config.sh'
   and from the 'enable_outbound_network_for_product_vm' because
   gateway should be set from the DHCP lease.

 * the sysconfig configuration files on the fuel master node now
   configured the right way. the backup files for configuration
   files are created. also added some comments for changes in the
   scripts.

 * now the default routing on the fuel master node correctly
   configured without creating the second default route. also
   ZeroConf route creation and NetworkManager now switched off
   to correct work of the network service.

 * the 'resolv.conf', 'dnsmasq.upstream' and 'astute.yaml' now
   correctly modified and could contain up to three DNS nameservers.

 * added support for the new dockerless 9.0 Fuel.

Implements blueprint: get-rid-docker-containers

Change-Id: I8f32fb8105d0781938757fa13d5dcbbacbf9c845
Closes-Bug: #1544241
Partial-Bug: #1323365
2016-02-15 00:13:47 +03:00
Maksim Malchuk 42cc02bd68 Increase timeouts for the Cobbler container restart
This commit increase timeouts for 'expect' to wait for the
command prompt after the Cobbler container restart which
in some cases takes too long time.

Change-Id: Ic9861cc08f6411f8b126a02432422ad07f49d22a
Closes-Bug: #1542320
2016-02-10 21:04:53 +03:00
Maksim Malchuk b09d8c6081 Correct parsing of bootstrap_admin_node.log
This commit fixes parsing of $goodline and $badline strings
in the 'bootstrap_admin_node.log' which causes incorrect
behaviour of VirtualBox scripts under Windows 10.

Change-Id: Ib90582adf4d5b3aa03ade081d788e5177add4b93
Closes-Bug: #1538143
2016-01-26 17:23:15 +03:00
Maksim Malchuk ddeb2f866a Use BSD's 'sed' regexp on MacOSX
VirtualBox scripts tested well only with GNU version of the
'sed', but MacOSX systems without custom brew-installed
packages contain BSD's version of the sed. This commit
fixes regexp to use both versions.

Change-Id: I058cac4eb9c2beefffc20ad05a47bc1d8ed2169d
Closes-Bug: #1537822
2016-01-25 19:49:16 +03:00
Maksim Malchuk 291c8c4319 Disable VirtualBox Remote Desktop Extension (VRDE)
VRDE should disabled by default. It can be enabled by the
'headless' option in the config.sh

Change-Id: I2bc9f5a03e1d410fe9a092532fe75c41d80af84f
Closes-Bug: #1502114
2016-01-23 01:48:37 +03:00
Maksim Malchuk 5cdbcc30d1 Fix PATH issue for VirtualBox on Windows
The support to deploy on a remote machine is broke the
default behaviour on the Windows OS, so now it always
needs to set the $PATH manually before using the scripts.

Also, the new functionality didn't work on the remote
Windows machine because the scripts change the $PATH on
the local system only.

This commit adds some more checks and fixes the local
$PATH setup. It didn't check remote system requirements
so deploy on a remote machine still have some problems.
Added several messages in the scripts.

Also this commit contain increased timeouts to fix
failures during network interfaces add/change operations
on some Windows systems.

Change-Id: If5dadc1ece3931f42eac423aae4d7016d45c2040
Closes-Bug: #1534129
Partial-Bug: #1491925
2016-01-22 08:22:10 +03:00
Maksim Malchuk 85e5cf4817 Proper Windows 7/8/10 support
This commit adds enchantments and proper support for Windows 7/8/10:
 * more verbose messages.
 * by default all network interfaces will be removed.
 * some code cleanup and regexp fixes.
 * added sleeps for some network operations.
 * proper support for windows full filenames.

Change-Id: Ic56f8d114bdaf83dd12b76dd6cc46eaa8d74da52
Closes-Bug: #1524558
Closes-Bug: #1496042
2016-01-13 17:02:22 +03:00
Jenkins 6d66994733 Merge "Fix network connectivity issues" 2015-12-31 13:20:27 +00:00
Dmitry Bilunov d0a4d33caa Fix network connectivity issues
Master node needs an outbound internet connection to download repository
metadata during admin node bootstrap process. We need to wait until it
starts building docker containers, then enable the connection and wait
until the bootstrap process completes.

This change depends on another patch, which makes 'dockerctl build all'
much more verbose (https://review.openstack.org/#/c/261062/36).

Change-Id: Ibcc50bb47bd95dc1675aaf1abddbac375a434e2a
Depends-On: I77a1d3a32633390c1fe37bbeb81da5d0996972df
Closes-Bug: 1525967
2015-12-29 12:08:13 +03:00
Jenkins a08d3d640c Merge "Do not hardcode scancodes that change isolinux boot params" 2015-12-18 15:32:23 +00:00
Dmitry Bilunov e61354ccd2 Fix network connectivity issues
Master node needs an outbound internet connection to download repository
metadata during admin node bootstrap process. We need to wait until it
starts building docker containers, then enable the connection and wait
until the bootstrap process completes.

Partial-Bug: 1525967
Change-Id: I0ca296cb5f727d2b6a5708355956c30e4ccf283b
2015-12-17 18:23:28 +03:00
Dmitry Bilunov 95a5cfb6f1 Do not hardcode scancodes that change isolinux boot params
We have a "skipfuelmenu" variable in virtualbox scripts, which allows to
skip "fuelmenu" step during the installation procedure. This option is
enabled by default.

Currently, we have a hardcoded variable $boot_line, which contains scan
codes, passed by VirtualBox into isolinux on an emulated keyboard.

We should generate these scancodes from a user specified line instead of
hardcoding them.

Partial-Bug: 1525967
Change-Id: Ia2419b5e2eaa4b30cd2876112d7c080abbebcba5
2015-12-17 12:09:23 +03:00
Dmitry Teselkin c5cbe939d6 FORWARD rules for public network
CentOS7 comes with pre-defined REJECT rule in FORWARD chain
that doesn't allow to access external networks from public
network.

When deploying ISO with virtualbox scripts slave nodes are trying
to connect to external networks via public net, with default
gateway on master node. However, they can't establish a connection
because there is no explicit rule in FORWARD chain to allow it,
so they are rejected.

This commit adds rules to allow connection to ext networks in
that usecase.

Compatible with CentOS6 & CentOS7 master node.

Blueprint: master-on-centos7

Change-Id: I5b61ae6e7562ea5b446809027c487acc11119889
2015-12-02 10:52:20 +00:00
Ivan Suzdal a96589911c Disable colorised grep output
In centos 7 grep aliased to

  grep --color=auto

which causes line matching error in product.sh

Blueprint: master-on-centos7

Breaks: nothing

Closes-Bug: #1517140

Change-Id: If7b351834535a5dbe900ec5387d48fcb81885458
2015-11-25 13:38:03 +00:00
Stanislav Makar ebabd4604b Use right way to skip fuelmenu
Use virtualbox built-in keyboardputscancode instead of using
ssh to master node and kill fuelmenu.

Change-Id: Ie3a12b7ca54e4c606f4c88145cc3cbad5822480a
Closes-bug: #1501796
2015-10-05 10:18:25 +00:00
Vasiliy Pleshakov 7dc713ff28 Enable VRDE option for VMs in vbox scripts
VRDE option makes VMs accessible via RDP.
Fix vboxmanage to run via execute decorator.

Closes-Bug: #1498889
Change-Id: I93560126940457518fc4385c0518ab00d4b3d800
2015-09-24 15:03:52 +03:00
bgaifullin ca5a2adfcf Added support to deploy product on remote machine via ssh
It is useful in case if there is 2 machines:
the main that has limited resources and used only for development and
the second, that has enough resources to use it for deployment.
enable feature VRDP for virtual machine

Change-Id: Ib34a188311cc04250d29e685bf5b9f12ac2aeb05
Closes-Bug: #1491925
2015-09-23 12:54:42 +03:00
Serhiy Ovsianikov 5e336fb715 VBox - there are a lot of ssh.exe processes under Cygwin
When we execute the installation of the Fuel master node we are
launching ssh commands and checking messages in the file
bootstrap_admin_node.log. If the ssh processes accumulate in the
operating system you could see the following error: “The system
has no more ptys”.
Also Cygwin does not work correctly with the command
"send "res=$(for i in 1 2 3 4...)"

Change-Id: I30aab51452505e88c18abc866f88efde2d7650fb
Closes-Bug: #1457956
2015-05-25 10:14:23 +03:00
Serhiy Ovsianikov 7dc55cc8f1 Fix for VBox "No Internet connection on compute nodes"
The scripts work without any firewall tuning on the user's computers.
The Fuel master node is forwarding the public network through
the existing NAT interface.

Change-Id: I2962bccb39828da4ff011889f990a67d89322ca3
Closes-Bug: #1288135
2015-05-14 20:20:57 +03:00
Serhiy Ovsianikov 6a1b721625 Nodes waiting for manual partitioning
Adds serial numbers of disks to slave nodes

Change-Id: I20b66de6b2917e9674fb124068630ba5da3e59cf
Closes-Bug: #1431891
2015-04-27 17:49:46 +03:00
Serhiy Ovsianikov 9737a945a6 Delete only the demo hostonly networks
Change-Id: I81b1c73d782e75e89ce76c51e0b6e9246409d80e
Closes-Bug: #1384976
2015-04-07 15:27:55 +03:00
Jenkins 8841a977e3 Merge "Switch virtualbox script to 82540EM adapter driver" 2015-04-02 08:18:38 +00:00
Nikolay Markov 510542f7ae Removed RHOS/RHEL warning from virtualbox script
Change-Id: I69f2ff63d74983a08a0715ef334362d1ae6c5df9
Closes-Bug: #1413933
2015-03-30 12:49:07 +03:00
Bogdan Dobrelya 252ac49e48 Switch virtualbox script to 82540EM adapter driver
With the PCnet-FAST III network adapter driver Centos 6.5 nodes
in environments get isolated via the management network and that
completely breaks the virtualbox script users experience.

The solution it to switch back to Intel PRO/1000 MT 82540EM
as it shows no issues with the connectivity.

DocImpact: Virtualbox guide

Closes-bug: #1434610

Change-Id: I33ae3cccd6f36723200cff0ff73ba0d12814fd3e
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
2015-03-20 16:21:24 +00:00
Serhiy Ovsianikov ad8aaacc91 Slave nodes are not booted
We restart all the NICs of master node after we ensure Cobbler is
ready. Restarting NIC breaks network connection between Cobbler
and outgoing physical network. Added another restart of the docker
container after network restart.

Change-Id: I0bbba2fbad801e109f52ee5fbcf203b8ba7d1dd8
Closes-Bug: #1427227
2015-03-03 09:07:08 +02:00
Jenkins 89f22db486 Merge "Call which from virtualbox scripts" 2015-02-17 22:51:52 +00:00
Serhiy Ovsianikov 7ddf69872f Call which from virtualbox scripts
The "which" command is replaced with the "type" command. The free
memory check error on the host has been fixed.

Change-Id: I2cb8d143616372b649d51b9543160d40e5f2f510
Closes-Bug: #1415685
2015-02-12 11:31:32 +02:00
Serhiy Ovsianikov af9123332f VirtualBox scripts calls ping incorrectly
Fixed checking for Internet connectivity on the host computer,
fixed bug call ping utility with different arguments and under
different systems. Added check run docker container cobbler
on the master node.

Change-Id: If8a8862faca083f038d184e11c5a0d057eb91b56
Closes-Bug: #1412459
2015-02-05 17:05:37 +02:00
Jenkins 5494f985f6 Merge "Correct search of name virtual machines in list" 2014-12-30 17:17:24 +00:00
Matthew Mosesohn 1679c27f65 Default showmenu=yes, add workaround for VirtualBox
Change-Id: I763a76cf44a8ba69be4621375c782431eccaaf55
Closes-Bug: #1402519
2014-12-17 18:48:32 +03:00
Serhiy Ovsianikov 057b95e3ef Correct search of name virtual machines in list
In the functions is_vm_running() and is_vm_present(), located in the
file function/vm.sh, search of running and available virtual machines
has been fixed. The search of the names virtual machines
extrafuel-master and extrafuel-slave-1 didn't work correctly.

Change-Id: If73546e5b4b2a8a64f0b955f85579ee0dafd93f0
Closes-Bug: #1387602
2014-12-11 11:33:18 +02:00
Matthew Mosesohn 6e02b0ded7 Fail Fuel Master deployment if puppet or check fails
Puppet apply for Fuel Master deployment runs with
--detailed-exitcodes in order to capture any failures
and fails if any resource fails to apply, including
docker containers.
Cleaned up some obsolete lines about hiera and astute.yaml.

Fixed automated environment deployment scripts to detect
failed deployments and fail as well.

Change-Id: I29238a27f1335d63a6c82274a6dab9b25e1ecf0a
Related-Bug: #1390129
2014-11-10 19:09:52 +04:00
Dmitry Borodaenko 2faf976236 Parametrize headless option for VirtualBox
If you need to start VirtualBox VMs without a GUI, for example, on a
remote computer, you can now set the 'headless' parameter in config.sh
to '1'.

DocImpact
Closes-Bug: #1304345

Change-Id: I868fa67335506a5e048d37411f5d5795b560a338
2014-10-31 12:50:36 -07:00
Dmitry Tyzhnenko 6cc70091ed Changes to improve work under windows
Added check for procps in prepare-environment
Available memory check moved to separate action
Added requirements section in README
Fixed top and free check in Cygwin

Change-Id: I2e700602fe7bb81464975521023f4693462b4379
Closes-Bug: #1373655
2014-10-09 17:08:51 +03:00
Jenkins 66b624b472 Merge "Fixes a bug with filename extension during .vdi creation." 2014-10-08 19:29:23 +00:00
Evgeny Kozhemyakin 4e137849b3 Some functions in vbox scripts relied on language specific output.
Change-Id: I1c4be75336c2a8150f8f73a628185df2de19b16c
Closes-Bug: 1376434
2014-10-08 18:36:57 +04:00
Evgeny Kozhemyakin d853bd7f72 Fixes a bug with filename extension during .vdi creation.
Change-Id: Ib1a7b0256d8961946e844f265667053e5e422d9b
Closes-Bug: 1376429
2014-10-08 14:11:05 +04:00
Dmitry Tyzhnenko b3f18704b3 Apply different configurations by separate launchers
Add 3 lauchers for 4, 8 and 16 GB RAM on host PC.

For Linux(Cygwin) and Darwin used different way of fetch total memory.

Change-Id: I70487bda3e7492f72b5d5051de2e697bcae03377
Closes-Bug: #1358345
2014-09-01 18:18:41 +03:00
Fabrizio Soppelsa e83d9e2689 Fixes cobbler dnsmasq settings
Change-Id: I439ad25d263a57324c6cff6aa00b9a49e5767726
Closes-Bug: 1323365
2014-08-18 19:13:44 +04:00