Commit Graph

150 Commits

Author SHA1 Message Date
Andreas Jaeger 3e5483d1dc Retire repository
Fuel (from openstack namespace) and fuel-ccp (in x namespace)
repositories are unused and ready to retire.

This change removes all content from the repository and adds the usual
README file to point out that the repository is retired following the
process from
https://docs.openstack.org/infra/manual/drivers.html#retiring-a-project

See also
http://lists.openstack.org/pipermail/openstack-discuss/2019-December/011647.html

Depends-On: https://review.opendev.org/699362
Change-Id: If0c2011947c9eb63f59093812b5f9f95ce56a6f8
2019-12-18 09:39:30 +01:00
Vladimir Kozhukalov ec4abb2573 Add command_prefix field to puppet mcagent
This will allow to run puppet with environment variables.
E.g. FACTER_foo=bar puppet apply ...

Change-Id: I1e435262e810ead46689078513607f6a99a19043
Implements: blueprint get-rid-cobbler-dnsmasq
(cherry picked from commit c734b03042)
2017-03-15 11:49:35 +03:00
Dmitry Ilyin 1c1578b64a Add basemodulepath to the Puppet mcagent
This parameter is required for Puppet 4
to be able to find the base modules without
any environment defined.

Puppet 3 is able to work in the legacy mode
without the environment support and does not
case if there is base module path or not.

Closes-Bug: 1655663
Change-Id: I60f2c78ef5fe366314eea186f4671d198e54f1d6
2017-01-11 14:33:47 +00:00
Dmitry Ilyin 2505ab1d8e Fix mcagent report
Set reports to none in order to disable the Puppet
reporting during the deployment. It some cases it
Puppet was failing the deploymnet being unable to
store the report file to the missing Puppet master.

Change-Id: I888316824920f71f6c4953c513eea3a4c277d50b
2017-01-11 17:28:45 +03:00
Evgeny L fd7fe0ee73 Add logging for network checker MCollective plugin
Closes-bug: #1641741
Change-Id: I0ab24230a036c22d6fa96d5cf2e534260bed6e33
2016-11-21 16:40:19 +00:00
Georgy Kibardin ac2703949f Remove puppet status files right before running it
This prevents us from picking up status files from previous run when
current run hasn't written them for some reason, i.e. crash etc.

Change-Id: I83d0b4aa3c42210279b75ed7b575919d2d092ff0
Closes-Bug: #1560026
(cherry picked from commit e5311dd97b)
2016-09-21 14:53:23 +00:00
Jenkins c33fe77e77 Merge "Filter raw_report only with log events for noop_run" 2016-09-06 17:28:19 +00:00
Denis Egorenko 0b353f3ed3 Filter raw_report only with log events for noop_run
Use filter for raw_report only with log events (such as what was
changed, were was changed, what was triggered and etc) for noop_run.

Change-Id: I4e0f1d25e8145de46f7ff059956cd086bf2f699c
Related-bug: #1618945
2016-09-01 19:38:55 +03:00
Jenkins 652622f203 Merge "Use 'discover' instead of 'vlans' commands for DHCP discover" 2016-08-29 14:23:36 +00:00
Denis Egorenko 30e09c10f9 Add ability to run puppet with noop
This patch adds ability to run deployment graph with noop option.
In same time, this option will be applied only to 'shell' and
'puppet' types only.

Change-Id: Ibcb275bb84dfd553ab07e6d58af753ecf96ab3a5
2016-08-18 13:23:12 +03:00
Kyrylo Galanov 8402425be1 Fix race condition in get puppet status
Check if puppet is running or not before reading last_summary

Closes-bug: #1593166
Change-Id: Ie8d68b570109277ba3324d6404d626bc98eb44ba
2016-06-30 06:01:31 +02:00
Artem Roma b19509b452 Use 'discover' instead of 'vlans' commands for DHCP discover
Interface of dhcpchecker has been changed so this patch make net_probe
agent work in accordance.

Change-Id: If4fbcb9643b0f45f7e1b76d8ae8f525cef1df298
Related-Bug: #1569325
2016-06-06 12:05:20 +03:00
Artem Roma 2d3f9db07b Revert "Use new command for DHCP discovery check"
This reverts commit a0c53594e8.

Change-Id: Ic1688f30dc6a4c8e8339b9d9d25416daaaeffa4f
2016-06-03 13:31:36 +00:00
Artem Roma a0c53594e8 Use new command for DHCP discovery check
Change-Id: Ifa1d51103dbca26fad9ef8526d06ab002b2320d2
Related-Bug: #1569325
Depends-On: I30e4c1614095291bf9a5cb144f15800d1bd6f850
2016-05-31 18:11:45 +03:00
Vladimir Sharshov (warpc) 065bc28c80 Support detailed puppet run report
Without this change Astute send only combined summary: part data
from last_run_summary and part data from last_run_report.
With this change user can setup Astute send detailed report in
summary by setup 'puppet_raw_report' in Astute config.
In this case Astute will also send raw_report field with
full puppet run report.

Change-Id: I52bd709fc3fdd44d5477f75bdb36d063a2754555
2016-05-24 18:05:33 +03:00
Dmitry Guryanov 3c00fb6550 Fix cleaning boot sectors of disks on delete
Bootloaders may check MBR signature to determine,
if it can boot from thios disk. So let's clear it
together with boot code.

Also #{dev[:name]} is just a name of a device, like
sdb, so add /dev/ path.

Change-Id: Ifc23fe4e4919a10b3d5546c98ee333ccac9c92f2
2016-05-10 20:04:13 +03:00
Dmitry Guryanov 9a547037ef Don't use oflag=direct while erasing bootloader code
We are erasing 446 bytes of bootloader code before rebooting
node, but you can write only blocks with O_DIRECT, so let's
write 446 bytes without oflag=direct and do sync after dd
instead.

Change-Id: I7b5f9749b170a9b7191991dd02cb867bba0e4c43
Partial-Bug: #1573105
Closes-Bug: #1538587
2016-04-27 18:42:08 +03:00
Vladimir Sharshov (warpc) b672edc601 Support FusionIO flash storage device
Add 251 as valid code for storage device

Change-Id: I5ab12bc507fa860aac9e55f0fcd1a3bf4228a226
Closes-Bug: #1571039
2016-04-15 21:48:20 +03:00
Vladimir Sharshov (warpc) 2915ad5acf Strong check for puppet transaction report
We should check not only class of report, but value of
resource statuses.

Also we should not use default pid to allow running other puppet
instances

Related-Bug: #1552805
Closes-Bug: #1566582
Change-Id: I1dd0c25891c8d064e0f3ab1a12ddb14698070c17
2016-04-06 18:11:47 +03:00
Jenkins b7812110cc Merge "Bump version to 10.0" 2016-04-06 12:07:43 +00:00
Jenkins 88f00d35dd Merge "Allow runnining other puppet instances" 2016-04-05 16:40:01 +00:00
Dmitry Guryanov e770d4ec7d Erase only boot code in MBR during node delete
Zeroing first 1Mb of a block device will almost always
lead to serios system error, if there is a filesystem
on this block device and this filesystem is mounted.

This code had 2 points: to prevent system from booting
from hard drive after reboot and to prevent anaconda
(or other OS installer) to automatically recognize
disk structure. But since we only use image-based provision
this is not the case anymore.

It's enough to clear first 446 bytes of MBR where the first
stage of a bootloader resides. So we will also be able to
check nodes disks and filesystems after deleting it from
cluster for troubleshooting for example, because partition
scheme will not be touched.

https://wiki.archlinux.org/index.php/Master_Boot_Record

Change-Id: I60f2b250d6d5997b4b471c27ed00d057ae73c30a
Fixes-bug: #1538587
2016-03-29 11:59:12 +03:00
Sergey Kulanov 0d0f36418b Bump version to 10.0
Change-Id: I9168641b8cf515f613c3c1066bd545917a1e6133
Related-bug: #1558589
2016-03-27 20:30:44 +00:00
Jenkins acf65e9e34 Merge "Send error output to puppet log" 2016-03-24 14:47:46 +00:00
Georgy Kibardin 9e7c6d5b57 Allow runnining other puppet instances
Do not enter error state when other puppet instances are detected by the
time we run puppet apply. Let it be other puppet owner responsibility to
synchronize with our puppet instance.

Change-Id: Id01f16d661c55b0cc82bf3a6eed2050deb5665d1
Closes-Bug: #1552805
2016-03-23 11:29:56 +03:00
Aleksandr Didenko cc96d438b0 Add timeout to urlaccesscheck command
5 seconds timeout per URL should be enough to detect probelms with
URL accessibility and avoid MC agent execution timeouts.

Change-Id: Ic0214c8164d0659ee6f5dd73e8e1c438d413c76a
Closes-bug: #1558460
2016-03-18 13:18:39 +01:00
twm2016 b781cd5417 Send error output to puppet log
Sets the daemonize command option to /var/log/puppet-error.log

Change-Id: I0e253471619fd945a13458a7a8a8f48daa06ee82
Closes-Bug: #1459330
2016-03-14 16:18:12 -05:00
Alex Schultz 1f4ccee1be Add parsing of last run puppet report
This change adds in the attemped to parsing of the puppet's
last_run_report.yaml as part of the summary task. This will add a list
of resources that were changed or failed to the response from the
puppetd mcollective agent

Change-Id: Iddec06add86cf20f19c3165020d2d6e465f908a2
Related-Blueprint: granular-task-idempotency
2016-02-10 17:10:33 +00:00
Sergey Kulanov 2bef8bc37e Bump version to 9.0
Change-Id: I1a2f5b59d356b1b1ad8495eb16fba225d7eaa8cc
2015-12-17 15:45:26 +02:00
Aleksandra Fedorova 7cea69bd02 Update paths due to stackforge migration
All repositories have been moved from stackforge/ to openstack/ namespace.

Change-Id: I7657a209468f1865b9daafac956b65fc38ccbc51
2015-10-18 01:05:24 +03:00
Fedor Zhadaev e99368bd77 Continue node_erase even if prevent_discover fails
Even if prevent_discover fails we should continue node erasing.

Change-Id: Iacc68383ec5f694c5b4b6af8530d66f0f7d64cc7
Closes-Bug: #1496366
2015-10-08 15:21:36 +03:00
Vladimir Sharshov (warpc) 9126e1ce33 Bump version to 8.0
Change-Id: I40144ebe01aa1e4e16dda1e921a6a9b6f2f9fe73
2015-08-28 16:46:52 +03:00
Dmitry Shulyak c2819dd713 Add collect_timeout and cleanup hung listeners properly
netprobe will be started with *collect_timeout* parameter
that is lower than net_probe.rb agent timeout

hung frame listeners will be matched correctly, and cleaned with
termination signal

Change-Id: I7dc2adf6aa1d199e2b8fe58718aad5e56f85b9d1
Partial-Bug: 1466020
2015-08-12 19:07:18 +03:00
Jenkins 7802b7f3b9 Merge "Revert "Add HOME variable to puppetd mcagent"" 2015-08-03 13:52:56 +00:00
Matthew Mosesohn 68e741f8fc Revert "Add HOME variable to puppetd mcagent"
This reverts commit c7fc19f942.
Closes-Bug: #1480192

Change-Id: Ia4664a51d30f4e07e2147427c2b5bf15af574b48
2015-08-03 13:45:06 +00:00
Jenkins 488db988a1 Merge "New message about repository check fail" 2015-07-30 13:50:57 +00:00
Matthew Mosesohn c7fc19f942 Add HOME variable to puppetd mcagent
Some puppet modules depend on HOME variable
being configured for normal operation.

Change-Id: Iba1a0c6413fc8756d7bd60f6e5a3201d8d120c86
Closes-Bug: #1479763
2015-07-30 14:57:46 +03:00
Vladimir Sharshov (warpc) 745fea3968 New message about repository check fail
Done:
- change message about error;
- add into mcollective log info about perfomed command;
- add tests.

Change-Id: I0c0c9b67157879e05fd4c43f67477d8de3b8f549
Related-Bug: #1471085
2015-07-29 18:28:30 +03:00
Alexei Sheplyakov 199a9bcb0f nailgun-mcagents: log the command being executed
Having to guess which command has failed is not that much fun.

blueprint fuel-bootstrap-on-ubuntu

Change-Id: Iff0feffa39d4fddadafe90b46f7e238cf026a52e
2015-06-25 16:56:50 +03:00
Jenkins 776157f722 Merge "Adjust wait to allow erase_node to send response" 2015-06-15 14:03:28 +00:00
Alex Schultz a6218d4696 Adjust wait to allow erase_node to send response
This change changes the way the erase_node action performs the cleanup
of the disks. We attempt to remount any ext2/3/4 devices as RO and
set the error action to continue. Additionally we are no longer using
sysrq to sync all file systems, reboot all file systems, or sending a
SIGTERM to all processes. Now the disk erase occurs and a sysrq to
reboot the machine after 5 seconds via a forked process. This should
allow for mcollective to send back the response to the fuel node to
acknowledge the erase_node action.

Change-Id: If5ce3d1c2ce99ec422a372bfc30b273583f9fb38
Closes-Bug: 1461074
2015-06-11 08:51:37 -05:00
Aleksandra Fedorova 58869dfcc2 Bump version to 7.0
Change-Id: I63f09bc041d8604d9f2c23e568752db5b91583e2
2015-06-08 20:56:07 +03:00
Alex Schultz 1b8588b6ea Update erase_node deletion process
When mcollective is launched via Upstart, the current implementation
of the filesystem erase code is not being executed as part of the
SIGTERM handler that is called when we attempt to SIGTERM all
processes. This change pulls the majority of the code we use to
erase a system out of a child thread into the main agent action. This
change leaves the reboot in a child process and SIGTERM handler so
that astute will get the response for the erase_node command and will
mark it complete. An added benefit of this change is that the debug
messages are now returned back to astute and show up in the astute.log
where previously they were being silently discared.

Change-Id: Ib9ee7db0a4d872ea5d1485ec036940f12b0d251e
Closes-Bug: 1461074
2015-06-03 15:13:08 -05:00
Łukasz Oleś 79f9135697 Create required directories before creating a file
Change-Id: Iceac5103fa7512aeb2a9e10d7e573a200f3c33e3
Closes-bug: #1456895
2015-05-20 08:10:07 +00:00
Jenkins d1706534d4 Merge "Add repo availability verification with network setup" 2015-05-19 18:01:40 +00:00
Vladimir Kozhukalov 961359f387 Moved nodiscover to /etc/nailgun-agent
We create /etc/nailgun-agent/nodiscover during
provisioning and then this file is assumed to be
removed in /etc/rc.local which guarantees
that nailgun-agent doesn't change mcollective config at the
same time when cloud-init does this. Otherwise, we can
end up with corrupted mcollective config.

Former location of this file /var/run/nodiscover assumes
it is removed at the beginning of the boot process while
we need it to be in place at least until cloud-init
has finished its magic. For details see
http://www.pathname.com/fhs/pub/fhs-2.3.html#VARRUNRUNTIMEVARIABLEDATA

Related-Patch: If8d1252e6d351ad073de26afc13a19de76f531fb
Change-Id: I5fca4ca39abdc273f6958f2643fae6c5c99fba68
Related-Bug: #1449186
2015-05-19 12:41:40 +03:00
Dmitry Shulyak 24eda075fe Add repo availability verification with network setup
Repo availability with and without setup will return 
response in next format:

  {uid=> '3', status=> 1, out=>{failed_urls=>[...]}, err=>"Error message"}

Partial-Bug: 1439686
Change-Id: I3216b97df5e7b8974ac7155d06446c4419d293a1
2015-05-18 07:41:51 +00:00
Vladimir Sharshov (warpc) cb655a9a9a Send correct message about failed provision node, fix node type detection
We use 'hook' role because we do not need to calculate
multirole progress. Also for provision we do need role
at all. But here we use DeploymentProxyReporter and
need role.

Fix node type detection: 'target\n' or 'target' should
be detected as 'target'

Change-Id: Ibb87bf4a0b0abdf5ad0d703bb40cc55ae8ce9104
Closes-Bug: #1455824
Closes-Bug: #1455883
Co-Authored-By: Vladimir Kozhukalov <vkozhukalov@mirantis.com>
Co-Authored-By: Łukasz Oleś <loles@mirantis.com>
2015-05-17 13:55:12 +03:00
Jenkins 7e3e81f2e3 Merge "Use urlaccesscheck to try to retrieve repos" 2015-05-15 15:44:06 +00:00
Maciej Kwiek 12ef23583a Use urlaccesscheck to try to retrieve repos
Add check_url_retrieval action to net_probe.rb. It uses urlaccesscheck
from network checker to retrieve urls passed as parameter.

Add check_repositories method to dispatcher. It uses above action via
orchestrator to test given urls.

Partial-Bug: #1439686
Depends-On: Idc04f74ad7364dee452e9151391654f828e2342d
Change-Id: Ifb28bd0a53abf07e48d41683d10f90546889b0e4
2015-05-15 17:17:00 +02:00