Commit Graph

1159 Commits

Author SHA1 Message Date
Andreas Jaeger 3e5483d1dc Retire repository
Fuel (from openstack namespace) and fuel-ccp (in x namespace)
repositories are unused and ready to retire.

This change removes all content from the repository and adds the usual
README file to point out that the repository is retired following the
process from
https://docs.openstack.org/infra/manual/drivers.html#retiring-a-project

See also
http://lists.openstack.org/pipermail/openstack-discuss/2019-December/011647.html

Depends-On: https://review.opendev.org/699362
Change-Id: If0c2011947c9eb63f59093812b5f9f95ce56a6f8
2019-12-18 09:39:30 +01:00
OpenDev Sysadmins 46d1908d60 OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:39:51 +00:00
Jenkins e61117ba7c Merge "Revert "Bump version to 11.0.0"" 2017-03-29 11:58:18 +00:00
Vladimir Kuklin 60c39fa362 Revert "Bump version to 11.0.0"
This reverts commit 682e626961.

Change-Id: I8084b437f3a4daf512732095d6c35bdb816d6514
2017-03-29 11:53:25 +00:00
Vladimir Sharshov (warpc) 039ce9e0b8 Do not send data about nodes in case of task deployment
Nailgun use data about nodes in stop deployment respond
to reset it to discovory state which is unexpected behavior
for already provisioned nodes in case of task deployment

Change-Id: I39de8a8afd627b0bf209d9a7f6ad6e19abd99016
Partial-Bug: #1672964
2017-03-28 16:39:03 +03:00
Jenkins 0145a4abf5 Merge "Bump version to 11.0.0" 2017-03-23 12:28:21 +00:00
Jenkins cbec1d0887 Merge "Add command_prefix field to puppet mcagent" 2017-03-21 13:30:01 +00:00
Jenkins 2f01ecc857 Merge "Fix wrong ready status instead of stopped for stop deployment" 2017-03-20 12:52:44 +00:00
Vladimir Sharshov (warpc) 496212798e Fix wrong ready status instead of stopped for stop deployment
Report ready status for node means successful node status
which can be get if all tasks was passed with ready and skipped
statuses.

Same effect can be get if Astute mark node as skipped. In this
case we also get equal status 'successful'.

So we need ask node about skipped statuses before ask it about
successful status to prevent losing context about stop
deployment operation.

Change-Id: I3c042425cab800de0bfc4e03f29414b145f44983
Closes-Bug: #1672964
2017-03-17 20:48:52 +03:00
Valeriy Sakharov 446346b32c Add handling of exit code 100 from timmy.
Diagnostic snapshot returns "Timmy: exit code 100" in the case of
insufficient disk space. In the manual docs of timmy such exit code
has more detailed description.

Change-Id: Idb2a3c31d32025e990c981ff5717309a4a536589
Closes-Bug: #1671455
2017-03-17 16:20:45 +04:00
Vladimir Kozhukalov ec4abb2573 Add command_prefix field to puppet mcagent
This will allow to run puppet with environment variables.
E.g. FACTER_foo=bar puppet apply ...

Change-Id: I1e435262e810ead46689078513607f6a99a19043
Implements: blueprint get-rid-cobbler-dnsmasq
(cherry picked from commit c734b03042)
2017-03-15 11:49:35 +03:00
Vladimir Sharshov (warpc) 892894bfb5 task_deploy: no implicit conversion of String into Integer
Now Astute will not calculate fault tolerance groups and
critical node uids twice.

Change-Id: I3bf2dd0ffc0fc74fd9c670bd50b32e3285ae7e2a
Closes-Bug: #1669499
2017-03-02 19:16:31 +03:00
Vladimir Kuklin 682e626961 Bump version to 11.0.0
Change-Id: I2dee213c28f94c4b7819a14316f433e195b30372
2017-03-02 17:27:34 +03:00
Vladimir Sharshov (warpc) 48ee1f7467 Fail tolerance behavior for upload file tasks
Additional changes:

- decrease number of "reset undefined retries" messages;
- rewriting log messages for better understanding.

Change-Id: I17db392ac4c73a3c08505fcbaf17dbcce96ebd91
Blueprint: graph-concept-extension
2017-02-28 04:50:19 +03:00
Vladimir Sharshov (warpc) c489e972ff Add retries for upload tasks: upload_file and upload_files
Some of mcollective client for some reason can ignore task
from Astute. For such cases Astute shoult retry it request.

Also:
- refactoring tasks to support class hook post_initialize
  instead of super
- change @task and @ctx to equal instance methods
- removed old fixtures

Change-Id: I96613f53303fd71acc437d2f8f47b599bcf3b5d9
2017-02-16 19:06:49 +03:00
Vladimir Sharshov (warpc) 003a0a0efd Astute do not respect debug option for puppet task
Run cluster with enable debug option do not affect
puppet task which always run with debug disable.

It is happened because Nailgun send debug option which
Astute setup for every task, but puppet task required
puppet_debug option to control it behavior. This code
will connect this parameters.

Change-Id: I8df68105aa699e83673c39a0f03bb22673171d6f
Closes-Bug: #1662512
2017-02-07 17:13:35 +03:00
Vladimir Kozhukalov 64d62086e8 Move not provisioned nodes to error status
When there are lot of nodes to provision and we provision
them by chunks, we could fail in the middle due to "Too many
nodes failed to provision". If so, we need to append those
nodes where we did not started provision at all to the list
of failed nodes. Otherwise, those nodes will be reported
as 'provisioned' with progress = 100 and rebooted.
But for some reasons we bind all nodes before starting provision
to debian-installer profile in cobbler, and being rebooted
these not provisioned nodes will fail to boot, because since
7.0 we put empty files where cobbler expects debian-installer
kernel and initrd files. :-)

Change-Id: I2a401b80614ee7dd5a10931b9b50bcff066f790f
Closes-Bug: #1656269
(cherry picked from commit 570049ca1f)
2017-01-16 15:12:18 +03:00
Jenkins 891367a72a Merge "Improve the gracefully stop debug messages" 2017-01-16 08:39:45 +00:00
Jenkins 6eea2344d7 Merge "Add basemodulepath to the Puppet mcagent" 2017-01-13 17:14:12 +00:00
Dmitry Ilyin 96e535ae2c Improve the gracefully stop debug messages
Change-Id: I736aebefbeba7fd1ddaa0ce844a53999d346d7fd
(cherry picked from commit b78e52d204)
2017-01-13 17:11:29 +00:00
Jenkins 0b9c778325 Merge "Fix mcagent report" 2017-01-13 15:04:41 +00:00
Dmitry Ilyin 1c1578b64a Add basemodulepath to the Puppet mcagent
This parameter is required for Puppet 4
to be able to find the base modules without
any environment defined.

Puppet 3 is able to work in the legacy mode
without the environment support and does not
case if there is base module path or not.

Closes-Bug: 1655663
Change-Id: I60f2c78ef5fe366314eea186f4671d198e54f1d6
2017-01-11 14:33:47 +00:00
Dmitry Ilyin 2505ab1d8e Fix mcagent report
Set reports to none in order to disable the Puppet
reporting during the deployment. It some cases it
Puppet was failing the deploymnet being unable to
store the report file to the missing Puppet master.

Change-Id: I888316824920f71f6c4953c513eea3a4c277d50b
2017-01-11 17:28:45 +03:00
Dmitry Ilyin cc4ecafe2c Add missing comments
Change-Id: I4d59bb10b3340ae85ea8406fd238ad8843b4bc50
2017-01-11 14:10:03 +00:00
Jenkins d411a2e0f2 Merge "Network problem tolerance puppet status check" 2017-01-06 11:53:16 +00:00
Vladimir Sharshov (warpc) 7c0485eb1a Network problem tolerance puppet status check
Connection between node and Astute can be lost some
times, so we need more tries to get info about task
status on node.

Two changes:

- instead of 1 try Astute will run 6 tries with 10
timeout for every attempt;
- it will process such behavior for puppet using separately
  retries: puppet_undefined_retries

Instead of full puppet retry status retry is safety because
it is idempotent.

Puppet undefined retries can be setup using Astute config
or sending undefined_retries in puppet task parameters same
way as for usual retries. Most important thing: it will refresh
to original value every time when Astute get defined answer.

Change-Id: Ie86576a3400be5a6b11041c8e6acf89abf3bbd51
Related-Bug: #1653210
Closes-Bug: #1653737
2017-01-05 18:02:18 +03:00
Vladimir Sharshov (warpc) b0752c7a78 Fix fail detection for provisioning
Add test to prevent such behavior in future

Change-Id: If833723f0301f2008e6aabfc888d0bdf693f4f2e
Partial-Bug: #1653210
2016-12-30 12:45:13 +03:00
Jenkins 06fe7856f6 Merge "Upload file task timeout support" 2016-12-28 14:50:06 +00:00
Vladimir Sharshov (warpc) dc47550460 Use async shell call for provision
This change allow to use async shell task based on
puppet to run provision commands.

It is transition change between old run way of image
provision and provision as graph which will also
used async shell to run.

It is more fault tolerance way to provision because
temporary problem with connection between master node
and provisioning node do not block or fail provision.

Important notice: it is allow only if bootstrap image
has puppet and daemonize packages which is true for 9.2
or higher releases.

Change-Id: Ie634fae9b63bf0c103ec8926647af75b57cefe23
Related-Bug: #1644618
2016-12-27 19:51:57 +03:00
Vladimir Sharshov (warpc) f475c45dfc Upload file task timeout support
Astute will not retry and will not wait around 10 minutes for
every node which connection was missed in case of
upload file task. For now it will wait only default upload
timeout.

Default timeout for upload now can be setup in config. For now
it is 60 seconds. Also upload file task now support timeout
parameter which will overide default.

Change-Id: Ice8207f539566a50d4eb30c04ab563c3ee1278ec
Closes-Bug: #1629031
2016-12-27 19:43:16 +03:00
Jenkins 1dc4d754b7 Merge "Speed up graph && node processing" 2016-12-16 13:59:24 +00:00
Vladimir Sharshov (warpc) e12bdbd984 Speed up graph && node processing
- in case of big number of node (more then 200) and tasks
(more then 20000), progress calculation can slow down
- remove status magent call from puppet run (decrease number
  of magent calls from 2 to 1 in case of positive scenario)

Change-Id: I70675a6bbd391d0112c594626bdb0ce7bb9e3e1e
2016-12-16 15:04:15 +03:00
Vladimir Sharshov (warpc) 3905cab1ea Compact nailgun hook error message
This change change error message by adding '\n\n' before error
details which give Fuel UI ability to hide this part of message.

Change-Id: I2e93ee3aa0aae183cd320d2438f781a975c5e70f
Closes-Bug: #1614422
2016-12-15 23:11:14 +03:00
Flavio Percoco 7d69504cf6 Show team and repo badges on README
This patch adds the team's and repository's badges to the README file.
The motivation behind this is to communicate the project status and
features at first glance.

For more information about this effort, please read this email thread:

http://lists.openstack.org/pipermail/openstack-dev/2016-October/105562.html

To see an example of how this would look like check:

https://gist.github.com/de41bea42a0fcac0e9d5ab669ec130dc

Change-Id: I2f52299e68ed5151ac2016e8ceccf064028f19be
2016-11-30 12:19:22 +00:00
Jenkins 5dccee10ec Merge "Revert "Support global progress for tasks"" 2016-11-23 17:26:08 +00:00
Jenkins 94a03de62d Merge "Add logging for network checker MCollective plugin" 2016-11-23 10:19:05 +00:00
Jenkins 584dba9acd Merge "Remove info from the log message about retries for suceed tasks." 2016-11-22 09:07:55 +00:00
Jenkins 41bf29fea0 Merge "Set timeout for resource which is used to wrap shell tasks." 2016-11-22 09:07:10 +00:00
Jenkins 215c353c0d Merge "Fix default retries parameters for shell tasks" 2016-11-22 09:05:40 +00:00
Evgeny L fd7fe0ee73 Add logging for network checker MCollective plugin
Closes-bug: #1641741
Change-Id: I0ab24230a036c22d6fa96d5cf2e534260bed6e33
2016-11-21 16:40:19 +00:00
Jenkins 5856dc1076 Merge "Run nailgun-agent on rebooted nodes" 2016-11-14 08:59:01 +00:00
Evgeny L 9bebfc6b17 Fix default retries parameters for shell tasks
Use shell specific parameters shell_retries and shell_interval,
instead of mc_retries and mc_interval which are used for retries
if node was not accesible via MCollective.

Closes-bug: #1641198
Change-Id: I04a4d187ab3aa4cde46b2775766eb88babd46ab7
2016-11-11 20:58:23 +00:00
Evgeny L e4abca6827 Set timeout for resource which is used to wrap shell tasks.
Slow tasks fail, because default timeout for `exec` resource
is 300 seconds. The patch passes timeout from the task to
puppet wrapper.

Closes-bug: #1641190
Change-Id: I8f7c2120e61144911481c83b0da391e30bbc6f2f
2016-11-11 20:40:28 +00:00
Evgeny L 99153e5374 Remove info from the log message about retries for suceed tasks.
Sometimes engineers missread the message, it's not obvious
that there such a thing as succeed_retries, so it's read
as a message of failed task which does not have more
retries.

Closes-bug: #1641194
Change-Id: I948996fcb8054a2bde27a9de7c7cac650b3c2b8c
2016-11-11 20:37:50 +00:00
Vladimir Kuklin 1ab30505b7 Revert "Support global progress for tasks"
This reverts commit 3f21d35f35.

Change-Id: If0cf99129fdc38c40ee8322c872f6b4f9b83c0b5
Partial-bug: #1633212
2016-11-08 09:38:26 +00:00
Vladimir Sharshov (warpc) bca595a964 New version of puppet task engine
Changes:

- remove report from task engine;
- remove old logic for hangs and 'idling' statuses;
- increase code redability;
- add code docs;
- support retries in case of MClient errors for status
  and run actions;
- replace timeout raise on usual code;
- descrease waiting time for puppet run (from 120 to 10) and
  time between try (from 30 to 2);
- mcollective retry descrease from 5 to 1. Now it will use
  puppet retries if failed during network/mcollective problem
  after 1 try.

Closes-Bug: #1613396
Change-Id: I98fe3df65ef335b03eceb2c401eba12cf68ee1c8
2016-10-17 13:08:30 +03:00
Vladimir Sharshov (warpc) de9c731fc2 Run nailgun-agent on rebooted nodes
Without this change some node can be marked wrongly
as offline in Nailgun side.

Change-Id: I4a89ac101867effe6f277c2dcaa93e9b67b65875
Closes-Bug: #1626072
2016-10-13 14:09:01 +00:00
Vladimir Sharshov (warpc) 11ec66899e Support global progress for tasks
Calculate progress for cluster using simple formula

    100 * all_tasks_finished / all_tasks_total

It will works with custom graph too.

Change-Id: Iaea07ec19d80d5f344c8ecf434f771da7a608157
Closes-Bug: #1623937
2016-09-26 14:02:30 +03:00
Jenkins c11a24c052 Merge "Fix non-working zero tolerance error group" 2016-09-26 10:56:49 +00:00
Jenkins 00f10f8cfc Merge "Increase xml rpc timeout" 2016-09-23 09:32:07 +00:00