Commit Graph

432 Commits

Author SHA1 Message Date
OpenDev Sysadmins 89dc41f0eb OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:50:51 +00:00
Dmitrii Sutiagin 883dca4cf0 Change: improve roles string split
This change has been requested by Dmitrii Kabanov dkabanov@mirantis.com.
Now if roles is a string, it does not have to have spaces after commas.

Change-Id: I8b7bae1e1f2a4955dda9440b629393f18edc6fac
2017-10-24 13:40:11 -07:00
Dmitrii Sutiagin 377f3bb085 Fix: scripts_all_pairs does not trigger archive
Change-Id: I46b41fdfdd13d7039521c5d19f90f558ae2ad944
2017-10-20 23:46:12 +00:00
ritesh.arya fc2dbf8707 PyPy is not checked at gate.
Change-Id: I39f7080ddc8379b36246d718c8cf3f2aa2e720a9
2017-06-29 18:50:17 +05:30
Dmitrii Kabanov 4300eaa765 Change: prepend conf.env_vars to scripts with env vars
Fix SPT after Change-Id: I4f61e0ac061263d249bfa210cc5f165fbfee2471

Change-Id: I1fb4021f8bc2fe5fd2a27df4a7ce8f26c3329a0f
2017-03-22 19:09:34 -07:00
Dmitrii Kabanov 39b8aa8b96 Change: use environment variable for openrc in SPT
Change-Id: I4f61e0ac061263d249bfa210cc5f165fbfee2471
2017-03-20 16:01:41 -07:00
Dmitry Sutyagin ff8faad8a4 Add: collect ceilometer & aodh config
Change-Id: I5fe6cc4e6777a83e64a22df108d6e6953922d37b
2017-03-14 18:39:23 -07:00
Aleksandr Dobdin 5945cd7c88 Fix: add "fuel2 task list" for 10.x series
Closes-Bug: #1661247
Change-Id: I3835d168f295fcb45ea0c91f2266358cb9735d92
2017-03-02 11:53:54 +04:00
Dmitry Sutyagin 0f7a39be83 Fix: exec_pair trace; SPT bugs; print non-0 exit
- Fix crash when hitting logger.warning in exec_pair
- Fix SPT bugs:
  - iperf sometimes not installed for HW to HW test
  - iperf_server_stop broken in several ways
  - glance download script has wrong filename
  - SPT_parser traces on empty glance output
- Print to stdout on non-0 exit to tell about unclean exit to user
- Reorder SPT copy-paste line once more

Change-Id: I7a37b5fce5bc620cc9e2db8d232180c215cd3782
2017-02-24 14:56:11 -08:00
Dmitry Sutyagin c8727d1431 Fix: UnicodeDecodeError, broken spec; add SPT
- Only convert outputs/errors to unicode if printing required,
  use 'replace' error handling to avoid errors. Write original
  byte str to output files to avoid double conversion.
- Fix spec broken with 1.26.6.
- Add simplified-performance-testing config & rq files, scripts.
  Can be used after deployment to get a few benchmark values.
  SPT_parser.sh can be used to parse results.

Change-Id: I2aacfdbd9574ff737a6b88a29d87ae56abd03e46
2017-02-23 16:02:58 -08:00
Jenkins ffb5092290 Merge "Update documentation to match timmy 1.26.6 code" 2017-02-14 23:28:44 +00:00
Jenkins 76a534acd3 Merge "Fix: CLI docs" 2017-02-14 23:28:33 +00:00
Dmitry Sutyagin d485bdfbb6 Update documentation to match timmy 1.26.6 code
Might have missed something though!..

Change-Id: Ia35c5398570c6c46ec9a7d2e28a1865b56b24013
2017-02-14 15:20:33 -08:00
Dmitry Sutyagin 7d0c582065 Fix: CLI docs
Change-Id: Iea3847e07e7f919a0fdcb66eab76b12be155d101
2017-02-14 15:18:38 -08:00
Dmitry Sutyagin d6ec39fc50 Bump version to 1.26.6
Change-Id: I435ec9dadab787f60284562afc574b0663cc6fe2
2017-01-19 16:21:02 -08:00
Vladimir Kozhukalov 565cfaf344 Add yum.repos.d directory to snapshot
Change-Id: I7f64aacb5f1a96c885135d358323ee3af9c01834
2017-01-19 15:12:38 +03:00
Aleksandr Dobdin 5f439b7aae Change: print only summary for analysis module if all nodes are ok
Change-Id: Idfd592ffdbc8e493a698f477bdb5e4ff11d0697e
2017-01-18 11:29:22 +00:00
Nam Nguyen Hoai ebe583f558 Replace yaml.load() with yaml.safe_load()
Avoid dangerous file parsing and object serialization libraries.
yaml.load is the obvious function to use but it is dangerous[1]
Because yaml.load return Python object may be dangerous if you
receive a YAML document from an untrusted source such as the Internet.
The function yaml.safe_load limits this ability to simple Python
objects like integers or lists.

In addition, Bandit flags yaml.load() as security risk so replace
all occurrences with yaml.safe_load(). Thus I replace yaml.load()
with yaml.safe_load()

[1] https://security.openstack.org/guidelines/dg_avoid-dangerous-input-parsing-libraries.html

Change-Id: I4b554fa20c2391a0f7a11fd5d6f5f944f0de2d03
2017-01-18 14:04:11 +07:00
Dmitry Sutyagin 4139ef04cf Change: minor changes in analyze & rabbitmq module
Change-Id: Ib3e373bfea86ad35e3e2f384b0cdc8762cc25f5a
2016-12-27 17:42:31 -08:00
Aleksandr Dobdin ee44efcd49 Added: stderr for mapping scripts
Change-Id: If40ea86db849f09ffc2e9936483a2dee3776e65e
2016-12-27 11:03:35 +00:00
Dmitry Sutyagin 77634b9565 Add: max_pairs argument; other minor changes
- Add max_pairs parameter to limit concurrency for
scripts_all_pairs run
- Move maxthreads and logs_maxthreads into configuration
- Rework some of the configuration comments

Change-Id: I74c308c9a7aa5177eba8d6c9afb69c79bc1f809a
2016-12-22 17:30:09 -08:00
Dmitry Sutyagin f292a9fccd Fix: scripts_all_pairs sometimes uses same node
Change-Id: I4b1ce980514ecc0b77a229c9dcb878dac9db8079
2016-12-21 14:11:59 -08:00
Dmitry Sutyagin 3d535488ba Add: rabbitmq analysis module
rabbitmqctl list_queues:
    - non-empty queues (100 - yellow, 1000 - red)

rabbitmqctl status:
- disk_free vs disk_free_limit
- file_descriptors (sockets & total)

Change-Id: I0697683f31fb8b235aadf845d531053875f2ff48
2016-12-20 20:36:28 -08:00
Aleksandr Dobdin dd688c9d96 Fix: download network templates for 9.1
Change-Id: I145dffa48d932415b19de3c30a60dbcae1b05fbd
2016-12-20 08:38:48 +00:00
Oleksandr Liemieshko f00b04a3ed Fix: flake8 warnings
Change-Id: I6e36654d53117327c91f4819afa517ccb13d8952
2016-12-15 19:49:21 -08:00
Oleksandr Liemieshko 4600fef101 Add: scripts_all_pairs 'one way' mode
Add config parameter scripts_all_pairs_one_way
Add cli argument --one-way

Change-Id: I27237f2b8534a284b05aad63d9b78ca9ff9b943a
2016-12-15 19:39:35 -08:00
Dmitry Sutyagin 6988c468d8 Fix: RuntimeWarning when using analyze
Change-Id: Ie0e5c67cf2daf04b63d36fb7f28658bbf4471a80
2016-12-14 16:18:24 -08:00
Dmitry Sutyagin 9169d0cd13 Change: compact analyze output, minor refactor
Change-Id: If29463ac4d349dffa0dd6817fdace2795ffc6f9a
2016-12-12 20:26:19 -08:00
Dmitry Sutyagin c3c0182c72 Add: dynamic import of analyze modules
modules should be put into timmy/analyze_modules directory
subdirectories are also supported

__example__.py explains the internals and can be used as a template

Change-Id: I4d32f2467dfe1885e71340bd24e8e587aed667c1
2016-12-12 20:02:10 -08:00
Aleksandr Dobdin 89131f92e1 Add: fuel network template download script
starting from MOS 7.0

Change-Id: I0ec27a1e61988c1026989c656d7ac86323a9078d
2016-12-12 14:08:11 -08:00
Dmitry Sutyagin ba213af116 Fix: IOError if no-clean + outdir missing
Change-Id: I93df3bcf8834939a84668ea6f904e961922425b4
2016-12-09 19:13:12 -08:00
Oleksandr Liemieshko d3f313478b Add: ability to analyze old results
change mapscr structure
add function generate_mapscr
add property scripts_ddir
add conf parameter 'offline'
add cli argument 'offline'
call generate_mapscr from analyze when mapscr empty
add fuel-node-json script
add fuel-node-json to default.yaml

+ fix analyze parse_df_* fail with longer dev names in df output

how to analyze old results:
1. extact results archive into /tmp/timmy/info
2. run timmy with the following arguments:
--no-clean
--analyze
--offline
--nodes-json /tmp/timmy/info/scripts/fuel/fuel-node-json

Change-Id: I4eeb314e9cd00a1c43096e2bfeb583da958ec439
2016-12-09 18:35:33 -08:00
Aleksandr Dobdin fc6151fbb8 Fix: merge postgres dump
Added: logrotate config file

Change-Id: I4525f30197d178dbaf2af85fe20d961902deec06
2016-12-07 12:25:48 +00:00
Oleksandr Liemieshko d038b827f3 Fix: fake not implemented for commands
Change-Id: I703d562b2b70310859dfc16de82af86a126dc058
2016-12-06 19:53:21 -08:00
Oleksandr Liemieshko abdb347e6b Add: function analyze
Add argument -a --analyze
Add conf parameter 'analyze'
Add analizys for scripts: 'df-m', 'df-i'

Change-Id: I0697777da6be773103b337c001df8aaeb4290db1
2016-12-06 19:25:40 -08:00
Dmitry Sutyagin 49900d09eb Add: collect haproxy stats
Change-Id: If93339e7007c6d279128bc080ab7db2c5389870b
2016-12-05 09:15:43 -08:00
Aleksandr Dobdin 4cb2524c49 Added: new spec file
Change-Id: I5c10a9101361f4f04d8532d5f46cf729f65d7be7
2016-12-01 15:43:52 +03:00
Dmitry Sutyagin 956bf1f945 Fix: Fuel not skipped when shell mode used
This is a fix for a regression introduced in
commit 24e9d4f7c6

Change-Id: I22d58d70661fcf4aa58ae500bfef207e830d57f0
2016-11-30 15:53:30 -08:00
Dmitry Sutyagin 0799872729 Change: fuel postgres dump collection
We now attempt to collect the dump disregarding the release
For both postgres in docker and in main system.
Two files will always be present in collected results:
fuel-docker-postgres-backup and fuel-postgres-backup
One of them will be empty, the other will contain the backup.

Which one is empty depends on whether postgres is in docker or not.

Change-Id: I9627fb00595ae8ce21188727b8d3de71b64fbcf1
2016-11-29 18:50:12 -08:00
Dmitry Sutyagin d5b268cf72 Add: timmy version in log and outdir
Change-Id: I14e1847744dd0ab69faaa2490bcce40ac2d9e594
2016-11-28 18:17:58 -08:00
Dmitry Sutyagin 3bd21aafe2 Change: collect /etc/fuel** instead of /etc/fuel
Change-Id: I710ee1a876dd0586bef9258f29cc13524e79e67d
2016-11-28 16:07:26 -08:00
Dmitry Sutyagin b7fb24bfc2 Add: debugging traceback on USR1
Change-Id: I53e139c4168d18691f16b42a60e4f2b10def0eb2
2016-11-28 15:34:54 -08:00
Dmitry Sutyagin 6eb8f52c11 fix: timmy fails in "mdir" when using --dest-file
Closes-Bug: https://github.com/adobdin/timmy/issues/68
Change-Id: I0454416896d17b45bd756cb4cc40ac8d3c60193f
2016-11-22 18:45:44 -08:00
Dmitry Sutyagin de323f534b fix: tummy stuck when calculating log size
Timmy can get stuck on proc.join() if queue has not been collected
and the queue does not fit into the system pipe buffer.

This fix adds a loop in which we try to get data from the queue and
then join the process but with a 1 second timeout, so we don't block
forever.

Closes-Bug: https://github.com/adobdin/timmy/issues/66
Change-Id: I0d96a7c8aa6823bc5c22c4b6b74e4897d52d4332
2016-11-22 18:13:50 -08:00
Jenkins 851e279185 Merge "fix: conf_assign_once can assign to skipped nodes" 2016-11-21 20:21:33 +00:00
Dmitry Sutyagin 24e9d4f7c6 fix: conf_assign_once can assign to skipped nodes
+ refactor
+ rename "filtered_out" to "skipped"

Change-Id: I59b82797301e62b946ae05ab580909975efcd726
2016-11-21 11:06:02 -08:00
Aleksandr Dobdin 6db1649a2e version bump
Change-Id: I3969f37876784391d908e9d582cbc183042a0282
2016-11-21 11:30:37 +00:00
Dmitry Sutyagin c1e77f357c Add: collect resolv.conf in Xenial (systemd)
Closes-Bug: #1628201
Change-Id: I5dfd188bcf6fe7999b595038bf44e56e9f3e2ad3
2016-11-14 17:15:09 -08:00
Dmitry Sutyagin 4f0e10e81e Add: make rsync options configurable
Related-Bug: #1628201
Change-Id: Iedbd1b9f7d1925d4788abd6b2ea48e89aaef737f
2016-11-14 17:15:04 -08:00
Dmitry Sutyagin 4c1a1f6ebd Add: load notice in usage doc
Closes-Bug: #1625778
Change-Id: Ib396aadb82a9d9a4dc56321d595998abf14f0c2e
2016-11-14 14:02:14 -08:00