Commit Graph

109 Commits

Author SHA1 Message Date
Andreas Jaeger 946b07d23b Retire repo
This repo was created by accident, use deb-python-os-testr
instead.

Needed-By: I1ac1a06931c8b6dd7c2e73620a0302c29e605f03
Change-Id: I81894aea69b9d09b0977039623c26781093a397a
2017-04-17 19:29:25 +02:00
Attila Fazekas 083faa0741 Simplify logic in _get_test_list
_get_test_list had the same action for the elif case,
it was replaced by 'or' .

Change-Id: I2be9974beea3ca398d61e58726a63518b15cf3c4
2016-07-27 15:40:15 +02:00
Jenkins e15700f1b9 Merge "Make unexpected success as fail" 2016-07-07 21:14:31 +00:00
Masayuki Igawa 2b33cfa983 Fix doc warnings and disable smarty-pants
This commit fixes some doc warnings and disables the smarty-pants
function. The html_use_smartypants function renders '--' to '–'(–)
but it's not good for command options.

Change-Id: Iab0a93db86f46f26b074ca3e9904fd5ff1b0f533
2016-06-29 13:57:02 +09:00
OpenStack Proposal Bot 023351aef2 Updated from global requirements
Change-Id: I22e18be6ce0cedec98063a848d205b292d0b92e1
2016-06-22 05:46:39 +00:00
Matthew Treinish 89594a37e6 Remove the TODO file
The problem with TODO files is they require constant commits to keep
up to date, and this rarely happens. As is the case here where this
file is now quite stale and hasn't ever been updated. This commit
just drops the file in favor of just using launchpad as our task
tracking solution.

Change-Id: Id576d0f4dab2ecaf28db93909b7860306898a759
2016-06-21 19:23:47 +00:00
Jenkins b2d7365c89 Merge "Sort failed tests at the top on HTML result page" 2016-06-21 18:49:43 +00:00
Jenkins 79fa9a47fc Merge "Add documentation for generate-subunit" 2016-06-21 18:21:15 +00:00
Masayuki Igawa 10f1d43b07 Make unexpected success as fail
This commit makes unexpected success (uxsuccess) as fail. We already
consider expected fail as success. So this is a consistent change.

Change-Id: Ic8f9f07354dc16bc0daac71f59aa9799c04c27a6
2016-06-17 16:42:21 +09:00
Matthew Treinish 01da1dbac1
Add documentation for generate-subunit
When the generate-subunit command was added to os-testr we neglected
to add documentation for the new command, this commit addressed that.

Change-Id: Ie643ecd2eb5faa98bfae921a9d9f96a33c7d43ba
2016-06-10 14:00:47 -04:00
melanie witt f95f1d4448 Sort failed tests at the top on HTML result page
Currently tests are sorted alphabetically by test class name regardless
of the pass/fail status. When troubleshooting failed unit tests in
jenkins jobs with many unit tests (> 11242 in nova), one must scroll
potentially a lot or wait as the page loads to search for the word
'fail' to get to the details of the failed test.

This sorts failed (and error) tests at the top of the HTML page for
easier troubleshooting (sorted failed tests + sorted passed tests).

Change-Id: I0b575e77c4a3e1cc73e60ea48ca5b9bf2e84d76f
2016-05-26 20:38:37 +00:00
Jenkins e5e11dca2e Merge "Add whitelist file to ostestr docs" 2016-05-26 02:00:46 +00:00
Matthew Treinish 74999a5dcc
Add whitelist file to ostestr docs
This commit adds the missing details for the whitelist file to the
ostestr docs.

Change-Id: I863dcad9b1a77a083f7007ab76760e77295c610d
2016-05-24 15:58:41 -04:00
Jenkins a04c851f35 Merge "Split functionality out of main" 2016-05-24 19:25:41 +00:00
Jenkins 0cf7a786d3 Merge "Seperate regex builder logic into a seperate module" 2016-05-24 19:22:44 +00:00
Jenkins 1afd5e916d Merge "Fix coverage option and execution" 2016-05-23 23:15:00 +00:00
Matthew Treinish 73bf72c71b
Seperate regex builder logic into a seperate module
The regex building logic is independently useful and will likely start
to be used in other places. This commits splits it out from the ostestr
cli and makes it an independent module that just contains the pieces
necessary for building a selection regex.

Change-Id: Ic8494d0f54357fdafd650b40219e6ad7fd5a65ad
2016-05-23 19:10:16 -04:00
Jenkins a5bd26aaa8 Merge "Fix docs typos" 2016-05-23 23:04:17 +00:00
step6829 7c2bb825c4
Split functionality out of main
This commit splits out the actual output generation functionality from
the main function. It also adds parameters for specifying a stdin and
stdout file object. This enables external access to the output
generation within python, which could be useful for integrating
subunit-trace output with your own test runner.

Change-Id: Id9fc13b9b70c5b2cc47b48eee6426e7e312eff7f
2016-05-23 16:09:58 -04:00
OpenStack Proposal Bot 24a0b840b5 Updated from global requirements
Change-Id: Ie11baaa6281b9879a469ebf5bae1e17f80325c9a
2016-05-06 22:21:28 +00:00
Jenkins e92c5e8b37 Merge "Add version option for ostestr and subunit-trace" 2016-04-22 23:11:07 +00:00
Masayuki Igawa deaabb5fb7 Fix docs typos
This commit fixes docs typos.

Change-Id: I7f2369e2aad82f2883e408f56204c89e723cc376
2016-04-18 16:21:30 +09:00
OpenStack Proposal Bot 23557a0bf8 Updated from global requirements
Change-Id: I12ace2aa7553d892e4325f59dcaeb43271af0eaa
2016-04-13 12:47:16 +00:00
Yushiro FURUKAWA 6e908db6df Fix coverage option and execution
--coverage-package-name option was no longer supported by 'testr'[1].
This commit replaces from 'testr' to 'test' as coverage option.

[1] https://review.openstack.org/#/c/217847/

Change-Id: I0430fd696752c1cd8e33bb2d146e08e442ebc3f8
2016-04-13 07:43:58 +09:00
Masayuki Igawa 0bb53cdfcc Add version option for ostestr and subunit-trace
This commit adds a version option to os-testr commands. Users would like
to confirm the version when then face unexpected behavior of the command
like a bug.

Change-Id: I30ee9623c25f2ce2da0fab0b5e0a2795b46a2cd6
2016-04-12 13:08:32 +09:00
Masayuki Igawa 9a6f4c9653 Remove openstack-common.conf
This commit removes openstack-common.conf file. It was introduced by the
cookiecutter when the os-testr repository was created. However, this
file isn't used anymore, and it was already removed from the
cookiecutter repository as a cleanup[1].

[1] I2b5377391a4422caa395f62fbd5df3049f01fdec

Change-Id: Id33e4c7c4bd8cebded08f5dad55a60cf0be7cd0f
2016-04-04 14:46:55 +09:00
Jenkins 7010f0d921 Merge "remove python 3.3 trove classifier" 2016-03-29 19:04:14 +00:00
Jenkins 52ed42c483 Merge "py26/py33 are no longer supported by Infra's CI" 2016-03-29 19:04:09 +00:00
Masayuki Igawa 28a9f32ec7 Add pypi download + version badges into README.rst
This commit adds pypi download and version badges into README.rst.
With these badges, users can know the latest version and download
statistics.

Change-Id: I16eed1cf4acf84df728ba9c9dcf7706d14a484fe
2016-03-28 13:50:58 +09:00
Shu Muto 7ac7fc457b remove python 3.3 trove classifier
OpenStack projects are no longer being tested under Python 3.3, so
remove the trove classifier implying that this project supports 3.3.

Change-Id: Ic189fc1f4159459457bf9ca0e55969f6b17b2d8e
Closes-Bug: #1526170
2016-02-23 00:19:34 +00:00
Matthew Treinish 8502e72356
Treat xfail output like success
This commit updates one edge case where output from xfail was treated
like a failure instead of like a success.

Change-Id: I073302bc9aea6751906cb4955055c55b7c5dc3fc
2016-02-22 16:30:26 -05:00
Jenkins c0e03d3e31 Merge "Enable testr run passthrough arguments" 2016-02-11 21:12:50 +00:00
OpenStack Proposal Bot 08b5418f73 Updated from global requirements
Change-Id: I2246ce4ec35e0d60ca68dc6920d6d558a43fde7d
2016-02-10 21:57:50 +00:00
Jenkins 747dce792e Merge "remove python 2.6 trove classifier" 2016-02-04 05:00:51 +00:00
Jake Yip 7980dde165 correct typo
Change-Id: I39e4eacadca8caa5c249de5a2105b4674a54a27b
2016-02-02 15:59:27 +11:00
Jenkins 6f599a2735 Merge "Add unit test for colorizer" 2016-01-28 10:58:40 +00:00
Matthew Treinish bef89fc8f8
Enable testr run passthrough arguments
This commit enables passing through any unknown arguments to testr run.
There are several features in testr's run cli which aren't exposed in
ostestr. Instead of adding a duplicate argument for each of these this
commit will capture any unidentified arguments and will pass them
through to the testr run subprocess call.

Change-Id: I26eb5c6a5908258c3035b93d72924646bb834d40
2016-01-26 04:40:06 -05:00
Masayuki Igawa 87ec944a0c Updated from global requirements
This commit updates *requirements.txt that comes from global
requirements.

Change-Id: I19df7b5d7ce54d5a793018e8158d985775fb7007
2016-01-26 14:25:59 +09:00
Masayuki Igawa 8f71069bc8 Add unit test for colorizer
This commit adds unit-test cases for colorizer module.

Change-Id: I329a808bbed3240e6fa41ac21d3e5558a0704d6a
2016-01-12 13:58:24 +09:00
Jenkins 2366c8c170 Merge "Add subunit_trace --color option's doc" 2016-01-07 01:20:33 +00:00
Jenkins 29c64b1287 Merge "Support comments in whitelist files" 2016-01-05 17:24:51 +00:00
Davanum Srinivas b46734734b Support comments in whitelist files
We already support comments in blacklist files. we should
do the same for whitelist files as well.

Change-Id: I5ad0c113cdb04dd1bdaa4d8bfdd1a3ab169fb0af
2016-01-05 11:45:02 -05:00
Matthew Treinish cc64a3a585
Add tool to create a subunit stream
This commit adds a generate_subunit.py script which is used to
generate a subunit stream with a single result for a period of time.
It takes 2 mandatory args and 2 optional to specify the start time,
stop time, and optionally the status (it defaults to success) and an
id for test (if one isn't provided 'devstack' is used) The resulting
stream is written to STDOUT. There is some overlap with subunit-output
from tool from python-subunit, but this is a much smaller scope to just
just do a test_id, status, and timestamps. subunit-output doesn't support
timestamps. Eventually it'll be good to add the missing pieces to
subunit-output at which point we can likely deprecate and remove this.

The intent here is to leverage this to inject 'test results' into the
subunit2sql db to reflect failures that occur before tempest (or any
other test suite) is run. This is necessary for the openstack-health
dashboard. (otherwise it makes our failure rate look much better than
it is) This is only needed until we get a zuul mysql reporter in place
which can give us the higher level run information.

Change-Id: Icc7df33e4d73ba6322af38fbdf3aea230f2fcf4d
2016-01-04 17:30:47 -05:00
janonymous 6f3958fb35 py26/py33 are no longer supported by Infra's CI
Python 3.3/2.6 support would be dropped by
Infra team from mitaka,CI would no longer be testing it,
so projects should drop it also.

Change-Id: Ib4c347038aa894ef808c0ab731d9b38982a47b40
2015-12-26 14:22:24 +05:30
Doug Hellmann 5ca66b4680 remove python 2.6 trove classifier
OpenStack projects are no longer being tested under Python 2.6, so
remove the trove classifier implying that this project supports 2.6.

Change-Id: Iac614c24ba33b169ffcb83680556adf0b550f2c3
2015-12-23 01:31:14 +00:00
Jenkins befba5c111 Merge "Add support to ostestr to use subunit-trace color" 2015-12-17 18:33:46 +00:00
Jenkins a316fa98f8 Merge "Fail if no tests were successfully executed" 2015-12-17 18:33:40 +00:00
Jenkins 6c07c1c0c9 Merge "Fix documentation typos" 2015-12-12 23:46:07 +00:00
Matthew Treinish 2cb71893d1
Add support to ostestr to use subunit-trace color
This commit adds a new flag to the ostestr cli, --color, which
is a passthrough option to subunit-trace to enabled colorized
output.

Change-Id: Ic38e008982d8f5bca78c52f51c69b5333744ecbc
2015-12-10 18:15:37 -05:00
Masayuki Igawa 67079cd97e Add subunit_trace --color option's doc
This commit adds a document for the subunit_trace --color option.

Change-Id: I0278a20ead837d20161e4410abec0c711cc402cd
2015-12-05 23:04:49 +09:00