1. PyCharm inspection: ignore no member for magic places
(six.moves, mixin for system_test, unicode<->string on python2)
2. Fix docstrings
3. Fix reraise of SkipTest
(use raise instead of raising again the same exception, but no args)
4. Bash simple variable usage
Closes-bug: #1578998
Change-Id: Ifac2dcb68b323ce48c6c80598abfd18ed9bf2caf
Change: %s by {:s}, %d by {:d} in string and use .format method for formatting
Closes-bug: #1552139
Change-Id: Ic9bdf9200fa89fa7c78f2806a7b94e3eee914cf9
Some design of system_test packages:
- move actions to separate package
- move core fuctionality to core package
Change-Id: I7b12380a687c9cccbd44d79819f842b1b2470cd5
Implemets blueprint template-based-testcases
1. Fix imports (lovercase imported as UPPERCASE)
2. Fix local variables (CamelCase/UPPERCASE)
3. Use Python3 compatible syntax, when it possible
4. Define attributes in __init__
5. Remove redundant parenthesis
6. Add /logs to .gitignore (to prevent log publish and remove fake git status notifications)
blueprint fuel-qa-python3-compatibility
Change-Id: Ifd60646055d07f888b2e204083b99d9db507f93e
For run the tests from both test suites (fuelweb_test, system_test) we
may use new runner - run_system_test.py.
Changes in framework:
- add @testcase decorator use instead of @factory
Features of new runner:
- auto discovering all test in both test suites
- show the groups from the test suites
- explain content of groups
- run the several groups at the same time
- combine configuration with the test groups from new suite
- run old groups
- use runner in utils/jenkins/system_tests.sh
Changes in tests:
- remove @factory function
- add @testcase to each test class
Change-Id: Ic4086dde60ca8a94dcd2ee079376c97ce719ff03
Implemets blueprint template-based-testcases
1. screnarios -> scenarios
2. spended_time -> spent time (used only at 1 place)
3. rename few test methods (not groups)
4. removed unused code (
assign element of dictionary before return of this element only,
redundant parenthesis - again,
comeback of mutable defaults - again,
variable, which redefined on the next line in if-else)
Change-Id: I68ffdc85c2d1289d7ab6ef6a7f4084c19e7afcf9
Related-Bug: #1513777
Runtime changing of yaml config via environment variable use !os_env
Add validator for unique file name of yaml config file. We should have
unique file names in system_test/tests_templates/tests_configs
Yaml configuration compiled only when test started, than increase
creation speed of test plan and improve isolation of config files
Using name of yaml file for link config and test case instead of the
test-group node in yaml file before
Add several types of group names:
case_group.CONFIG
case_gorup(CONFIG)
case_gorup[CONFIG]
case_gorup{CONFIG}
Add default devops template
system_test/tests_templates/devops_configs/default.yaml
Use devops config in ceph_all_on_neutron_vlan.yaml
Implements blueprint template-based-testcases
Change-Id: Ib5ae4126041b2aad059199e93d0c78457125b1fe
Add @nested_action decorator
To combine some actions into one use @nested_action for method
which returns list of sub actions.
Implement blueprint template-based-testcases
Change-Id: Iac85df6ddaaa83ae2966d3a4e0963aa534c38877
For snapshot name used case class + hash from config name + step
DeployCheckRadosGW_562aa0fd_Step002
Implements blueprint template-based-testcases
Change-Id: Iad3be3f4a4f7cd7977ed7a22948247e4c2354624
Use decorator @action for method which used as step.
Prefix _action_ still work.
Implements blueprint template-based-testcases
Change-Id: I802d79071c313528a29d6f63abf2db5f6cebbe7f
Rework fuleweb_test framworks for automation generating TestCase
put yaml confs into fuelweb_test/system_tests_templates
define Case in fuelweb_test/actions_tests
proboscis generate group of test for each case and config
For sen new test plans use Jenkins script.
for all matrix:
sh -x "utils/jenkins/system_tests.sh" -L -j $JOB_NAME \
-t test -w "$WORKSPACE" -i $ISO_PATH \
-o --group=system_test \
-o --show-plan -k -K
for some case and all configuration:
sh -x "utils/jenkins/system_tests.sh" -L -j $JOB_NAME \
-t test -w "$WORKSPACE" -i $ISO_PATH \
-o --group=system_test.create_deploy_ostf \
-o --show-plan -k -K
for some case and some config
sh -x "utils/jenkins/system_tests.sh" -L -j $JOB_NAME \
-t test -w "$WORKSPACE" -i $ISO_PATH \
-o --group=system_test.create_deploy_ostf.1ctrl_1comp_1cinder_neutronVLAN \
-o --show-plan -k -K
for run all destroy controllers failover cases
sh -x "utils/jenkins/system_tests.sh" -L -j $JOB_NAME \
-t test -w "$WORKSPACE" -i $ISO_PATH \
-o --group=system_test.failover.destroy_controllers.3ctrl_2comp_1cndr_neutronVLAN \
-o --show-plan -k -K
Change-Id: I81eeb0df84a0f373be029f20ec6c53e8d3596596
Implements blueprint template-based-testcases