Some design of system_test packages:
- move actions to separate package
- move core fuctionality to core package
Change-Id: I7b12380a687c9cccbd44d79819f842b1b2470cd5
Implemets blueprint template-based-testcases
For run the tests from both test suites (fuelweb_test, system_test) we
may use new runner - run_system_test.py.
Changes in framework:
- add @testcase decorator use instead of @factory
Features of new runner:
- auto discovering all test in both test suites
- show the groups from the test suites
- explain content of groups
- run the several groups at the same time
- combine configuration with the test groups from new suite
- run old groups
- use runner in utils/jenkins/system_tests.sh
Changes in tests:
- remove @factory function
- add @testcase to each test class
Change-Id: Ic4086dde60ca8a94dcd2ee079376c97ce719ff03
Implemets blueprint template-based-testcases
Add function for adding custom group which checks presence
the config file
Implement blueprint template-based-testcases
Change-Id: I4347754749cc5d7fb3c46eeebea6cb0097551777
To avoid false positive result in gate fuel library test add next assertion:
* We have packages that should be updated - if not raise error
* Packages from review is higer version that installed - if not raise error
Change-Id: I065bef8f73d2abdb1b3a905a2720a2db5277e4fc
Closes-Bug: #1523466
For define own group, put it into group_list in
define_custom_group() at run_tests.py
Implements blueprint template-based-testcases
Change-Id: I8804768f17dc2368b7c2f99dc838ec0308bba79a
Rework fuleweb_test framworks for automation generating TestCase
put yaml confs into fuelweb_test/system_tests_templates
define Case in fuelweb_test/actions_tests
proboscis generate group of test for each case and config
For sen new test plans use Jenkins script.
for all matrix:
sh -x "utils/jenkins/system_tests.sh" -L -j $JOB_NAME \
-t test -w "$WORKSPACE" -i $ISO_PATH \
-o --group=system_test \
-o --show-plan -k -K
for some case and all configuration:
sh -x "utils/jenkins/system_tests.sh" -L -j $JOB_NAME \
-t test -w "$WORKSPACE" -i $ISO_PATH \
-o --group=system_test.create_deploy_ostf \
-o --show-plan -k -K
for some case and some config
sh -x "utils/jenkins/system_tests.sh" -L -j $JOB_NAME \
-t test -w "$WORKSPACE" -i $ISO_PATH \
-o --group=system_test.create_deploy_ostf.1ctrl_1comp_1cinder_neutronVLAN \
-o --show-plan -k -K
for run all destroy controllers failover cases
sh -x "utils/jenkins/system_tests.sh" -L -j $JOB_NAME \
-t test -w "$WORKSPACE" -i $ISO_PATH \
-o --group=system_test.failover.destroy_controllers.3ctrl_2comp_1cndr_neutronVLAN \
-o --show-plan -k -K
Change-Id: I81eeb0df84a0f373be029f20ec6c53e8d3596596
Implements blueprint template-based-testcases
Andreas Jaeger