fuel-plugin-murano/docs/testing_documentation/test_plan/source/testing_tools.rst

Testing tools recommended by Mirantis

Mirantis recommends that you use a series of testing tools to make sure your plugin meets both Mirantis and OpenStack Community testing standards. For your convenience, the list below also provides the specific categories of the plugin to apply these tools.

Download URLs are listed in appendix.

OSTF

Mirantis OpenStack has built-in system called Health Check for a quick high-level verification of the cloud. Health Check will test the basic operations of the OpenStack API, HA validation (check MySQL and RabbitMQ clusters status) and other critical functions.

OSTF (aka Health Checks) run automatically on deploying your cluster with the plugin installed. This means, OSTF is obligatory step in all test cases.

Suitable for any plugin.

Shaker ~~~~~

Shaker is used to test network performance. It’s the distributed data-plane testing tool for OpenStack.

Suitable for Networking/SDN plugins.

Rally

Rally is used to test API functionality and performance. Rally is a benchmarking tool developed by OpenStack community and is widely used in OpenStack ecosystem.

Suitable for any plugin.

Tempest

Tempest is an original test framework developed by community and aimed to cover all possible API functionality available in Openstack components or added by third-party modules/drivers/plugins.

It contains hundreds of tests.

Suitable for any plugin.

Fio

Fio is used for disk performance measurement.

Suitable for storage plugins.

Wally

Wally enables testing framework for measuring block storage devices performance.

Suitable for storage plugins.