x
/
fuel-plugin-dynatrace
Code Issues Proposed changes
fuel-plugin-dynatrace/doc/qa/source/systemtesting.rst

8.2 KiB
Raw Blame History

System Test Scenarios

Install plugin and deploy environment

Test Case ID

  • install_plugin_deploy_env

Steps

  1. Install plugin using Fuel CLI, refer to the Installation Guide
  2. Ensure plugin is successfully installed, as in the Installation Guide
  3. Create environment with enabled plugin in Fuel Web UI
  4. Add 3 controller nodes and apply the Controller role to all 3, 1 compute node, and 1 Dynatrace Security Gateway node
  5. Run network verification
  6. Deploy the cluster
  7. Verify there were no error messages during the deployment
  8. Run health check

Expected Result

  1. Plugin is installed successfully.
  2. Dynatrace OneAgent is installed on the controller nodes.
  3. Dynatrace Security Gateway is setup successfully.
  4. All OSTF tests pass.
  5. Environment is deployed successfully.

Modifying environment with enabled plugin (remove/add controller nodes)

Test Case ID

  • modify_env_with_plugin_remove_add_controller

Steps

  1. Install plugin using Fuel CLI, refer to the Installation Guide
  2. Ensure plugin is successfully installed, as in the Installation Guide
  3. Create environment with enabled plugin in Fuel Web UI
  4. Add 3 controller nodes and apply the Controller role to all 3, 1 compute node, and 1 Dynatrace Security Gateway node
  5. Run network verification
  6. Deploy the cluster
  7. Verify there were no error messages during the deployment
  8. Run OpenStack health check
  9. Remove 1 controller node
  10. Redeploy the cluster
  11. Run health check
  12. Add 1 new controller node
  13. Redeploy the cluster
  14. Run health check

Expected Result

  1. Plugin is installed successfully.
  2. Dynatrace OneAgent is installed on the controller nodes.
  3. Dynatrace Security Gateway is setup successfully.
  4. All OSTF tests pass.
  5. Environment is deployed successfully.
  6. The environment is redeployed successfully when adding/removing a controller node.

Modifying environment with enabled plugin (remove/add compute nodes)

Test Case ID

  • modify_env_with_plugin_remove_add_compute

Steps

  1. Install plugin using Fuel CLI, refer to the Installation Guide
  2. Ensure plugin is successfully installed, as in the Installation Guide
  3. Create environment with enabled plugin in Fuel Web UI
  4. Add 3 controller nodes and apply the Controller role to all 3, 1 compute node, and 1 Dynatrace Security Gateway node
  5. Run network verification
  6. Deploy the cluster
  7. Verify there were no error messages during the deployment
  8. Run health check
  9. Add 1 compute node
  10. Redeploy the cluster
  11. Run health check
  12. Remove 1 compute node
  13. Redeploy the cluster
  14. Run health check

Expected Result

  1. Plugin is installed successfully.
  2. Dynatrace OneAgent is installed on the controller nodes.
  3. Dynatrace Security Gateway is setup successfully.
  4. All OSTF tests pass.
  5. Environment is deployed successfully.
  6. The environment is redeployed successfully when adding/removing a compute node.

Uninstall of plugin in the deployed environment

Test Case ID

  • uninstall_plugin_with_deployed_env

Steps

  1. Install plugin using Fuel CLI, refer to the Installation Guide
  2. Ensure plugin is successfully installed, as in the Installation Guide
  3. Create environment with enabled plugin in Fuel Web UI
  4. Add 3 controller nodes and apply the Controller role to all 3, 1 compute node, and 1 Dynatrace Security Gateway node
  5. Run network verification
  6. Deploy the cluster
  7. Verify there were no error messages during the deployment
  8. Run health check
  9. Uninstall the plugin with running fuel plugins --remove <plugin-name>==<plugin_version>
  10. Ensure that the following output appears in CLI: "400 Client Error: Bad Request (Can't delete plugin which is enabled for some environment.)"

Expected Result

  1. Plugin is installed successfully.
  2. Dynatrace OneAgent is installed on the controller nodes.
  3. Dynatrace Security Gateway is setup successfully.
  4. All OSTF tests pass.
  5. Environment is deployed successfully.
  6. An alert is displayed when trying to uninstall the plugin.

Uninstall of plugin in the non-deployed environment

Test Case ID

  • uninstall_plugin

Steps

  1. Install plugin using Fuel CLI, refer to the Installation Guide
  2. Ensure plugin is successfully installed, as in the Installation Guide
  3. Create environment with enabled plugin in Fuel Web UI
  4. Add 3 controller nodes and apply the Controller role to all 3, 1 compute node, and 1 Dynatrace Security Gateway node
  5. Run network verification
  6. Delete listed environment
  7. Uninstall the plugin with running fuel plugins --remove <plugin-name>==<plugin_version>

Expected Result

  1. Plugin is installed successfully.
  2. The cluster is created and network verification is passed.
  3. The plugin is enabled and configured in the Fuel Web UI.
  4. When uninstalling the plugin, no plugin-related elements are left in the environment (e.g. UI elements disappear, Nailgun database is restored to the default state, no output for command "fuel plugins --list").

Verify hot-pluggable functionality of the plugin

Test Case ID

  • hot_pluggable_plugin

Steps

  1. Install plugin using Fuel CLI, refer to the Installation Guide
  2. Ensure plugin is successfully installed, as in the Installation Guide
  3. Create environment with disabled plugin in Fuel Web UI
  4. Add 1 controller node and apply the Controller role and 1 compute node
  5. Run network verification
  6. Deploy the cluster
  7. Verify there were no error messages during the deployment
  8. Run health check
  9. Verify that no Dynatrace processes are running on either the controller node, nor the compute node
  10. Enable the plugin and fill out mandatory fields
  11. Add 2 controller nodes and 1 Dynatrace Security Gateway node
  12. Run network verification
  13. Redeploy the cluster
  14. Verify there were no error messages during the deployment
  15. Run health check
  16. Verify that Dynatrace OneAgent is running on all controller nodes and the Dynatrace Security Gateway was setup successfully

Expected Result

  1. Plugin is installed successfully.
  2. When the plugin is disabled no Dynatrace component is installed.
  3. It's possible to redeploy the cluster with the plugin activated.
  4. Then the Dynatrace OneAgent is installed on the controller nodes, the Dynatrace Security Gateway is setup successfully.
  5. All OSTF tests pass.
  6. Environment is deployed successfully.
  7. The environment is redeployed successfully when adding nodes.