A tool to load OpenStack clouds end to end in both control plane and data plane.
Go to file
Yichen Wang 70742b22b9 Fix the Rest API server to support storage tests
1. Fix the Rest API server to support storage tests;
2. Add a new folder to hold Web UI for storage tests;

Change-Id: Id55e77fab17b587ab1590b33281117bfba9245e3
2016-01-27 18:02:45 -08:00
doc Update doc for web service and other 2016-01-12 08:59:10 -08:00
kb_dib Feature commit #6 to support running fio 2016-01-26 20:57:27 -08:00
kb_server Fix the Rest API server to support storage tests 2016-01-27 18:02:45 -08:00
kb_web fix typo 2015-12-17 16:44:57 -08:00
kloudbuster Feature commit #6 to support running fio 2016-01-26 20:57:27 -08:00
.coveragerc Change ignore-errors to ignore_errors 2015-09-21 14:28:33 +00:00
.gitignore for minify code 2015-11-04 19:31:59 -08:00
.gitreview Update .gitreview for new Gerrit remote name 2015-08-03 22:33:36 +00:00
.mailmap Initial commit to openstack/kloudbuster 2015-08-03 15:49:39 -07:00
.testr.conf Initial release of VMTP to stackforge 2015-02-09 14:14:00 -08:00
HACKING.rst Initial commit to openstack/kloudbuster 2015-08-03 15:49:39 -07:00
LICENSE Initial release of VMTP to stackforge 2015-02-09 14:14:00 -08:00
MANIFEST.in Initial release of VMTP to stackforge 2015-02-09 14:14:00 -08:00
README.rst Feature commit #4 to support running fio 2016-01-22 15:11:30 -08:00
babel.cfg Initial release of VMTP to stackforge 2015-02-09 14:14:00 -08:00
openstack-common.conf Initial commit to openstack/kloudbuster 2015-08-03 15:49:39 -07:00
requirements-dev.txt Adding support to store CPU info 2015-02-25 16:07:19 -08:00
requirements.txt Fix the automated building issue for DIB 2015-11-10 10:33:26 -08:00
setup.cfg Add --show-config 2015-08-28 15:10:20 -07:00
setup.py Initial commit to openstack/kloudbuster 2015-08-03 15:49:39 -07:00
test-requirements.txt Add the support for dynamiclly generating the HTML page 2015-09-22 15:45:51 -07:00
tox.ini py26 is no longer supported by Infra's CI 2015-12-26 14:01:28 +05:30

README.rst

Overview

How good is your OpenStack data plane under real heavy load?

KloudBuster is a tool that can load the data plane of any Neutron OpenStack cloud at massive scale and can measure how well the cloud behaves under load.

Features

  • Neutron configuration agnostic (any encapsulation, any overlay, any plugin)

  • Can load the data plane with one OpenStack cloud (single-cloud operations for L3 East-West scale) or 2 OpenStack clouds (dual-cloud operations with one cloud hosting the HTTP servers and the other loading HTTP traffic for L3 North-South scale testing)

  • User can specify any number of tenants, routers, networks (only limited by cloud capacity) and KloudBuster will stage all these resources in a way that makes sense for operational data plane traffic

  • HTTP traffic load:

    • Real HTTP servers (Nginx) running in real Linux images (Ubuntu 14.04)
    • Can specify any number of HTTP servers per tenant
    • High performance and highly scalable HTTP traffic generators to simulate huge number of HTTP users and TCP connections (hundreds of thousands to millions)
    • overall throughput and latency measurement for every single HTTP request (typically millions per run) using the open source HdrHistogram library
  • Traffic shaping to specify on which links traffic should flow

  • Highly efficient and scalable metric aggregation

  • Can support periodic reporting and aggregation of results

  • Automatic cleanup upon termination (by default)

  • Manual cleanup script

  • Web Server mode with Web UI to drive scale test from your browser

  • Web Server mode with REST interface:

    • Allows KloudBuster to be driven by other programs
    • Swagger 2.0 YAML description of the REST interface
  • Aggregated results provide an easy to understand way to assess the scale of the cloud under test

  • KloudBuster VM images built using OpenStack DIB (Disk Image Builder)

  • Verified to work on any OpenStack release starting from IceHouse

Limitations

  • Requires Neutron networking (does not support Nova networking)
  • Only supports HTTP traffic in this version

Contributions and Feedbacks

If you are interested in OpenStack Performance and Scale, contributions and feedbacks are welcome!

The KloudBuster code is still relatively small in size and touches many different areas such as:

  • Backend control plane and data plane (python, C)
  • Frontend RESTful interface
  • REST modeilizatiuon (swagger)
  • Web User Interface (javascript)

If you have any feedbacks or would like to make small or large contributions, simply send an email to openstack-dev@lists.openstack.org with a '[kloudbuster]' tag in the subject.

Licensing

KloudBuster is licensed under the Apache License, Version 2.0 (the "License"). You may not use this tool except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

KloudBuster VM images contain multiple open source license components: