Added a new workload in browbeat, where in it runs fio
benchmarks against vms attached with cinder volumes(backed by ceph)
and collects the results
Change-Id: I3bfe96fcf3242a0f88c50be35fe9d6368910fab8
two policies are added to handle short and long term indices.
life of the indices can be configured using the 'elasticsearch.life'
field at browbeat-config.yml file
shortterm will have: 125 days
longterm will have 2 years
the policy and the policy based templates can be created using the
'es-template' install playbook.
Change-Id: I0f4a4a9acc03092fd582ae4ff50f688850def953
This patch adds an option in browbeat-config.yaml to create annotations
on a Grafana dashboard for a Browbeat scenario. This would be useful for
CI as it provides information on Grafana about what Browbeat scenario was
running at a particular time.
Change-Id: I83a9c74a56379da35ec9466a7492aecc2ee64ea9
This patch introduces the following changes.
1. We often have multiple executions of the same atomic action in
a single rally iteration. Existing rally charts do not show duration
for duplicate actions in an iteration accurately. This patch introduces
line charts for each occurence of a duplicate atomic action for each
instance, by passing it as additive data.
2. This patch also adds a per iteration stacked area chart that shows
data per iteration for each occurence of all atomic actions in the iteration.
3. This patch also adds a duration line chart for each resource created by
Rally.
Co-authored-by: venkata anil <anilvenkata@redhat.com>
Change-Id: I44dafad69cdbcd6db7c8fd9148f1b35d89924e03
This patch introduces the following changes.
1. Playbooks have been created to start collectd on different hosts.
2. A feature has been added that allows a user to start collectd containers
before running workloads, and stop the collectd containers after running
the workloads. This will help us in minimising the space used for storing
collectd data.
Change-Id: I7926884f461e97bc67453f46eef0121c46c7f19e
since ES not able to index the large number of bulk data reducing the
cache size to avoid the timeout
Change-Id: I6d59e74a64015472dbb7df3f07ffd26336400a10
This commit
1. Provides a playbook to install the filebeat agent on all
undercloud/overcloud nodes
2. Provides another playbook that adds the browbeat uuid to the
filebeat config file and starts filebeat during browbeat run
3. Corresponding changes in browbeat.py and browbeat/tools.py
to run the playbook to insert custom browbeat uuid in the
filebeat configuration.
Change-Id: Idd2efaf931f4ff581db715a04adef738f81d281c
Currently the user had to manually change version.json to reflect the
environment in which the user is running browbeat. This commit adds functionality
for browbeat to consume OSP version data captured from stockpile and ship it ES
along with result data, as metadata.
Change-Id: Ic8036914046aa19680abf491683bb9cd141875ff
Now we have the option to benchmark both undercloud and overcloud by setting rally_benchmark variable in browbeat-config.yaml
Change-Id: Id04bc9b6b24dfc8a0d8216b6c3596422567cce95
yum_pacakges data is captured by stockpile but is not currently
beging procssed by prescribe. This patch fixes that.
Change-Id: I3ac6c08d6e9ba462fe924498241f5b300d8cec15
Signed-off-by: Sai Sindhur Malleni <smalleni@redhat.com>
Remove is_pingable and load_stackrc methods its
not being used anywhere.
Change-Id: Ie7019fcaaa2523f9b8aeafa4414b0d5d195d6a52
Signed-off-by: Charles Short <chucks@redhat.com>
With the addition of a8b256cad6
and 3791692021 we can have stockpile
set the var so that's one less var for the user to set.
Change-Id: Ic0e31549685d0f66fe09b4dc1694945f3071b873
According to the rally changelog:
--task argument of rally task report command and --task argument of
rally task use command were deprecated in Rally 0.10.0 in favor of a
unified --uuid argumnet.
Update accordingly.
Change-Id: Ide5147016f638e831fa83024813ea9d411db01e7
Signed-off-by: Charles Short <chucks@redhat.com>
In OSP15, the default containers are podman. So we need
to pass container_cli environment variable as "podman"
so that the podman containers configuration file on the
undercloud can be parsed.
Change-Id: I223c46baf4cf36596c8ff1e7468eb9fd1a0f1126
Signed-off-by: Charles Short <chucks@redhat.com>
Take into account ansible-inventory output changes with
newer versions of anisble. Specifically for 'facter_processor'
ansible fact and 'processtor_type'.
Change-Id: I9a34e0aff9758d34b3f38907abcdaa050df612dc
Signed-off-by: Charles Short <chucks@redhat.com>
Use six to fix compatibility issues betwen python2.7
and python3.
Change-Id: Ia4cb715edf5cb5b86b83c2da0ef2de83078732bf
Signed-off-by: Charles Short <chucks@redhat.com>
Move the perkit, rally and shaker workloads to their own submodule
in the browbeat namespace. So we dont pollute the browswer namespace
and make the code a bit more orgranized.
Change-Id: Ib833e86e71e595d336c27b08774f164e8f8c49bd
Signed-off-by: Charles Short <chucks@redhat.com>
1. Browbeat shall make use of the fs001 which is the targetted version
of stockpile, thus it won't run all roles against all hosts.
2. Also updated the bug where node_name wasn't added to dictionary when
prescribe first hits data that was gathered from outside config file.
Change-Id: Ieac2c090713b307b4971aee3fd4d5b24f14b9fc9
When comparing OSP10 to OSP13 we were seeing issues when comparing
metadata. This patch addresses that issue, as well as ignores IP
addresses for the compare.
Change-Id: I9b827c80d98d84c862a228e72c2e6e3ee6cb4d9a
In certain cases, where the hosts file have groups outside of the
interested ones, namely undercloud, computes and controller. Running
prescribe, will cause errors while building hardware-metadata, as
certain keys maybe missing. Thus, applying same logic that's used for
software-metadata to look at interested groups only.
Co-Authored-By: Joe Talerico <jtaleric@redhat.com>
Change-Id: I62c4dbfbc5d679ce4267d930934bcef9a78da13a
Python3.7 finally removed relative imports so we adopt the correct
syntax and also making py37 job voting to avoid regressions.
Change-Id: I16e01344e8ae1c732c31264c50d6dd57143ea799
The find_cmd is not being used anywhere so remove it.
Change-Id: Ib3cc664b7af049e236e7662eee4890b1f40de646
Signed-off-by: Chuck Short <chucks@redhat.com>
This would facilitate browbeat users to take advantage of
work being done wrt browbench utilities.
To use stockpile just update metadata_playbook to
ansible/gather/stockpile_gather.yml
Change-Id: I4c12920007f66bc3378439b437676e4cb162b082
Move numpy out of requirements into extras, as it's not required
for running browbeat, but only used for insights like compare
results.
So to install with insights, pip install .[insights], to perform
the CLI operations such as compare.
Added a tox test to ensure no dep conflict arises.
Change-Id: Id8aafcd479003ae79ab8c2d0f1fa378ea38d60d2
Closes-Bug: #1799690
One of the edge cases that was missing was that of a service
not being present in uuid 2's metadata, added a simple test case to ensure
it's present in both datasets before continuing.
Change-Id: Ic2c49fb6dc348acf5dff8291008200a24001340f
This fixes several flake8 failures and integrates flake8 into linters
tox environment.
Rule W504 is disabled because at this moment there is no known way
to avoid flapping between W504 and W503.
This allows us to retire openstack-tox-pep8 job because the more
beneric openstack-tox-linters includes it. Still, developers will
be able to coveniently run only pep8 if they want.
Change-Id: I7da0f6f09a533dd1c4dc303029e8c587bc200f66