11 KiB
Keystone authentication with kill of Keystone on one node
This report is generated on results collected by execution of the following Rally scenario:
---
{% set repeat = repeat|default(5) %}
Authenticate.keystone:
{% for iteration in range(repeat) %}
-
runner:
type: "constant_for_duration"
duration: 60
concurrency: 20
context:
users:
tenants: 1
users_per_tenant: 1
hooks:
-
name: fault_injection
args:
action: kill keystone service on one node
trigger:
name: event
args:
unit: iteration
at: [100]
{% endfor %}
Summary
Service downtime, s | MTTR, s | Absolute performance degradation, s | Relative performance degradation, ratio |
---|---|---|---|
2.8 ±1.1 | 8.3 ±2.4 | 3.10 ±0.23 | 16.35 ±0.92 |
- Metrics:
-
- Service downtime is the time interval between the first and the last errors.
- MTTR is the mean time to recover service performance after the fault.
- Absolute performance degradation is an absolute difference between the mean of operation duration during recovery period and the baseline's.
- Relative performance degradation is the ratio between the mean of operation duration during recovery period and the baseline's.
Details
This section contains individual data for particular scenario runs.
Run #1
Baseline
Baseline samples are collected before the start of fault injection. They are used to estimate service performance degradation after the fault.
Samples | Median, s | Mean, s | Std dev | 95% percentile, s |
---|---|---|---|---|
|
|
|
|
|
Service downtime
The tested service is not available during the following time period(s).
# | Downtime, s |
---|---|
|
0.024 ±0.024 |
|
1.830 ±0.010 |
Service performance degradation
The tested service has measurable performance degradation during the following time period(s).
# | Time to recover, s | Absolute degradation, s | Relative degradation |
---|---|---|---|
|
4.189 ±0.033 | 1.94 ±0.59 | 8.5 ±2.3 |
Run #2
Baseline
Baseline samples are collected before the start of fault injection. They are used to estimate service performance degradation after the fault.
Samples | Median, s | Mean, s | Std dev | 95% percentile, s |
---|---|---|---|---|
|
|
|
|
|
Service downtime
The tested service is not available during the following time period(s).
# | Downtime, s |
---|---|
|
0.0015 ±0.0015 |
|
1.3940 ±0.0024 |
Service performance degradation
The tested service has measurable performance degradation during the following time period(s).
# | Time to recover, s | Absolute degradation, s | Relative degradation |
---|---|---|---|
|
7.198 ±0.068 | 4.0 ±1.2 | 15.7 ±4.4 |
Run #3
Baseline
Baseline samples are collected before the start of fault injection. They are used to estimate service performance degradation after the fault.
Samples | Median, s | Mean, s | Std dev | 95% percentile, s |
---|---|---|---|---|
|
|
|
|
|
Service downtime
The tested service is not available during the following time period(s).
# | Downtime, s |
---|---|
|
1.883 ±0.011 |
Service performance degradation
The tested service has measurable performance degradation during the following time period(s).
# | Time to recover, s | Absolute degradation, s | Relative degradation |
---|---|---|---|
|
5.762 ±0.047 | 2.46 ±0.79 | 11.2 ±3.2 |
Run #4
Baseline
Baseline samples are collected before the start of fault injection. They are used to estimate service performance degradation after the fault.
Samples | Median, s | Mean, s | Std dev | 95% percentile, s |
---|---|---|---|---|
|
|
|
|
|
Service downtime
The tested service is not available during the following time period(s).
# | Downtime, s |
---|---|
|
1.191 ±0.013 |
Service performance degradation
The tested service has measurable performance degradation during the following time period(s).
# | Time to recover, s | Absolute degradation, s | Relative degradation |
---|---|---|---|
|
5.796 ±0.042 | 2.61 ±0.80 | 9.0 ±2.5 |
Run #5
Baseline
Baseline samples are collected before the start of fault injection. They are used to estimate service performance degradation after the fault.
Samples | Median, s | Mean, s | Std dev | 95% percentile, s |
---|---|---|---|---|
|
|
|
|
|
Service downtime
The tested service is not available during the following time period(s).
# | Downtime, s |
---|---|
|
7.468 ±0.017 |
Service performance degradation
The tested service has measurable performance degradation during the following time period(s).
# | Time to recover, s | Absolute degradation, s | Relative degradation |
---|---|---|---|
|
0.8176 ±0.0016 | 0.176 ±0.024 | 1.88 ±0.12 |
|
0.3703 ±0.0011 | 0.199 ±0.047 | 2.00 ±0.24 |
|
3.7349 ±0.0019 | 0.228 ±0.018 | 2.145 ±0.090 |
|
0.5604 ±0.0019 | 0.178 ±0.033 | 1.89 ±0.17 |
|
0.5767 ±0.0012 | 0.175 ±0.026 | 1.88 ±0.13 |
|
1.1616 ±0.0019 | 0.192 ±0.025 | 1.96 ±0.12 |
|
1.1645 ±0.0019 | 0.200 ±0.024 | 2.01 ±0.12 |
|
0.3467 ±0.0016 | 0.179 ±0.045 | 1.90 ±0.23 |
|
0.8827 ±0.0014 | 0.218 ±0.033 | 2.09 ±0.16 |
|
0.4818 ±0.0018 | 0.175 ±0.036 | 1.88 ±0.18 |
|
2.9380 ±0.0013 | 0.193 ±0.018 | 1.967 ±0.091 |
|
0.1112 ±0.0027 | 0.169 ±0.034 | 1.85 ±0.17 |
|
0.6466 ±0.0015 | 0.205 ±0.032 | 2.03 ±0.16 |
|
0.1132 ±0.0015 | 0.144 ±0.028 | 1.72 ±0.14 |
|
4.886 ±0.039 | 1.82 ±0.57 | 10.1 ±2.9 |