Commit Graph

42 Commits

Author SHA1 Message Date
ahothan 1316bd443d Migrate code to python3/Ubuntu 20.04
Change-Id: I18a21e04d009afdee3afc2723afdbade24bfdf71
2020-07-24 23:22:25 -07:00
ahothan 0ec39ec1d0 Fix git URL to use opendev repo
Change-Id: I462ff90be8368e24f5f633e8306607402e8bbb60
2019-04-30 15:42:50 -07:00
Yichen Wang 1da3c08594 Enhancements networking support of storage testing
1. Support to run storage testing off provider network;
2. Support to run sotrage testing with IPv6 subnets;
3. Remove the NOVA client version restriction;
4. Update to use ubuntu 18.04 as KloudBuster base image;
5. Use config_drive to pass configs;

Change-Id: Ie0753b0c6616edb13c5426c26a9e04983d330d0d
2019-04-29 21:14:04 -07:00
ahothan 8c52aa0e06 Fix web UI crash https://bugs.launchpad.net/kloudbuster/+bug/1775689
Change-Id: I74deaa7923e10da5694403753e6743cce1dc3501
Signed-off-by: ahothan <ahothan@cisco.com>
2018-06-13 08:08:32 -07:00
ahothan fc42153774 Fix failure to add static route in http client VM
Add hostname in etc/hosts to prevent sudo to fail
Add additional syslog in agent code
Add devuser login to troubleshoot VM

Change-Id: I59a28fe3eb0c354721989a3f3e1102e67949d545
Signed-off-by: ahothan <ahothan@cisco.com>
2018-06-13 06:45:44 -07:00
ahothan 4a0f595d02 Fix build issue caused by pip error (10.0.1)
Change-Id: Ie36d8d5068c4a6dd3d2efc1c4adcb6ab723c4f06
2018-05-23 00:25:55 -07:00
Nguyen Hung Phuong 668dd098a4 Replaces yaml.load() with yaml.safe_load()
Yaml.load() return Python object may be dangerous if you receive a YAML
document from an untrusted source such as the Internet. The function
yaml.safe_load() limits this ability to simple Python objects like integers or
lists.

Reference:
https://security.openstack.org/guidelines/dg_avoid-dangerous-input-parsing-libraries.html

Change-Id: I8cff003dad2d0b4ca19b12d45cb5538f683192cd
2018-02-13 09:28:01 +00:00
ahothan 8f892eaeeb Include VM image in contaimer
add script to build VM image and container, to extract VM image from container
update doc
remove version check with agent
update vm image upload
auto upload VM image from pkg root dir
show simplified version string

Change-Id: I9dc44c52656d81f271c91d6826dc0e128fed980d
2017-07-24 16:32:10 -07:00
Yichen Wang 622a3d6cab Remove unnecessary settings when building KB image
Change-Id: I30e827fb1cee3df0bd0da0243b95ad2a1ed50879
2017-01-04 15:03:02 -08:00
Yichen Wang 5e00ff9fbc Update KloudBuster image to base on Ubuntu Xenial
Change-Id: I77ae1bd22c009e20fddfd5949696af47e7816a57
2017-01-04 14:44:29 -08:00
Yichen Wang e73212a19b Remove "trim" from FIO output
Change-Id: If92ec5bc541ed6b5a77dd7c561f59937cdaf6260
2016-08-16 13:35:59 -07:00
Yichen Wang 81a9e673bb Fix the DIB issue for building KB image
1. Fix the DIB issue for building KB image;
2. Remove the redundent package installations during image building;

Change-Id: Ia3d817e062bfa5567ea354596f7ab8bd811ded3c
2016-06-28 12:08:43 -07:00
Xin 0822f5fe6f remove management tool from web UI
Change-Id: I477cfcb223038aa28034211b240d4625e99e8022
2016-04-18 21:01:29 -07:00
Michael Napolitano ef1b3b13d9 Added nuttcp source to project (instead of wget'ing it).
Change-Id: I313ecc49972d7cc99b972a97a9774b2220617cc6
2016-04-13 12:23:40 -04:00
Michael Napolitano c8483fa81a Resubmission of last multicast review, with freshly checkedout code
Change-Id: I4908ecde3870f7ce5799c995293f98c0b8aeb4d8
2016-04-08 14:56:39 -04:00
Yichen Wang 00ca0da14e Feature commit to support storage testing on ephemeral disk
1. Feature commit to support storage testing on ephemeral disk;
2. Default the disk size to 0;
3. Update to fio-2.8 in KloudBuster image;

Change-Id: I72b61828f3ce04c48ab9ab107e37a4927c3a454f
2016-03-21 17:39:59 -07:00
Yichen Wang 93e2304a51 Add wrapper script to start kb_server from PyPI installation
Change-Id: Ib8f9d30b9589f73d90617d47253925440134c2f2
2016-03-15 21:13:26 -07:00
Yichen Wang 73511dbf51 Add rwmixread into result json
Change-Id: I0880678aae82f31315725628c031975e3969a679
2016-03-10 22:10:39 +00:00
Yichen Wang 0f73b7a946 Add io_file_size for running storage test
1. Add io_file_size for running storage test;
2. Use fio itself to generate io files instead of using dd with /dev/zero;

Change-Id: I1c3c81f9d6676813c7db443a56848908ee4052be
2016-03-05 00:19:57 +00:00
Yichen Wang 5766ff9893 Enhancements to support mixed read/write tests
1. Enhancements to support mixed read/write tests;
2. Add a name field for each storage test cases;
3. Support to run customized storage tests by supplying 'extra_opts';
4. Fixed the get status API error when staging resources;

Change-Id: Iecd4001268757ed24fedbc17813f0c0fb8110c68
2016-02-26 10:50:44 -08:00
Yichen Wang f14c427391 Feature enhancements for storage testing
1. volume_size will be ignored if not running storage test;
2. Change the degrading percentile calculation logic for progression runs;
3. Remove total_server_vm counts from result reporting;
4. The result will now show the total IOPS/Throughputs requested for all VMs;

Change-Id: I5718734f6aa4fe2a94cf96340f92bd735e1c55db
2016-01-28 17:54:46 -08:00
Yichen Wang 3c3a2f44eb Feature commit #6 to support running fio
1. Support progression runs on FIO;

Change-Id: Id0b29328fc7198982515849db17487b8b9716a94
2016-01-26 20:57:27 -08:00
Yichen Wang 5597be46a4 Feature commit #5 to support running fio
Change-Id: Ib362fe7de3a84c37e4c11483c631fb6e4d6d0891
2016-01-25 14:26:36 -08:00
Yichen Wang 7f638bfd59 Feature commit #4 to support running fio
Change-Id: Ic6fc253bd1d5a11c0ebb119d456557477a66ba2a
2016-01-22 15:11:30 -08:00
Yichen Wang 51dad53784 Feature commit #2 to support running fio
Change-Id: If08ebf50a3c59647f40a498fdfdb180b4ab5176b
2016-01-19 16:53:11 -08:00
Yichen Wang 781f59015b Feature commit #1 to support running fio
Change-Id: Id211e499fbd25703777d56cb7d7e4a8342e00f67
2016-01-15 17:14:10 -08:00
Yichen Wang b15484d929 Add the installation of fio into KloudBuster image
Change-Id: I5571234d8a1bce6245b2f85b487b09a6a68fa130
2016-01-07 22:53:05 -08:00
Yichen Wang 5bef576618 Set HdrHistogram_c to a stable label to workaround the build issue
Change-Id: I84dd6de224586f853c4e885ed10062d1bbca37e9
2015-12-10 13:10:31 -08:00
Yichen Wang 9d09061d96 Bug fixes for alpha releases
1. Document enhancements on stand profiling;
2. Synchornize polling interval with report interval when calling from Web UI;
3. Fix the bug which prevent doing multiple progression runs;
4. Isolate logs from different sessions if multiple are running;

Change-Id: Ie2b8a499a942f95a5c7ec80405ce2db10cc8ebdc
2015-12-03 15:19:50 -08:00
Yichen Wang 97874b246f Fix the traceback when doing progression run
1. Fix the traceback when doing progression run;
2. Fix the agent code to dynamically generate HTML payload;
3. Count both socket errors and timeouts in the stop limit of progression runs;
4. Enhance the documents and add the reference data;

Change-Id: I242e7bbb6ab02f6ec7f27bc334f991d153386c9b
2015-11-17 10:15:21 -08:00
Yichen Wang 244f525a89 Release drop for v5 image
Change-Id: Ie942ad92c991159016407589e4c6fabbf060e088
2015-11-10 17:27:38 -08:00
Yichen Wang 52df31f156 Fix the Web UI building issue
Change-Id: Ic5d919331f2cc23132212a3a1e729ed153102a37
2015-11-10 14:24:43 -08:00
Yichen Wang e0408bb653 Fix the automated building issue for DIB
Change-Id: Ibebf1c7cef23f48c472c7b09df505221d7b91307
2015-11-10 10:33:26 -08:00
Yichen Wang e4bab5c222 Re-write the agent code to support stand-alone run
1. Re-write the agent code to support stand-alone run;
2. Document refinement for Web UI development;
3. Bug-fix for building Web UI;
4. Remove the pre-built Web UI from GitHub;

Change-Id: Idf2c0363cd4545fbd28d590da9128c204db69abf
2015-11-09 14:15:21 -08:00
Yichen Wang dbd455bc7d Add support to stop testing via Rest API
1. Add support to stop testing via Rest API;
2. Automatically enable floating IP if under dual-cloud mode;
3. Enhance to support running KloudBuster without keypair;
4. Disable the percentile_of_packet_not_timeout check for progression runs;

Change-Id: I4904d7322719b4784f5cd40250529dfa7578bd0a
2015-10-13 01:27:07 -07:00
Yichen Wang 6d358ae31c Fix the cmake issue for building kloudbuster images
Change-Id: I8348193b0017e319fd1c061b16c746fcbf4df2fd
2015-10-11 19:20:06 -07:00
Yichen Wang af8fd33451 Announce the v4 image for KloudBuster
New features:
1. Support the progression runs;
2. Support to dynamically generate the HTML file based on the size requested for http servers;
3. Update the HdrHistogram to use v2 encoding/decoding algorithm for better performance and higher compression;

Change-Id: I69293145702cd766f47e8146c77919f3e6cbdb7f
2015-09-22 21:39:54 -07:00
Yichen Wang 578a12d05f Add the support for dynamiclly generating the HTML page
1. Add the support for dynamiclly generating the HTML page;
2. v4 image is still back-compatible to v3 image;
3. Update the doc build settings;

Change-Id: Icdde42baac95b40dc21c20295f382eacbff7d7d0
2015-09-22 15:45:51 -07:00
Yichen Wang b50786dbbe Add support for progression runs
1. Add support for progression runs;
2. Move http_tool_config from metadata to redis message;
3. v4 image is created (back-compatiable to v3 if progression run is disabled);
4. Documents refines on cfg.scale.yaml;
5. Simplify the logging format string;

Change-Id: Iec92f0c6c5664c9e45bb377d3273204f8f27e0d8
2015-09-22 13:55:13 -07:00
Yichen Wang f64ab431f9 Remove users_per_tenant, small fixes/enhancements
Change-Id: Iac724062b5c18bfba537660fcec8706b9e9b13f0
2015-09-08 13:39:19 -07:00
Yichen Wang d7d9575dda Cleanup logic enhancements, document enhancements
1. Enhance the cleanup logic;
2. Add the missing keypair into the resource logger;
3. Document enhancements on installation and contribution;
4. Fix the bug when parsing the image version string in DIB;
5. Fix the typo in Rest API specification;

Change-Id: Ibf4a1c7828ee4522938b4b55f9a8af5e6c6a133b
2015-09-02 22:59:28 -07:00
Yichen Wang 988a99e7a1 Add support to upload official image from OpenStack
1. Add support to upload official image from OpenStack;
2. Move dib and kb_server to upper level directory;
3. Fix the issue of dumping pecan server logs using Rest API;

Change-Id: I636fe4a1a2213d72c37fc09f37e1f70b2ca8c394
2015-09-02 10:32:38 -07:00