From 18f7b6e7f7578a68966ba1db0559fa2cdec2882a Mon Sep 17 00:00:00 2001 From: Sergey Date: Mon, 17 Apr 2017 20:02:01 +0400 Subject: [PATCH] Add shaker test for cluster in upgrade Add shaker test plans and test results for ccp cluster during upgrade for Mitaka to Newton Change-Id: I5e3fc83048dc28b00a5c10fc50067d2efaf09106 --- .../test_plans/fuel_ccp_upgrade/plan.rst | 10 +- .../neutron_fuel_ccp_upgrade/plan.rst | 189 +++++ .../configs/Network_Scheme.png | Bin 0 -> 12537 bytes .../neutron_fuel_ccp_upgrade/configs/ccp.yaml | 17 + .../configs/configs.yaml | 64 ++ .../configs/repos.yaml | 39 + .../configs/topology.yaml | 86 +++ .../configs/versions-mitaka.yaml | 41 + .../configs/versions-newton.yaml | 81 ++ .../neutron_fuel_ccp_upgrade/index.rst | 141 ++++ .../reports/full-l2.html | 724 ++++++++++++++++++ .../reports/full-l3-east-west.html | 724 ++++++++++++++++++ 12 files changed, 2109 insertions(+), 7 deletions(-) create mode 100644 doc/source/test_plans/neutron_fuel_ccp_upgrade/plan.rst create mode 100644 doc/source/test_results/neutron_fuel_ccp_upgrade/configs/Network_Scheme.png create mode 100644 doc/source/test_results/neutron_fuel_ccp_upgrade/configs/ccp.yaml create mode 100644 doc/source/test_results/neutron_fuel_ccp_upgrade/configs/configs.yaml create mode 100644 doc/source/test_results/neutron_fuel_ccp_upgrade/configs/repos.yaml create mode 100644 doc/source/test_results/neutron_fuel_ccp_upgrade/configs/topology.yaml create mode 100644 doc/source/test_results/neutron_fuel_ccp_upgrade/configs/versions-mitaka.yaml create mode 100644 doc/source/test_results/neutron_fuel_ccp_upgrade/configs/versions-newton.yaml create mode 100644 doc/source/test_results/neutron_fuel_ccp_upgrade/index.rst create mode 100644 doc/source/test_results/neutron_fuel_ccp_upgrade/reports/full-l2.html create mode 100644 doc/source/test_results/neutron_fuel_ccp_upgrade/reports/full-l3-east-west.html diff --git a/doc/source/test_plans/fuel_ccp_upgrade/plan.rst b/doc/source/test_plans/fuel_ccp_upgrade/plan.rst index ac0b8c6..2b9ca48 100644 --- a/doc/source/test_plans/fuel_ccp_upgrade/plan.rst +++ b/doc/source/test_plans/fuel_ccp_upgrade/plan.rst @@ -17,13 +17,9 @@ Fuel Containerized Control Plane upgradability performance testing Test Plan ========= -This document is inspired by -:ref:`openstack_control_plane_performance_test_plan`, and aims to cover -baseline cloud operations and extend this test suite to verify containerized -deployment approach. As :ref:`openstack_control_plane_performance_test_plan` -this test plan covers basic cloud operation VMs creation, as well as -long-running test suites to verify cloud stability during update Open -Stack from Mitaka to Newton. +This test plan covers basic network performance with long-running test suites +to verify cloud network stability and performance during update Open Stack +from Mitaka to Newton. Test Environment ---------------- diff --git a/doc/source/test_plans/neutron_fuel_ccp_upgrade/plan.rst b/doc/source/test_plans/neutron_fuel_ccp_upgrade/plan.rst new file mode 100644 index 0000000..45b8276 --- /dev/null +++ b/doc/source/test_plans/neutron_fuel_ccp_upgrade/plan.rst @@ -0,0 +1,189 @@ +.. _neutron_fuel_ccp_upgrade_test_plans: + +============================================================= +OpenStack Neutron Testing During Open Stack Upgrade Test Plan +============================================================= + +:status: **ready** +:version: 1.0 + +:Abstract: + + This test plan aims to provide set of tests to identify OpenStack + performance against given containerized OpenStack cloud (installed + on the top of pre-deployed Kubernetes cluster) using simple minimalistic set + of Shaker tests during upgrade from Mitaka to Newton. + +:Conventions: + + - **Shaker** - Data plane performance testing tool + - **iperf** - Commonly-used network testing tool + + +Test Plan +========= + +The purpose of this section is to describe scenarios for testing Open Stack +networking during upgrade from Mitaka to Newton. + + +Test Environment +---------------- + +Preparation +^^^^^^^^^^^ + +This test plan is performed against existing OpenStack cloud installed on top +of pre-deployed Kubernetes cluster with `fuel-ccp`_ tool with pre-installed Rally +framework. + +.. _fuel-ccp: http://fuel-ccp.readthedocs.io/en/latest/ + +Environment description +^^^^^^^^^^^^^^^^^^^^^^^ +The environment description includes hardware specification of servers, +network parameters, operation system and OpenStack deployment characteristics. + +Hardware +~~~~~~~~ + +This section contains list of all types of hardware nodes (table below is +an example). + ++-----------+-------+----------------------------------------------------+ +| Parameter | Value | Comments | ++-----------+-------+----------------------------------------------------+ +| model | | e.g. Supermicro X9SRD-F | ++-----------+-------+----------------------------------------------------+ +| CPU | | e.g. 6 x Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz | ++-----------+-------+----------------------------------------------------+ +| role | | e.g. compute or network | ++-----------+-------+----------------------------------------------------+ + +Network +~~~~~~~ + +This section contains list of interfaces and network parameters. For +complicated cases this section may include topology diagram and switch +parameters (table below is an example). + ++------------------+-------+-------------------------+ +| Parameter | Value | Comments | ++------------------+-------+-------------------------+ +| network role | | e.g. provider or public | ++------------------+-------+-------------------------+ +| card model | | e.g. Intel | ++------------------+-------+-------------------------+ +| driver | | e.g. ixgbe | ++------------------+-------+-------------------------+ +| speed | | e.g. 10G or 1G | ++------------------+-------+-------------------------+ +| MTU | | e.g. 9000 | ++------------------+-------+-------------------------+ +| offloading modes | | e.g. default | ++------------------+-------+-------------------------+ + +Software +~~~~~~~~ + +This section describes installed software (table below is an example). + ++-----------------+-------+---------------------------+ +| Parameter | Value | Comments | ++-----------------+-------+---------------------------+ +| OS | | e.g. Ubuntu 14.04.3 | ++-----------------+-------+---------------------------+ +| OpenStack | | e.g. Mitaka | ++-----------------+-------+---------------------------+ +| Hypervisor | | e.g. KVM | ++-----------------+-------+---------------------------+ +| Neutron plugin | | e.g. ML2 + OVS | ++-----------------+-------+---------------------------+ +| L2 segmentation | | e.g. VLAN / VxLAN / GRE | ++-----------------+-------+---------------------------+ +| virtual routers | | e.g. HA / DVR | ++-----------------+-------+---------------------------+ + +Test tool +--------- + +Shaker wraps around popular system network testing tools like iperf, iperf3 +and netperf (with help of flent). Shaker is able to deploy OpenStack instances +and networks in different topologies. Shaker scenario specifies the deployment +and list of tests to execute. Additionally tests may be tuned dynamically +in command-line. + +Test Case 1: Analysis of L2 metrics during Open Stack upgrade +------------------------------------------------------------- + +Description +^^^^^^^^^^^ + +`Shaker `__ is +able to deploy OpenStack instances and networks in different topologies. + + +The following steps should be executed: + +1. Deploy Kubernetes cluster +2. Deploy Open Stack cluster +3. Run full_l2 shaker's scenario and wait successfully stack heats deployment +4. Start Open Stack upgrade + + + +List of performance metrics +^^^^^^^^^^^^^^^^^^^^^^^^^^^ +.. table:: Shaker metrics + +======== =============== ================= ====================================== +Priority Value Measurement Units Description +======== =============== ================= ====================================== +1 Errors times Number of errors during testing +1 Lost times Number of lost results during testing +1 Latency ms The network latency +1 TCP bandwidth Mbits/s TCP network bandwidth +2 UDP bandwidth packets per sec Number of UDP packets of 32 bytes size +2 TCP retransmits packets per sec Number of retransmitted TCP packets +======== =============== ================= ====================================== + +Test Case 2: Analysis of L3 metrics during Open Stack upgrade +------------------------------------------------------------- + +Description +^^^^^^^^^^^ + +`Shaker `__ is +able to deploy OpenStack instances and networks in different topologies. + + +The following steps should be executed: + +1. Deploy Kubernetes cluster +2. Deploy Open Stack cluster +3. Run full_l3_east_west shaker's scenario and wait successfully stack heats + deployment +4. Start Open Stack upgrade + + + +List of performance metrics +^^^^^^^^^^^^^^^^^^^^^^^^^^^ +.. table:: Shaker metrics + +======== =============== ================= ====================================== +Priority Value Measurement Units Description +======== =============== ================= ====================================== +1 Errors times Number of errors during testing +1 Lost times Number of lost results during testing +1 Latency ms The network latency +1 TCP bandwidth Mbits/s TCP network bandwidth +2 UDP bandwidth packets per sec Number of UDP packets of 32 bytes size +2 TCP retransmits packets per sec Number of retransmitted TCP packets +======== =============== ================= ====================================== + +Reports +======= + +Test plan execution reports: + * :ref:`neutron_fuel_ccp_upgrade_report` diff --git a/doc/source/test_results/neutron_fuel_ccp_upgrade/configs/Network_Scheme.png b/doc/source/test_results/neutron_fuel_ccp_upgrade/configs/Network_Scheme.png new file mode 100644 index 0000000000000000000000000000000000000000..5ee45b5aa6d8bc9920ff1ec46590b753337505a6 GIT binary patch literal 12537 zcmeHuc{rO}yLVc&N?Tf#8cMb1B514T)=b)%&rhqP-76}guTCg-uGPJ_g&|F*SFvIoa>xFlIMEXdhT`K>-W3w-+ES_C*hBE z)i2Po(*Xd03z{0L`Tzhm7yvl!OG{}0FaW!1DF^ijhNkKRL*KELjPAr7S!RIONU1IQJnbvCcQC

0BrOcH5KqBxauqhaGnRT@&E{+qO}kB>$;L>7nE-9WymkjBOi5q zyLzhhx;jJa+N_z9c#tx@m-gj_AKuUZLihidss3wZcHeF4F*MND^=2U}LH z?8SR}CIO0Gk7xb$82#^pd>WTSen0E8QIt9C8gSIYl_3M5zvnL)EYP>_cUU$5XyRK6 zRVe@x_75ZSZ-TregvcS&{^s+^rywITCx9g9_q}f%5^!W2$9a0hpEfh?Z`&XrIL-4o zo}wR>Tv-#i4+M4(?QgwU4?ayzRsLV1F%~AX9|H&$IQ1y^K74g$&DQMVb%fUCpSE~Q%5s>7WT@F@%(ET7<`4ADvO5=L4&z3NPEWq0g#dIFY4me z2da}VeOa@`32e@CPL5A^?sF;wt@_#?;X7sOs+;1sWjrM@ghcP*xqn)W|42OkoxTnp zm=BVw3xX{=yC=QesFt%2mtW$CAe6l1L6C`F;a%K!zZdw<@9S*#e!J1y4XP7dnv#{) zbCt>4_45tTGK^D78WRlu2B4N4_pF59kcU;mIZ&WTKz~^tTeG+y|3WeCu09 zAY_wpfMC?T?r@>eZ4pF@$RLA>AX^WnnSsfUHT_QZ*U4^OT}EN0c}e!Q%}UijF^MOQGO{u5K-h-lCtYILR` zt#@g{Y#{x*p6&xLmsOKosH?Hs&WlR9VTeI^{C(E;Jt@qHNQ-b;eAeBVRTGUD0&F2~ zzV{{*>^!^z1Qj$O&oX)0+;|Y&B+0}Y&6XT+LYKbJz@@@1dx+8#Y4xv0=$U+=N+kzT z)g|q!%iw^D)LD%#$;umpR)gv9N12}3#HCfaI7WSr5d1WxCM+t&;&pUO;lmKBC8N*= z3K<-SdM)U0j`l3sWivGmczw^T3EJ+zPAe%nQ0c@ZF&FfKA8l)i20SnMyJ z(x$eyEd)Dt7UnmRjCv-s9R_}))b)fYY?&eiAI0M(zKhlhNAnS`)j!r7H~&a##uk6@ zY%SH$uPGdNsZA5O%7Re$UcFo&@hNL&Fwh1C* z;fJHr4Ma`#{`0^Lyn{`#NgXn2jM{fO2)GlX6knfA@Z0Q`Jt_Pc()r-2pMq@l1^ua+ z(ohq_;Y6V!h`yd&jOjM>lKoBsBxW^4KB|lK2_*5Zz4t=FRADp2#GrHcq?t6-7?r&g z{JrN660wEr%g>GTo=;kx7;M7bzJWMsXDQM@=#SX>BxzFGejA^J7K(D_1|4o{H7*!X zQ(dIqtSNcUONRI4fF~|Tq}>15#l*07Ycgc%SsxFAq#^}Ltew8Ja7WXARSTzY%H3TM7?Wq0dN>pAY6L~Wjg3>1?#WNX??L@vd%&iC@RfjG?+2|D zYite&;%xQLt&hsr+?r_ExE>ivVmbJ5H^#u{P43sSrojfoL*gD@iNuU~ zNrg%O@C3bon5*-{ga*t-i$9nZpW;0_UlMYa3G?L^<=oSK@U0c!%Qkcm_C(%qyu>qw zY%S3oV1!KRVXq!Do~N|)FdvII8!gST%^Bqf$NKm`UH^PE%7xU*f{EPoVyK3|#=WWy ze+oIZHDJ0s8;=L=)y1&uW$mo&TSf(o_4i&3dtQXS z0#mHGp%MPR&ky4EI<+QJxV_V>Q_6c(<#eBqIsU9N5UI-(0~v0TYi+XXGv%I^Ja$wR zr>wLKVIrP-wmXT!%OnueN%kz}K9Cl_{zDKE$QkQ5brH5ma%RsJUZl(6k%Nm!scVQB zEJT>vWjLv2q;#r7=%1)PiAl;Qm`Yz>APic|OBYVo#&#XndZ#(5n(45RxlyYgP#UKs zeWj;a3+dnq7RU~N-`zqZck(Y)#QVqhiGG3i==k;Ka1z1kK9HjQI_n^7@jU9qgm)(H>8ViHor(OP^Xv?h2eoe$q}iWH2q5ltt(tVC z>tGu)8emnGH+Sf81zLD*AM9Qs5p3j^fhJ26sgal7$eE}qi5w~Q_gCHK zT5{GwxtnyL!80{!PfhclEPiiAl2|AOIky43`qTO<^}zWXf%5ij^ZvI4ecCSxK?7%e zJcDVab6FlrS6-Jm+aAp4z@vXO@x9ucZL8C?V6t{BbNnEGm#k6GZSpSXSuE1~lZVN> zNeTYCe9r<^pcC#5kiu|YwFam%ru{rlo_+pKqnJxrjfJrU@w(9pMD3uIJD((M-0TrK z&N|(9N6Gal%5X^9s&LeJs&6HPHuo`+nDBXUf@ArOt2&OdqRyH>Ycm2U&BX;Ka z#+|}?&;@(b^3t`QDBS0ahl@86Z6zdjP2V9;T_EI)!SMHoM%SiIAe1$%WN*w-Z_aR_ z&SgJ%H3v)xSnx+&*c*K(C(B*@xXxQz7r5BWvj5|5K_>h9l@oc2VOVzbyR*)5`A$R1 z0AH{?kpZ@tGs11;GvK0o2(9|6L*IrI?cW_3zJ$u%UOTFR;<%&J{8$}pl%}$ZV^)}V z#Vg##4#qD}QpWz^W=WcT6l{^B-rriOVSJJmww5{DK%XngA7Nxzn-c}ger9exy(AHz z{PF9+NbjT}UW^Tz9xQL7GhBWazcbL>>1nmahWb#e>`Y8JqU)6}w&iObA1pj3Qw*WM ztd6IKX z%lS#}5XFk+YOv>Bi!2dbMV%F9O~@;*KH4ak$tob*_^=poEFxlvnC$7p$!zp*CN$sM z>7Vf+`o29}kDKn8;v}1EikuYR9#8dRP<~8Y!Hdc86Phw-jbB^gf_6gnx^&8uOW{qwQ3)2V;~r zBUbMJYqM=cj@Z!=y{Z=6&!{~D$9Vo8#YyhHBU1dpBlmVsv!WTokxA$abe!jbO+b7wdh(AvOP%CBmErpjd&tWykH_~kzR;UZL{$FpcnURh-eo46K?}~ z-ItmQ!^4(xz^E;)BYO?n-vit zl2LB-x0te6R_&`oH!{XcWR15@wi~gXA#1!|!VF5ldU&zV3rtP*gL0ufEq?*2R}9ZCRS{GeZNCbWs9PlTM@(`|?wi|k>5nw%IqPb* z`$WApzu5!|Y%~8@+Us9!@Jx!5NY`j^igDv(;Srz6+YB&A8K0Awecn~npDpMY zOlx!<;r^EBn4Xk(VDUHJig)JOe?2{V4{S=wo^voif%nl=Z|5j8;6eEOXKI%J4Ly4A zHzo>s`0gDSOYU~mkvx9jjM(a6j%*0-N1JwOJrjg%pRWyj`_?&Ymo* zc&S~_D}Bj(!I4Ud(d{v*(bi2g`U1w;s$F2_Ucp6brm;rxt53CTRDk2d>*4p{1yq>V zRcl&jhWketu{&OYyzrc*`@pQkUT4wo;>sQvt}8j8(r+J$^p3;qBY8PlD3 zROxc2Kak$YcMR-@E)=ZbDfB%Scf%e7GLsUVNgIfckkY)VlhUDD` zdmCZkRMg&zLfq=LI0b$^yduiYBd{Jm7gT3GzLQb8RU>^`%+RR4tH(65irBgCoR*W` zm7>EKf6L5@HCm1agN4L*Jaz8hm_vdgpjM=)F-jkmk)8ihgqIa$GV&g~h-OeO^j71F z-1l6mT9I>Fbay?+A3+C=Su|4Q$F8|FOzUkKIntC&_S%olUkmB}Ep@rDa{Q*GIGfqt zhCUF)k@nFzL|6*>D>M3!#{N$F3W#33>j}MPr61-0u#7AvLM0T z?}1I#G9HO(@)43!#BHPek+tWO@jpdFor+7oQ)2xLww>!(0TtU z$x#Po6dT^D?T)=&^z%WI$dc(`o>R5Uw3${+fEMsBH(_GPo|pb&P%!*oevw->klmYJt@GSDTwy@#CjNAc!4#%<2+yt+;h{O>xt`Yihd2Y z|5`uh*5t~@!yPq1UpMf8c7q4lFnjG7d>C3cb~uX z*}Oel@vvd#7bW%jdC|B`@?rXhA_SUHJS-CbXllO7HbSNG&sl8@i^e4cnz=<95@XHT zLDy&oE=Zu<#}e})$Bb?ft4c0w8xk$@93LEGrgea1#cG7deiy?4~@B8_ABcU5w@}%%-ZDNZeq5pNPbQft8n##gjAWO-z^@r)r`AS zc#1L|X;wj&pVXXnHfuoH*%eZ?% z7u_R0IrCDxf;B%o)CKLSQb4;-4du*xbn(^t2gjcw*?-~@_QkjF_O6m%`y!MU!`Z$V zuLAz;zKndx7t zqHYVw#gM~g|BUT4PGR6T^1ltE&mei_;jtBEGt6(i9p|z(Boa%ZNN7gEs(nc8=5-U5_K&PX`}-EH!ov zUK@58|Ni@MS?eF9tt^MW-5~<%$UeEkRe4i}d$RAOXDAa0dI%I=^k7MYtfZys`6yJc z%w|+dP=;@wQSfQR4(mDCKZzr?U5V|AVst|DqAi?6jGjXas+z{1Hqp&QAA`?*Icm{% z;0G!I$d8S85m+mVmI?CUys}oiX;%eLi-?dkexq>ndv!}4zpxaCN#;e!-L5S&b-6=B;=>F`zTT{^a?x$QCpcg9EW4Q?yk>Lp$ z7~5boynRL}c!$<^BDJvVNQ#fLjw~;q6yAv^sMjElJEky9rAW76WMbS7UHbs!PrYf$ z(;Z{bRh;k8sFFuf&fn45A9%|h?lW3dKHvQrJaIm^xc)4Lt#!66f@El?rq@y+D18On z30)|!)>y@a7)-VQ;mBswH`zrlpb<;Yzwg)ab)-?t5Y;|!asyHNGSjuEuF*TbC5+<3 zC8*)@9)2XLO+>=Ve)-*s?3QRh0}MsrmkPR?N{TiAXs|AXS8G0U@D3!3)=@a|?>G~EI+ZXBfs@s;~dmg!eWOt)X z6>=Sf{ZqQud&)$kO{^Q!QIs0{>OgJ4++Bq(G2xx&9Pjt#!*{0~*GQH)Zc$-^kYT)W8QxXWgyg93zvuxcPRLyfYWTu*-Kh}7tUi1_`5hL^}G8A z*8jc`o`|uHe8|Z>?DOz+4G~aRDhyFryxIPW^NqWj*B9grZ?1@)nTNwF}Nj$YPL zGz0x%zJJO1T#A3zE(c}^OefKOS#SWtx zngL;Cnjs1w(?1eaP)_!~1gmAv@KakC*T`ig4W|tAh3SWjFBHypKV4QL!h)YJ#4upH zV;Oew>_G;5+{hp7;S7zpX;|G-99&!lnp~{v^rt5y3LvbWGPJx#wSCDC)uiQ~6exkN zNtr$sMz9t*(c?qK7uw$(?S7G8Q3Rt2LGCWsK8sx#7PJmAHmrGRvuu9DjLF|x%fd=s z7;ZFpI6B7@UUY4P&u1ea8-G+ctB2xddLuLv*g0@dSR0a1=QuFZWbBx6Wk|*7)23bS zHh16yC9y3sH)T5;bTcI3Ei_^R;%J1YvH675&DD1XrRbDxC~78s00K95VT0P@icsW_ zbl&ilCU?SS>*xFGJ45Ys?FrUW+J@=#WiPHRUCI!bLX&?x28>J|xuc+O)AU&^`jqsN zJ+3h5%g$wF*=j?ALfxEEawxFv)QpE&>xt7eFLiXpvzLQG$*IY|1a$T~?>|(+9@@=! z2QDjZALICl3V!yDYDhxc%K%awb9)2Bi0<5rM8yQGg>4+!S6biu*Dvq-Sno8gY1|=mg5!;1&BkblQgo;pkIo94)yLvO>9P0&>?I zllNsK6Ea9*3m)%V5aLG<4%8j*C*n0K{+q^4iES@#EC4*Vz< zKg_vJ<7^p6sOUMHzI_CDzvY*9H+(-;NIa^@JXB&Jp+JA`fL`CqZdEicKp}f`Zq58- zgVom<`a{PrNDHAQ$@tSHS_WV6e4S$QlX=e4If-S4-ga}mG29d+fxwwfJ`PKdPfDO> z8Gftm+Xj>G#T}IzdG`8$$|mTPfE%^~_x@KnDz%~!%B^a8V?r;U*4Zr#BZa`5akfEH zpGAHtR8~kxRn)7l>P*1|atFUO6o%~c8xK*^G5y!ZGA=ut#+HmqO^L(;-Ej$zkj_=) ze76;BluUD2^Od`+asy$1*ZwV%S57LxBK7p@jb#q*pFM==3`mh>#Wz={M~}~ChVBWo zqbnmS4qaZUqOc+NiC&%0Hj#SYrJL({^gaj@{nJPE2iXr7%wq#dqWuCV^UsxB$|Afz)!j_5pZri5v_k7^;Zf5Pv(jD2 z&0|!+Tc7Q8ZD=fLwzx0KJ+6KIx}4RA>ZAB$ej9O>^mm%xi^@F%GX&3S5utDNy&L6S z4^P|%wL9Hl^9@_;N$#sSG9q)a?iZgjDJR(qoF|-uox^#+{LD%gUcXWhyaPM;W9T@G zxs8q+9^Lq#RpCF``sd$K3;6i}UPS{twQCKpYHg>1dM=+T4((Wf3kKNocznLj2Dti; z)0Otj{WHAn9I#XGU;Ve~dPryI?n(cfsVZEW8v0@^%@{OaDYV4bV3FU#nh;!)Eor3p zq|Ta4$lMBj1{*3InNXY?s*`5;(QC9;JrSM=>fc#t-1k4RwomQ2IH{o)Ei_E8E10ms zlp#%HkT0l}C^@uM>jRp89yVz@MU<@oVXsXWO%WcW^t27HO`1=`kFnN`TGz5~-`7zS z$DdtkR=hzMvcQAz9{rph$t%SnWMp6Ro^NUO(-(9Y7g>e&1~$vZSQm0H8WCRMGuA_}szXLR&Z!r_Nzg2#fqAI8@^>bwY^^4ZtA z5Fb}nYVzF3SziCb(a)APd6ysj0xzCWvtM*;S6{+Q=i1mj6F8Zf_0~P#Ln^t%j%DT6 zj0VR}8@Un*rm&)Sxn)*@(DcMNUhh(RnURyjt@xeXs%|MC3}VGgv3SJy(=+%64`K$A zxPbzvI?i~M*S+GpBs0Z`4c~JgenvfT@46vA>84~rohnO)+{ZLky^&DD3fxP>dRRl2 zWt1c1W8_N1z)i&1BlidtOm+xVt)i0y9$OH*z~x2EJzuSnGMuE8 zab!*;+fVcfOD1=%Nqwv;z8q3^7NeT;Lw4mrf46(I8Wn8=$#D5{uia52EaTEBh8Ewl z;69q;)ZT|N^dlH6zV&Nx08H>AsNk=T&K)ru>AN*pGjObLg^%?Q;IpEdYPyy~7 z@>XLdMSnqPMst%_a|_vBODCST>o27>X)il*6enGH!ygemp{vl?lMr>eKO%;G?IeGC zqf*ca(tG|&4krXl=8m4CG4N_n*0CzTlEK2q8+MH$@woEDSrvz^HekSw0-7j zCu`$jM>zl_ffCZ9z}un{_Y8qDvJ!V?CGUv` + +CCP Cluster configuration +:download:`configs.yaml ` + +CCP Cluster topology +:download:`topology.yaml ` + +CCP repositories configuration +:download:`repos.yaml ` + +CCP versions configuration for Mitaka +:download:`versions-mitaka.yaml ` + +CCP versions configuration for upgrade from Mitaka to Newton +:download:`versions-newton.yaml ` + +Upgrade and tests procedure +--------------------------- +* Install fuel-ccp +* Rename ``ccp.yaml`` to ``/root/.ccp.ymal`` +* Copy all yaml files to ``/root/`` +* Rename ``versions-mitaka.yaml`` to ``versions.yaml`` +* Execute ``ccp deploy`` and wait ok status for all services +* Install shaker +* On the node 172.20.9.40 execute ``shaker --scenario openstack/full_l2 --os-insecure --report full-l2.html --server-endpoint 172.20.9.40:31998`` +* Wait message ``INFO shaker.engine.quorum [-] Finished processing operation: ` | + +-------+----------------+---------------------------------------------------------+ + + + +Test Case 2: Analysis of L3 metrics during Open Stack upgrade +------------------------------------------------------------- +.. table:: Full L3 East West test results + + +-------+----------------+-----------------------------------------------------------------------------+ + |Losts |Errors |Full report | + +-------+----------------+-----------------------------------------------------------------------------+ + |0 |11 |:download:`L3 East West Full tests report ` | + +-------+----------------+-----------------------------------------------------------------------------+ + diff --git a/doc/source/test_results/neutron_fuel_ccp_upgrade/reports/full-l2.html b/doc/source/test_results/neutron_fuel_ccp_upgrade/reports/full-l2.html new file mode 100644 index 0000000..55209b0 --- /dev/null +++ b/doc/source/test_results/neutron_fuel_ccp_upgrade/reports/full-l2.html @@ -0,0 +1,724 @@ + + + + + + Shaker | The distributed data-plane testing tool for OpenStack + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +

+
+

Shaker | The Report

+
+
+
+
+ + +
+
+ + +
+
+ + +
+
+ + +
+
+ + +
+
+ +
+ +
+ + +
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file diff --git a/doc/source/test_results/neutron_fuel_ccp_upgrade/reports/full-l3-east-west.html b/doc/source/test_results/neutron_fuel_ccp_upgrade/reports/full-l3-east-west.html new file mode 100644 index 0000000..2bea30a --- /dev/null +++ b/doc/source/test_results/neutron_fuel_ccp_upgrade/reports/full-l3-east-west.html @@ -0,0 +1,724 @@ + + + + + + Shaker | The distributed data-plane testing tool for OpenStack + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+
+

Shaker | The Report

+
+
+
+
+ + +
+
+ + +
+
+ + +
+
+ + +
+
+ + +
+
+ +
+ +
+ + +
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + \ No newline at end of file