diff --git a/.aspell_en.wordlist b/.aspell_en.wordlist deleted file mode 100644 index 548299c19..000000000 --- a/.aspell_en.wordlist +++ /dev/null @@ -1,224 +0,0 @@ -personal_ws-1.1 en 223 -AMQP -API -APIs -Arista -assignee -AWS -backend -backends -backplane -balancer -balancers -behaviour -binded -bootable -bootloader -Brasero -Broadcom -CCISS -Ceilometer -CentOS -Ceph -checkbox -CIB -CIDR -Cirros -Cisco -CLI -Cloudera -CloudFormation -ClusterLabs -colocation -ConnectX -corosync -Cygwin -datacenter -datastore -Datastores -DHCP -DNS -DoS -dropdown -DRS -ESX -ESXi -eth -Etherpad -failover -FCoE -filesystem -FlatDHCP -FlatDHCPManager -FlatManager -frontend -Galera -Gerrit -GHz -GRE -GRO -GTID -GUID -Hadoop -HAproxy -HAProxy -hardcoded -Haswell -HDD -HDP -HealthCheck -Heartbleed -HortonWorks -hostname -hypervisor -hypervisors -IaaS -IceHouse -IDE -iDRAC -IEEE -IIS -IMG -ImgBurn -InfraRecorder -IOMMU -IOPS -IOV -IP -IPMI -IPs -iptables -IRC -iSCSI -iSER -JBOD -jpg -JSON -JVM -KVM -LACP -LBaaS -LDAP -Lenovo -lifecycle -login -lookups -loopback -LVM -LXC -MBR -Mellanox -memcached -metadata -middleware -Mirantis -Mnesia -MongoDB -MTU -multi -multicast -Murano -MySQL -Nagios -Nailgun -namespace -namespaces -Netgear -NFS -Nginx -NIC -NICs -NSX -NTP -OEM -online -openssh -OpenSSL -openstack -OpenStack -OpenSUSE -OSD -OSI -OSTF -overcommit -oversubscription -OVS -PageBreak -paravirtualized -Paxos -PCnet -pdf -PKI -plugin -png -PostgreSQL -POSTROUTING -PowerEdge -prefetch -PuppetDB -PXE -pxelinux -QEMU -RabbitMQ -RADOS -RadosGW -RBD -RESTful -RHEL -RPC -rst -rsyslogd -runtime -SATA -Scalability -Screenshots -SLB -SNAT -SQL -SQLAlchemy -SSD -startup -Stateful -stderr -STP -subnet -subnets -sudo -symlinks -Synchrony -syslog -TCP -TFTP -TODO -UDP -UEFI -UI -ULV -untagged -upgraders -uplink -USB -UUID -VBoxManage -vboxnet -vCenter -VirtualBox -virtualization -virtualize -virtualized -VLAN -VLANManager -VLANs -VM -VMDK -vMotion -VMs -VMware -VMWare -VNC -vSphere -vSwitch -workflow -XFS -yaml -Zabbix diff --git a/.gitignore b/.gitignore index 93fd8012b..38c70b718 100644 --- a/.gitignore +++ b/.gitignore @@ -1,7 +1,4 @@ +plantuml.jar /_build -/_images/*_svg.png -/_images/*_svg.jpg -/_images/*.pdf -/.idea /.tox -/doc + diff --git a/LICENSE b/LICENSE deleted file mode 100644 index 8d968b6cb..000000000 --- a/LICENSE +++ /dev/null @@ -1,201 +0,0 @@ - Apache License - Version 2.0, January 2004 - http://www.apache.org/licenses/ - - TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION - - 1. Definitions. - - "License" shall mean the terms and conditions for use, reproduction, - and distribution as defined by Sections 1 through 9 of this document. - - "Licensor" shall mean the copyright owner or entity authorized by - the copyright owner that is granting the License. - - "Legal Entity" shall mean the union of the acting entity and all - other entities that control, are controlled by, or are under common - control with that entity. For the purposes of this definition, - "control" means (i) the power, direct or indirect, to cause the - direction or management of such entity, whether by contract or - otherwise, or (ii) ownership of fifty percent (50%) or more of the - outstanding shares, or (iii) beneficial ownership of such entity. - - "You" (or "Your") shall mean an individual or Legal Entity - exercising permissions granted by this License. - - "Source" form shall mean the preferred form for making modifications, - including but not limited to software source code, documentation - source, and configuration files. - - "Object" form shall mean any form resulting from mechanical - transformation or translation of a Source form, including but - not limited to compiled object code, generated documentation, - and conversions to other media types. - - "Work" shall mean the work of authorship, whether in Source or - Object form, made available under the License, as indicated by a - copyright notice that is included in or attached to the work - (an example is provided in the Appendix below). - - "Derivative Works" shall mean any work, whether in Source or Object - form, that is based on (or derived from) the Work and for which the - editorial revisions, annotations, elaborations, or other modifications - represent, as a whole, an original work of authorship. For the purposes - of this License, Derivative Works shall not include works that remain - separable from, or merely link (or bind by name) to the interfaces of, - the Work and Derivative Works thereof. - - "Contribution" shall mean any work of authorship, including - the original version of the Work and any modifications or additions - to that Work or Derivative Works thereof, that is intentionally - submitted to Licensor for inclusion in the Work by the copyright owner - or by an individual or Legal Entity authorized to submit on behalf of - the copyright owner. For the purposes of this definition, "submitted" - means any form of electronic, verbal, or written communication sent - to the Licensor or its representatives, including but not limited to - communication on electronic mailing lists, source code control systems, - and issue tracking systems that are managed by, or on behalf of, the - Licensor for the purpose of discussing and improving the Work, but - excluding communication that is conspicuously marked or otherwise - designated in writing by the copyright owner as "Not a Contribution." - - "Contributor" shall mean Licensor and any individual or Legal Entity - on behalf of whom a Contribution has been received by Licensor and - subsequently incorporated within the Work. - - 2. Grant of Copyright License. Subject to the terms and conditions of - this License, each Contributor hereby grants to You a perpetual, - worldwide, non-exclusive, no-charge, royalty-free, irrevocable - copyright license to reproduce, prepare Derivative Works of, - publicly display, publicly perform, sublicense, and distribute the - Work and such Derivative Works in Source or Object form. - - 3. Grant of Patent License. Subject to the terms and conditions of - this License, each Contributor hereby grants to You a perpetual, - worldwide, non-exclusive, no-charge, royalty-free, irrevocable - (except as stated in this section) patent license to make, have made, - use, offer to sell, sell, import, and otherwise transfer the Work, - where such license applies only to those patent claims licensable - by such Contributor that are necessarily infringed by their - Contribution(s) alone or by combination of their Contribution(s) - with the Work to which such Contribution(s) was submitted. If You - institute patent litigation against any entity (including a - cross-claim or counterclaim in a lawsuit) alleging that the Work - or a Contribution incorporated within the Work constitutes direct - or contributory patent infringement, then any patent licenses - granted to You under this License for that Work shall terminate - as of the date such litigation is filed. - - 4. Redistribution. You may reproduce and distribute copies of the - Work or Derivative Works thereof in any medium, with or without - modifications, and in Source or Object form, provided that You - meet the following conditions: - - (a) You must give any other recipients of the Work or - Derivative Works a copy of this License; and - - (b) You must cause any modified files to carry prominent notices - stating that You changed the files; and - - (c) You must retain, in the Source form of any Derivative Works - that You distribute, all copyright, patent, trademark, and - attribution notices from the Source form of the Work, - excluding those notices that do not pertain to any part of - the Derivative Works; and - - (d) If the Work includes a "NOTICE" text file as part of its - distribution, then any Derivative Works that You distribute must - include a readable copy of the attribution notices contained - within such NOTICE file, excluding those notices that do not - pertain to any part of the Derivative Works, in at least one - of the following places: within a NOTICE text file distributed - as part of the Derivative Works; within the Source form or - documentation, if provided along with the Derivative Works; or, - within a display generated by the Derivative Works, if and - wherever such third-party notices normally appear. The contents - of the NOTICE file are for informational purposes only and - do not modify the License. You may add Your own attribution - notices within Derivative Works that You distribute, alongside - or as an addendum to the NOTICE text from the Work, provided - that such additional attribution notices cannot be construed - as modifying the License. - - You may add Your own copyright statement to Your modifications and - may provide additional or different license terms and conditions - for use, reproduction, or distribution of Your modifications, or - for any such Derivative Works as a whole, provided Your use, - reproduction, and distribution of the Work otherwise complies with - the conditions stated in this License. - - 5. Submission of Contributions. Unless You explicitly state otherwise, - any Contribution intentionally submitted for inclusion in the Work - by You to the Licensor shall be under the terms and conditions of - this License, without any additional terms or conditions. - Notwithstanding the above, nothing herein shall supersede or modify - the terms of any separate license agreement you may have executed - with Licensor regarding such Contributions. - - 6. Trademarks. This License does not grant permission to use the trade - names, trademarks, service marks, or product names of the Licensor, - except as required for reasonable and customary use in describing the - origin of the Work and reproducing the content of the NOTICE file. - - 7. Disclaimer of Warranty. Unless required by applicable law or - agreed to in writing, Licensor provides the Work (and each - Contributor provides its Contributions) on an "AS IS" BASIS, - WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or - implied, including, without limitation, any warranties or conditions - of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A - PARTICULAR PURPOSE. You are solely responsible for determining the - appropriateness of using or redistributing the Work and assume any - risks associated with Your exercise of permissions under this License. - - 8. Limitation of Liability. In no event and under no legal theory, - whether in tort (including negligence), contract, or otherwise, - unless required by applicable law (such as deliberate and grossly - negligent acts) or agreed to in writing, shall any Contributor be - liable to You for damages, including any direct, indirect, special, - incidental, or consequential damages of any character arising as a - result of this License or out of the use or inability to use the - Work (including but not limited to damages for loss of goodwill, - work stoppage, computer failure or malfunction, or any and all - other commercial damages or losses), even if such Contributor - has been advised of the possibility of such damages. - - 9. Accepting Warranty or Additional Liability. While redistributing - the Work or Derivative Works thereof, You may choose to offer, - and charge a fee for, acceptance of support, warranty, indemnity, - or other liability obligations and/or rights consistent with this - License. However, in accepting such obligations, You may act only - on Your own behalf and on Your sole responsibility, not on behalf - of any other Contributor, and only if You agree to indemnify, - defend, and hold each Contributor harmless for any liability - incurred by, or claims asserted against, such Contributor by reason - of your accepting any such warranty or additional liability. - - END OF TERMS AND CONDITIONS - - APPENDIX: How to apply the Apache License to your work. - - To apply the Apache License to your work, attach the following - boilerplate notice, with the fields enclosed by brackets "[]" - replaced with your own identifying information. (Don't include - the brackets!) The text should be enclosed in the appropriate - comment syntax for the file format. We also recommend that a - file or class name and description of purpose be included on the - same "printed page" as the copyright notice for easier - identification within third-party archives. - - Copyright [yyyy] [name of copyright owner] - - Licensed under the Apache License, Version 2.0 (the "License"); - you may not use this file except in compliance with the License. - You may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0 - - Unless required by applicable law or agreed to in writing, software - distributed under the License is distributed on an "AS IS" BASIS, - WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - See the License for the specific language governing permissions and - limitations under the License. diff --git a/Makefile b/Makefile index 52c824bf5..b782a89f5 100644 --- a/Makefile +++ b/Makefile @@ -4,8 +4,11 @@ # You can set these variables from the command line. SPHINXOPTS = SPHINXBUILD = sphinx-build -PAPER = letter +PAPER = BUILDDIR = _build +#PLANTUML = plantuml.jar +PLANTUML_FROM_PKG = /usr/share/plantuml/plantuml.jar + # Internal variables. PAPEROPT_a4 = -D latex_paper_size=a4 @@ -14,11 +17,7 @@ ALLSPHINXOPTS = -d $(BUILDDIR)/doctrees $(PAPEROPT_$(PAPER)) $(SPHINXOPTS) . # the i18n builder cannot share the environment and doctrees with the others I18NSPHINXOPTS = $(PAPEROPT_$(PAPER)) $(SPHINXOPTS) . -IMAGEDIRS = _images - -.PHONY: help clean html dirhtml singlehtml pickle json htmlhelp qthelp devhelp \ - epub latex latexpdf pdf text man changes linkcheck doctest gettext spell \ - spell_all +.PHONY: help clean html dirhtml singlehtml pickle json htmlhelp qthelp devhelp epub latex latexpdf text man changes linkcheck doctest gettext help: @echo "Please use \`make ' where is one of" @@ -33,8 +32,8 @@ help: @echo " epub to make an epub" @echo " latex to make LaTeX files, you can set PAPER=a4 or PAPER=letter" @echo " latexpdf to make LaTeX files and run them through pdflatex" + @echo " pdf to make PDF using rst2pdf" @echo " text to make text files" - @echo " pdf to make pdf files" @echo " man to make manual pages" @echo " texinfo to make Texinfo files" @echo " info to make Texinfo files and run them through makeinfo" @@ -42,36 +41,33 @@ help: @echo " changes to make an overview of all changed/added/deprecated items" @echo " linkcheck to check all external links for integrity" @echo " doctest to run all doctests embedded in the documentation (if enabled)" - @echo " spell to run aspell against .rst files changed in current commit" - @echo " spell_all to run aspell against all .rst files in pages/ directory" clean: -rm -rf $(BUILDDIR)/* - -@rm -f $(PDFs) -# Pattern rule for converting SVG to PDF -%.pdf : %.svg - inkscape -f $< -A $@ +#$(PLANTUML): +# @if [ -f $(PLANTUML_FROM_PKG) ]; \ +# then \ +# echo "Have installed plantuml. Creating link $(PLANTUML) on $(PLANTUML_FROM_PKG)."; \ +# ln -sf $(PLANTUML_FROM_PKG) $(PLANTUML); \ +# else \ +# echo "Downloading plantuml.jar."; \ +# wget https://downloads.sourceforge.net/project/plantuml/plantuml.jar -O $(PLANTUML); \ +# fi +# $(ACTION.TOUCH) -# Build a list of SVG files to convert to PDFs -PDFs := $(foreach dir, $(IMAGEDIRS), $(patsubst %.svg,%.pdf,$(wildcard $(dir)/*.svg))) - -# Make a rule to build all images -images: $(PDFs) - -all: clean html dirhtml singlehtml latexpdf pdf - -rawhtml: images - $(SPHINXBUILD) -b html $(ALLSPHINXOPTS) $(BUILDDIR)/html +html: +#$(PLANTUML) + $(SPHINXBUILD) -b html -W $(ALLSPHINXOPTS) $(BUILDDIR)/html @echo @echo "Build finished. The HTML pages are in $(BUILDDIR)/html." -dirhtml: images +dirhtml: $(SPHINXBUILD) -b dirhtml $(ALLSPHINXOPTS) $(BUILDDIR)/dirhtml @echo @echo "Build finished. The HTML pages are in $(BUILDDIR)/dirhtml." -singlehtml: images +singlehtml: $(SPHINXBUILD) -b singlehtml $(ALLSPHINXOPTS) $(BUILDDIR)/singlehtml @echo @echo "Build finished. The HTML page is in $(BUILDDIR)/singlehtml." @@ -86,13 +82,13 @@ json: @echo @echo "Build finished; now you can process the JSON files." -htmlhelp: images +htmlhelp: $(SPHINXBUILD) -b htmlhelp $(ALLSPHINXOPTS) $(BUILDDIR)/htmlhelp @echo @echo "Build finished; now you can run HTML Help Workshop with the" \ ".hhp project file in $(BUILDDIR)/htmlhelp." -qthelp: images +qthelp: $(SPHINXBUILD) -b qthelp $(ALLSPHINXOPTS) $(BUILDDIR)/qthelp @echo @echo "Build finished; now you can run "qcollectiongenerator" with the" \ @@ -101,7 +97,7 @@ qthelp: images @echo "To view the help file:" @echo "# assistant -collectionFile $(BUILDDIR)/qthelp/fuel.qhc" -devhelp: images +devhelp: $(SPHINXBUILD) -b devhelp $(ALLSPHINXOPTS) $(BUILDDIR)/devhelp @echo @echo "Build finished." @@ -110,29 +106,29 @@ devhelp: images @echo "# ln -s $(BUILDDIR)/devhelp $$HOME/.local/share/devhelp/fuel" @echo "# devhelp" -epub: images +epub: $(SPHINXBUILD) -b epub $(ALLSPHINXOPTS) $(BUILDDIR)/epub @echo @echo "Build finished. The epub file is in $(BUILDDIR)/epub." -latex: images +latex: $(SPHINXBUILD) -b latex $(ALLSPHINXOPTS) $(BUILDDIR)/latex @echo @echo "Build finished; the LaTeX files are in $(BUILDDIR)/latex." @echo "Run \`make' in that directory to run these through (pdf)latex" \ "(use \`make latexpdf' here to do that automatically)." -pdf: images - $(SPHINXBUILD) -b pdf -c pdf $(ALLSPHINXOPTS) $(BUILDDIR)/pdf - @echo - @echo "Build finished; the PDF file is in $(BUILDDIR)/pdf." - -latexpdf: images +latexpdf: $(SPHINXBUILD) -b latex $(ALLSPHINXOPTS) $(BUILDDIR)/latex @echo "Running LaTeX files through pdflatex..." $(MAKE) -C $(BUILDDIR)/latex all-pdf @echo "pdflatex finished; the PDF files are in $(BUILDDIR)/latex." +pdf: + $(SPHINXBUILD) -b pdf $(ALLSPHINXOPTS) $(BUILDDIR)/pdf + @echo + @echo "Build finished; the PDF file is in $(BUILDDIR)/pdf." + text: $(SPHINXBUILD) -b text $(ALLSPHINXOPTS) $(BUILDDIR)/text @echo @@ -176,25 +172,3 @@ doctest: $(SPHINXBUILD) -b doctest $(ALLSPHINXOPTS) $(BUILDDIR)/doctest @echo "Testing of doctests in the sources finished, look at the " \ "results in $(BUILDDIR)/doctest/output.txt." - -html: rawhtml - ./lunr.py - @echo - @echo "Lunr search index complete" - -SPELL = aspell -ASPELLOPTS = --dont-backup -d en --personal=.aspell_en.wordlist -RSTS := $(shell find pages/ -type f -name '*.rst') - -COMMIT_RSTS := $(shell git diff-tree --no-commit-id --name-only -r HEAD) -spell: - @for rst in $(COMMIT_RSTS); do \ - $(SPELL) $(ASPELLOPTS) check $$rst; \ - done - -spell_all: - @for rst in $(RSTS); do \ - $(SPELL) $(ASPELLOPTS) check $$rst; \ - done - @echo "Spell check complete" - diff --git a/README.md b/README.md deleted file mode 100644 index 8affd5110..000000000 --- a/README.md +++ /dev/null @@ -1,149 +0,0 @@ - -Mirantis OpenStack Documentation -================================= - -This repository contains the Mirantis OpenStack user and administrator -guides. For more details, see the [Mirantis OpenStack -portal](http://software.mirantis.com "Mirantis OpenStack portal"). - -Contributing -============ - -We welcome all people who are interested in helping our Documentation team -to improve our documentation. There are no formal membership requirements, -so feel free to hop in. The best way to contibute is to fork our repository, -do your changes and send us a Pull Request. You are invited to contribute -any type of contribution like new ideas, testing, and even deployment scripts. - -We also have an IRC channel at ``#fuel`` & ``#fuel-dev`` on ``irc.freenode.net`` -where you can ask questions and give feedback. - -Prerequisites -============= - -[Sphinx Documentation Generator](http://sphinx-doc.org/ "Sphinx -Documentation Generator") must be installed to build the documentation. -Please note that easy_install is a component of Python's Setup Tools -package, which is commonly an optional install on most distributions. - - -To get started, you need to install all necesasary tools. - -On Debian/Ubuntu: - - sudo apt-get install git python-pip python-dev make imagemagick libjpeg-dev inkscape aspell python-pillow - -On Fedora: - - sudo yum install git python-pip python-devel make ImageMagick libjpeg-turbo-devel inkscape aspell - -Among other things that installs -[ImageMagick](http://www.imagemagick.org/ "ImageMagick") and -[Inkscape](http://inkscape.org/ "Inkscape"). - -And Sphinx necessary extensions: - - sudo pip install -r requirements.txt - -In addition to these eggs you will need to install -[PlantUML](http://plantuml.sourceforge.net/ "PlantUML") - -To install PlantUML run this wget process: - - sudo wget \ - http://sourceforge.net/projects/plantuml/files/plantuml.jar/download \ - -O /sbin/plantuml.jar - -PlantumUML requires java: - sudo apt-get install openjdk-7-jre - -We use [Inkscape](http://inkscape.org/ "Inkscape") to edit SVG images -and convert them to PDF but you may use any other SVG-capable tool you -like. We're not picky. - -Building -======== - -To build a guide in HTML format, go to its directory and then run the -``make`` command in that directory, like so: - - make html - -To generate the PDF file run this: - - make pdf - -You will find generated HTML documentation at: - - _build/html - -You will find generated PDF documentation at: - - _build/pdf - -Reviewer's Checklist -==================== - -Checks for commit message: - -1. The goal and extent of the change should be described in the commit - message. - -2. If the commit is related to a LaunchPad bug, it should have - "Closes-Bug: nnnnnnn" line in the commit message. Likewise, - "blueprint name-of-the-blueprint" for a commit related to a - blueprint. Most non-trivial commits should have such references. - -Checks for content changes: - -1. For every block of content that is removed, there should be either a - block that replaces it, or an explanation in the commit message why - that block is no longer needed. - -2. Confirm that the new content is approved by a technical expert in the - relevant area. - -3. Check that the content is in the right document and the right - context. Deployment of Fuel itself is described in the Installation - Guide; deployment of Mirantis OpenStack using Fuel, in User Guide; - post-deployment operation of Mirantis OpenStack, in Operations Guide; - and so on. - -Checks for structural changes: - -1. For any removed file (including original path in a move or rename), - grep for the file name through all rst files and confirm that no - stale references to the file are left behind. - -2. For any added file (including new path in a move or rename), confirm - that the new path is referenced in a way that will get it included in - at least one document. - -Testing the change locally: - -1. Download the branch: - git review -d - -2. Check that it's based on the current tip of the master branch, look - for "origin/master" next to commit hash in the output of: - git log --graph --decorate - -3. If it's not, check if it can be rebased onto master cleanly: - git rebase --onto master HEAD^ - -4. Build HTML and PDF versions as described above. If rebase was - necessary, build from the rebased version: you want to see what the - result of the merge into master will look like - -5. Check that the count of warnings reported by 'make pdf' hasn't - increased relative to master. - -6. Check that all sections touched by the change show up in the table of - contents in the right place and at the right nesting level. - -Finally, go through all changes line by line and ask yourself: what is -the purpose of this change? Is that related to the description of the -review given in the commit message? Could it be accidental or result of -a merge error during rebase? - - diff --git a/_fonts/PTC55F.ttf b/_fonts/PTC55F.ttf deleted file mode 100644 index d117c1c0c..000000000 Binary files a/_fonts/PTC55F.ttf and /dev/null differ diff --git a/_fonts/PTC55F_W.eot b/_fonts/PTC55F_W.eot deleted file mode 100644 index 968d6e498..000000000 Binary files a/_fonts/PTC55F_W.eot and /dev/null differ diff --git a/_fonts/PTC55F_W.ttf b/_fonts/PTC55F_W.ttf deleted file mode 100644 index 66802733b..000000000 Binary files a/_fonts/PTC55F_W.ttf and /dev/null differ diff --git a/_fonts/PTC55F_W.woff b/_fonts/PTC55F_W.woff deleted file mode 100644 index 1c7d62e01..000000000 Binary files a/_fonts/PTC55F_W.woff and /dev/null differ diff --git a/_fonts/PTC75F.ttf b/_fonts/PTC75F.ttf deleted file mode 100644 index e3210a321..000000000 Binary files a/_fonts/PTC75F.ttf and /dev/null differ diff --git a/_fonts/PTC75F_W.eot b/_fonts/PTC75F_W.eot deleted file mode 100644 index 8ea7c612a..000000000 Binary files a/_fonts/PTC75F_W.eot and /dev/null differ diff --git a/_fonts/PTC75F_W.ttf b/_fonts/PTC75F_W.ttf deleted file mode 100644 index 0b83dc65c..000000000 Binary files a/_fonts/PTC75F_W.ttf and /dev/null differ diff --git a/_fonts/PTC75F_W.woff b/_fonts/PTC75F_W.woff deleted file mode 100644 index fb6770bb1..000000000 Binary files a/_fonts/PTC75F_W.woff and /dev/null differ diff --git a/_fonts/PTF55F.ttf b/_fonts/PTF55F.ttf deleted file mode 100644 index ed3e1b195..000000000 Binary files a/_fonts/PTF55F.ttf and /dev/null differ diff --git a/_fonts/PTF55F_W.eot b/_fonts/PTF55F_W.eot deleted file mode 100644 index 59de08fe6..000000000 Binary files a/_fonts/PTF55F_W.eot and /dev/null differ diff --git a/_fonts/PTF55F_W.ttf b/_fonts/PTF55F_W.ttf deleted file mode 100644 index 8adc1a0ad..000000000 Binary files a/_fonts/PTF55F_W.ttf and /dev/null differ diff --git a/_fonts/PTF55F_W.woff b/_fonts/PTF55F_W.woff deleted file mode 100644 index 65bf7617c..000000000 Binary files a/_fonts/PTF55F_W.woff and /dev/null differ diff --git a/_fonts/PTF56F.ttf b/_fonts/PTF56F.ttf deleted file mode 100644 index 3bbb3fd8f..000000000 Binary files a/_fonts/PTF56F.ttf and /dev/null differ diff --git a/_fonts/PTF56F_W.eot b/_fonts/PTF56F_W.eot deleted file mode 100644 index f4210c6a5..000000000 Binary files a/_fonts/PTF56F_W.eot and /dev/null differ diff --git a/_fonts/PTF56F_W.ttf b/_fonts/PTF56F_W.ttf deleted file mode 100644 index b3305397e..000000000 Binary files a/_fonts/PTF56F_W.ttf and /dev/null differ diff --git a/_fonts/PTF56F_W.woff b/_fonts/PTF56F_W.woff deleted file mode 100644 index 81957c7a4..000000000 Binary files a/_fonts/PTF56F_W.woff and /dev/null differ diff --git a/_fonts/PTF75F.ttf b/_fonts/PTF75F.ttf deleted file mode 100644 index 4a3608be3..000000000 Binary files a/_fonts/PTF75F.ttf and /dev/null differ diff --git a/_fonts/PTF75F_W.eot b/_fonts/PTF75F_W.eot deleted file mode 100644 index e6189c9b5..000000000 Binary files a/_fonts/PTF75F_W.eot and /dev/null differ diff --git a/_fonts/PTF75F_W.ttf b/_fonts/PTF75F_W.ttf deleted file mode 100644 index 028bf3534..000000000 Binary files a/_fonts/PTF75F_W.ttf and /dev/null differ diff --git a/_fonts/PTF75F_W.woff b/_fonts/PTF75F_W.woff deleted file mode 100644 index 863a33456..000000000 Binary files a/_fonts/PTF75F_W.woff and /dev/null differ diff --git a/_fonts/PTF76F.ttf b/_fonts/PTF76F.ttf deleted file mode 100644 index 55e17fd56..000000000 Binary files a/_fonts/PTF76F.ttf and /dev/null differ diff --git a/_fonts/PTF76F_W.eot b/_fonts/PTF76F_W.eot deleted file mode 100644 index 8db58df30..000000000 Binary files a/_fonts/PTF76F_W.eot and /dev/null differ diff --git a/_fonts/PTF76F_W.ttf b/_fonts/PTF76F_W.ttf deleted file mode 100644 index d4970b439..000000000 Binary files a/_fonts/PTF76F_W.ttf and /dev/null differ diff --git a/_fonts/PTF76F_W.woff b/_fonts/PTF76F_W.woff deleted file mode 100644 index def677d0f..000000000 Binary files a/_fonts/PTF76F_W.woff and /dev/null differ diff --git a/_fonts/PTM55F.ttf b/_fonts/PTM55F.ttf deleted file mode 100644 index 1d9f770e3..000000000 Binary files a/_fonts/PTM55F.ttf and /dev/null differ diff --git a/_fonts/PTM55F_W.ttf b/_fonts/PTM55F_W.ttf deleted file mode 100644 index 83ecbb3a3..000000000 Binary files a/_fonts/PTM55F_W.ttf and /dev/null differ diff --git a/_fonts/PTM55F_W.woff b/_fonts/PTM55F_W.woff deleted file mode 100644 index 368308776..000000000 Binary files a/_fonts/PTM55F_W.woff and /dev/null differ diff --git a/_fonts/PTM75F.ttf b/_fonts/PTM75F.ttf deleted file mode 100644 index 1cfa3e9b2..000000000 Binary files a/_fonts/PTM75F.ttf and /dev/null differ diff --git a/_fonts/PTM75F_W.ttf b/_fonts/PTM75F_W.ttf deleted file mode 100644 index 48a023f12..000000000 Binary files a/_fonts/PTM75F_W.ttf and /dev/null differ diff --git a/_fonts/PTM75F_W.woff b/_fonts/PTM75F_W.woff deleted file mode 100644 index 6006cdc5d..000000000 Binary files a/_fonts/PTM75F_W.woff and /dev/null differ diff --git a/_fonts/PTN57F.ttf b/_fonts/PTN57F.ttf deleted file mode 100644 index df8ba7185..000000000 Binary files a/_fonts/PTN57F.ttf and /dev/null differ diff --git a/_fonts/PTN57F_W.eot b/_fonts/PTN57F_W.eot deleted file mode 100644 index 0bb06faa9..000000000 Binary files a/_fonts/PTN57F_W.eot and /dev/null differ diff --git a/_fonts/PTN57F_W.ttf b/_fonts/PTN57F_W.ttf deleted file mode 100644 index c48b4a6a4..000000000 Binary files a/_fonts/PTN57F_W.ttf and /dev/null differ diff --git a/_fonts/PTN57F_W.woff b/_fonts/PTN57F_W.woff deleted file mode 100644 index 4267d7a88..000000000 Binary files a/_fonts/PTN57F_W.woff and /dev/null differ diff --git a/_fonts/PTN77F.ttf b/_fonts/PTN77F.ttf deleted file mode 100644 index 74494e851..000000000 Binary files a/_fonts/PTN77F.ttf and /dev/null differ diff --git a/_fonts/PTN77F_W.eot b/_fonts/PTN77F_W.eot deleted file mode 100644 index 4a5d1f914..000000000 Binary files a/_fonts/PTN77F_W.eot and /dev/null differ diff --git a/_fonts/PTN77F_W.ttf b/_fonts/PTN77F_W.ttf deleted file mode 100644 index cbc21827a..000000000 Binary files a/_fonts/PTN77F_W.ttf and /dev/null differ diff --git a/_fonts/PTN77F_W.woff b/_fonts/PTN77F_W.woff deleted file mode 100644 index d1fb8f1bb..000000000 Binary files a/_fonts/PTN77F_W.woff and /dev/null differ diff --git a/_fonts/PTS55F.ttf b/_fonts/PTS55F.ttf deleted file mode 100644 index 9eb3e6f5c..000000000 Binary files a/_fonts/PTS55F.ttf and /dev/null differ diff --git a/_fonts/PTS55F_W.eot b/_fonts/PTS55F_W.eot deleted file mode 100644 index c8db3d028..000000000 Binary files a/_fonts/PTS55F_W.eot and /dev/null differ diff --git a/_fonts/PTS55F_W.ttf b/_fonts/PTS55F_W.ttf deleted file mode 100644 index cc0d9088a..000000000 Binary files a/_fonts/PTS55F_W.ttf and /dev/null differ diff --git a/_fonts/PTS55F_W.woff b/_fonts/PTS55F_W.woff deleted file mode 100644 index 8af9db8a5..000000000 Binary files a/_fonts/PTS55F_W.woff and /dev/null differ diff --git a/_fonts/PTS56F.ttf b/_fonts/PTS56F.ttf deleted file mode 100644 index 394fa79cc..000000000 Binary files a/_fonts/PTS56F.ttf and /dev/null differ diff --git a/_fonts/PTS56F_W.eot b/_fonts/PTS56F_W.eot deleted file mode 100644 index cb58fe27c..000000000 Binary files a/_fonts/PTS56F_W.eot and /dev/null differ diff --git a/_fonts/PTS56F_W.ttf b/_fonts/PTS56F_W.ttf deleted file mode 100644 index 0fbee64d4..000000000 Binary files a/_fonts/PTS56F_W.ttf and /dev/null differ diff --git a/_fonts/PTS56F_W.woff b/_fonts/PTS56F_W.woff deleted file mode 100644 index fe5337937..000000000 Binary files a/_fonts/PTS56F_W.woff and /dev/null differ diff --git a/_fonts/PTS75F.ttf b/_fonts/PTS75F.ttf deleted file mode 100644 index d0265b22d..000000000 Binary files a/_fonts/PTS75F.ttf and /dev/null differ diff --git a/_fonts/PTS75F_W.eot b/_fonts/PTS75F_W.eot deleted file mode 100644 index f12d2ca7c..000000000 Binary files a/_fonts/PTS75F_W.eot and /dev/null differ diff --git a/_fonts/PTS75F_W.ttf b/_fonts/PTS75F_W.ttf deleted file mode 100644 index 4f038bdce..000000000 Binary files a/_fonts/PTS75F_W.ttf and /dev/null differ diff --git a/_fonts/PTS75F_W.woff b/_fonts/PTS75F_W.woff deleted file mode 100644 index 7c7edc324..000000000 Binary files a/_fonts/PTS75F_W.woff and /dev/null differ diff --git a/_fonts/PTS76F.ttf b/_fonts/PTS76F.ttf deleted file mode 100644 index 5d169103e..000000000 Binary files a/_fonts/PTS76F.ttf and /dev/null differ diff --git a/_fonts/PTS76F_W.eot b/_fonts/PTS76F_W.eot deleted file mode 100644 index dcad7e933..000000000 Binary files a/_fonts/PTS76F_W.eot and /dev/null differ diff --git a/_fonts/PTS76F_W.ttf b/_fonts/PTS76F_W.ttf deleted file mode 100644 index 9a2a6b803..000000000 Binary files a/_fonts/PTS76F_W.ttf and /dev/null differ diff --git a/_fonts/PTS76F_W.woff b/_fonts/PTS76F_W.woff deleted file mode 100644 index 45e95c58e..000000000 Binary files a/_fonts/PTS76F_W.woff and /dev/null differ diff --git a/_fonts/PTZ55F.ttf b/_fonts/PTZ55F.ttf deleted file mode 100644 index 311788312..000000000 Binary files a/_fonts/PTZ55F.ttf and /dev/null differ diff --git a/_fonts/PTZ55F_W.eot b/_fonts/PTZ55F_W.eot deleted file mode 100644 index 5b338fd2a..000000000 Binary files a/_fonts/PTZ55F_W.eot and /dev/null differ diff --git a/_fonts/PTZ55F_W.ttf b/_fonts/PTZ55F_W.ttf deleted file mode 100644 index 3148a6b47..000000000 Binary files a/_fonts/PTZ55F_W.ttf and /dev/null differ diff --git a/_fonts/PTZ55F_W.woff b/_fonts/PTZ55F_W.woff deleted file mode 100644 index 15c091284..000000000 Binary files a/_fonts/PTZ55F_W.woff and /dev/null differ diff --git a/_fonts/PTZ56F.ttf b/_fonts/PTZ56F.ttf deleted file mode 100644 index 1125c4505..000000000 Binary files a/_fonts/PTZ56F.ttf and /dev/null differ diff --git a/_fonts/PTZ56F_W.eot b/_fonts/PTZ56F_W.eot deleted file mode 100644 index 3947f75b3..000000000 Binary files a/_fonts/PTZ56F_W.eot and /dev/null differ diff --git a/_fonts/PTZ56F_W.ttf b/_fonts/PTZ56F_W.ttf deleted file mode 100644 index d369baa4c..000000000 Binary files a/_fonts/PTZ56F_W.ttf and /dev/null differ diff --git a/_fonts/PTZ56F_W.woff b/_fonts/PTZ56F_W.woff deleted file mode 100644 index 9ca8a050d..000000000 Binary files a/_fonts/PTZ56F_W.woff and /dev/null differ diff --git a/_fonts/type.xml b/_fonts/type.xml deleted file mode 100644 index 566ae4dbc..000000000 --- a/_fonts/type.xml +++ /dev/null @@ -1,260 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/_images/001-health-check-tab.jpg b/_images/001-health-check-tab.jpg deleted file mode 100644 index 79327acb7..000000000 Binary files a/_images/001-health-check-tab.jpg and /dev/null differ diff --git a/_images/001-health-check-tab.png b/_images/001-health-check-tab.png deleted file mode 100644 index 21da43c68..000000000 Binary files a/_images/001-health-check-tab.png and /dev/null differ diff --git a/_images/002-health-check-results.jpg b/_images/002-health-check-results.jpg deleted file mode 100644 index 18db74bd6..000000000 Binary files a/_images/002-health-check-results.jpg and /dev/null differ diff --git a/_images/002-health-check-results.png b/_images/002-health-check-results.png deleted file mode 100644 index 9bf5bc678..000000000 Binary files a/_images/002-health-check-results.png and /dev/null differ diff --git a/_images/080-networking-diagram.svg b/_images/080-networking-diagram.svg deleted file mode 100644 index a2838b0f8..000000000 --- a/_images/080-networking-diagram.svg +++ /dev/null @@ -1,1112 +0,0 @@ - - - - - - image/svg+xml - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - Fuel Master - admin - neutron-agent - - diff --git a/_images/1-1-mapping.png b/_images/1-1-mapping.png deleted file mode 100644 index a280c91eb..000000000 Binary files a/_images/1-1-mapping.png and /dev/null differ diff --git a/_images/6061network.png b/_images/6061network.png deleted file mode 100644 index a8f36a2a7..000000000 Binary files a/_images/6061network.png and /dev/null differ diff --git a/_images/Neutron_32_gre_v2.png b/_images/Neutron_32_gre_v2.png deleted file mode 100644 index ceb98dfdc..000000000 Binary files a/_images/Neutron_32_gre_v2.png and /dev/null differ diff --git a/_images/Neutron_32_vlan_v2.png b/_images/Neutron_32_vlan_v2.png deleted file mode 100644 index 62dcfad20..000000000 Binary files a/_images/Neutron_32_vlan_v2.png and /dev/null differ diff --git a/_images/Neutron_nsx_l2.png b/_images/Neutron_nsx_l2.png deleted file mode 100644 index 978aca1f7..000000000 Binary files a/_images/Neutron_nsx_l2.png and /dev/null differ diff --git a/_images/Neutron_nsx_l3.png b/_images/Neutron_nsx_l3.png deleted file mode 100644 index cdda46484..000000000 Binary files a/_images/Neutron_nsx_l3.png and /dev/null differ diff --git a/_images/assign-public-ips-to-computes.png b/_images/assign-public-ips-to-computes.png deleted file mode 100644 index 39d25af3b..000000000 Binary files a/_images/assign-public-ips-to-computes.png and /dev/null differ diff --git a/_images/authx/change_pass_not_vis.png b/_images/authx/change_pass_not_vis.png deleted file mode 100644 index 2970058e4..000000000 Binary files a/_images/authx/change_pass_not_vis.png and /dev/null differ diff --git a/_images/authx/f_menu_pass.png b/_images/authx/f_menu_pass.png deleted file mode 100644 index c74590115..000000000 Binary files a/_images/authx/f_menu_pass.png and /dev/null differ diff --git a/_images/bonding-setup-in-ui-2.png b/_images/bonding-setup-in-ui-2.png deleted file mode 100644 index 25c11372b..000000000 Binary files a/_images/bonding-setup-in-ui-2.png and /dev/null differ diff --git a/_images/bonding-setup-in-ui-3.png b/_images/bonding-setup-in-ui-3.png deleted file mode 100644 index e19f54e9b..000000000 Binary files a/_images/bonding-setup-in-ui-3.png and /dev/null differ diff --git a/_images/bonding-setup-in-ui-45.png b/_images/bonding-setup-in-ui-45.png deleted file mode 100644 index 5ab5dac99..000000000 Binary files a/_images/bonding-setup-in-ui-45.png and /dev/null differ diff --git a/_images/ceph_nodes.svg b/_images/ceph_nodes.svg deleted file mode 100644 index 504d39fac..000000000 --- a/_images/ceph_nodes.svg +++ /dev/null @@ -1,514 +0,0 @@ - - - - - - - - - - - - image/svg+xml - - - - - - - - controller 3 - - controller - - ceph-mon - - controller 2 - - controller - - ceph-mon - - controller 1 - - - - controller - - ceph-mon - - - - - - - - nova - - - - ceph client - compute 1 - compute n. . . - - - - - - - - - - ceph-osd - - - - - - ceph-osd - - storage 1 - storage n. . . - - - - - storage network - - - - - - management network - - diff --git a/_images/deployment-ha-compact.svg b/_images/deployment-ha-compact.svg deleted file mode 100644 index 741e080c9..000000000 --- a/_images/deployment-ha-compact.svg +++ /dev/null @@ -1,478 +0,0 @@ - - - - - - image/svg+xml - - - - - - - - - - - - - - - - - - - - Controller Node #1 - Controller Node #2 - Controller Node #3 - RabbitMQ Cluster - MySQL Galera - Neutron (Active) - - HAProxy (Active) - - Pacemaker Cluster - - - - RabbitMQ Cluster - MySQL Galera - Neutron (Standby) - - HAProxy (Standby) - - Pacemaker Cluster - - - - RabbitMQ Cluster - MySQL Galera - Neutron (Standby) - - HAProxy (Standby) - - Pacemaker Cluster - - - - - Cinder Node - Cinder Volume - - - Ceph Node - Ceph OSD - - - - Compute Node - Compute - diff --git a/_images/dual-hyperv-arch.png b/_images/dual-hyperv-arch.png deleted file mode 100644 index 33eef094f..000000000 Binary files a/_images/dual-hyperv-arch.png and /dev/null differ diff --git a/_images/errataPatching.png b/_images/errataPatching.png deleted file mode 100644 index d04e84f5b..000000000 Binary files a/_images/errataPatching.png and /dev/null differ diff --git a/_images/esx-connection-settings.png b/_images/esx-connection-settings.png deleted file mode 100644 index ccd4e2c65..000000000 Binary files a/_images/esx-connection-settings.png and /dev/null differ diff --git a/_images/esx-connection-type.png b/_images/esx-connection-type.png deleted file mode 100644 index 612d8d3af..000000000 Binary files a/_images/esx-connection-type.png and /dev/null differ diff --git a/_images/esx-manage-networks.png b/_images/esx-manage-networks.png deleted file mode 100644 index 7e1794a55..000000000 Binary files a/_images/esx-manage-networks.png and /dev/null differ diff --git a/_images/esx-target-device.png b/_images/esx-target-device.png deleted file mode 100644 index af44adb79..000000000 Binary files a/_images/esx-target-device.png and /dev/null differ diff --git a/_images/externalUbuntu.png b/_images/externalUbuntu.png deleted file mode 100644 index 42121c52b..000000000 Binary files a/_images/externalUbuntu.png and /dev/null differ diff --git a/_images/fig/d_install_w_internet.png b/_images/fig/d_install_w_internet.png deleted file mode 100644 index be37102e7..000000000 Binary files a/_images/fig/d_install_w_internet.png and /dev/null differ diff --git a/_images/fig/d_install_wo_internet.png b/_images/fig/d_install_wo_internet.png deleted file mode 100644 index 736b3de66..000000000 Binary files a/_images/fig/d_install_wo_internet.png and /dev/null differ diff --git a/_images/fig/scr_fuel_setup.png b/_images/fig/scr_fuel_setup.png deleted file mode 100644 index a160b3cc7..000000000 Binary files a/_images/fig/scr_fuel_setup.png and /dev/null differ diff --git a/_images/flatdhcpmanager-mh_scheme.jpg b/_images/flatdhcpmanager-mh_scheme.jpg deleted file mode 100644 index d51b9bf53..000000000 Binary files a/_images/flatdhcpmanager-mh_scheme.jpg and /dev/null differ diff --git a/_images/flatdhcpmanager-sh_scheme.jpg b/_images/flatdhcpmanager-sh_scheme.jpg deleted file mode 100644 index 55f8eb185..000000000 Binary files a/_images/flatdhcpmanager-sh_scheme.jpg and /dev/null differ diff --git a/_images/fuel-agent-architecture.png b/_images/fuel-agent-architecture.png deleted file mode 100644 index e23980c80..000000000 Binary files a/_images/fuel-agent-architecture.png and /dev/null differ diff --git a/_images/fuel-agent-build-image-sequence.png b/_images/fuel-agent-build-image-sequence.png deleted file mode 100644 index 7b650f2dd..000000000 Binary files a/_images/fuel-agent-build-image-sequence.png and /dev/null differ diff --git a/_images/fuel-agent-sequence.png b/_images/fuel-agent-sequence.png deleted file mode 100644 index 59f673c76..000000000 Binary files a/_images/fuel-agent-sequence.png and /dev/null differ diff --git a/_images/fuel-cli-warning.png b/_images/fuel-cli-warning.png deleted file mode 100644 index 87b95ffdb..000000000 Binary files a/_images/fuel-cli-warning.png and /dev/null differ diff --git a/_images/fuel-master-node-containers.png b/_images/fuel-master-node-containers.png deleted file mode 100644 index 5486dbdd5..000000000 Binary files a/_images/fuel-master-node-containers.png and /dev/null differ diff --git a/_images/fuel-network-settings.png b/_images/fuel-network-settings.png deleted file mode 100644 index f77987a30..000000000 Binary files a/_images/fuel-network-settings.png and /dev/null differ diff --git a/_images/fuel-plugin-netapp-configuration.png b/_images/fuel-plugin-netapp-configuration.png deleted file mode 100644 index 203ba7fcf..000000000 Binary files a/_images/fuel-plugin-netapp-configuration.png and /dev/null differ diff --git a/_images/fuel_master_install.png b/_images/fuel_master_install.png deleted file mode 100644 index dc97def54..000000000 Binary files a/_images/fuel_master_install.png and /dev/null differ diff --git a/_images/fuel_plugin_dev_ui_elements.png b/_images/fuel_plugin_dev_ui_elements.png deleted file mode 100644 index 77b11feb5..000000000 Binary files a/_images/fuel_plugin_dev_ui_elements.png and /dev/null differ diff --git a/_images/fuel_plugin_glusterfs_configuration.png b/_images/fuel_plugin_glusterfs_configuration.png deleted file mode 100644 index c79449bed..000000000 Binary files a/_images/fuel_plugin_glusterfs_configuration.png and /dev/null differ diff --git a/_images/fuel_plugin_lbaas_configuration.png b/_images/fuel_plugin_lbaas_configuration.png deleted file mode 100644 index 8c3cd0615..000000000 Binary files a/_images/fuel_plugin_lbaas_configuration.png and /dev/null differ diff --git a/_images/fuel_reference_title.jpg b/_images/fuel_reference_title.jpg deleted file mode 100644 index bd9eb7630..000000000 Binary files a/_images/fuel_reference_title.jpg and /dev/null differ diff --git a/_images/fuelmenu_DNS.png b/_images/fuelmenu_DNS.png deleted file mode 100644 index 12149458d..000000000 Binary files a/_images/fuelmenu_DNS.png and /dev/null differ diff --git a/_images/fuelmenu_Network_Customized_Setup.png b/_images/fuelmenu_Network_Customized_Setup.png deleted file mode 100644 index 30973d0fb..000000000 Binary files a/_images/fuelmenu_Network_Customized_Setup.png and /dev/null differ diff --git a/_images/fuelmenu_Network_Setup.png b/_images/fuelmenu_Network_Setup.png deleted file mode 100644 index b2e2f8a48..000000000 Binary files a/_images/fuelmenu_Network_Setup.png and /dev/null differ diff --git a/_images/fuelmenu_PXE_CustomizedSetup.jpg b/_images/fuelmenu_PXE_CustomizedSetup.jpg deleted file mode 100644 index 0e83c3c81..000000000 Binary files a/_images/fuelmenu_PXE_CustomizedSetup.jpg and /dev/null differ diff --git a/_images/fuelmenu_PXE_Setup.png b/_images/fuelmenu_PXE_Setup.png deleted file mode 100644 index 625af6e03..000000000 Binary files a/_images/fuelmenu_PXE_Setup.png and /dev/null differ diff --git a/_images/fuelmenu_Quit_Setup.png b/_images/fuelmenu_Quit_Setup.png deleted file mode 100644 index 3d72f2c16..000000000 Binary files a/_images/fuelmenu_Quit_Setup.png and /dev/null differ diff --git a/_images/fuelmenu_TimeSync.png b/_images/fuelmenu_TimeSync.png deleted file mode 100644 index 392c43712..000000000 Binary files a/_images/fuelmenu_TimeSync.png and /dev/null differ diff --git a/_images/groups.png b/_images/groups.png deleted file mode 100644 index fb39cf7a1..000000000 Binary files a/_images/groups.png and /dev/null differ diff --git a/_images/ha-overview.svg b/_images/ha-overview.svg deleted file mode 100644 index 86f26cd18..000000000 --- a/_images/ha-overview.svg +++ /dev/null @@ -1,1081 +0,0 @@ - - - - - - image/svg+xml - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - MySQL/Galera - - - pacemaker - RabbitMQ - HAProxy - HAProxy - glance-registry (HA) - HAProxy - Swift - glance-api (HA) - HAProxy - nova-scheduler - cinder-api (HA) - keystone-api (HA) - nova-api (HA) - Horizon (HA) - - - - - neutron-api (HA) - - - - - - - - - - - - - - pacemaker - - - HAProxy - neutron agents - - diff --git a/_images/host-only-networks-details.png b/_images/host-only-networks-details.png deleted file mode 100644 index 8351aa874..000000000 Binary files a/_images/host-only-networks-details.png and /dev/null differ diff --git a/_images/host-only-networks-preferences.png b/_images/host-only-networks-preferences.png deleted file mode 100644 index 5210df4de..000000000 Binary files a/_images/host-only-networks-preferences.png and /dev/null differ diff --git a/_images/logical-diagram-compute.svg b/_images/logical-diagram-compute.svg deleted file mode 100644 index 1d54f11c1..000000000 --- a/_images/logical-diagram-compute.svg +++ /dev/null @@ -1,296 +0,0 @@ - - - - - - image/svg+xml - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - HAProxy - E - I - - Controller Node - - - Compute Node(s) - - nova-compute - - - neutron-openvswitch-agent - - Open vSwitch - - - - diff --git a/_images/logical-diagram-controller.svg b/_images/logical-diagram-controller.svg deleted file mode 100644 index c4eaa179f..000000000 --- a/_images/logical-diagram-controller.svg +++ /dev/null @@ -1,917 +0,0 @@ - - - - - - - - - - - - image/svg+xml - - - - - - - - - - - - - - - HAProxy - E - I - Controller Node 1 - - - pacemaker - - neutron agents(active) - - mysql-wsrep - - horizon - - cinder-api - - neutron-api - - keystone-api - - glance-api - - nova-api - - nova-scheduler - - glance-registry - - rabbitmq - - - - - - - - - - - - - - - HAProxy - E - I - - Controller Node 2 - - - pacemaker - - neutron agents(hot standby) - - mysql-wsrep - - horizon - - cinder-api - - neutron-api - - keystone-api - - glance-api - - nova-api - - nova-scheduler - - glance-registry - - rabbitmq - - - - - - - - MySQL Galera Cluster(Active/Active) - RabbitMQ Cluster(Active/Active) - - - - - - - E - I - External IP - Internal IP - - diff --git a/_images/logical-diagram-storage.svg b/_images/logical-diagram-storage.svg deleted file mode 100644 index 423ce337d..000000000 --- a/_images/logical-diagram-storage.svg +++ /dev/null @@ -1,277 +0,0 @@ - - - - - - image/svg+xml - - - - - - - - - - - - - - - - - - - - - - - HAProxy - E - I - - Controller Node - - Swift Nodes - - swift - - - - Swift Proxies - - swift-proxy - - - - diff --git a/_images/mm_bootflow.png b/_images/mm_bootflow.png deleted file mode 100644 index 4f66678f8..000000000 Binary files a/_images/mm_bootflow.png and /dev/null differ diff --git a/_images/network_settings.jpg b/_images/network_settings.jpg deleted file mode 100644 index 578d29bbb..000000000 Binary files a/_images/network_settings.jpg and /dev/null differ diff --git a/_images/neutron_dvr_ref-arch.png b/_images/neutron_dvr_ref-arch.png deleted file mode 100644 index 82a3a364d..000000000 Binary files a/_images/neutron_dvr_ref-arch.png and /dev/null differ diff --git a/_images/new_router.png b/_images/new_router.png deleted file mode 100644 index ba724f8d5..000000000 Binary files a/_images/new_router.png and /dev/null differ diff --git a/_images/nsx-cleanup-1.png b/_images/nsx-cleanup-1.png deleted file mode 100644 index b31c4908b..000000000 Binary files a/_images/nsx-cleanup-1.png and /dev/null differ diff --git a/_images/nsx-cleanup-2.png b/_images/nsx-cleanup-2.png deleted file mode 100644 index c75a011af..000000000 Binary files a/_images/nsx-cleanup-2.png and /dev/null differ diff --git a/_images/nsx-cleanup-3.png b/_images/nsx-cleanup-3.png deleted file mode 100644 index 7c70e48f1..000000000 Binary files a/_images/nsx-cleanup-3.png and /dev/null differ diff --git a/_images/nsx-settings-filled.png b/_images/nsx-settings-filled.png deleted file mode 100644 index a4e3b6aa1..000000000 Binary files a/_images/nsx-settings-filled.png and /dev/null differ diff --git a/_images/nsx-settings.png b/_images/nsx-settings.png deleted file mode 100644 index 00fd2fd18..000000000 Binary files a/_images/nsx-settings.png and /dev/null differ diff --git a/_images/nsx-vcenter-arch.png b/_images/nsx-vcenter-arch.png deleted file mode 100644 index c010f1115..000000000 Binary files a/_images/nsx-vcenter-arch.png and /dev/null differ diff --git a/_images/nsx-vswitch1.png b/_images/nsx-vswitch1.png deleted file mode 100644 index 97c7b34b8..000000000 Binary files a/_images/nsx-vswitch1.png and /dev/null differ diff --git a/_images/nsx-vswitch10.png b/_images/nsx-vswitch10.png deleted file mode 100644 index 7ac1bef88..000000000 Binary files a/_images/nsx-vswitch10.png and /dev/null differ diff --git a/_images/nsx-vswitch11.png b/_images/nsx-vswitch11.png deleted file mode 100644 index d69024704..000000000 Binary files a/_images/nsx-vswitch11.png and /dev/null differ diff --git a/_images/nsx-vswitch12.png b/_images/nsx-vswitch12.png deleted file mode 100755 index ef7c03b8f..000000000 Binary files a/_images/nsx-vswitch12.png and /dev/null differ diff --git a/_images/nsx-vswitch13.png b/_images/nsx-vswitch13.png deleted file mode 100644 index e121eb2c4..000000000 Binary files a/_images/nsx-vswitch13.png and /dev/null differ diff --git a/_images/nsx-vswitch2.png b/_images/nsx-vswitch2.png deleted file mode 100644 index b79bc1303..000000000 Binary files a/_images/nsx-vswitch2.png and /dev/null differ diff --git a/_images/nsx-vswitch3.png b/_images/nsx-vswitch3.png deleted file mode 100644 index 28e0933f0..000000000 Binary files a/_images/nsx-vswitch3.png and /dev/null differ diff --git a/_images/nsx-vswitch4.png b/_images/nsx-vswitch4.png deleted file mode 100644 index ef6e7ae27..000000000 Binary files a/_images/nsx-vswitch4.png and /dev/null differ diff --git a/_images/nsx-vswitch5.png b/_images/nsx-vswitch5.png deleted file mode 100644 index 4193cb419..000000000 Binary files a/_images/nsx-vswitch5.png and /dev/null differ diff --git a/_images/nsx-vswitch6.png b/_images/nsx-vswitch6.png deleted file mode 100644 index b1b7496ee..000000000 Binary files a/_images/nsx-vswitch6.png and /dev/null differ diff --git a/_images/nsx-vswitch7.png b/_images/nsx-vswitch7.png deleted file mode 100644 index 34942e1b3..000000000 Binary files a/_images/nsx-vswitch7.png and /dev/null differ diff --git a/_images/nsx-vswitch8.png b/_images/nsx-vswitch8.png deleted file mode 100644 index 2d16f5dc7..000000000 Binary files a/_images/nsx-vswitch8.png and /dev/null differ diff --git a/_images/nsx-vswitch9.png b/_images/nsx-vswitch9.png deleted file mode 100644 index 8abd44b0f..000000000 Binary files a/_images/nsx-vswitch9.png and /dev/null differ diff --git a/_images/patchcommit.png b/_images/patchcommit.png deleted file mode 100644 index 484c844cb..000000000 Binary files a/_images/patchcommit.png and /dev/null differ diff --git a/_images/patchingRepos.png b/_images/patchingRepos.png deleted file mode 100644 index bfdc6d1f1..000000000 Binary files a/_images/patchingRepos.png and /dev/null differ diff --git a/_images/patchingReposOps.png b/_images/patchingReposOps.png deleted file mode 100644 index 9e0617b60..000000000 Binary files a/_images/patchingReposOps.png and /dev/null differ diff --git a/_images/physical-network.png b/_images/physical-network.png deleted file mode 100644 index 50556ae66..000000000 Binary files a/_images/physical-network.png and /dev/null differ diff --git a/_images/preinstall_d_flat_dhcp.jpg b/_images/preinstall_d_flat_dhcp.jpg deleted file mode 100644 index 1164495a7..000000000 Binary files a/_images/preinstall_d_flat_dhcp.jpg and /dev/null differ diff --git a/_images/preinstall_d_gre_2nics.png b/_images/preinstall_d_gre_2nics.png deleted file mode 100644 index 57e955987..000000000 Binary files a/_images/preinstall_d_gre_2nics.png and /dev/null differ diff --git a/_images/preinstall_d_gre_3nics.png b/_images/preinstall_d_gre_3nics.png deleted file mode 100644 index 0845b113c..000000000 Binary files a/_images/preinstall_d_gre_3nics.png and /dev/null differ diff --git a/_images/preinstall_d_gre_4nics.png b/_images/preinstall_d_gre_4nics.png deleted file mode 100644 index fe5b717f8..000000000 Binary files a/_images/preinstall_d_gre_4nics.png and /dev/null differ diff --git a/_images/preinstall_d_logic_network.jpg b/_images/preinstall_d_logic_network.jpg deleted file mode 100644 index d3c8bb2f5..000000000 Binary files a/_images/preinstall_d_logic_network.jpg and /dev/null differ diff --git a/_images/preinstall_d_switch_connect.jpg b/_images/preinstall_d_switch_connect.jpg deleted file mode 100644 index dcad0d981..000000000 Binary files a/_images/preinstall_d_switch_connect.jpg and /dev/null differ diff --git a/_images/preinstall_d_vlan.jpg b/_images/preinstall_d_vlan.jpg deleted file mode 100644 index da33de1b2..000000000 Binary files a/_images/preinstall_d_vlan.jpg and /dev/null differ diff --git a/_images/preinstall_d_vlan_3nics.png b/_images/preinstall_d_vlan_3nics.png deleted file mode 100644 index 4970c6326..000000000 Binary files a/_images/preinstall_d_vlan_3nics.png and /dev/null differ diff --git a/_images/preinstall_d_vlan_4nics.png b/_images/preinstall_d_vlan_4nics.png deleted file mode 100644 index b95c60e95..000000000 Binary files a/_images/preinstall_d_vlan_4nics.png and /dev/null differ diff --git a/_images/procps.png b/_images/procps.png deleted file mode 100644 index 9276549fe..000000000 Binary files a/_images/procps.png and /dev/null differ diff --git a/_images/qsg/d_workflow1.png b/_images/qsg/d_workflow1.png deleted file mode 100644 index 9d5d23934..000000000 Binary files a/_images/qsg/d_workflow1.png and /dev/null differ diff --git a/_images/qsg/d_workflow2.png b/_images/qsg/d_workflow2.png deleted file mode 100644 index f910668b6..000000000 Binary files a/_images/qsg/d_workflow2.png and /dev/null differ diff --git a/_images/qsg/src_network_setup.png b/_images/qsg/src_network_setup.png deleted file mode 100644 index 112cfbff5..000000000 Binary files a/_images/qsg/src_network_setup.png and /dev/null differ diff --git a/_images/reset_environment_button.png b/_images/reset_environment_button.png deleted file mode 100644 index b4067797d..000000000 Binary files a/_images/reset_environment_button.png and /dev/null differ diff --git a/_images/scr_configure_interfaces.png b/_images/scr_configure_interfaces.png deleted file mode 100644 index 0fdd2e02c..000000000 Binary files a/_images/scr_configure_interfaces.png and /dev/null differ diff --git a/_images/set_gateway.png b/_images/set_gateway.png deleted file mode 100644 index c006003ef..000000000 Binary files a/_images/set_gateway.png and /dev/null differ diff --git a/_images/stop_deployment_button.png b/_images/stop_deployment_button.png deleted file mode 100644 index 3fbd329cc..000000000 Binary files a/_images/stop_deployment_button.png and /dev/null differ diff --git a/_images/style_guide_titles.png b/_images/style_guide_titles.png deleted file mode 100644 index 19ae9a7c5..000000000 Binary files a/_images/style_guide_titles.png and /dev/null differ diff --git a/_images/upgrade/env-version-check.png b/_images/upgrade/env-version-check.png deleted file mode 100644 index f80c6e052..000000000 Binary files a/_images/upgrade/env-version-check.png and /dev/null differ diff --git a/_images/upgrade/fuel-version-check.png b/_images/upgrade/fuel-version-check.png deleted file mode 100644 index e8c32ed71..000000000 Binary files a/_images/upgrade/fuel-version-check.png and /dev/null differ diff --git a/_images/user_screen_shots/add-nodes1.png b/_images/user_screen_shots/add-nodes1.png deleted file mode 100644 index 9ecaf1fa0..000000000 Binary files a/_images/user_screen_shots/add-nodes1.png and /dev/null differ diff --git a/_images/user_screen_shots/assign-role-confirm.png b/_images/user_screen_shots/assign-role-confirm.png deleted file mode 100644 index 2b9ad739a..000000000 Binary files a/_images/user_screen_shots/assign-role-confirm.png and /dev/null differ diff --git a/_images/user_screen_shots/assign-role-confirm2.png b/_images/user_screen_shots/assign-role-confirm2.png deleted file mode 100644 index e7ec1c3d0..000000000 Binary files a/_images/user_screen_shots/assign-role-confirm2.png and /dev/null differ diff --git a/_images/user_screen_shots/assign-roles1.png b/_images/user_screen_shots/assign-roles1.png deleted file mode 100644 index 23bd2b1b6..000000000 Binary files a/_images/user_screen_shots/assign-roles1.png and /dev/null differ diff --git a/_images/user_screen_shots/assign-roles2.png b/_images/user_screen_shots/assign-roles2.png deleted file mode 100644 index a3d23d90d..000000000 Binary files a/_images/user_screen_shots/assign-roles2.png and /dev/null differ diff --git a/_images/user_screen_shots/assign-roles3.png b/_images/user_screen_shots/assign-roles3.png deleted file mode 100644 index c485f4ae8..000000000 Binary files a/_images/user_screen_shots/assign-roles3.png and /dev/null differ diff --git a/_images/user_screen_shots/assign-roles4.png b/_images/user_screen_shots/assign-roles4.png deleted file mode 100644 index 020637b15..000000000 Binary files a/_images/user_screen_shots/assign-roles4.png and /dev/null differ diff --git a/_images/user_screen_shots/change_pass_notification.png b/_images/user_screen_shots/change_pass_notification.png deleted file mode 100644 index 86f8cf1f3..000000000 Binary files a/_images/user_screen_shots/change_pass_notification.png and /dev/null differ diff --git a/_images/user_screen_shots/change_pass_ui.png b/_images/user_screen_shots/change_pass_ui.png deleted file mode 100644 index fd71e9dd7..000000000 Binary files a/_images/user_screen_shots/change_pass_ui.png and /dev/null differ diff --git a/_images/user_screen_shots/choose-hypervisor-ug.png b/_images/user_screen_shots/choose-hypervisor-ug.png deleted file mode 100644 index f9dd46554..000000000 Binary files a/_images/user_screen_shots/choose-hypervisor-ug.png and /dev/null differ diff --git a/_images/user_screen_shots/cinder-storage-backend-vmware.png b/_images/user_screen_shots/cinder-storage-backend-vmware.png deleted file mode 100644 index 3ba2b2898..000000000 Binary files a/_images/user_screen_shots/cinder-storage-backend-vmware.png and /dev/null differ diff --git a/_images/user_screen_shots/cinder-vmdk-backend.png b/_images/user_screen_shots/cinder-vmdk-backend.png deleted file mode 100644 index d8c815433..000000000 Binary files a/_images/user_screen_shots/cinder-vmdk-backend.png and /dev/null differ diff --git a/_images/user_screen_shots/cobbler-edit-system.png b/_images/user_screen_shots/cobbler-edit-system.png deleted file mode 100644 index ef456c55f..000000000 Binary files a/_images/user_screen_shots/cobbler-edit-system.png and /dev/null differ diff --git a/_images/user_screen_shots/create_new_environ.png b/_images/user_screen_shots/create_new_environ.png deleted file mode 100644 index 107bc880a..000000000 Binary files a/_images/user_screen_shots/create_new_environ.png and /dev/null differ diff --git a/_images/user_screen_shots/debug-logging.png b/_images/user_screen_shots/debug-logging.png deleted file mode 100644 index fe887598c..000000000 Binary files a/_images/user_screen_shots/debug-logging.png and /dev/null differ diff --git a/_images/user_screen_shots/define-hostname01.png b/_images/user_screen_shots/define-hostname01.png deleted file mode 100644 index 0bde1a802..000000000 Binary files a/_images/user_screen_shots/define-hostname01.png and /dev/null differ diff --git a/_images/user_screen_shots/define-hostname02.png b/_images/user_screen_shots/define-hostname02.png deleted file mode 100644 index eacf7a405..000000000 Binary files a/_images/user_screen_shots/define-hostname02.png and /dev/null differ diff --git a/_images/user_screen_shots/deploy-changes-dashboard.png b/_images/user_screen_shots/deploy-changes-dashboard.png deleted file mode 100644 index 71b30cf69..000000000 Binary files a/_images/user_screen_shots/deploy-changes-dashboard.png and /dev/null differ diff --git a/_images/user_screen_shots/deploy_env.png b/_images/user_screen_shots/deploy_env.png deleted file mode 100644 index 91166723e..000000000 Binary files a/_images/user_screen_shots/deploy_env.png and /dev/null differ diff --git a/_images/user_screen_shots/fuel-dashboard01.png b/_images/user_screen_shots/fuel-dashboard01.png deleted file mode 100644 index 5ae664858..000000000 Binary files a/_images/user_screen_shots/fuel-dashboard01.png and /dev/null differ diff --git a/_images/user_screen_shots/fuel-post-boot.png b/_images/user_screen_shots/fuel-post-boot.png deleted file mode 100644 index 09d5b5fc9..000000000 Binary files a/_images/user_screen_shots/fuel-post-boot.png and /dev/null differ diff --git a/_images/user_screen_shots/fuel_log_in_panel_blank.png b/_images/user_screen_shots/fuel_log_in_panel_blank.png deleted file mode 100644 index 6b0ba1d8c..000000000 Binary files a/_images/user_screen_shots/fuel_log_in_panel_blank.png and /dev/null differ diff --git a/_images/user_screen_shots/fuel_starts.png b/_images/user_screen_shots/fuel_starts.png deleted file mode 100644 index dc0b45108..000000000 Binary files a/_images/user_screen_shots/fuel_starts.png and /dev/null differ diff --git a/_images/user_screen_shots/ha_high_perf.png b/_images/user_screen_shots/ha_high_perf.png deleted file mode 100644 index 8f9a8b46a..000000000 Binary files a/_images/user_screen_shots/ha_high_perf.png and /dev/null differ diff --git a/_images/user_screen_shots/horizon-openstack-ops.png b/_images/user_screen_shots/horizon-openstack-ops.png deleted file mode 100644 index 90cc77159..000000000 Binary files a/_images/user_screen_shots/horizon-openstack-ops.png and /dev/null differ diff --git a/_images/user_screen_shots/intel_iommu.png b/_images/user_screen_shots/intel_iommu.png deleted file mode 100644 index dd09e4bd7..000000000 Binary files a/_images/user_screen_shots/intel_iommu.png and /dev/null differ diff --git a/_images/user_screen_shots/interfaces_example.png b/_images/user_screen_shots/interfaces_example.png deleted file mode 100755 index dc62aa7b0..000000000 Binary files a/_images/user_screen_shots/interfaces_example.png and /dev/null differ diff --git a/_images/user_screen_shots/kernel-parameters.png b/_images/user_screen_shots/kernel-parameters.png deleted file mode 100644 index ace7056c5..000000000 Binary files a/_images/user_screen_shots/kernel-parameters.png and /dev/null differ diff --git a/_images/user_screen_shots/manage-nodes.png b/_images/user_screen_shots/manage-nodes.png deleted file mode 100644 index c39e874ed..000000000 Binary files a/_images/user_screen_shots/manage-nodes.png and /dev/null differ diff --git a/_images/user_screen_shots/manage-nodes2.png b/_images/user_screen_shots/manage-nodes2.png deleted file mode 100644 index c9b5244cd..000000000 Binary files a/_images/user_screen_shots/manage-nodes2.png and /dev/null differ diff --git a/_images/user_screen_shots/manage-nodes3.png b/_images/user_screen_shots/manage-nodes3.png deleted file mode 100644 index 9cf52c225..000000000 Binary files a/_images/user_screen_shots/manage-nodes3.png and /dev/null differ diff --git a/_images/user_screen_shots/master-logs.png b/_images/user_screen_shots/master-logs.png deleted file mode 100644 index b6001b812..000000000 Binary files a/_images/user_screen_shots/master-logs.png and /dev/null differ diff --git a/_images/user_screen_shots/mellanox-neutron.png b/_images/user_screen_shots/mellanox-neutron.png deleted file mode 100755 index e640f8509..000000000 Binary files a/_images/user_screen_shots/mellanox-neutron.png and /dev/null differ diff --git a/_images/user_screen_shots/messages.png b/_images/user_screen_shots/messages.png deleted file mode 100644 index b1e463349..000000000 Binary files a/_images/user_screen_shots/messages.png and /dev/null differ diff --git a/_images/user_screen_shots/name_environ.png b/_images/user_screen_shots/name_environ.png deleted file mode 100644 index 95df0d29a..000000000 Binary files a/_images/user_screen_shots/name_environ.png and /dev/null differ diff --git a/_images/user_screen_shots/net-settings1.png b/_images/user_screen_shots/net-settings1.png deleted file mode 100644 index 82c8a1134..000000000 Binary files a/_images/user_screen_shots/net-settings1.png and /dev/null differ diff --git a/_images/user_screen_shots/net-settings2.png b/_images/user_screen_shots/net-settings2.png deleted file mode 100644 index e839d846b..000000000 Binary files a/_images/user_screen_shots/net-settings2.png and /dev/null differ diff --git a/_images/user_screen_shots/net-settings3.png b/_images/user_screen_shots/net-settings3.png deleted file mode 100644 index 634d5b8eb..000000000 Binary files a/_images/user_screen_shots/net-settings3.png and /dev/null differ diff --git a/_images/user_screen_shots/net_verify_failure-warning.png b/_images/user_screen_shots/net_verify_failure-warning.png deleted file mode 100644 index d8f5e0648..000000000 Binary files a/_images/user_screen_shots/net_verify_failure-warning.png and /dev/null differ diff --git a/_images/user_screen_shots/net_verify_failure.png b/_images/user_screen_shots/net_verify_failure.png deleted file mode 100644 index a3afe2f04..000000000 Binary files a/_images/user_screen_shots/net_verify_failure.png and /dev/null differ diff --git a/_images/user_screen_shots/net_verify_in_progress.png b/_images/user_screen_shots/net_verify_in_progress.png deleted file mode 100644 index 10d032edf..000000000 Binary files a/_images/user_screen_shots/net_verify_in_progress.png and /dev/null differ diff --git a/_images/user_screen_shots/net_verify_success.png b/_images/user_screen_shots/net_verify_success.png deleted file mode 100644 index b426d6441..000000000 Binary files a/_images/user_screen_shots/net_verify_success.png and /dev/null differ diff --git a/_images/user_screen_shots/network-services.png b/_images/user_screen_shots/network-services.png deleted file mode 100644 index eac021655..000000000 Binary files a/_images/user_screen_shots/network-services.png and /dev/null differ diff --git a/_images/user_screen_shots/neutron-dvr.png b/_images/user_screen_shots/neutron-dvr.png deleted file mode 100644 index 0a13a7a4c..000000000 Binary files a/_images/user_screen_shots/neutron-dvr.png and /dev/null differ diff --git a/_images/user_screen_shots/nova-flatdhcp-man.png b/_images/user_screen_shots/nova-flatdhcp-man.png deleted file mode 100644 index fb671cbb5..000000000 Binary files a/_images/user_screen_shots/nova-flatdhcp-man.png and /dev/null differ diff --git a/_images/user_screen_shots/nova-net-vlan.png b/_images/user_screen_shots/nova-net-vlan.png deleted file mode 100644 index a89dda0b3..000000000 Binary files a/_images/user_screen_shots/nova-net-vlan.png and /dev/null differ diff --git a/_images/user_screen_shots/nova-verify.png b/_images/user_screen_shots/nova-verify.png deleted file mode 100644 index 9505920f8..000000000 Binary files a/_images/user_screen_shots/nova-verify.png and /dev/null differ diff --git a/_images/user_screen_shots/nova-vlan-check.png b/_images/user_screen_shots/nova-vlan-check.png deleted file mode 100644 index ddb49d812..000000000 Binary files a/_images/user_screen_shots/nova-vlan-check.png and /dev/null differ diff --git a/_images/user_screen_shots/nsx-additional.png b/_images/user_screen_shots/nsx-additional.png deleted file mode 100644 index 196f501db..000000000 Binary files a/_images/user_screen_shots/nsx-additional.png and /dev/null differ diff --git a/_images/user_screen_shots/nsx-create-env.png b/_images/user_screen_shots/nsx-create-env.png deleted file mode 100644 index c65833542..000000000 Binary files a/_images/user_screen_shots/nsx-create-env.png and /dev/null differ diff --git a/_images/user_screen_shots/nsx-deployment-mode.png b/_images/user_screen_shots/nsx-deployment-mode.png deleted file mode 100644 index a9d17aa29..000000000 Binary files a/_images/user_screen_shots/nsx-deployment-mode.png and /dev/null differ diff --git a/_images/user_screen_shots/nsx-gateway-transport-type.png b/_images/user_screen_shots/nsx-gateway-transport-type.png deleted file mode 100644 index 4a56ed8a9..000000000 Binary files a/_images/user_screen_shots/nsx-gateway-transport-type.png and /dev/null differ diff --git a/_images/user_screen_shots/nsx-hv.png b/_images/user_screen_shots/nsx-hv.png deleted file mode 100644 index ccb7c05e9..000000000 Binary files a/_images/user_screen_shots/nsx-hv.png and /dev/null differ diff --git a/_images/user_screen_shots/nsx-networking.png b/_images/user_screen_shots/nsx-networking.png deleted file mode 100644 index 794a5f0ac..000000000 Binary files a/_images/user_screen_shots/nsx-networking.png and /dev/null differ diff --git a/_images/user_screen_shots/nsx-storage.png b/_images/user_screen_shots/nsx-storage.png deleted file mode 100644 index 24987b2b8..000000000 Binary files a/_images/user_screen_shots/nsx-storage.png and /dev/null differ diff --git a/_images/user_screen_shots/other-nodes-logs.png b/_images/user_screen_shots/other-nodes-logs.png deleted file mode 100644 index e8ff98147..000000000 Binary files a/_images/user_screen_shots/other-nodes-logs.png and /dev/null differ diff --git a/_images/user_screen_shots/partition-disks.png b/_images/user_screen_shots/partition-disks.png deleted file mode 100644 index 64a02c64c..000000000 Binary files a/_images/user_screen_shots/partition-disks.png and /dev/null differ diff --git a/_images/user_screen_shots/partition-disks0.png b/_images/user_screen_shots/partition-disks0.png deleted file mode 100644 index 25b86fdbc..000000000 Binary files a/_images/user_screen_shots/partition-disks0.png and /dev/null differ diff --git a/_images/user_screen_shots/platform_services-vmware.png b/_images/user_screen_shots/platform_services-vmware.png deleted file mode 100644 index c36d24165..000000000 Binary files a/_images/user_screen_shots/platform_services-vmware.png and /dev/null differ diff --git a/_images/user_screen_shots/platform_services.png b/_images/user_screen_shots/platform_services.png deleted file mode 100644 index fb42cf388..000000000 Binary files a/_images/user_screen_shots/platform_services.png and /dev/null differ diff --git a/_images/user_screen_shots/plugins-tab.png b/_images/user_screen_shots/plugins-tab.png deleted file mode 100644 index 7558679b6..000000000 Binary files a/_images/user_screen_shots/plugins-tab.png and /dev/null differ diff --git a/_images/user_screen_shots/provision-method.png b/_images/user_screen_shots/provision-method.png deleted file mode 100644 index 5f168bdf3..000000000 Binary files a/_images/user_screen_shots/provision-method.png and /dev/null differ diff --git a/_images/user_screen_shots/public-key.png b/_images/user_screen_shots/public-key.png deleted file mode 100644 index 87426af18..000000000 Binary files a/_images/user_screen_shots/public-key.png and /dev/null differ diff --git a/_images/user_screen_shots/public-tls.png b/_images/user_screen_shots/public-tls.png deleted file mode 100644 index 8461fa5a6..000000000 Binary files a/_images/user_screen_shots/public-tls.png and /dev/null differ diff --git a/_images/user_screen_shots/qcow.png b/_images/user_screen_shots/qcow.png deleted file mode 100644 index 1becb0868..000000000 Binary files a/_images/user_screen_shots/qcow.png and /dev/null differ diff --git a/_images/user_screen_shots/rack.png b/_images/user_screen_shots/rack.png deleted file mode 100644 index fbbcecb20..000000000 Binary files a/_images/user_screen_shots/rack.png and /dev/null differ diff --git a/_images/user_screen_shots/remove-node-inventory.png b/_images/user_screen_shots/remove-node-inventory.png deleted file mode 100644 index e33f0b000..000000000 Binary files a/_images/user_screen_shots/remove-node-inventory.png and /dev/null differ diff --git a/_images/user_screen_shots/select-nova-config-dhcp.png b/_images/user_screen_shots/select-nova-config-dhcp.png deleted file mode 100644 index f1b4a4f77..000000000 Binary files a/_images/user_screen_shots/select-nova-config-dhcp.png and /dev/null differ diff --git a/_images/user_screen_shots/select-nova-config-vlan.png b/_images/user_screen_shots/select-nova-config-vlan.png deleted file mode 100644 index e96aa379f..000000000 Binary files a/_images/user_screen_shots/select-nova-config-vlan.png and /dev/null differ diff --git a/_images/user_screen_shots/select-two-hypervisors.png b/_images/user_screen_shots/select-two-hypervisors.png deleted file mode 100644 index bc9e1c782..000000000 Binary files a/_images/user_screen_shots/select-two-hypervisors.png and /dev/null differ diff --git a/_images/user_screen_shots/select-vcenter-kvm.png b/_images/user_screen_shots/select-vcenter-kvm.png deleted file mode 100644 index d128ab48e..000000000 Binary files a/_images/user_screen_shots/select-vcenter-kvm.png and /dev/null differ diff --git a/_images/user_screen_shots/settings-access.png b/_images/user_screen_shots/settings-access.png deleted file mode 100644 index a5b9d2cfd..000000000 Binary files a/_images/user_screen_shots/settings-access.png and /dev/null differ diff --git a/_images/user_screen_shots/settings-mod-services.png b/_images/user_screen_shots/settings-mod-services.png deleted file mode 100644 index 0b10da4c0..000000000 Binary files a/_images/user_screen_shots/settings-mod-services.png and /dev/null differ diff --git a/_images/user_screen_shots/settings-scheduler.png b/_images/user_screen_shots/settings-scheduler.png deleted file mode 100644 index 2380cdec2..000000000 Binary files a/_images/user_screen_shots/settings-scheduler.png and /dev/null differ diff --git a/_images/user_screen_shots/settings-storage.png b/_images/user_screen_shots/settings-storage.png deleted file mode 100644 index d3c882653..000000000 Binary files a/_images/user_screen_shots/settings-storage.png and /dev/null differ diff --git a/_images/user_screen_shots/settings-vcenter.png b/_images/user_screen_shots/settings-vcenter.png deleted file mode 100644 index 21ca8aca0..000000000 Binary files a/_images/user_screen_shots/settings-vcenter.png and /dev/null differ diff --git a/_images/user_screen_shots/settings-vlan-splinters.png b/_images/user_screen_shots/settings-vlan-splinters.png deleted file mode 100644 index 96031cc1e..000000000 Binary files a/_images/user_screen_shots/settings-vlan-splinters.png and /dev/null differ diff --git a/_images/user_screen_shots/statistics-create-account.png b/_images/user_screen_shots/statistics-create-account.png deleted file mode 100644 index 1d8cc8315..000000000 Binary files a/_images/user_screen_shots/statistics-create-account.png and /dev/null differ diff --git a/_images/user_screen_shots/statistics-name.png b/_images/user_screen_shots/statistics-name.png deleted file mode 100644 index 89135e20b..000000000 Binary files a/_images/user_screen_shots/statistics-name.png and /dev/null differ diff --git a/_images/user_screen_shots/statistics-opt-in.png b/_images/user_screen_shots/statistics-opt-in.png deleted file mode 100644 index 44292fbc8..000000000 Binary files a/_images/user_screen_shots/statistics-opt-in.png and /dev/null differ diff --git a/_images/user_screen_shots/statistics-retrieve-password.png b/_images/user_screen_shots/statistics-retrieve-password.png deleted file mode 100644 index 1fcfc550b..000000000 Binary files a/_images/user_screen_shots/statistics-retrieve-password.png and /dev/null differ diff --git a/_images/user_screen_shots/storage-backend.png b/_images/user_screen_shots/storage-backend.png deleted file mode 100644 index e31a82461..000000000 Binary files a/_images/user_screen_shots/storage-backend.png and /dev/null differ diff --git a/_images/user_screen_shots/storage-iser.png b/_images/user_screen_shots/storage-iser.png deleted file mode 100755 index 567dd0348..000000000 Binary files a/_images/user_screen_shots/storage-iser.png and /dev/null differ diff --git a/_images/user_screen_shots/style-crop-screen-bad.png b/_images/user_screen_shots/style-crop-screen-bad.png deleted file mode 100644 index 26d6a13d6..000000000 Binary files a/_images/user_screen_shots/style-crop-screen-bad.png and /dev/null differ diff --git a/_images/user_screen_shots/style-crop-screen-bad2.png b/_images/user_screen_shots/style-crop-screen-bad2.png deleted file mode 100644 index 9924e59c1..000000000 Binary files a/_images/user_screen_shots/style-crop-screen-bad2.png and /dev/null differ diff --git a/_images/user_screen_shots/syslog.png b/_images/user_screen_shots/syslog.png deleted file mode 100644 index 53f54d346..000000000 Binary files a/_images/user_screen_shots/syslog.png and /dev/null differ diff --git a/_images/user_screen_shots/ui_select_offloads01.png b/_images/user_screen_shots/ui_select_offloads01.png deleted file mode 100644 index 5ded0037d..000000000 Binary files a/_images/user_screen_shots/ui_select_offloads01.png and /dev/null differ diff --git a/_images/user_screen_shots/ui_select_offloads02.png b/_images/user_screen_shots/ui_select_offloads02.png deleted file mode 100644 index 691a196b0..000000000 Binary files a/_images/user_screen_shots/ui_select_offloads02.png and /dev/null differ diff --git a/_images/user_screen_shots/vcenter-add-nodes.png b/_images/user_screen_shots/vcenter-add-nodes.png deleted file mode 100644 index 47a42a638..000000000 Binary files a/_images/user_screen_shots/vcenter-add-nodes.png and /dev/null differ diff --git a/_images/user_screen_shots/vcenter-additional.png b/_images/user_screen_shots/vcenter-additional.png deleted file mode 100644 index 3d71844ca..000000000 Binary files a/_images/user_screen_shots/vcenter-additional.png and /dev/null differ diff --git a/_images/user_screen_shots/vcenter-cinder.png b/_images/user_screen_shots/vcenter-cinder.png deleted file mode 100644 index 7017cd335..000000000 Binary files a/_images/user_screen_shots/vcenter-cinder.png and /dev/null differ diff --git a/_images/user_screen_shots/vcenter-create-env.png b/_images/user_screen_shots/vcenter-create-env.png deleted file mode 100644 index f6d200c7d..000000000 Binary files a/_images/user_screen_shots/vcenter-create-env.png and /dev/null differ diff --git a/_images/user_screen_shots/vcenter-glance-backend.png b/_images/user_screen_shots/vcenter-glance-backend.png deleted file mode 100644 index 532de1b2e..000000000 Binary files a/_images/user_screen_shots/vcenter-glance-backend.png and /dev/null differ diff --git a/_images/user_screen_shots/vcenter-hv.png b/_images/user_screen_shots/vcenter-hv.png deleted file mode 100644 index d98d10ff2..000000000 Binary files a/_images/user_screen_shots/vcenter-hv.png and /dev/null differ diff --git a/_images/user_screen_shots/vcenter-networking-no-nsx.png b/_images/user_screen_shots/vcenter-networking-no-nsx.png deleted file mode 100644 index 11485cdc7..000000000 Binary files a/_images/user_screen_shots/vcenter-networking-no-nsx.png and /dev/null differ diff --git a/_images/user_screen_shots/vcenter_glance_settings.png b/_images/user_screen_shots/vcenter_glance_settings.png deleted file mode 100644 index cc1bc1fcd..000000000 Binary files a/_images/user_screen_shots/vcenter_glance_settings.png and /dev/null differ diff --git a/_images/user_screen_shots/verify-network-warning.png b/_images/user_screen_shots/verify-network-warning.png deleted file mode 100644 index 3deb327d8..000000000 Binary files a/_images/user_screen_shots/verify-network-warning.png and /dev/null differ diff --git a/_images/user_screen_shots/vmware-tab-cinder.png b/_images/user_screen_shots/vmware-tab-cinder.png deleted file mode 100644 index 77b397414..000000000 Binary files a/_images/user_screen_shots/vmware-tab-cinder.png and /dev/null differ diff --git a/_images/user_screen_shots/vmware-tab-common.png b/_images/user_screen_shots/vmware-tab-common.png deleted file mode 100644 index b0c1cf345..000000000 Binary files a/_images/user_screen_shots/vmware-tab-common.png and /dev/null differ diff --git a/_images/user_screen_shots/vmware-tab-glance.png b/_images/user_screen_shots/vmware-tab-glance.png deleted file mode 100644 index 105a2685e..000000000 Binary files a/_images/user_screen_shots/vmware-tab-glance.png and /dev/null differ diff --git a/_images/user_screen_shots/vmware-tab-nova-computes.png b/_images/user_screen_shots/vmware-tab-nova-computes.png deleted file mode 100644 index c8f99c67e..000000000 Binary files a/_images/user_screen_shots/vmware-tab-nova-computes.png and /dev/null differ diff --git a/_images/user_screen_shots/vmware-tab-nova-two.png b/_images/user_screen_shots/vmware-tab-nova-two.png deleted file mode 100644 index cddfa5449..000000000 Binary files a/_images/user_screen_shots/vmware-tab-nova-two.png and /dev/null differ diff --git a/_images/user_screen_shots/vmware-tab-nova.png b/_images/user_screen_shots/vmware-tab-nova.png deleted file mode 100644 index fca545ac0..000000000 Binary files a/_images/user_screen_shots/vmware-tab-nova.png and /dev/null differ diff --git a/_images/user_screen_shots/vmware-tab-vcenter.png b/_images/user_screen_shots/vmware-tab-vcenter.png deleted file mode 100644 index eb68bfca8..000000000 Binary files a/_images/user_screen_shots/vmware-tab-vcenter.png and /dev/null differ diff --git a/_images/user_screen_shots/vmware-tab-vlan.png b/_images/user_screen_shots/vmware-tab-vlan.png deleted file mode 100644 index 6f8ddedf2..000000000 Binary files a/_images/user_screen_shots/vmware-tab-vlan.png and /dev/null differ diff --git a/_images/user_screen_shots/zabbix-access.png b/_images/user_screen_shots/zabbix-access.png deleted file mode 100644 index 7f63199a3..000000000 Binary files a/_images/user_screen_shots/zabbix-access.png and /dev/null differ diff --git a/_images/vCenter/2.1-Fuel-vCenter-go-to-vCenter.png b/_images/vCenter/2.1-Fuel-vCenter-go-to-vCenter.png deleted file mode 100644 index 332bb6b3e..000000000 Binary files a/_images/vCenter/2.1-Fuel-vCenter-go-to-vCenter.png and /dev/null differ diff --git a/_images/vCenter/2.2a-fuel-vcenter-go-to-datastore.png b/_images/vCenter/2.2a-fuel-vcenter-go-to-datastore.png deleted file mode 100644 index be27c902c..000000000 Binary files a/_images/vCenter/2.2a-fuel-vcenter-go-to-datastore.png and /dev/null differ diff --git a/_images/vCenter/2.2b-fuel-vcenter-select-your-datastore.png b/_images/vCenter/2.2b-fuel-vcenter-select-your-datastore.png deleted file mode 100644 index 355325b71..000000000 Binary files a/_images/vCenter/2.2b-fuel-vcenter-select-your-datastore.png and /dev/null differ diff --git a/_images/vCenter/2.3-fuel-vcenter-brouse-files.png b/_images/vCenter/2.3-fuel-vcenter-brouse-files.png deleted file mode 100644 index 7aafcc25e..000000000 Binary files a/_images/vCenter/2.3-fuel-vcenter-brouse-files.png and /dev/null differ diff --git a/_images/vCenter/2.4-fuel-vcenter-click-upload.png b/_images/vCenter/2.4-fuel-vcenter-click-upload.png deleted file mode 100644 index 28a2f0426..000000000 Binary files a/_images/vCenter/2.4-fuel-vcenter-click-upload.png and /dev/null differ diff --git a/_images/vCenter/3.1-fuel-vcenter-go-to-hosts.png b/_images/vCenter/3.1-fuel-vcenter-go-to-hosts.png deleted file mode 100644 index 29f22d156..000000000 Binary files a/_images/vCenter/3.1-fuel-vcenter-go-to-hosts.png and /dev/null differ diff --git a/_images/vCenter/3.2-fuel-vcenter-choose-host.png b/_images/vCenter/3.2-fuel-vcenter-choose-host.png deleted file mode 100644 index 837933499..000000000 Binary files a/_images/vCenter/3.2-fuel-vcenter-choose-host.png and /dev/null differ diff --git a/_images/vCenter/3.3-fuel-vcenter-choose-manage-networking.png b/_images/vCenter/3.3-fuel-vcenter-choose-manage-networking.png deleted file mode 100644 index bd532ea7d..000000000 Binary files a/_images/vCenter/3.3-fuel-vcenter-choose-manage-networking.png and /dev/null differ diff --git a/_images/vCenter/3.4-fuel-vcenter-create-network.png b/_images/vCenter/3.4-fuel-vcenter-create-network.png deleted file mode 100644 index 68e112dab..000000000 Binary files a/_images/vCenter/3.4-fuel-vcenter-create-network.png and /dev/null differ diff --git a/_images/vCenter/3.5-fuel-vcenter-portgroup-net.png b/_images/vCenter/3.5-fuel-vcenter-portgroup-net.png deleted file mode 100644 index 18832d036..000000000 Binary files a/_images/vCenter/3.5-fuel-vcenter-portgroup-net.png and /dev/null differ diff --git a/_images/vCenter/3.6-fuel-vcenter-choose-a-switch.png b/_images/vCenter/3.6-fuel-vcenter-choose-a-switch.png deleted file mode 100644 index 289a1fc68..000000000 Binary files a/_images/vCenter/3.6-fuel-vcenter-choose-a-switch.png and /dev/null differ diff --git a/_images/vCenter/3.7-fuel-vcenter-network-name-and-vlan.png b/_images/vCenter/3.7-fuel-vcenter-network-name-and-vlan.png deleted file mode 100644 index a22604257..000000000 Binary files a/_images/vCenter/3.7-fuel-vcenter-network-name-and-vlan.png and /dev/null differ diff --git a/_images/vCenter/3.8-fuel-vcenter-select-created-network.png b/_images/vCenter/3.8-fuel-vcenter-select-created-network.png deleted file mode 100644 index fe18003f3..000000000 Binary files a/_images/vCenter/3.8-fuel-vcenter-select-created-network.png and /dev/null differ diff --git a/_images/vCenter/3.9-fuel-vcenter-accept-promiscuous.png b/_images/vCenter/3.9-fuel-vcenter-accept-promiscuous.png deleted file mode 100644 index 6309225d8..000000000 Binary files a/_images/vCenter/3.9-fuel-vcenter-accept-promiscuous.png and /dev/null differ diff --git a/_images/vCenter/4.1-fuel-vcenter-go-to-VMs.png b/_images/vCenter/4.1-fuel-vcenter-go-to-VMs.png deleted file mode 100644 index 2e83da03a..000000000 Binary files a/_images/vCenter/4.1-fuel-vcenter-go-to-VMs.png and /dev/null differ diff --git a/_images/vCenter/4.10-fuel-vcenter-VM-hardware-settings.png b/_images/vCenter/4.10-fuel-vcenter-VM-hardware-settings.png deleted file mode 100644 index 527b78208..000000000 Binary files a/_images/vCenter/4.10-fuel-vcenter-VM-hardware-settings.png and /dev/null differ diff --git a/_images/vCenter/4.11-fuel-vcenter-vm-enable-bios.png b/_images/vCenter/4.11-fuel-vcenter-vm-enable-bios.png deleted file mode 100644 index 422395d3b..000000000 Binary files a/_images/vCenter/4.11-fuel-vcenter-vm-enable-bios.png and /dev/null differ diff --git a/_images/vCenter/4.12-fuel-vcenter-VM-settings-verify.png b/_images/vCenter/4.12-fuel-vcenter-VM-settings-verify.png deleted file mode 100644 index 600ee786a..000000000 Binary files a/_images/vCenter/4.12-fuel-vcenter-VM-settings-verify.png and /dev/null differ diff --git a/_images/vCenter/4.2-fuel-vcenter-create-VM.png b/_images/vCenter/4.2-fuel-vcenter-create-VM.png deleted file mode 100644 index 74da6d16e..000000000 Binary files a/_images/vCenter/4.2-fuel-vcenter-create-VM.png and /dev/null differ diff --git a/_images/vCenter/4.3-fuel-vcenter-new-vm-p1.png b/_images/vCenter/4.3-fuel-vcenter-new-vm-p1.png deleted file mode 100644 index c3210d747..000000000 Binary files a/_images/vCenter/4.3-fuel-vcenter-new-vm-p1.png and /dev/null differ diff --git a/_images/vCenter/4.4-fuel-vcenter-new-vm-name-and-DC.png b/_images/vCenter/4.4-fuel-vcenter-new-vm-name-and-DC.png deleted file mode 100644 index e74dc6eac..000000000 Binary files a/_images/vCenter/4.4-fuel-vcenter-new-vm-name-and-DC.png and /dev/null differ diff --git a/_images/vCenter/4.5a-fuel-vcenter-new-vm-select-compute.png b/_images/vCenter/4.5a-fuel-vcenter-new-vm-select-compute.png deleted file mode 100644 index c977ad784..000000000 Binary files a/_images/vCenter/4.5a-fuel-vcenter-new-vm-select-compute.png and /dev/null differ diff --git a/_images/vCenter/4.5b-fuel-vcenter-new-vm-storage.png b/_images/vCenter/4.5b-fuel-vcenter-new-vm-storage.png deleted file mode 100644 index 6e6abeb46..000000000 Binary files a/_images/vCenter/4.5b-fuel-vcenter-new-vm-storage.png and /dev/null differ diff --git a/_images/vCenter/4.5c-fuel-vcenter-new-vm-compatibility.png b/_images/vCenter/4.5c-fuel-vcenter-new-vm-compatibility.png deleted file mode 100644 index d913b3edb..000000000 Binary files a/_images/vCenter/4.5c-fuel-vcenter-new-vm-compatibility.png and /dev/null differ diff --git a/_images/vCenter/4.6-fuel-vcenter-new-vm-guest-os.png b/_images/vCenter/4.6-fuel-vcenter-new-vm-guest-os.png deleted file mode 100644 index f72f2ad17..000000000 Binary files a/_images/vCenter/4.6-fuel-vcenter-new-vm-guest-os.png and /dev/null differ diff --git a/_images/vCenter/4.8-fuel-vcenter-VM-use-ISO.png b/_images/vCenter/4.8-fuel-vcenter-VM-use-ISO.png deleted file mode 100644 index 8ed5af29b..000000000 Binary files a/_images/vCenter/4.8-fuel-vcenter-VM-use-ISO.png and /dev/null differ diff --git a/_images/vCenter/4.9-fuel-vcenter-VM-select-ISO.png b/_images/vCenter/4.9-fuel-vcenter-VM-select-ISO.png deleted file mode 100644 index 633cddbf8..000000000 Binary files a/_images/vCenter/4.9-fuel-vcenter-VM-select-ISO.png and /dev/null differ diff --git a/_images/vCenter/5.1-fuel-vcenter-power-on-VM.png b/_images/vCenter/5.1-fuel-vcenter-power-on-VM.png deleted file mode 100644 index cc3b96456..000000000 Binary files a/_images/vCenter/5.1-fuel-vcenter-power-on-VM.png and /dev/null differ diff --git a/_images/vCenter/5.2-fuel-vcenter-open-vnc.png b/_images/vCenter/5.2-fuel-vcenter-open-vnc.png deleted file mode 100644 index 2cb47b5a5..000000000 Binary files a/_images/vCenter/5.2-fuel-vcenter-open-vnc.png and /dev/null differ diff --git a/_images/vCenter/5.3-fuel-vcenter-bios-boot-priority.png b/_images/vCenter/5.3-fuel-vcenter-bios-boot-priority.png deleted file mode 100644 index cf90ea81a..000000000 Binary files a/_images/vCenter/5.3-fuel-vcenter-bios-boot-priority.png and /dev/null differ diff --git a/_images/vCenter/5.4-fuel-vcenter-use-CD-as-first-boot-device.png b/_images/vCenter/5.4-fuel-vcenter-use-CD-as-first-boot-device.png deleted file mode 100644 index a9f99c3c8..000000000 Binary files a/_images/vCenter/5.4-fuel-vcenter-use-CD-as-first-boot-device.png and /dev/null differ diff --git a/_images/vCenter/5.5-fuel-vcenter-save-bios-and-proceed.png b/_images/vCenter/5.5-fuel-vcenter-save-bios-and-proceed.png deleted file mode 100644 index abfaea794..000000000 Binary files a/_images/vCenter/5.5-fuel-vcenter-save-bios-and-proceed.png and /dev/null differ diff --git a/_images/vCenter/5.6-fuel-vcenter-iso-boot-menu.png b/_images/vCenter/5.6-fuel-vcenter-iso-boot-menu.png deleted file mode 100644 index 1865806c1..000000000 Binary files a/_images/vCenter/5.6-fuel-vcenter-iso-boot-menu.png and /dev/null differ diff --git a/_images/vCenter/5.7-fuel-vcenter-fuelmenu.png b/_images/vCenter/5.7-fuel-vcenter-fuelmenu.png deleted file mode 100644 index ee0b2f0e0..000000000 Binary files a/_images/vCenter/5.7-fuel-vcenter-fuelmenu.png and /dev/null differ diff --git a/_images/vCenter/5.8-fuel-vcenter-fuelmenu-exit.png b/_images/vCenter/5.8-fuel-vcenter-fuelmenu-exit.png deleted file mode 100644 index 0ae60479f..000000000 Binary files a/_images/vCenter/5.8-fuel-vcenter-fuelmenu-exit.png and /dev/null differ diff --git a/_images/vCenter/5.9-fuel-vcenter-master-node-installation-complete.png b/_images/vCenter/5.9-fuel-vcenter-master-node-installation-complete.png deleted file mode 100644 index a10687408..000000000 Binary files a/_images/vCenter/5.9-fuel-vcenter-master-node-installation-complete.png and /dev/null differ diff --git a/_images/vCenter/6.1-fuel-vcenter-bootstrap-vmware.png b/_images/vCenter/6.1-fuel-vcenter-bootstrap-vmware.png deleted file mode 100644 index ce6e75143..000000000 Binary files a/_images/vCenter/6.1-fuel-vcenter-bootstrap-vmware.png and /dev/null differ diff --git a/_images/vCenter/6a-fuel-vcenter-slave-settings.png b/_images/vCenter/6a-fuel-vcenter-slave-settings.png deleted file mode 100644 index 93b6cbfb4..000000000 Binary files a/_images/vCenter/6a-fuel-vcenter-slave-settings.png and /dev/null differ diff --git a/_images/vCenter/6b-fuel-vcenter-slave-nodes-occur.png b/_images/vCenter/6b-fuel-vcenter-slave-nodes-occur.png deleted file mode 100644 index b40dbb691..000000000 Binary files a/_images/vCenter/6b-fuel-vcenter-slave-nodes-occur.png and /dev/null differ diff --git a/_images/vCenter/Fuel_in_vCenter_networking.png b/_images/vCenter/Fuel_in_vCenter_networking.png deleted file mode 100644 index cd2670acb..000000000 Binary files a/_images/vCenter/Fuel_in_vCenter_networking.png and /dev/null differ diff --git a/_images/vbox-image1.png b/_images/vbox-image1.png deleted file mode 100644 index 4b172d775..000000000 Binary files a/_images/vbox-image1.png and /dev/null differ diff --git a/_images/vbox-image2.png b/_images/vbox-image2.png deleted file mode 100644 index a43a23284..000000000 Binary files a/_images/vbox-image2.png and /dev/null differ diff --git a/_images/vbox_node_settings.jpg b/_images/vbox_node_settings.jpg deleted file mode 100644 index 00edfe9b4..000000000 Binary files a/_images/vbox_node_settings.jpg and /dev/null differ diff --git a/_images/vbox_public_settings.jpg b/_images/vbox_public_settings.jpg deleted file mode 100644 index 068bcb933..000000000 Binary files a/_images/vbox_public_settings.jpg and /dev/null differ diff --git a/_images/vboxnet1.png b/_images/vboxnet1.png deleted file mode 100644 index 6428f19fc..000000000 Binary files a/_images/vboxnet1.png and /dev/null differ diff --git a/_images/vboxnet2.png b/_images/vboxnet2.png deleted file mode 100644 index f42cadd35..000000000 Binary files a/_images/vboxnet2.png and /dev/null differ diff --git a/_images/vcenter-ha-architecture.png b/_images/vcenter-ha-architecture.png deleted file mode 100644 index f614e9fe1..000000000 Binary files a/_images/vcenter-ha-architecture.png and /dev/null differ diff --git a/_images/vcenter-network-topology.png b/_images/vcenter-network-topology.png deleted file mode 100644 index 0fe3d2e5a..000000000 Binary files a/_images/vcenter-network-topology.png and /dev/null differ diff --git a/_images/vcenter-nsx-settings.png b/_images/vcenter-nsx-settings.png deleted file mode 100644 index da83a3bc8..000000000 Binary files a/_images/vcenter-nsx-settings.png and /dev/null differ diff --git a/_images/vlanmanager_scheme.jpg b/_images/vlanmanager_scheme.jpg deleted file mode 100644 index 88938f850..000000000 Binary files a/_images/vlanmanager_scheme.jpg and /dev/null differ diff --git a/_images/vpnaas_plugin.png b/_images/vpnaas_plugin.png deleted file mode 100644 index e74685240..000000000 Binary files a/_images/vpnaas_plugin.png and /dev/null differ diff --git a/_static/config.sh b/_static/config.sh deleted file mode 100644 index 4f819c763..000000000 --- a/_static/config.sh +++ /dev/null @@ -1,71 +0,0 @@ -#!/bin/bash - -# Copyright 2013 Mirantis, Inc. -# -# Licensed under the Apache License, Version 2.0 (the "License"); you may -# not use this file except in compliance with the License. You may obtain -# a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT -# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the -# License for the specific language governing permissions and limitations -# under the License. - -# The number of nodes for installing OpenStack on -# - for minimal non-HA installation, specify 2 (1 controller + 1 compute) -# - for minimal non-HA with Cinder installation, specify 3 (1 ctrl + 1 compute + 1 cinder) -# - for minimal HA installation, specify 4 (3 controllers + 1 compute) -cluster_size=3 - -# Get the first available ISO from the directory 'iso' -iso_path=`ls -1 iso/*.iso 2>/dev/null | head -1` - -# Every Fuel Web machine name will start from this prefix -vm_name_prefix=fuel-web- - -# Host interfaces to bridge VMs interfaces with -idx=0 -for ip in 10.20.0.1 172.16.1.1 172.16.0.1; do - host_nic_name[$idx]=vboxnet$idx - host_nic_ip[$idx]=$ip - host_nic_mask[$idx]=255.255.255.0 - idx=$((idx+1)) -done - -# Master node settings -vm_master_cpu_cores=1 -vm_master_memory_mb=1024 -vm_master_disk_mb=16384 - -# Master node access to the internet through the host system, using VirtualBox NAT adapter -vm_master_nat_network=192.168.200/24 -vm_master_nat_gateway=192.168.200.2 - -# These settings will be used to check if master node has installed or not. -# If you modify networking params for master node during the boot time -# (i.e. if you pressed Tab in a boot loader and modified params), -# make sure that these values reflect that change. -vm_master_ip=10.20.0.2 -vm_master_username=root -vm_master_password=r00tme -vm_master_prompt='root@fuel ~]#' - -# Slave node settings -vm_slave_cpu_cores=1 - -# This section allows you to define RAM size in MB for each slave node. -# Keep in mind that PXE boot might not work correctly with values lower than 768. -# You can specify memory size for the specific slaves, other will get default vm_slave_memory_default -vm_slave_memory_default=768 -vm_slave_memory_mb[1]=768 # for controller node 768 MB should be sufficient -vm_slave_memory_mb[2]=1024 # for compute node 1GB is recommended, otherwise VM instances in OpenStack may not boot -vm_slave_memory_mb[3]=768 # for a dedicated Cinder node 768 MB should be sufficient - -# This section allows you to define HDD size in MB for all the slaves nodes. -# All the slaves will have identical disk configuration. Each slave will have three disks of the following sizes. -vm_slave_first_disk_mb=16384 -vm_slave_second_disk_mb=32768 -vm_slave_third_disk_mb=65536 diff --git a/_static/l2_ovs_bond_ovs_pp.diff b/_static/l2_ovs_bond_ovs_pp.diff deleted file mode 100644 index 7d6c17988..000000000 --- a/_static/l2_ovs_bond_ovs_pp.diff +++ /dev/null @@ -1,24 +0,0 @@ -diff --git /etc/puppet/modules/l23network/lib/puppet/provider/l2_ovs_bond/ovs.rb /etc/puppet/modules/l23network/lib/puppet/provider/l2_ovs_bond/ovs.rb ---- /etc/puppet/modules/l23network/lib/puppet/provider/l2_ovs_bond/ovs.rb -+++ /etc/puppet/modules/l23network/lib/puppet/provider/l2_ovs_bond/ovs.rb -@@ -1,7 +1,8 @@ - Puppet::Type.type(:l2_ovs_bond).provide(:ovs) do - optional_commands( - :vsctl => "/usr/bin/ovs-vsctl", -- :appctl => "/usr/bin/ovs-appctl" -+ :appctl => "/usr/bin/ovs-appctl", -+ :iproute => "/sbin/ip" - ) - - def _exists?(bond) -@@ -40,6 +41,10 @@ def create - bond_create_cmd += bond_properties - end - begin -+ @resource[:interfaces].each do |iface| -+ ip_addr_flush_cmd = ['addr', 'flush', 'dev', iface] -+ iproute(ip_addr_flush_cmd) -+ end - vsctl(bond_create_cmd) - rescue Puppet::ExecutionFailure => error - notice(">>>#{bond_create_cmd.join(',')}<<<") diff --git a/_static/manage_dnsmasq_py.diff b/_static/manage_dnsmasq_py.diff deleted file mode 100644 index f7e4458c5..000000000 --- a/_static/manage_dnsmasq_py.diff +++ /dev/null @@ -1,10 +0,0 @@ ---- /usr/lib/python2.6/site-packages/cobbler/modules/manage_dnsmasq.py 2012-06-18 00:22:25.000000000 +0000 -+++ /usr/lib/python2.6/site-packages/cobbler/modules/manage_dnsmasq.py 2013-12-27 14:04:25.930601378 +0000 -@@ -170,6 +170,7 @@ - # dnsmasq knows how to read this database of MACs -> IPs, so we'll keep it up to date - # every time we add a system. - # read 'man ethers' for format info -+ return - fh = open("/etc/ethers","w+") - for system in self.systems: - if not system.is_management_supported(cidr_ok=False): diff --git a/_static/mirantis_icon.ico b/_static/mirantis_icon.ico deleted file mode 100644 index 6362bc545..000000000 Binary files a/_static/mirantis_icon.ico and /dev/null differ diff --git a/_static/mirantis_logo.png b/_static/mirantis_logo.png deleted file mode 100644 index 179ab3ca0..000000000 Binary files a/_static/mirantis_logo.png and /dev/null differ diff --git a/_templates/bootstrap/globaltoc.html b/_templates/bootstrap/globaltoc.html new file mode 100644 index 000000000..cb9f38fb6 --- /dev/null +++ b/_templates/bootstrap/globaltoc.html @@ -0,0 +1,4 @@ +
  • + {{ _('Site') }} +
      {{ toctree(maxdepth=1) }}
    +
    • diff --git a/_templates/bootstrap/layout.html b/_templates/bootstrap/layout.html new file mode 100644 index 000000000..8bc387f2e --- /dev/null +++ b/_templates/bootstrap/layout.html @@ -0,0 +1,134 @@ +{% extends "basic/layout.html" %} +{% set script_files = script_files + ['_static/bootstrap.js'] %} +{% set css_files = ['_static/bootstrap.css', '_static/bootstrap-sphinx.css'] + css_files %} + +{# Sidebar: Rework into our Boostrap nav section. #} +{% macro navBar() %} + + +{% endmacro %} + +{%- block extrahead %} + +{% endblock %} + +{% block header %}{{ navBar() }}{% endblock %} + +{# Silence the sidebar's, relbar's #} +{% block sidebar1 %}{% endblock %} +{% block sidebar2 %}{% endblock %} +{% block relbar1 %}{% endblock %} +{% block relbar2 %}{% endblock %} + +{%- block content %} +
    + {% block body %} {% endblock %} +
    +{%- endblock %} + +{%- block footer %} +
    +
    +

    Back to top

    +

    + {%- if show_copyright %} + {%- if hasdoc('copyright') %} + {% trans path=pathto('copyright'), copyright=copyright|e %}© Copyright {{ copyright }}.{% endtrans %}
    + {%- else %} + {% trans copyright=copyright|e %}© Copyright {{ copyright }}.{% endtrans %}
    + {%- endif %} + {%- endif %} + {%- if last_updated %} + {% trans last_updated=last_updated|e %}Last updated on {{ last_updated }}.{% endtrans %}
    + {%- endif %} + {%- if show_sphinx %} + {% trans sphinx_version=sphinx_version|e %}Created using Sphinx {{ sphinx_version }}.{% endtrans %}
    + {%- endif %} +

    +
    +
    +{%- endblock %} + diff --git a/_templates/bootstrap/localtoc.html b/_templates/bootstrap/localtoc.html new file mode 100644 index 000000000..c47d98801 --- /dev/null +++ b/_templates/bootstrap/localtoc.html @@ -0,0 +1,5 @@ +
  • + {{ _('Page') }} +
      {{ toc }}
    + +
    • diff --git a/_templates/bootstrap/relations.html b/_templates/bootstrap/relations.html new file mode 100644 index 000000000..b3df68e3b --- /dev/null +++ b/_templates/bootstrap/relations.html @@ -0,0 +1,8 @@ +{%- if prev %} +
  • {{ "«"|safe }} {{ prev.title }}
    • +{%- endif %} +{%- if next %} +
  • {{ next.title }} {{ "»"|safe }}
    • +{%- endif %} diff --git a/_templates/bootstrap/searchbox.html b/_templates/bootstrap/searchbox.html new file mode 100644 index 000000000..67852e6f8 --- /dev/null +++ b/_templates/bootstrap/searchbox.html @@ -0,0 +1,7 @@ +{%- if pagename != "search" %} +
    + + + +
    +{%- endif %} diff --git a/_templates/bootstrap/sourcelink.html b/_templates/bootstrap/sourcelink.html new file mode 100644 index 000000000..21ae2d8fe --- /dev/null +++ b/_templates/bootstrap/sourcelink.html @@ -0,0 +1,4 @@ +{%- if show_source and has_source and sourcename %} +
  • {{ _('Source') }}
    • +{%- endif %} diff --git a/_templates/bootstrap/static/bootstrap-responsive.css b/_templates/bootstrap/static/bootstrap-responsive.css new file mode 100644 index 000000000..dd134a1bd --- /dev/null +++ b/_templates/bootstrap/static/bootstrap-responsive.css @@ -0,0 +1,9 @@ +/*! + * Bootstrap Responsive v2.0.3 + * + * Copyright 2012 Twitter, Inc + * Licensed under the Apache License v2.0 + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Designed and built with all the love in the world @twitter by @mdo and @fat. + */.clearfix{*zoom:1}.clearfix:before,.clearfix:after{display:table;content:""}.clearfix:after{clear:both}.hide-text{font:0/0 a;color:transparent;text-shadow:none;background-color:transparent;border:0}.input-block-level{display:block;width:100%;min-height:28px;-webkit-box-sizing:border-box;-moz-box-sizing:border-box;-ms-box-sizing:border-box;box-sizing:border-box}.hidden{display:none;visibility:hidden}.visible-phone{display:none!important}.visible-tablet{display:none!important}.hidden-desktop{display:none!important}@media(max-width:767px){.visible-phone{display:inherit!important}.hidden-phone{display:none!important}.hidden-desktop{display:inherit!important}.visible-desktop{display:none!important}}@media(min-width:768px) and (max-width:979px){.visible-tablet{display:inherit!important}.hidden-tablet{display:none!important}.hidden-desktop{display:inherit!important}.visible-desktop{display:none!important}}@media(max-width:480px){.nav-collapse{-webkit-transform:translate3d(0,0,0)}.page-header h1 small{display:block;line-height:18px}input[type="checkbox"],input[type="radio"]{border:1px solid #ccc}.form-horizontal .control-group>label{float:none;width:auto;padding-top:0;text-align:left}.form-horizontal .controls{margin-left:0}.form-horizontal .control-list{padding-top:0}.form-horizontal .form-actions{padding-right:10px;padding-left:10px}.modal{position:absolute;top:10px;right:10px;left:10px;width:auto;margin:0}.modal.fade.in{top:auto}.modal-header .close{padding:10px;margin:-10px}.carousel-caption{position:static}}@media(max-width:767px){body{padding-right:20px;padding-left:20px}.navbar-fixed-top,.navbar-fixed-bottom{margin-right:-20px;margin-left:-20px}.container-fluid{padding:0}.dl-horizontal dt{float:none;width:auto;clear:none;text-align:left}.dl-horizontal dd{margin-left:0}.container{width:auto}.row-fluid{width:100%}.row,.thumbnails{margin-left:0}[class*="span"],.row-fluid [class*="span"]{display:block;float:none;width:auto;margin-left:0}.input-large,.input-xlarge,.input-xxlarge,input[class*="span"],select[class*="span"],textarea[class*="span"],.uneditable-input{display:block;width:100%;min-height:28px;-webkit-box-sizing:border-box;-moz-box-sizing:border-box;-ms-box-sizing:border-box;box-sizing:border-box}.input-prepend input,.input-append input,.input-prepend input[class*="span"],.input-append input[class*="span"]{display:inline-block;width:auto}}@media(min-width:768px) and (max-width:979px){.row{margin-left:-20px;*zoom:1}.row:before,.row:after{display:table;content:""}.row:after{clear:both}[class*="span"]{float:left;margin-left:20px}.container,.navbar-fixed-top .container,.navbar-fixed-bottom .container{width:724px}.span12{width:724px}.span11{width:662px}.span10{width:600px}.span9{width:538px}.span8{width:476px}.span7{width:414px}.span6{width:352px}.span5{width:290px}.span4{width:228px}.span3{width:166px}.span2{width:104px}.span1{width:42px}.offset12{margin-left:764px}.offset11{margin-left:702px}.offset10{margin-left:640px}.offset9{margin-left:578px}.offset8{margin-left:516px}.offset7{margin-left:454px}.offset6{margin-left:392px}.offset5{margin-left:330px}.offset4{margin-left:268px}.offset3{margin-left:206px}.offset2{margin-left:144px}.offset1{margin-left:82px}.row-fluid{width:100%;*zoom:1}.row-fluid:before,.row-fluid:after{display:table;content:""}.row-fluid:after{clear:both}.row-fluid [class*="span"]{display:block;float:left;width:100%;min-height:28px;margin-left:2.762430939%;*margin-left:2.709239449638298%;-webkit-box-sizing:border-box;-moz-box-sizing:border-box;-ms-box-sizing:border-box;box-sizing:border-box}.row-fluid [class*="span"]:first-child{margin-left:0}.row-fluid .span12{width:99.999999993%;*width:99.9468085036383%}.row-fluid .span11{width:91.436464082%;*width:91.38327259263829%}.row-fluid .span10{width:82.87292817100001%;*width:82.8197366816383%}.row-fluid .span9{width:74.30939226%;*width:74.25620077063829%}.row-fluid .span8{width:65.74585634900001%;*width:65.6926648596383%}.row-fluid .span7{width:57.182320438000005%;*width:57.129128948638304%}.row-fluid .span6{width:48.618784527%;*width:48.5655930376383%}.row-fluid .span5{width:40.055248616%;*width:40.0020571266383%}.row-fluid .span4{width:31.491712705%;*width:31.4385212156383%}.row-fluid .span3{width:22.928176794%;*width:22.874985304638297%}.row-fluid .span2{width:14.364640883%;*width:14.311449393638298%}.row-fluid .span1{width:5.801104972%;*width:5.747913482638298%}input,textarea,.uneditable-input{margin-left:0}input.span12,textarea.span12,.uneditable-input.span12{width:714px}input.span11,textarea.span11,.uneditable-input.span11{width:652px}input.span10,textarea.span10,.uneditable-input.span10{width:590px}input.span9,textarea.span9,.uneditable-input.span9{width:528px}input.span8,textarea.span8,.uneditable-input.span8{width:466px}input.span7,textarea.span7,.uneditable-input.span7{width:404px}input.span6,textarea.span6,.uneditable-input.span6{width:342px}input.span5,textarea.span5,.uneditable-input.span5{width:280px}input.span4,textarea.span4,.uneditable-input.span4{width:218px}input.span3,textarea.span3,.uneditable-input.span3{width:156px}input.span2,textarea.span2,.uneditable-input.span2{width:94px}input.span1,textarea.span1,.uneditable-input.span1{width:32px}}@media(min-width:1200px){.row{margin-left:-30px;*zoom:1}.row:before,.row:after{display:table;content:""}.row:after{clear:both}[class*="span"]{float:left;margin-left:30px}.container,.navbar-fixed-top .container,.navbar-fixed-bottom .container{width:1170px}.span12{width:1170px}.span11{width:1070px}.span10{width:970px}.span9{width:870px}.span8{width:770px}.span7{width:670px}.span6{width:570px}.span5{width:470px}.span4{width:370px}.span3{width:270px}.span2{width:170px}.span1{width:70px}.offset12{margin-left:1230px}.offset11{margin-left:1130px}.offset10{margin-left:1030px}.offset9{margin-left:930px}.offset8{margin-left:830px}.offset7{margin-left:730px}.offset6{margin-left:630px}.offset5{margin-left:530px}.offset4{margin-left:430px}.offset3{margin-left:330px}.offset2{margin-left:230px}.offset1{margin-left:130px}.row-fluid{width:100%;*zoom:1}.row-fluid:before,.row-fluid:after{display:table;content:""}.row-fluid:after{clear:both}.row-fluid [class*="span"]{display:block;float:left;width:100%;min-height:28px;margin-left:2.564102564%;*margin-left:2.510911074638298%;-webkit-box-sizing:border-box;-moz-box-sizing:border-box;-ms-box-sizing:border-box;box-sizing:border-box}.row-fluid [class*="span"]:first-child{margin-left:0}.row-fluid .span12{width:100%;*width:99.94680851063829%}.row-fluid .span11{width:91.45299145300001%;*width:91.3997999636383%}.row-fluid .span10{width:82.905982906%;*width:82.8527914166383%}.row-fluid .span9{width:74.358974359%;*width:74.30578286963829%}.row-fluid .span8{width:65.81196581200001%;*width:65.7587743226383%}.row-fluid .span7{width:57.264957265%;*width:57.2117657756383%}.row-fluid .span6{width:48.717948718%;*width:48.6647572286383%}.row-fluid .span5{width:40.170940171000005%;*width:40.117748681638304%}.row-fluid .span4{width:31.623931624%;*width:31.5707401346383%}.row-fluid .span3{width:23.076923077%;*width:23.0237315876383%}.row-fluid .span2{width:14.529914530000001%;*width:14.4767230406383%}.row-fluid .span1{width:5.982905983%;*width:5.929714493638298%}input,textarea,.uneditable-input{margin-left:0}input.span12,textarea.span12,.uneditable-input.span12{width:1160px}input.span11,textarea.span11,.uneditable-input.span11{width:1060px}input.span10,textarea.span10,.uneditable-input.span10{width:960px}input.span9,textarea.span9,.uneditable-input.span9{width:860px}input.span8,textarea.span8,.uneditable-input.span8{width:760px}input.span7,textarea.span7,.uneditable-input.span7{width:660px}input.span6,textarea.span6,.uneditable-input.span6{width:560px}input.span5,textarea.span5,.uneditable-input.span5{width:460px}input.span4,textarea.span4,.uneditable-input.span4{width:360px}input.span3,textarea.span3,.uneditable-input.span3{width:260px}input.span2,textarea.span2,.uneditable-input.span2{width:160px}input.span1,textarea.span1,.uneditable-input.span1{width:60px}.thumbnails{margin-left:-30px}.thumbnails>li{margin-left:30px}.row-fluid .thumbnails{margin-left:0}}@media(max-width:979px){body{padding-top:0}.navbar-fixed-top{position:static;margin-bottom:18px}.navbar-fixed-top .navbar-inner{padding:5px}.navbar .container{width:auto;padding:0}.navbar .brand{padding-right:10px;padding-left:10px;margin:0 0 0 -5px}.nav-collapse{clear:both}.nav-collapse .nav{float:none;margin:0 0 9px}.nav-collapse .nav>li{float:none}.nav-collapse .nav>li>a{margin-bottom:2px}.nav-collapse .nav>.divider-vertical{display:none}.nav-collapse .nav .nav-header{color:#999;text-shadow:none}.nav-collapse .nav>li>a,.nav-collapse .dropdown-menu a{padding:6px 15px;font-weight:bold;color:#999;-webkit-border-radius:3px;-moz-border-radius:3px;border-radius:3px}.nav-collapse .btn{padding:4px 10px 4px;font-weight:normal;-webkit-border-radius:4px;-moz-border-radius:4px;border-radius:4px}.nav-collapse .dropdown-menu li+li a{margin-bottom:2px}.nav-collapse .nav>li>a:hover,.nav-collapse .dropdown-menu a:hover{background-color:#222}.nav-collapse.in .btn-group{padding:0;margin-top:5px}.nav-collapse .dropdown-menu{position:static;top:auto;left:auto;display:block;float:none;max-width:none;padding:0;margin:0 15px;background-color:transparent;border:0;-webkit-border-radius:0;-moz-border-radius:0;border-radius:0;-webkit-box-shadow:none;-moz-box-shadow:none;box-shadow:none}.nav-collapse .dropdown-menu:before,.nav-collapse .dropdown-menu:after{display:none}.nav-collapse .dropdown-menu .divider{display:none}.nav-collapse .navbar-form,.nav-collapse .navbar-search{float:none;padding:9px 15px;margin:9px 0;border-top:1px solid #222;border-bottom:1px solid #222;-webkit-box-shadow:inset 0 1px 0 rgba(255,255,255,0.1),0 1px 0 rgba(255,255,255,0.1);-moz-box-shadow:inset 0 1px 0 rgba(255,255,255,0.1),0 1px 0 rgba(255,255,255,0.1);box-shadow:inset 0 1px 0 rgba(255,255,255,0.1),0 1px 0 rgba(255,255,255,0.1)}.navbar .nav-collapse .nav.pull-right{float:none;margin-left:0}.nav-collapse,.nav-collapse.collapse{height:0;overflow:hidden}.navbar .btn-navbar{display:block}.navbar-static .navbar-inner{padding-right:10px;padding-left:10px}}@media(min-width:980px){.nav-collapse.collapse{height:auto!important;overflow:visible!important}} diff --git a/_templates/bootstrap/static/bootstrap-sphinx.css_t b/_templates/bootstrap/static/bootstrap-sphinx.css_t new file mode 100644 index 000000000..965aa9ecf --- /dev/null +++ b/_templates/bootstrap/static/bootstrap-sphinx.css_t @@ -0,0 +1,24 @@ +/* +* bootstrap-sphinx.css +* ~~~~~~~~~~~~~~~~~~~~ +* +* Sphinx stylesheet -- Twitter Bootstrap theme. +*/ + +body { + padding-top: 52px; +} + +.navbar .brand { + color: #FFF; + text-shadow: #777 2px 2px 3px; +} + +{%- block sidebarlogo %} + {%- if logo %} +.navbar h3 a, .navbar .brand { + background: transparent url("{{ logo }}") no-repeat 22px 3px; + padding-left: 62px; +} + {%- endif %} +{%- endblock %} diff --git a/_templates/bootstrap/static/bootstrap.css b/_templates/bootstrap/static/bootstrap.css new file mode 100644 index 000000000..1c75d0c07 --- /dev/null +++ b/_templates/bootstrap/static/bootstrap.css @@ -0,0 +1,9 @@ +/*! + * Bootstrap v2.0.3 + * + * Copyright 2012 Twitter, Inc + * Licensed under the Apache License v2.0 + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Designed and built with all the love in the world @twitter by @mdo and @fat. + */article,aside,details,figcaption,figure,footer,header,hgroup,nav,section{display:block}audio,canvas,video{display:inline-block;*display:inline;*zoom:1}audio:not([controls]){display:none}html{font-size:100%;-webkit-text-size-adjust:100%;-ms-text-size-adjust:100%}a:focus{outline:thin dotted #333;outline:5px auto -webkit-focus-ring-color;outline-offset:-2px}a:hover,a:active{outline:0}sub,sup{position:relative;font-size:75%;line-height:0;vertical-align:baseline}sup{top:-0.5em}sub{bottom:-0.25em}img{max-width:100%;vertical-align:middle;border:0;-ms-interpolation-mode:bicubic}button,input,select,textarea{margin:0;font-size:100%;vertical-align:middle}button,input{*overflow:visible;line-height:normal}button::-moz-focus-inner,input::-moz-focus-inner{padding:0;border:0}button,input[type="button"],input[type="reset"],input[type="submit"]{cursor:pointer;-webkit-appearance:button}input[type="search"]{-webkit-box-sizing:content-box;-moz-box-sizing:content-box;box-sizing:content-box;-webkit-appearance:textfield}input[type="search"]::-webkit-search-decoration,input[type="search"]::-webkit-search-cancel-button{-webkit-appearance:none}textarea{overflow:auto;vertical-align:top}.clearfix{*zoom:1}.clearfix:before,.clearfix:after{display:table;content:""}.clearfix:after{clear:both}.hide-text{font:0/0 a;color:transparent;text-shadow:none;background-color:transparent;border:0}.input-block-level{display:block;width:100%;min-height:28px;-webkit-box-sizing:border-box;-moz-box-sizing:border-box;-ms-box-sizing:border-box;box-sizing:border-box}body{margin:0;font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px;line-height:18px;color:#333;background-color:#fff}a{color:#08c;text-decoration:none}a:hover{color:#005580;text-decoration:underline}.row{margin-left:-20px;*zoom:1}.row:before,.row:after{display:table;content:""}.row:after{clear:both}[class*="span"]{float:left;margin-left:20px}.container,.navbar-fixed-top .container,.navbar-fixed-bottom .container{width:940px}.span12{width:940px}.span11{width:860px}.span10{width:780px}.span9{width:700px}.span8{width:620px}.span7{width:540px}.span6{width:460px}.span5{width:380px}.span4{width:300px}.span3{width:220px}.span2{width:140px}.span1{width:60px}.offset12{margin-left:980px}.offset11{margin-left:900px}.offset10{margin-left:820px}.offset9{margin-left:740px}.offset8{margin-left:660px}.offset7{margin-left:580px}.offset6{margin-left:500px}.offset5{margin-left:420px}.offset4{margin-left:340px}.offset3{margin-left:260px}.offset2{margin-left:180px}.offset1{margin-left:100px}.row-fluid{width:100%;*zoom:1}.row-fluid:before,.row-fluid:after{display:table;content:""}.row-fluid:after{clear:both}.row-fluid [class*="span"]{display:block;float:left;width:100%;min-height:28px;margin-left:2.127659574%;*margin-left:2.0744680846382977%;-webkit-box-sizing:border-box;-moz-box-sizing:border-box;-ms-box-sizing:border-box;box-sizing:border-box}.row-fluid [class*="span"]:first-child{margin-left:0}.row-fluid .span12{width:99.99999998999999%;*width:99.94680850063828%}.row-fluid .span11{width:91.489361693%;*width:91.4361702036383%}.row-fluid .span10{width:82.97872339599999%;*width:82.92553190663828%}.row-fluid .span9{width:74.468085099%;*width:74.4148936096383%}.row-fluid .span8{width:65.95744680199999%;*width:65.90425531263828%}.row-fluid .span7{width:57.446808505%;*width:57.3936170156383%}.row-fluid .span6{width:48.93617020799999%;*width:48.88297871863829%}.row-fluid .span5{width:40.425531911%;*width:40.3723404216383%}.row-fluid .span4{width:31.914893614%;*width:31.8617021246383%}.row-fluid .span3{width:23.404255317%;*width:23.3510638276383%}.row-fluid .span2{width:14.89361702%;*width:14.8404255306383%}.row-fluid .span1{width:6.382978723%;*width:6.329787233638298%}.container{margin-right:auto;margin-left:auto;*zoom:1}.container:before,.container:after{display:table;content:""}.container:after{clear:both}.container-fluid{padding-right:20px;padding-left:20px;*zoom:1}.container-fluid:before,.container-fluid:after{display:table;content:""}.container-fluid:after{clear:both}p{margin:0 0 9px;font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px;line-height:18px}p small{font-size:11px;color:#999}.lead{margin-bottom:18px;font-size:20px;font-weight:200;line-height:27px}h1,h2,h3,h4,h5,h6{margin:0;font-family:inherit;font-weight:bold;color:inherit;text-rendering:optimizelegibility}h1 small,h2 small,h3 small,h4 small,h5 small,h6 small{font-weight:normal;color:#999}h1{font-size:30px;line-height:36px}h1 small{font-size:18px}h2{font-size:24px;line-height:36px}h2 small{font-size:18px}h3{font-size:18px;line-height:27px}h3 small{font-size:14px}h4,h5,h6{line-height:18px}h4{font-size:14px}h4 small{font-size:12px}h5{font-size:12px}h6{font-size:11px;color:#999;text-transform:uppercase}.page-header{padding-bottom:17px;margin:18px 0;border-bottom:1px solid #eee}.page-header h1{line-height:1}ul,ol{padding:0;margin:0 0 9px 25px}ul ul,ul ol,ol ol,ol ul{margin-bottom:0}ul{list-style:disc}ol{list-style:decimal}li{line-height:18px}ul.unstyled,ol.unstyled{margin-left:0;list-style:none}dl{margin-bottom:18px}dt,dd{line-height:18px}dt{font-weight:bold;line-height:17px}dd{margin-left:9px}.dl-horizontal dt{float:left;width:120px;overflow:hidden;clear:left;text-align:right;text-overflow:ellipsis;white-space:nowrap}.dl-horizontal dd{margin-left:130px}hr{margin:18px 0;border:0;border-top:1px solid #eee;border-bottom:1px solid #fff}strong{font-weight:bold}em{font-style:italic}.muted{color:#999}abbr[title]{cursor:help;border-bottom:1px dotted #ddd}abbr.initialism{font-size:90%;text-transform:uppercase}blockquote{padding:0 0 0 15px;margin:0 0 18px;border-left:5px solid #eee}blockquote p{margin-bottom:0;font-size:16px;font-weight:300;line-height:22.5px}blockquote small{display:block;line-height:18px;color:#999}blockquote small:before{content:'\2014 \00A0'}blockquote.pull-right{float:right;padding-right:15px;padding-left:0;border-right:5px solid #eee;border-left:0}blockquote.pull-right p,blockquote.pull-right small{text-align:right}q:before,q:after,blockquote:before,blockquote:after{content:""}address{display:block;margin-bottom:18px;font-style:normal;line-height:18px}small{font-size:100%}cite{font-style:normal}code,pre{padding:0 3px 2px;font-family:Menlo,Monaco,Consolas,"Courier New",monospace;font-size:12px;color:#333;-webkit-border-radius:3px;-moz-border-radius:3px;border-radius:3px}code{padding:2px 4px;color:#d14;background-color:#f7f7f9;border:1px solid #e1e1e8}pre{display:block;padding:8.5px;margin:0 0 9px;font-size:12.025px;line-height:18px;word-break:break-all;word-wrap:break-word;white-space:pre;white-space:pre-wrap;background-color:#f5f5f5;border:1px solid #ccc;border:1px solid rgba(0,0,0,0.15);-webkit-border-radius:4px;-moz-border-radius:4px;border-radius:4px}pre.prettyprint{margin-bottom:18px}pre code{padding:0;color:inherit;background-color:transparent;border:0}.pre-scrollable{max-height:340px;overflow-y:scroll}form{margin:0 0 18px}fieldset{padding:0;margin:0;border:0}legend{display:block;width:100%;padding:0;margin-bottom:27px;font-size:19.5px;line-height:36px;color:#333;border:0;border-bottom:1px solid #eee}legend small{font-size:13.5px;color:#999}label,input,button,select,textarea{font-size:13px;font-weight:normal;line-height:18px}input,button,select,textarea{font-family:"Helvetica Neue",Helvetica,Arial,sans-serif}label{display:block;margin-bottom:5px;color:#333}input,textarea,select,.uneditable-input{display:inline-block;width:210px;height:18px;padding:4px;margin-bottom:9px;font-size:13px;line-height:18px;color:#555;background-color:#fff;border:1px solid #ccc;-webkit-border-radius:3px;-moz-border-radius:3px;border-radius:3px}.uneditable-textarea{width:auto;height:auto}label input,label textarea,label select{display:block}input[type="image"],input[type="checkbox"],input[type="radio"]{width:auto;height:auto;padding:0;margin:3px 0;*margin-top:0;line-height:normal;cursor:pointer;background-color:transparent;border:0 \9;-webkit-border-radius:0;-moz-border-radius:0;border-radius:0}input[type="image"]{border:0}input[type="file"]{width:auto;padding:initial;line-height:initial;background-color:#fff;background-color:initial;border:initial;-webkit-box-shadow:none;-moz-box-shadow:none;box-shadow:none}input[type="button"],input[type="reset"],input[type="submit"]{width:auto;height:auto}select,input[type="file"]{height:28px;*margin-top:4px;line-height:28px}input[type="file"]{line-height:18px \9}select{width:220px;background-color:#fff}select[multiple],select[size]{height:auto}input[type="image"]{-webkit-box-shadow:none;-moz-box-shadow:none;box-shadow:none}textarea{height:auto}input[type="hidden"]{display:none}.radio,.checkbox{min-height:18px;padding-left:18px}.radio input[type="radio"],.checkbox input[type="checkbox"]{float:left;margin-left:-18px}.controls>.radio:first-child,.controls>.checkbox:first-child{padding-top:5px}.radio.inline,.checkbox.inline{display:inline-block;padding-top:5px;margin-bottom:0;vertical-align:middle}.radio.inline+.radio.inline,.checkbox.inline+.checkbox.inline{margin-left:10px}input,textarea{-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.075);-moz-box-shadow:inset 0 1px 1px rgba(0,0,0,0.075);box-shadow:inset 0 1px 1px rgba(0,0,0,0.075);-webkit-transition:border linear .2s,box-shadow linear .2s;-moz-transition:border linear .2s,box-shadow linear .2s;-ms-transition:border linear .2s,box-shadow linear .2s;-o-transition:border linear .2s,box-shadow linear .2s;transition:border linear .2s,box-shadow linear .2s}input:focus,textarea:focus{border-color:rgba(82,168,236,0.8);outline:0;outline:thin dotted \9;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.075),0 0 8px rgba(82,168,236,0.6);-moz-box-shadow:inset 0 1px 1px rgba(0,0,0,0.075),0 0 8px rgba(82,168,236,0.6);box-shadow:inset 0 1px 1px rgba(0,0,0,0.075),0 0 8px rgba(82,168,236,0.6)}input[type="file"]:focus,input[type="radio"]:focus,input[type="checkbox"]:focus,select:focus{outline:thin dotted #333;outline:5px auto -webkit-focus-ring-color;outline-offset:-2px;-webkit-box-shadow:none;-moz-box-shadow:none;box-shadow:none}.input-mini{width:60px}.input-small{width:90px}.input-medium{width:150px}.input-large{width:210px}.input-xlarge{width:270px}.input-xxlarge{width:530px}input[class*="span"],select[class*="span"],textarea[class*="span"],.uneditable-input[class*="span"],.row-fluid input[class*="span"],.row-fluid select[class*="span"],.row-fluid textarea[class*="span"],.row-fluid .uneditable-input[class*="span"]{float:none;margin-left:0}input,textarea,.uneditable-input{margin-left:0}input.span12,textarea.span12,.uneditable-input.span12{width:930px}input.span11,textarea.span11,.uneditable-input.span11{width:850px}input.span10,textarea.span10,.uneditable-input.span10{width:770px}input.span9,textarea.span9,.uneditable-input.span9{width:690px}input.span8,textarea.span8,.uneditable-input.span8{width:610px}input.span7,textarea.span7,.uneditable-input.span7{width:530px}input.span6,textarea.span6,.uneditable-input.span6{width:450px}input.span5,textarea.span5,.uneditable-input.span5{width:370px}input.span4,textarea.span4,.uneditable-input.span4{width:290px}input.span3,textarea.span3,.uneditable-input.span3{width:210px}input.span2,textarea.span2,.uneditable-input.span2{width:130px}input.span1,textarea.span1,.uneditable-input.span1{width:50px}input[disabled],select[disabled],textarea[disabled],input[readonly],select[readonly],textarea[readonly]{cursor:not-allowed;background-color:#eee;border-color:#ddd}input[type="radio"][disabled],input[type="checkbox"][disabled],input[type="radio"][readonly],input[type="checkbox"][readonly]{background-color:transparent}.control-group.warning>label,.control-group.warning .help-block,.control-group.warning .help-inline{color:#c09853}.control-group.warning input,.control-group.warning select,.control-group.warning textarea{color:#c09853;border-color:#c09853}.control-group.warning input:focus,.control-group.warning select:focus,.control-group.warning textarea:focus{border-color:#a47e3c;-webkit-box-shadow:0 0 6px #dbc59e;-moz-box-shadow:0 0 6px #dbc59e;box-shadow:0 0 6px #dbc59e}.control-group.warning .input-prepend .add-on,.control-group.warning .input-append .add-on{color:#c09853;background-color:#fcf8e3;border-color:#c09853}.control-group.error>label,.control-group.error .help-block,.control-group.error .help-inline{color:#b94a48}.control-group.error input,.control-group.error select,.control-group.error textarea{color:#b94a48;border-color:#b94a48}.control-group.error input:focus,.control-group.error select:focus,.control-group.error textarea:focus{border-color:#953b39;-webkit-box-shadow:0 0 6px #d59392;-moz-box-shadow:0 0 6px #d59392;box-shadow:0 0 6px #d59392}.control-group.error .input-prepend .add-on,.control-group.error .input-append .add-on{color:#b94a48;background-color:#f2dede;border-color:#b94a48}.control-group.success>label,.control-group.success .help-block,.control-group.success .help-inline{color:#468847}.control-group.success input,.control-group.success select,.control-group.success textarea{color:#468847;border-color:#468847}.control-group.success input:focus,.control-group.success select:focus,.control-group.success textarea:focus{border-color:#356635;-webkit-box-shadow:0 0 6px #7aba7b;-moz-box-shadow:0 0 6px #7aba7b;box-shadow:0 0 6px #7aba7b}.control-group.success .input-prepend .add-on,.control-group.success .input-append .add-on{color:#468847;background-color:#dff0d8;border-color:#468847}input:focus:required:invalid,textarea:focus:required:invalid,select:focus:required:invalid{color:#b94a48;border-color:#ee5f5b}input:focus:required:invalid:focus,textarea:focus:required:invalid:focus,select:focus:required:invalid:focus{border-color:#e9322d;-webkit-box-shadow:0 0 6px #f8b9b7;-moz-box-shadow:0 0 6px #f8b9b7;box-shadow:0 0 6px #f8b9b7}.form-actions{padding:17px 20px 18px;margin-top:18px;margin-bottom:18px;background-color:#f5f5f5;border-top:1px solid #ddd;*zoom:1}.form-actions:before,.form-actions:after{display:table;content:""}.form-actions:after{clear:both}.uneditable-input{overflow:hidden;white-space:nowrap;cursor:not-allowed;background-color:#fff;border-color:#eee;-webkit-box-shadow:inset 0 1px 2px rgba(0,0,0,0.025);-moz-box-shadow:inset 0 1px 2px rgba(0,0,0,0.025);box-shadow:inset 0 1px 2px rgba(0,0,0,0.025)}:-moz-placeholder{color:#999}::-webkit-input-placeholder{color:#999}.help-block,.help-inline{color:#555}.help-block{display:block;margin-bottom:9px}.help-inline{display:inline-block;*display:inline;padding-left:5px;vertical-align:middle;*zoom:1}.input-prepend,.input-append{margin-bottom:5px}.input-prepend input,.input-append input,.input-prepend select,.input-append select,.input-prepend .uneditable-input,.input-append .uneditable-input{position:relative;margin-bottom:0;*margin-left:0;vertical-align:middle;-webkit-border-radius:0 3px 3px 0;-moz-border-radius:0 3px 3px 0;border-radius:0 3px 3px 0}.input-prepend input:focus,.input-append input:focus,.input-prepend select:focus,.input-append select:focus,.input-prepend .uneditable-input:focus,.input-append .uneditable-input:focus{z-index:2}.input-prepend .uneditable-input,.input-append .uneditable-input{border-left-color:#ccc}.input-prepend .add-on,.input-append .add-on{display:inline-block;width:auto;height:18px;min-width:16px;padding:4px 5px;font-weight:normal;line-height:18px;text-align:center;text-shadow:0 1px 0 #fff;vertical-align:middle;background-color:#eee;border:1px solid #ccc}.input-prepend .add-on,.input-append .add-on,.input-prepend .btn,.input-append .btn{margin-left:-1px;-webkit-border-radius:0;-moz-border-radius:0;border-radius:0}.input-prepend .active,.input-append .active{background-color:#a9dba9;border-color:#46a546}.input-prepend .add-on,.input-prepend .btn{margin-right:-1px}.input-prepend .add-on:first-child,.input-prepend .btn:first-child{-webkit-border-radius:3px 0 0 3px;-moz-border-radius:3px 0 0 3px;border-radius:3px 0 0 3px}.input-append input,.input-append select,.input-append .uneditable-input{-webkit-border-radius:3px 0 0 3px;-moz-border-radius:3px 0 0 3px;border-radius:3px 0 0 3px}.input-append .uneditable-input{border-right-color:#ccc;border-left-color:#eee}.input-append .add-on:last-child,.input-append .btn:last-child{-webkit-border-radius:0 3px 3px 0;-moz-border-radius:0 3px 3px 0;border-radius:0 3px 3px 0}.input-prepend.input-append input,.input-prepend.input-append select,.input-prepend.input-append .uneditable-input{-webkit-border-radius:0;-moz-border-radius:0;border-radius:0}.input-prepend.input-append .add-on:first-child,.input-prepend.input-append .btn:first-child{margin-right:-1px;-webkit-border-radius:3px 0 0 3px;-moz-border-radius:3px 0 0 3px;border-radius:3px 0 0 3px}.input-prepend.input-append .add-on:last-child,.input-prepend.input-append .btn:last-child{margin-left:-1px;-webkit-border-radius:0 3px 3px 0;-moz-border-radius:0 3px 3px 0;border-radius:0 3px 3px 0}.search-query{padding-right:14px;padding-right:4px \9;padding-left:14px;padding-left:4px \9;margin-bottom:0;-webkit-border-radius:14px;-moz-border-radius:14px;border-radius:14px}.form-search input,.form-inline input,.form-horizontal input,.form-search textarea,.form-inline textarea,.form-horizontal textarea,.form-search select,.form-inline select,.form-horizontal select,.form-search .help-inline,.form-inline .help-inline,.form-horizontal .help-inline,.form-search .uneditable-input,.form-inline .uneditable-input,.form-horizontal .uneditable-input,.form-search .input-prepend,.form-inline .input-prepend,.form-horizontal .input-prepend,.form-search .input-append,.form-inline .input-append,.form-horizontal .input-append{display:inline-block;*display:inline;margin-bottom:0;*zoom:1}.form-search .hide,.form-inline .hide,.form-horizontal .hide{display:none}.form-search label,.form-inline label{display:inline-block}.form-search .input-append,.form-inline .input-append,.form-search .input-prepend,.form-inline .input-prepend{margin-bottom:0}.form-search .radio,.form-search .checkbox,.form-inline .radio,.form-inline .checkbox{padding-left:0;margin-bottom:0;vertical-align:middle}.form-search .radio input[type="radio"],.form-search .checkbox input[type="checkbox"],.form-inline .radio input[type="radio"],.form-inline .checkbox input[type="checkbox"]{float:left;margin-right:3px;margin-left:0}.control-group{margin-bottom:9px}legend+.control-group{margin-top:18px;-webkit-margin-top-collapse:separate}.form-horizontal .control-group{margin-bottom:18px;*zoom:1}.form-horizontal .control-group:before,.form-horizontal .control-group:after{display:table;content:""}.form-horizontal .control-group:after{clear:both}.form-horizontal .control-label{float:left;width:140px;padding-top:5px;text-align:right}.form-horizontal .controls{*display:inline-block;*padding-left:20px;margin-left:160px;*margin-left:0}.form-horizontal .controls:first-child{*padding-left:160px}.form-horizontal .help-block{margin-top:9px;margin-bottom:0}.form-horizontal .form-actions{padding-left:160px}table{max-width:100%;background-color:transparent;border-collapse:collapse;border-spacing:0}.table{width:100%;margin-bottom:18px}.table th,.table td{padding:8px;line-height:18px;text-align:left;vertical-align:top;border-top:1px solid #ddd}.table th{font-weight:bold}.table thead th{vertical-align:bottom}.table caption+thead tr:first-child th,.table caption+thead tr:first-child td,.table colgroup+thead tr:first-child th,.table colgroup+thead tr:first-child td,.table thead:first-child tr:first-child th,.table thead:first-child tr:first-child td{border-top:0}.table tbody+tbody{border-top:2px solid #ddd}.table-condensed th,.table-condensed td{padding:4px 5px}.table-bordered{border:1px solid #ddd;border-collapse:separate;*border-collapse:collapsed;border-left:0;-webkit-border-radius:4px;-moz-border-radius:4px;border-radius:4px}.table-bordered th,.table-bordered td{border-left:1px solid #ddd}.table-bordered caption+thead tr:first-child th,.table-bordered caption+tbody tr:first-child th,.table-bordered caption+tbody tr:first-child td,.table-bordered colgroup+thead tr:first-child th,.table-bordered colgroup+tbody tr:first-child th,.table-bordered colgroup+tbody tr:first-child td,.table-bordered thead:first-child tr:first-child th,.table-bordered tbody:first-child tr:first-child th,.table-bordered tbody:first-child tr:first-child td{border-top:0}.table-bordered thead:first-child tr:first-child th:first-child,.table-bordered tbody:first-child tr:first-child td:first-child{-webkit-border-top-left-radius:4px;border-top-left-radius:4px;-moz-border-radius-topleft:4px}.table-bordered thead:first-child tr:first-child th:last-child,.table-bordered tbody:first-child tr:first-child td:last-child{-webkit-border-top-right-radius:4px;border-top-right-radius:4px;-moz-border-radius-topright:4px}.table-bordered thead:last-child tr:last-child th:first-child,.table-bordered tbody:last-child tr:last-child td:first-child{-webkit-border-radius:0 0 0 4px;-moz-border-radius:0 0 0 4px;border-radius:0 0 0 4px;-webkit-border-bottom-left-radius:4px;border-bottom-left-radius:4px;-moz-border-radius-bottomleft:4px}.table-bordered thead:last-child tr:last-child th:last-child,.table-bordered tbody:last-child tr:last-child td:last-child{-webkit-border-bottom-right-radius:4px;border-bottom-right-radius:4px;-moz-border-radius-bottomright:4px}.table-striped tbody tr:nth-child(odd) td,.table-striped tbody tr:nth-child(odd) th{background-color:#f9f9f9}.table tbody tr:hover td,.table tbody tr:hover th{background-color:#f5f5f5}table .span1{float:none;width:44px;margin-left:0}table .span2{float:none;width:124px;margin-left:0}table .span3{float:none;width:204px;margin-left:0}table .span4{float:none;width:284px;margin-left:0}table .span5{float:none;width:364px;margin-left:0}table .span6{float:none;width:444px;margin-left:0}table .span7{float:none;width:524px;margin-left:0}table .span8{float:none;width:604px;margin-left:0}table .span9{float:none;width:684px;margin-left:0}table .span10{float:none;width:764px;margin-left:0}table .span11{float:none;width:844px;margin-left:0}table .span12{float:none;width:924px;margin-left:0}table .span13{float:none;width:1004px;margin-left:0}table .span14{float:none;width:1084px;margin-left:0}table .span15{float:none;width:1164px;margin-left:0}table .span16{float:none;width:1244px;margin-left:0}table .span17{float:none;width:1324px;margin-left:0}table .span18{float:none;width:1404px;margin-left:0}table .span19{float:none;width:1484px;margin-left:0}table .span20{float:none;width:1564px;margin-left:0}table .span21{float:none;width:1644px;margin-left:0}table .span22{float:none;width:1724px;margin-left:0}table .span23{float:none;width:1804px;margin-left:0}table .span24{float:none;width:1884px;margin-left:0}[class^="icon-"],[class*=" icon-"]{display:inline-block;width:14px;height:14px;*margin-right:.3em;line-height:14px;vertical-align:text-top;background-image:url("../img/glyphicons-halflings.png");background-position:14px 14px;background-repeat:no-repeat}[class^="icon-"]:last-child,[class*=" icon-"]:last-child{*margin-left:0}.icon-white{background-image:url("../img/glyphicons-halflings-white.png")}.icon-glass{background-position:0 0}.icon-music{background-position:-24px 0}.icon-search{background-position:-48px 0}.icon-envelope{background-position:-72px 0}.icon-heart{background-position:-96px 0}.icon-star{background-position:-120px 0}.icon-star-empty{background-position:-144px 0}.icon-user{background-position:-168px 0}.icon-film{background-position:-192px 0}.icon-th-large{background-position:-216px 0}.icon-th{background-position:-240px 0}.icon-th-list{background-position:-264px 0}.icon-ok{background-position:-288px 0}.icon-remove{background-position:-312px 0}.icon-zoom-in{background-position:-336px 0}.icon-zoom-out{background-position:-360px 0}.icon-off{background-position:-384px 0}.icon-signal{background-position:-408px 0}.icon-cog{background-position:-432px 0}.icon-trash{background-position:-456px 0}.icon-home{background-position:0 -24px}.icon-file{background-position:-24px -24px}.icon-time{background-position:-48px -24px}.icon-road{background-position:-72px -24px}.icon-download-alt{background-position:-96px -24px}.icon-download{background-position:-120px -24px}.icon-upload{background-position:-144px -24px}.icon-inbox{background-position:-168px -24px}.icon-play-circle{background-position:-192px -24px}.icon-repeat{background-position:-216px -24px}.icon-refresh{background-position:-240px -24px}.icon-list-alt{background-position:-264px -24px}.icon-lock{background-position:-287px -24px}.icon-flag{background-position:-312px -24px}.icon-headphones{background-position:-336px -24px}.icon-volume-off{background-position:-360px -24px}.icon-volume-down{background-position:-384px -24px}.icon-volume-up{background-position:-408px -24px}.icon-qrcode{background-position:-432px -24px}.icon-barcode{background-position:-456px -24px}.icon-tag{background-position:0 -48px}.icon-tags{background-position:-25px -48px}.icon-book{background-position:-48px -48px}.icon-bookmark{background-position:-72px -48px}.icon-print{background-position:-96px -48px}.icon-camera{background-position:-120px -48px}.icon-font{background-position:-144px -48px}.icon-bold{background-position:-167px -48px}.icon-italic{background-position:-192px -48px}.icon-text-height{background-position:-216px -48px}.icon-text-width{background-position:-240px -48px}.icon-align-left{background-position:-264px -48px}.icon-align-center{background-position:-288px -48px}.icon-align-right{background-position:-312px -48px}.icon-align-justify{background-position:-336px -48px}.icon-list{background-position:-360px -48px}.icon-indent-left{background-position:-384px -48px}.icon-indent-right{background-position:-408px -48px}.icon-facetime-video{background-position:-432px -48px}.icon-picture{background-position:-456px -48px}.icon-pencil{background-position:0 -72px}.icon-map-marker{background-position:-24px -72px}.icon-adjust{background-position:-48px -72px}.icon-tint{background-position:-72px -72px}.icon-edit{background-position:-96px -72px}.icon-share{background-position:-120px -72px}.icon-check{background-position:-144px -72px}.icon-move{background-position:-168px -72px}.icon-step-backward{background-position:-192px -72px}.icon-fast-backward{background-position:-216px -72px}.icon-backward{background-position:-240px -72px}.icon-play{background-position:-264px -72px}.icon-pause{background-position:-288px -72px}.icon-stop{background-position:-312px -72px}.icon-forward{background-position:-336px -72px}.icon-fast-forward{background-position:-360px -72px}.icon-step-forward{background-position:-384px -72px}.icon-eject{background-position:-408px -72px}.icon-chevron-left{background-position:-432px -72px}.icon-chevron-right{background-position:-456px -72px}.icon-plus-sign{background-position:0 -96px}.icon-minus-sign{background-position:-24px -96px}.icon-remove-sign{background-position:-48px -96px}.icon-ok-sign{background-position:-72px -96px}.icon-question-sign{background-position:-96px -96px}.icon-info-sign{background-position:-120px -96px}.icon-screenshot{background-position:-144px -96px}.icon-remove-circle{background-position:-168px -96px}.icon-ok-circle{background-position:-192px -96px}.icon-ban-circle{background-position:-216px -96px}.icon-arrow-left{background-position:-240px -96px}.icon-arrow-right{background-position:-264px -96px}.icon-arrow-up{background-position:-289px -96px}.icon-arrow-down{background-position:-312px -96px}.icon-share-alt{background-position:-336px -96px}.icon-resize-full{background-position:-360px -96px}.icon-resize-small{background-position:-384px -96px}.icon-plus{background-position:-408px -96px}.icon-minus{background-position:-433px -96px}.icon-asterisk{background-position:-456px -96px}.icon-exclamation-sign{background-position:0 -120px}.icon-gift{background-position:-24px -120px}.icon-leaf{background-position:-48px -120px}.icon-fire{background-position:-72px -120px}.icon-eye-open{background-position:-96px -120px}.icon-eye-close{background-position:-120px -120px}.icon-warning-sign{background-position:-144px -120px}.icon-plane{background-position:-168px -120px}.icon-calendar{background-position:-192px -120px}.icon-random{background-position:-216px -120px}.icon-comment{background-position:-240px -120px}.icon-magnet{background-position:-264px -120px}.icon-chevron-up{background-position:-288px -120px}.icon-chevron-down{background-position:-313px -119px}.icon-retweet{background-position:-336px -120px}.icon-shopping-cart{background-position:-360px -120px}.icon-folder-close{background-position:-384px -120px}.icon-folder-open{background-position:-408px -120px}.icon-resize-vertical{background-position:-432px -119px}.icon-resize-horizontal{background-position:-456px -118px}.icon-hdd{background-position:0 -144px}.icon-bullhorn{background-position:-24px -144px}.icon-bell{background-position:-48px -144px}.icon-certificate{background-position:-72px -144px}.icon-thumbs-up{background-position:-96px -144px}.icon-thumbs-down{background-position:-120px -144px}.icon-hand-right{background-position:-144px -144px}.icon-hand-left{background-position:-168px -144px}.icon-hand-up{background-position:-192px -144px}.icon-hand-down{background-position:-216px -144px}.icon-circle-arrow-right{background-position:-240px -144px}.icon-circle-arrow-left{background-position:-264px -144px}.icon-circle-arrow-up{background-position:-288px -144px}.icon-circle-arrow-down{background-position:-312px -144px}.icon-globe{background-position:-336px -144px}.icon-wrench{background-position:-360px -144px}.icon-tasks{background-position:-384px -144px}.icon-filter{background-position:-408px -144px}.icon-briefcase{background-position:-432px -144px}.icon-fullscreen{background-position:-456px -144px}.dropup,.dropdown{position:relative}.dropdown-toggle{*margin-bottom:-3px}.dropdown-toggle:active,.open .dropdown-toggle{outline:0}.caret{display:inline-block;width:0;height:0;vertical-align:top;border-top:4px solid #000;border-right:4px solid transparent;border-left:4px solid transparent;content:"";opacity:.3;filter:alpha(opacity=30)}.dropdown .caret{margin-top:8px;margin-left:2px}.dropdown:hover .caret,.open .caret{opacity:1;filter:alpha(opacity=100)}.dropdown-menu{position:absolute;top:100%;left:0;z-index:1000;display:none;float:left;min-width:160px;padding:4px 0;margin:1px 0 0;list-style:none;background-color:#fff;border:1px solid #ccc;border:1px solid rgba(0,0,0,0.2);*border-right-width:2px;*border-bottom-width:2px;-webkit-border-radius:5px;-moz-border-radius:5px;border-radius:5px;-webkit-box-shadow:0 5px 10px rgba(0,0,0,0.2);-moz-box-shadow:0 5px 10px rgba(0,0,0,0.2);box-shadow:0 5px 10px rgba(0,0,0,0.2);-webkit-background-clip:padding-box;-moz-background-clip:padding;background-clip:padding-box}.dropdown-menu.pull-right{right:0;left:auto}.dropdown-menu .divider{*width:100%;height:1px;margin:8px 1px;*margin:-5px 0 5px;overflow:hidden;background-color:#e5e5e5;border-bottom:1px solid #fff}.dropdown-menu a{display:block;padding:3px 15px;clear:both;font-weight:normal;line-height:18px;color:#333;white-space:nowrap}.dropdown-menu li>a:hover,.dropdown-menu .active>a,.dropdown-menu .active>a:hover{color:#fff;text-decoration:none;background-color:#08c}.open{*z-index:1000}.open .dropdown-menu{display:block}.pull-right .dropdown-menu{right:0;left:auto}.dropup .caret,.navbar-fixed-bottom .dropdown .caret{border-top:0;border-bottom:4px solid #000;content:"\2191"}.dropup .dropdown-menu,.navbar-fixed-bottom .dropdown .dropdown-menu{top:auto;bottom:100%;margin-bottom:1px}.typeahead{margin-top:2px;-webkit-border-radius:4px;-moz-border-radius:4px;border-radius:4px}.well{min-height:20px;padding:19px;margin-bottom:20px;background-color:#f5f5f5;border:1px solid #eee;border:1px solid rgba(0,0,0,0.05);-webkit-border-radius:4px;-moz-border-radius:4px;border-radius:4px;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.05);-moz-box-shadow:inset 0 1px 1px rgba(0,0,0,0.05);box-shadow:inset 0 1px 1px rgba(0,0,0,0.05)}.well blockquote{border-color:#ddd;border-color:rgba(0,0,0,0.15)}.well-large{padding:24px;-webkit-border-radius:6px;-moz-border-radius:6px;border-radius:6px}.well-small{padding:9px;-webkit-border-radius:3px;-moz-border-radius:3px;border-radius:3px}.fade{opacity:0;filter:alpha(opacity=0);-webkit-transition:opacity .15s linear;-moz-transition:opacity .15s linear;-ms-transition:opacity .15s linear;-o-transition:opacity .15s linear;transition:opacity .15s linear}.fade.in{opacity:1;filter:alpha(opacity=100)}.collapse{position:relative;height:0;overflow:hidden;-webkit-transition:height .35s ease;-moz-transition:height .35s ease;-ms-transition:height .35s ease;-o-transition:height .35s ease;transition:height .35s ease}.collapse.in{height:auto}.close{float:right;font-size:20px;font-weight:bold;line-height:18px;color:#000;text-shadow:0 1px 0 #fff;opacity:.2;filter:alpha(opacity=20)}.close:hover{color:#000;text-decoration:none;cursor:pointer;opacity:.4;filter:alpha(opacity=40)}button.close{padding:0;cursor:pointer;background:transparent;border:0;-webkit-appearance:none}.btn{display:inline-block;*display:inline;padding:4px 10px 4px;margin-bottom:0;*margin-left:.3em;font-size:13px;line-height:18px;*line-height:20px;color:#333;text-align:center;text-shadow:0 1px 1px rgba(255,255,255,0.75);vertical-align:middle;cursor:pointer;background-color:#f5f5f5;*background-color:#e6e6e6;background-image:-ms-linear-gradient(top,#fff,#e6e6e6);background-image:-webkit-gradient(linear,0 0,0 100%,from(#fff),to(#e6e6e6));background-image:-webkit-linear-gradient(top,#fff,#e6e6e6);background-image:-o-linear-gradient(top,#fff,#e6e6e6);background-image:linear-gradient(top,#fff,#e6e6e6);background-image:-moz-linear-gradient(top,#fff,#e6e6e6);background-repeat:repeat-x;border:1px solid #ccc;*border:0;border-color:rgba(0,0,0,0.1) rgba(0,0,0,0.1) rgba(0,0,0,0.25);border-color:#e6e6e6 #e6e6e6 #bfbfbf;border-bottom-color:#b3b3b3;-webkit-border-radius:4px;-moz-border-radius:4px;border-radius:4px;filter:progid:dximagetransform.microsoft.gradient(startColorstr='#ffffff',endColorstr='#e6e6e6',GradientType=0);filter:progid:dximagetransform.microsoft.gradient(enabled=false);*zoom:1;-webkit-box-shadow:inset 0 1px 0 rgba(255,255,255,0.2),0 1px 2px rgba(0,0,0,0.05);-moz-box-shadow:inset 0 1px 0 rgba(255,255,255,0.2),0 1px 2px rgba(0,0,0,0.05);box-shadow:inset 0 1px 0 rgba(255,255,255,0.2),0 1px 2px rgba(0,0,0,0.05)}.btn:hover,.btn:active,.btn.active,.btn.disabled,.btn[disabled]{background-color:#e6e6e6;*background-color:#d9d9d9}.btn:active,.btn.active{background-color:#ccc \9}.btn:first-child{*margin-left:0}.btn:hover{color:#333;text-decoration:none;background-color:#e6e6e6;*background-color:#d9d9d9;background-position:0 -15px;-webkit-transition:background-position .1s linear;-moz-transition:background-position .1s linear;-ms-transition:background-position .1s linear;-o-transition:background-position .1s linear;transition:background-position .1s linear}.btn:focus{outline:thin dotted #333;outline:5px auto -webkit-focus-ring-color;outline-offset:-2px}.btn.active,.btn:active{background-color:#e6e6e6;background-color:#d9d9d9 \9;background-image:none;outline:0;-webkit-box-shadow:inset 0 2px 4px rgba(0,0,0,0.15),0 1px 2px rgba(0,0,0,0.05);-moz-box-shadow:inset 0 2px 4px rgba(0,0,0,0.15),0 1px 2px rgba(0,0,0,0.05);box-shadow:inset 0 2px 4px rgba(0,0,0,0.15),0 1px 2px rgba(0,0,0,0.05)}.btn.disabled,.btn[disabled]{cursor:default;background-color:#e6e6e6;background-image:none;opacity:.65;filter:alpha(opacity=65);-webkit-box-shadow:none;-moz-box-shadow:none;box-shadow:none}.btn-large{padding:9px 14px;font-size:15px;line-height:normal;-webkit-border-radius:5px;-moz-border-radius:5px;border-radius:5px}.btn-large [class^="icon-"]{margin-top:1px}.btn-small{padding:5px 9px;font-size:11px;line-height:16px}.btn-small [class^="icon-"]{margin-top:-1px}.btn-mini{padding:2px 6px;font-size:11px;line-height:14px}.btn-primary,.btn-primary:hover,.btn-warning,.btn-warning:hover,.btn-danger,.btn-danger:hover,.btn-success,.btn-success:hover,.btn-info,.btn-info:hover,.btn-inverse,.btn-inverse:hover{color:#fff;text-shadow:0 -1px 0 rgba(0,0,0,0.25)}.btn-primary.active,.btn-warning.active,.btn-danger.active,.btn-success.active,.btn-info.active,.btn-inverse.active{color:rgba(255,255,255,0.75)}.btn{border-color:#ccc;border-color:rgba(0,0,0,0.1) rgba(0,0,0,0.1) rgba(0,0,0,0.25)}.btn-primary{background-color:#0074cc;*background-color:#05c;background-image:-ms-linear-gradient(top,#08c,#05c);background-image:-webkit-gradient(linear,0 0,0 100%,from(#08c),to(#05c));background-image:-webkit-linear-gradient(top,#08c,#05c);background-image:-o-linear-gradient(top,#08c,#05c);background-image:-moz-linear-gradient(top,#08c,#05c);background-image:linear-gradient(top,#08c,#05c);background-repeat:repeat-x;border-color:#05c #05c #003580;border-color:rgba(0,0,0,0.1) rgba(0,0,0,0.1) rgba(0,0,0,0.25);filter:progid:dximagetransform.microsoft.gradient(startColorstr='#0088cc',endColorstr='#0055cc',GradientType=0);filter:progid:dximagetransform.microsoft.gradient(enabled=false)}.btn-primary:hover,.btn-primary:active,.btn-primary.active,.btn-primary.disabled,.btn-primary[disabled]{background-color:#05c;*background-color:#004ab3}.btn-primary:active,.btn-primary.active{background-color:#004099 \9}.btn-warning{background-color:#faa732;*background-color:#f89406;background-image:-ms-linear-gradient(top,#fbb450,#f89406);background-image:-webkit-gradient(linear,0 0,0 100%,from(#fbb450),to(#f89406));background-image:-webkit-linear-gradient(top,#fbb450,#f89406);background-image:-o-linear-gradient(top,#fbb450,#f89406);background-image:-moz-linear-gradient(top,#fbb450,#f89406);background-image:linear-gradient(top,#fbb450,#f89406);background-repeat:repeat-x;border-color:#f89406 #f89406 #ad6704;border-color:rgba(0,0,0,0.1) rgba(0,0,0,0.1) rgba(0,0,0,0.25);filter:progid:dximagetransform.microsoft.gradient(startColorstr='#fbb450',endColorstr='#f89406',GradientType=0);filter:progid:dximagetransform.microsoft.gradient(enabled=false)}.btn-warning:hover,.btn-warning:active,.btn-warning.active,.btn-warning.disabled,.btn-warning[disabled]{background-color:#f89406;*background-color:#df8505}.btn-warning:active,.btn-warning.active{background-color:#c67605 \9}.btn-danger{background-color:#da4f49;*background-color:#bd362f;background-image:-ms-linear-gradient(top,#ee5f5b,#bd362f);background-image:-webkit-gradient(linear,0 0,0 100%,from(#ee5f5b),to(#bd362f));background-image:-webkit-linear-gradient(top,#ee5f5b,#bd362f);background-image:-o-linear-gradient(top,#ee5f5b,#bd362f);background-image:-moz-linear-gradient(top,#ee5f5b,#bd362f);background-image:linear-gradient(top,#ee5f5b,#bd362f);background-repeat:repeat-x;border-color:#bd362f #bd362f #802420;border-color:rgba(0,0,0,0.1) rgba(0,0,0,0.1) rgba(0,0,0,0.25);filter:progid:dximagetransform.microsoft.gradient(startColorstr='#ee5f5b',endColorstr='#bd362f',GradientType=0);filter:progid:dximagetransform.microsoft.gradient(enabled=false)}.btn-danger:hover,.btn-danger:active,.btn-danger.active,.btn-danger.disabled,.btn-danger[disabled]{background-color:#bd362f;*background-color:#a9302a}.btn-danger:active,.btn-danger.active{background-color:#942a25 \9}.btn-success{background-color:#5bb75b;*background-color:#51a351;background-image:-ms-linear-gradient(top,#62c462,#51a351);background-image:-webkit-gradient(linear,0 0,0 100%,from(#62c462),to(#51a351));background-image:-webkit-linear-gradient(top,#62c462,#51a351);background-image:-o-linear-gradient(top,#62c462,#51a351);background-image:-moz-linear-gradient(top,#62c462,#51a351);background-image:linear-gradient(top,#62c462,#51a351);background-repeat:repeat-x;border-color:#51a351 #51a351 #387038;border-color:rgba(0,0,0,0.1) rgba(0,0,0,0.1) rgba(0,0,0,0.25);filter:progid:dximagetransform.microsoft.gradient(startColorstr='#62c462',endColorstr='#51a351',GradientType=0);filter:progid:dximagetransform.microsoft.gradient(enabled=false)}.btn-success:hover,.btn-success:active,.btn-success.active,.btn-success.disabled,.btn-success[disabled]{background-color:#51a351;*background-color:#499249}.btn-success:active,.btn-success.active{background-color:#408140 \9}.btn-info{background-color:#49afcd;*background-color:#2f96b4;background-image:-ms-linear-gradient(top,#5bc0de,#2f96b4);background-image:-webkit-gradient(linear,0 0,0 100%,from(#5bc0de),to(#2f96b4));background-image:-webkit-linear-gradient(top,#5bc0de,#2f96b4);background-image:-o-linear-gradient(top,#5bc0de,#2f96b4);background-image:-moz-linear-gradient(top,#5bc0de,#2f96b4);background-image:linear-gradient(top,#5bc0de,#2f96b4);background-repeat:repeat-x;border-color:#2f96b4 #2f96b4 #1f6377;border-color:rgba(0,0,0,0.1) rgba(0,0,0,0.1) rgba(0,0,0,0.25);filter:progid:dximagetransform.microsoft.gradient(startColorstr='#5bc0de',endColorstr='#2f96b4',GradientType=0);filter:progid:dximagetransform.microsoft.gradient(enabled=false)}.btn-info:hover,.btn-info:active,.btn-info.active,.btn-info.disabled,.btn-info[disabled]{background-color:#2f96b4;*background-color:#2a85a0}.btn-info:active,.btn-info.active{background-color:#24748c \9}.btn-inverse{background-color:#414141;*background-color:#222;background-image:-ms-linear-gradient(top,#555,#222);background-image:-webkit-gradient(linear,0 0,0 100%,from(#555),to(#222));background-image:-webkit-linear-gradient(top,#555,#222);background-image:-o-linear-gradient(top,#555,#222);background-image:-moz-linear-gradient(top,#555,#222);background-image:linear-gradient(top,#555,#222);background-repeat:repeat-x;border-color:#222 #222 #000;border-color:rgba(0,0,0,0.1) rgba(0,0,0,0.1) rgba(0,0,0,0.25);filter:progid:dximagetransform.microsoft.gradient(startColorstr='#555555',endColorstr='#222222',GradientType=0);filter:progid:dximagetransform.microsoft.gradient(enabled=false)}.btn-inverse:hover,.btn-inverse:active,.btn-inverse.active,.btn-inverse.disabled,.btn-inverse[disabled]{background-color:#222;*background-color:#151515}.btn-inverse:active,.btn-inverse.active{background-color:#080808 \9}button.btn,input[type="submit"].btn{*padding-top:2px;*padding-bottom:2px}button.btn::-moz-focus-inner,input[type="submit"].btn::-moz-focus-inner{padding:0;border:0}button.btn.btn-large,input[type="submit"].btn.btn-large{*padding-top:7px;*padding-bottom:7px}button.btn.btn-small,input[type="submit"].btn.btn-small{*padding-top:3px;*padding-bottom:3px}button.btn.btn-mini,input[type="submit"].btn.btn-mini{*padding-top:1px;*padding-bottom:1px}.btn-group{position:relative;*margin-left:.3em;*zoom:1}.btn-group:before,.btn-group:after{display:table;content:""}.btn-group:after{clear:both}.btn-group:first-child{*margin-left:0}.btn-group+.btn-group{margin-left:5px}.btn-toolbar{margin-top:9px;margin-bottom:9px}.btn-toolbar .btn-group{display:inline-block;*display:inline;*zoom:1}.btn-group>.btn{position:relative;float:left;margin-left:-1px;-webkit-border-radius:0;-moz-border-radius:0;border-radius:0}.btn-group>.btn:first-child{margin-left:0;-webkit-border-bottom-left-radius:4px;border-bottom-left-radius:4px;-webkit-border-top-left-radius:4px;border-top-left-radius:4px;-moz-border-radius-bottomleft:4px;-moz-border-radius-topleft:4px}.btn-group>.btn:last-child,.btn-group>.dropdown-toggle{-webkit-border-top-right-radius:4px;border-top-right-radius:4px;-webkit-border-bottom-right-radius:4px;border-bottom-right-radius:4px;-moz-border-radius-topright:4px;-moz-border-radius-bottomright:4px}.btn-group>.btn.large:first-child{margin-left:0;-webkit-border-bottom-left-radius:6px;border-bottom-left-radius:6px;-webkit-border-top-left-radius:6px;border-top-left-radius:6px;-moz-border-radius-bottomleft:6px;-moz-border-radius-topleft:6px}.btn-group>.btn.large:last-child,.btn-group>.large.dropdown-toggle{-webkit-border-top-right-radius:6px;border-top-right-radius:6px;-webkit-border-bottom-right-radius:6px;border-bottom-right-radius:6px;-moz-border-radius-topright:6px;-moz-border-radius-bottomright:6px}.btn-group>.btn:hover,.btn-group>.btn:focus,.btn-group>.btn:active,.btn-group>.btn.active{z-index:2}.btn-group .dropdown-toggle:active,.btn-group.open .dropdown-toggle{outline:0}.btn-group>.dropdown-toggle{*padding-top:4px;padding-right:8px;*padding-bottom:4px;padding-left:8px;-webkit-box-shadow:inset 1px 0 0 rgba(255,255,255,0.125),inset 0 1px 0 rgba(255,255,255,0.2),0 1px 2px rgba(0,0,0,0.05);-moz-box-shadow:inset 1px 0 0 rgba(255,255,255,0.125),inset 0 1px 0 rgba(255,255,255,0.2),0 1px 2px rgba(0,0,0,0.05);box-shadow:inset 1px 0 0 rgba(255,255,255,0.125),inset 0 1px 0 rgba(255,255,255,0.2),0 1px 2px rgba(0,0,0,0.05)}.btn-group>.btn-mini.dropdown-toggle{padding-right:5px;padding-left:5px}.btn-group>.btn-small.dropdown-toggle{*padding-top:4px;*padding-bottom:4px}.btn-group>.btn-large.dropdown-toggle{padding-right:12px;padding-left:12px}.btn-group.open .dropdown-toggle{background-image:none;-webkit-box-shadow:inset 0 2px 4px rgba(0,0,0,0.15),0 1px 2px rgba(0,0,0,0.05);-moz-box-shadow:inset 0 2px 4px rgba(0,0,0,0.15),0 1px 2px rgba(0,0,0,0.05);box-shadow:inset 0 2px 4px rgba(0,0,0,0.15),0 1px 2px rgba(0,0,0,0.05)}.btn-group.open .btn.dropdown-toggle{background-color:#e6e6e6}.btn-group.open .btn-primary.dropdown-toggle{background-color:#05c}.btn-group.open .btn-warning.dropdown-toggle{background-color:#f89406}.btn-group.open .btn-danger.dropdown-toggle{background-color:#bd362f}.btn-group.open .btn-success.dropdown-toggle{background-color:#51a351}.btn-group.open .btn-info.dropdown-toggle{background-color:#2f96b4}.btn-group.open .btn-inverse.dropdown-toggle{background-color:#222}.btn .caret{margin-top:7px;margin-left:0}.btn:hover .caret,.open.btn-group .caret{opacity:1;filter:alpha(opacity=100)}.btn-mini .caret{margin-top:5px}.btn-small .caret{margin-top:6px}.btn-large .caret{margin-top:6px;border-top-width:5px;border-right-width:5px;border-left-width:5px}.dropup .btn-large .caret{border-top:0;border-bottom:5px solid #000}.btn-primary .caret,.btn-warning .caret,.btn-danger .caret,.btn-info .caret,.btn-success .caret,.btn-inverse .caret{border-top-color:#fff;border-bottom-color:#fff;opacity:.75;filter:alpha(opacity=75)}.alert{padding:8px 35px 8px 14px;margin-bottom:18px;color:#c09853;text-shadow:0 1px 0 rgba(255,255,255,0.5);background-color:#fcf8e3;border:1px solid #fbeed5;-webkit-border-radius:4px;-moz-border-radius:4px;border-radius:4px}.alert-heading{color:inherit}.alert .close{position:relative;top:-2px;right:-21px;line-height:18px}.alert-success{color:#468847;background-color:#dff0d8;border-color:#d6e9c6}.alert-danger,.alert-error{color:#b94a48;background-color:#f2dede;border-color:#eed3d7}.alert-info{color:#3a87ad;background-color:#d9edf7;border-color:#bce8f1}.alert-block{padding-top:14px;padding-bottom:14px}.alert-block>p,.alert-block>ul{margin-bottom:0}.alert-block p+p{margin-top:5px}.nav{margin-bottom:18px;margin-left:0;list-style:none}.nav>li>a{display:block}.nav>li>a:hover{text-decoration:none;background-color:#eee}.nav>.pull-right{float:right}.nav .nav-header{display:block;padding:3px 15px;font-size:11px;font-weight:bold;line-height:18px;color:#999;text-shadow:0 1px 0 rgba(255,255,255,0.5);text-transform:uppercase}.nav li+.nav-header{margin-top:9px}.nav-list{padding-right:15px;padding-left:15px;margin-bottom:0}.nav-list>li>a,.nav-list .nav-header{margin-right:-15px;margin-left:-15px;text-shadow:0 1px 0 rgba(255,255,255,0.5)}.nav-list>li>a{padding:3px 15px}.nav-list>.active>a,.nav-list>.active>a:hover{color:#fff;text-shadow:0 -1px 0 rgba(0,0,0,0.2);background-color:#08c}.nav-list [class^="icon-"]{margin-right:2px}.nav-list .divider{*width:100%;height:1px;margin:8px 1px;*margin:-5px 0 5px;overflow:hidden;background-color:#e5e5e5;border-bottom:1px solid #fff}.nav-tabs,.nav-pills{*zoom:1}.nav-tabs:before,.nav-pills:before,.nav-tabs:after,.nav-pills:after{display:table;content:""}.nav-tabs:after,.nav-pills:after{clear:both}.nav-tabs>li,.nav-pills>li{float:left}.nav-tabs>li>a,.nav-pills>li>a{padding-right:12px;padding-left:12px;margin-right:2px;line-height:14px}.nav-tabs{border-bottom:1px solid #ddd}.nav-tabs>li{margin-bottom:-1px}.nav-tabs>li>a{padding-top:8px;padding-bottom:8px;line-height:18px;border:1px solid transparent;-webkit-border-radius:4px 4px 0 0;-moz-border-radius:4px 4px 0 0;border-radius:4px 4px 0 0}.nav-tabs>li>a:hover{border-color:#eee #eee #ddd}.nav-tabs>.active>a,.nav-tabs>.active>a:hover{color:#555;cursor:default;background-color:#fff;border:1px solid #ddd;border-bottom-color:transparent}.nav-pills>li>a{padding-top:8px;padding-bottom:8px;margin-top:2px;margin-bottom:2px;-webkit-border-radius:5px;-moz-border-radius:5px;border-radius:5px}.nav-pills>.active>a,.nav-pills>.active>a:hover{color:#fff;background-color:#08c}.nav-stacked>li{float:none}.nav-stacked>li>a{margin-right:0}.nav-tabs.nav-stacked{border-bottom:0}.nav-tabs.nav-stacked>li>a{border:1px solid #ddd;-webkit-border-radius:0;-moz-border-radius:0;border-radius:0}.nav-tabs.nav-stacked>li:first-child>a{-webkit-border-radius:4px 4px 0 0;-moz-border-radius:4px 4px 0 0;border-radius:4px 4px 0 0}.nav-tabs.nav-stacked>li:last-child>a{-webkit-border-radius:0 0 4px 4px;-moz-border-radius:0 0 4px 4px;border-radius:0 0 4px 4px}.nav-tabs.nav-stacked>li>a:hover{z-index:2;border-color:#ddd}.nav-pills.nav-stacked>li>a{margin-bottom:3px}.nav-pills.nav-stacked>li:last-child>a{margin-bottom:1px}.nav-tabs .dropdown-menu{-webkit-border-radius:0 0 5px 5px;-moz-border-radius:0 0 5px 5px;border-radius:0 0 5px 5px}.nav-pills .dropdown-menu{-webkit-border-radius:4px;-moz-border-radius:4px;border-radius:4px}.nav-tabs .dropdown-toggle .caret,.nav-pills .dropdown-toggle .caret{margin-top:6px;border-top-color:#08c;border-bottom-color:#08c}.nav-tabs .dropdown-toggle:hover .caret,.nav-pills .dropdown-toggle:hover .caret{border-top-color:#005580;border-bottom-color:#005580}.nav-tabs .active .dropdown-toggle .caret,.nav-pills .active .dropdown-toggle .caret{border-top-color:#333;border-bottom-color:#333}.nav>.dropdown.active>a:hover{color:#000;cursor:pointer}.nav-tabs .open .dropdown-toggle,.nav-pills .open .dropdown-toggle,.nav>li.dropdown.open.active>a:hover{color:#fff;background-color:#999;border-color:#999}.nav li.dropdown.open .caret,.nav li.dropdown.open.active .caret,.nav li.dropdown.open a:hover .caret{border-top-color:#fff;border-bottom-color:#fff;opacity:1;filter:alpha(opacity=100)}.tabs-stacked .open>a:hover{border-color:#999}.tabbable{*zoom:1}.tabbable:before,.tabbable:after{display:table;content:""}.tabbable:after{clear:both}.tab-content{overflow:auto}.tabs-below>.nav-tabs,.tabs-right>.nav-tabs,.tabs-left>.nav-tabs{border-bottom:0}.tab-content>.tab-pane,.pill-content>.pill-pane{display:none}.tab-content>.active,.pill-content>.active{display:block}.tabs-below>.nav-tabs{border-top:1px solid #ddd}.tabs-below>.nav-tabs>li{margin-top:-1px;margin-bottom:0}.tabs-below>.nav-tabs>li>a{-webkit-border-radius:0 0 4px 4px;-moz-border-radius:0 0 4px 4px;border-radius:0 0 4px 4px}.tabs-below>.nav-tabs>li>a:hover{border-top-color:#ddd;border-bottom-color:transparent}.tabs-below>.nav-tabs>.active>a,.tabs-below>.nav-tabs>.active>a:hover{border-color:transparent #ddd #ddd #ddd}.tabs-left>.nav-tabs>li,.tabs-right>.nav-tabs>li{float:none}.tabs-left>.nav-tabs>li>a,.tabs-right>.nav-tabs>li>a{min-width:74px;margin-right:0;margin-bottom:3px}.tabs-left>.nav-tabs{float:left;margin-right:19px;border-right:1px solid #ddd}.tabs-left>.nav-tabs>li>a{margin-right:-1px;-webkit-border-radius:4px 0 0 4px;-moz-border-radius:4px 0 0 4px;border-radius:4px 0 0 4px}.tabs-left>.nav-tabs>li>a:hover{border-color:#eee #ddd #eee #eee}.tabs-left>.nav-tabs .active>a,.tabs-left>.nav-tabs .active>a:hover{border-color:#ddd transparent #ddd #ddd;*border-right-color:#fff}.tabs-right>.nav-tabs{float:right;margin-left:19px;border-left:1px solid #ddd}.tabs-right>.nav-tabs>li>a{margin-left:-1px;-webkit-border-radius:0 4px 4px 0;-moz-border-radius:0 4px 4px 0;border-radius:0 4px 4px 0}.tabs-right>.nav-tabs>li>a:hover{border-color:#eee #eee #eee #ddd}.tabs-right>.nav-tabs .active>a,.tabs-right>.nav-tabs .active>a:hover{border-color:#ddd #ddd #ddd transparent;*border-left-color:#fff}.navbar{*position:relative;*z-index:2;margin-bottom:18px;overflow:visible}.navbar-inner{min-height:40px;padding-right:20px;padding-left:20px;background-color:#2c2c2c;background-image:-moz-linear-gradient(top,#333,#222);background-image:-ms-linear-gradient(top,#333,#222);background-image:-webkit-gradient(linear,0 0,0 100%,from(#333),to(#222));background-image:-webkit-linear-gradient(top,#333,#222);background-image:-o-linear-gradient(top,#333,#222);background-image:linear-gradient(top,#333,#222);background-repeat:repeat-x;-webkit-border-radius:4px;-moz-border-radius:4px;border-radius:4px;filter:progid:dximagetransform.microsoft.gradient(startColorstr='#333333',endColorstr='#222222',GradientType=0);-webkit-box-shadow:0 1px 3px rgba(0,0,0,0.25),inset 0 -1px 0 rgba(0,0,0,0.1);-moz-box-shadow:0 1px 3px rgba(0,0,0,0.25),inset 0 -1px 0 rgba(0,0,0,0.1);box-shadow:0 1px 3px rgba(0,0,0,0.25),inset 0 -1px 0 rgba(0,0,0,0.1)}.navbar .container{width:auto}.nav-collapse.collapse{height:auto}.navbar{color:#999}.navbar .brand:hover{text-decoration:none}.navbar .brand{display:block;float:left;padding:8px 20px 12px;margin-left:-20px;font-size:20px;font-weight:200;line-height:1;color:#999}.navbar .navbar-text{margin-bottom:0;line-height:40px}.navbar .navbar-link{color:#999}.navbar .navbar-link:hover{color:#fff}.navbar .btn,.navbar .btn-group{margin-top:5px}.navbar .btn-group .btn{margin:0}.navbar-form{margin-bottom:0;*zoom:1}.navbar-form:before,.navbar-form:after{display:table;content:""}.navbar-form:after{clear:both}.navbar-form input,.navbar-form select,.navbar-form .radio,.navbar-form .checkbox{margin-top:5px}.navbar-form input,.navbar-form select{display:inline-block;margin-bottom:0}.navbar-form input[type="image"],.navbar-form input[type="checkbox"],.navbar-form input[type="radio"]{margin-top:3px}.navbar-form .input-append,.navbar-form .input-prepend{margin-top:6px;white-space:nowrap}.navbar-form .input-append input,.navbar-form .input-prepend input{margin-top:0}.navbar-search{position:relative;float:left;margin-top:6px;margin-bottom:0}.navbar-search .search-query{padding:4px 9px;font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px;font-weight:normal;line-height:1;color:#fff;background-color:#626262;border:1px solid #151515;-webkit-box-shadow:inset 0 1px 2px rgba(0,0,0,0.1),0 1px 0 rgba(255,255,255,0.15);-moz-box-shadow:inset 0 1px 2px rgba(0,0,0,0.1),0 1px 0 rgba(255,255,255,0.15);box-shadow:inset 0 1px 2px rgba(0,0,0,0.1),0 1px 0 rgba(255,255,255,0.15);-webkit-transition:none;-moz-transition:none;-ms-transition:none;-o-transition:none;transition:none}.navbar-search .search-query:-moz-placeholder{color:#ccc}.navbar-search .search-query::-webkit-input-placeholder{color:#ccc}.navbar-search .search-query:focus,.navbar-search .search-query.focused{padding:5px 10px;color:#333;text-shadow:0 1px 0 #fff;background-color:#fff;border:0;outline:0;-webkit-box-shadow:0 0 3px rgba(0,0,0,0.15);-moz-box-shadow:0 0 3px rgba(0,0,0,0.15);box-shadow:0 0 3px rgba(0,0,0,0.15)}.navbar-fixed-top,.navbar-fixed-bottom{position:fixed;right:0;left:0;z-index:1030;margin-bottom:0}.navbar-fixed-top .navbar-inner,.navbar-fixed-bottom .navbar-inner{padding-right:0;padding-left:0;-webkit-border-radius:0;-moz-border-radius:0;border-radius:0}.navbar-fixed-top .container,.navbar-fixed-bottom .container{width:940px}.navbar-fixed-top{top:0}.navbar-fixed-bottom{bottom:0}.navbar .nav{position:relative;left:0;display:block;float:left;margin:0 10px 0 0}.navbar .nav.pull-right{float:right}.navbar .nav>li{display:block;float:left}.navbar .nav>li>a{float:none;padding:9px 10px 11px;line-height:19px;color:#999;text-decoration:none;text-shadow:0 -1px 0 rgba(0,0,0,0.25)}.navbar .btn{display:inline-block;padding:4px 10px 4px;margin:5px 5px 6px;line-height:18px}.navbar .btn-group{padding:5px 5px 6px;margin:0}.navbar .nav>li>a:hover{color:#fff;text-decoration:none;background-color:transparent}.navbar .nav .active>a,.navbar .nav .active>a:hover{color:#fff;text-decoration:none;background-color:#222}.navbar .divider-vertical{width:1px;height:40px;margin:0 9px;overflow:hidden;background-color:#222;border-right:1px solid #333}.navbar .nav.pull-right{margin-right:0;margin-left:10px}.navbar .btn-navbar{display:none;float:right;padding:7px 10px;margin-right:5px;margin-left:5px;background-color:#2c2c2c;*background-color:#222;background-image:-ms-linear-gradient(top,#333,#222);background-image:-webkit-gradient(linear,0 0,0 100%,from(#333),to(#222));background-image:-webkit-linear-gradient(top,#333,#222);background-image:-o-linear-gradient(top,#333,#222);background-image:linear-gradient(top,#333,#222);background-image:-moz-linear-gradient(top,#333,#222);background-repeat:repeat-x;border-color:#222 #222 #000;border-color:rgba(0,0,0,0.1) rgba(0,0,0,0.1) rgba(0,0,0,0.25);filter:progid:dximagetransform.microsoft.gradient(startColorstr='#333333',endColorstr='#222222',GradientType=0);filter:progid:dximagetransform.microsoft.gradient(enabled=false);-webkit-box-shadow:inset 0 1px 0 rgba(255,255,255,0.1),0 1px 0 rgba(255,255,255,0.075);-moz-box-shadow:inset 0 1px 0 rgba(255,255,255,0.1),0 1px 0 rgba(255,255,255,0.075);box-shadow:inset 0 1px 0 rgba(255,255,255,0.1),0 1px 0 rgba(255,255,255,0.075)}.navbar .btn-navbar:hover,.navbar .btn-navbar:active,.navbar .btn-navbar.active,.navbar .btn-navbar.disabled,.navbar .btn-navbar[disabled]{background-color:#222;*background-color:#151515}.navbar .btn-navbar:active,.navbar .btn-navbar.active{background-color:#080808 \9}.navbar .btn-navbar .icon-bar{display:block;width:18px;height:2px;background-color:#f5f5f5;-webkit-border-radius:1px;-moz-border-radius:1px;border-radius:1px;-webkit-box-shadow:0 1px 0 rgba(0,0,0,0.25);-moz-box-shadow:0 1px 0 rgba(0,0,0,0.25);box-shadow:0 1px 0 rgba(0,0,0,0.25)}.btn-navbar .icon-bar+.icon-bar{margin-top:3px}.navbar .dropdown-menu:before{position:absolute;top:-7px;left:9px;display:inline-block;border-right:7px solid transparent;border-bottom:7px solid #ccc;border-left:7px solid transparent;border-bottom-color:rgba(0,0,0,0.2);content:''}.navbar .dropdown-menu:after{position:absolute;top:-6px;left:10px;display:inline-block;border-right:6px solid transparent;border-bottom:6px solid #fff;border-left:6px solid transparent;content:''}.navbar-fixed-bottom .dropdown-menu:before{top:auto;bottom:-7px;border-top:7px solid #ccc;border-bottom:0;border-top-color:rgba(0,0,0,0.2)}.navbar-fixed-bottom .dropdown-menu:after{top:auto;bottom:-6px;border-top:6px solid #fff;border-bottom:0}.navbar .nav li.dropdown .dropdown-toggle .caret,.navbar .nav li.dropdown.open .caret{border-top-color:#fff;border-bottom-color:#fff}.navbar .nav li.dropdown.active .caret{opacity:1;filter:alpha(opacity=100)}.navbar .nav li.dropdown.open>.dropdown-toggle,.navbar .nav li.dropdown.active>.dropdown-toggle,.navbar .nav li.dropdown.open.active>.dropdown-toggle{background-color:transparent}.navbar .nav li.dropdown.active>.dropdown-toggle:hover{color:#fff}.navbar .pull-right .dropdown-menu,.navbar .dropdown-menu.pull-right{right:0;left:auto}.navbar .pull-right .dropdown-menu:before,.navbar .dropdown-menu.pull-right:before{right:12px;left:auto}.navbar .pull-right .dropdown-menu:after,.navbar .dropdown-menu.pull-right:after{right:13px;left:auto}.breadcrumb{padding:7px 14px;margin:0 0 18px;list-style:none;background-color:#fbfbfb;background-image:-moz-linear-gradient(top,#fff,#f5f5f5);background-image:-ms-linear-gradient(top,#fff,#f5f5f5);background-image:-webkit-gradient(linear,0 0,0 100%,from(#fff),to(#f5f5f5));background-image:-webkit-linear-gradient(top,#fff,#f5f5f5);background-image:-o-linear-gradient(top,#fff,#f5f5f5);background-image:linear-gradient(top,#fff,#f5f5f5);background-repeat:repeat-x;border:1px solid #ddd;-webkit-border-radius:3px;-moz-border-radius:3px;border-radius:3px;filter:progid:dximagetransform.microsoft.gradient(startColorstr='#ffffff',endColorstr='#f5f5f5',GradientType=0);-webkit-box-shadow:inset 0 1px 0 #fff;-moz-box-shadow:inset 0 1px 0 #fff;box-shadow:inset 0 1px 0 #fff}.breadcrumb li{display:inline-block;*display:inline;text-shadow:0 1px 0 #fff;*zoom:1}.breadcrumb .divider{padding:0 5px;color:#999}.breadcrumb .active a{color:#333}.pagination{height:36px;margin:18px 0}.pagination ul{display:inline-block;*display:inline;margin-bottom:0;margin-left:0;-webkit-border-radius:3px;-moz-border-radius:3px;border-radius:3px;*zoom:1;-webkit-box-shadow:0 1px 2px rgba(0,0,0,0.05);-moz-box-shadow:0 1px 2px rgba(0,0,0,0.05);box-shadow:0 1px 2px rgba(0,0,0,0.05)}.pagination li{display:inline}.pagination a{float:left;padding:0 14px;line-height:34px;text-decoration:none;border:1px solid #ddd;border-left-width:0}.pagination a:hover,.pagination .active a{background-color:#f5f5f5}.pagination .active a{color:#999;cursor:default}.pagination .disabled span,.pagination .disabled a,.pagination .disabled a:hover{color:#999;cursor:default;background-color:transparent}.pagination li:first-child a{border-left-width:1px;-webkit-border-radius:3px 0 0 3px;-moz-border-radius:3px 0 0 3px;border-radius:3px 0 0 3px}.pagination li:last-child a{-webkit-border-radius:0 3px 3px 0;-moz-border-radius:0 3px 3px 0;border-radius:0 3px 3px 0}.pagination-centered{text-align:center}.pagination-right{text-align:right}.pager{margin-bottom:18px;margin-left:0;text-align:center;list-style:none;*zoom:1}.pager:before,.pager:after{display:table;content:""}.pager:after{clear:both}.pager li{display:inline}.pager a{display:inline-block;padding:5px 14px;background-color:#fff;border:1px solid #ddd;-webkit-border-radius:15px;-moz-border-radius:15px;border-radius:15px}.pager a:hover{text-decoration:none;background-color:#f5f5f5}.pager .next a{float:right}.pager .previous a{float:left}.pager .disabled a,.pager .disabled a:hover{color:#999;cursor:default;background-color:#fff}.modal-open .dropdown-menu{z-index:2050}.modal-open .dropdown.open{*z-index:2050}.modal-open .popover{z-index:2060}.modal-open .tooltip{z-index:2070}.modal-backdrop{position:fixed;top:0;right:0;bottom:0;left:0;z-index:1040;background-color:#000}.modal-backdrop.fade{opacity:0}.modal-backdrop,.modal-backdrop.fade.in{opacity:.8;filter:alpha(opacity=80)}.modal{position:fixed;top:50%;left:50%;z-index:1050;width:560px;margin:-250px 0 0 -280px;overflow:auto;background-color:#fff;border:1px solid #999;border:1px solid rgba(0,0,0,0.3);*border:1px solid #999;-webkit-border-radius:6px;-moz-border-radius:6px;border-radius:6px;-webkit-box-shadow:0 3px 7px rgba(0,0,0,0.3);-moz-box-shadow:0 3px 7px rgba(0,0,0,0.3);box-shadow:0 3px 7px rgba(0,0,0,0.3);-webkit-background-clip:padding-box;-moz-background-clip:padding-box;background-clip:padding-box}.modal.fade{top:-25%;-webkit-transition:opacity .3s linear,top .3s ease-out;-moz-transition:opacity .3s linear,top .3s ease-out;-ms-transition:opacity .3s linear,top .3s ease-out;-o-transition:opacity .3s linear,top .3s ease-out;transition:opacity .3s linear,top .3s ease-out}.modal.fade.in{top:50%}.modal-header{padding:9px 15px;border-bottom:1px solid #eee}.modal-header .close{margin-top:2px}.modal-body{max-height:400px;padding:15px;overflow-y:auto}.modal-form{margin-bottom:0}.modal-footer{padding:14px 15px 15px;margin-bottom:0;text-align:right;background-color:#f5f5f5;border-top:1px solid #ddd;-webkit-border-radius:0 0 6px 6px;-moz-border-radius:0 0 6px 6px;border-radius:0 0 6px 6px;*zoom:1;-webkit-box-shadow:inset 0 1px 0 #fff;-moz-box-shadow:inset 0 1px 0 #fff;box-shadow:inset 0 1px 0 #fff}.modal-footer:before,.modal-footer:after{display:table;content:""}.modal-footer:after{clear:both}.modal-footer .btn+.btn{margin-bottom:0;margin-left:5px}.modal-footer .btn-group .btn+.btn{margin-left:-1px}.tooltip{position:absolute;z-index:1020;display:block;padding:5px;font-size:11px;opacity:0;filter:alpha(opacity=0);visibility:visible}.tooltip.in{opacity:.8;filter:alpha(opacity=80)}.tooltip.top{margin-top:-2px}.tooltip.right{margin-left:2px}.tooltip.bottom{margin-top:2px}.tooltip.left{margin-left:-2px}.tooltip.top .tooltip-arrow{bottom:0;left:50%;margin-left:-5px;border-top:5px solid #000;border-right:5px solid transparent;border-left:5px solid transparent}.tooltip.left .tooltip-arrow{top:50%;right:0;margin-top:-5px;border-top:5px solid transparent;border-bottom:5px solid transparent;border-left:5px solid #000}.tooltip.bottom .tooltip-arrow{top:0;left:50%;margin-left:-5px;border-right:5px solid transparent;border-bottom:5px solid #000;border-left:5px solid transparent}.tooltip.right .tooltip-arrow{top:50%;left:0;margin-top:-5px;border-top:5px solid transparent;border-right:5px solid #000;border-bottom:5px solid transparent}.tooltip-inner{max-width:200px;padding:3px 8px;color:#fff;text-align:center;text-decoration:none;background-color:#000;-webkit-border-radius:4px;-moz-border-radius:4px;border-radius:4px}.tooltip-arrow{position:absolute;width:0;height:0}.popover{position:absolute;top:0;left:0;z-index:1010;display:none;padding:5px}.popover.top{margin-top:-5px}.popover.right{margin-left:5px}.popover.bottom{margin-top:5px}.popover.left{margin-left:-5px}.popover.top .arrow{bottom:0;left:50%;margin-left:-5px;border-top:5px solid #000;border-right:5px solid transparent;border-left:5px solid transparent}.popover.right .arrow{top:50%;left:0;margin-top:-5px;border-top:5px solid transparent;border-right:5px solid #000;border-bottom:5px solid transparent}.popover.bottom .arrow{top:0;left:50%;margin-left:-5px;border-right:5px solid transparent;border-bottom:5px solid #000;border-left:5px solid transparent}.popover.left .arrow{top:50%;right:0;margin-top:-5px;border-top:5px solid transparent;border-bottom:5px solid transparent;border-left:5px solid #000}.popover .arrow{position:absolute;width:0;height:0}.popover-inner{width:280px;padding:3px;overflow:hidden;background:#000;background:rgba(0,0,0,0.8);-webkit-border-radius:6px;-moz-border-radius:6px;border-radius:6px;-webkit-box-shadow:0 3px 7px rgba(0,0,0,0.3);-moz-box-shadow:0 3px 7px rgba(0,0,0,0.3);box-shadow:0 3px 7px rgba(0,0,0,0.3)}.popover-title{padding:9px 15px;line-height:1;background-color:#f5f5f5;border-bottom:1px solid #eee;-webkit-border-radius:3px 3px 0 0;-moz-border-radius:3px 3px 0 0;border-radius:3px 3px 0 0}.popover-content{padding:14px;background-color:#fff;-webkit-border-radius:0 0 3px 3px;-moz-border-radius:0 0 3px 3px;border-radius:0 0 3px 3px;-webkit-background-clip:padding-box;-moz-background-clip:padding-box;background-clip:padding-box}.popover-content p,.popover-content ul,.popover-content ol{margin-bottom:0}.thumbnails{margin-left:-20px;list-style:none;*zoom:1}.thumbnails:before,.thumbnails:after{display:table;content:""}.thumbnails:after{clear:both}.row-fluid .thumbnails{margin-left:0}.thumbnails>li{float:left;margin-bottom:18px;margin-left:20px}.thumbnail{display:block;padding:4px;line-height:1;border:1px solid #ddd;-webkit-border-radius:4px;-moz-border-radius:4px;border-radius:4px;-webkit-box-shadow:0 1px 1px rgba(0,0,0,0.075);-moz-box-shadow:0 1px 1px rgba(0,0,0,0.075);box-shadow:0 1px 1px rgba(0,0,0,0.075)}a.thumbnail:hover{border-color:#08c;-webkit-box-shadow:0 1px 4px rgba(0,105,214,0.25);-moz-box-shadow:0 1px 4px rgba(0,105,214,0.25);box-shadow:0 1px 4px rgba(0,105,214,0.25)}.thumbnail>img{display:block;max-width:100%;margin-right:auto;margin-left:auto}.thumbnail .caption{padding:9px}.label,.badge{font-size:10.998px;font-weight:bold;line-height:14px;color:#fff;text-shadow:0 -1px 0 rgba(0,0,0,0.25);white-space:nowrap;vertical-align:baseline;background-color:#999}.label{padding:1px 4px 2px;-webkit-border-radius:3px;-moz-border-radius:3px;border-radius:3px}.badge{padding:1px 9px 2px;-webkit-border-radius:9px;-moz-border-radius:9px;border-radius:9px}a.label:hover,a.badge:hover{color:#fff;text-decoration:none;cursor:pointer}.label-important,.badge-important{background-color:#b94a48}.label-important[href],.badge-important[href]{background-color:#953b39}.label-warning,.badge-warning{background-color:#f89406}.label-warning[href],.badge-warning[href]{background-color:#c67605}.label-success,.badge-success{background-color:#468847}.label-success[href],.badge-success[href]{background-color:#356635}.label-info,.badge-info{background-color:#3a87ad}.label-info[href],.badge-info[href]{background-color:#2d6987}.label-inverse,.badge-inverse{background-color:#333}.label-inverse[href],.badge-inverse[href]{background-color:#1a1a1a}@-webkit-keyframes progress-bar-stripes{from{background-position:40px 0}to{background-position:0 0}}@-moz-keyframes progress-bar-stripes{from{background-position:40px 0}to{background-position:0 0}}@-ms-keyframes progress-bar-stripes{from{background-position:40px 0}to{background-position:0 0}}@-o-keyframes progress-bar-stripes{from{background-position:0 0}to{background-position:40px 0}}@keyframes progress-bar-stripes{from{background-position:40px 0}to{background-position:0 0}}.progress{height:18px;margin-bottom:18px;overflow:hidden;background-color:#f7f7f7;background-image:-moz-linear-gradient(top,#f5f5f5,#f9f9f9);background-image:-ms-linear-gradient(top,#f5f5f5,#f9f9f9);background-image:-webkit-gradient(linear,0 0,0 100%,from(#f5f5f5),to(#f9f9f9));background-image:-webkit-linear-gradient(top,#f5f5f5,#f9f9f9);background-image:-o-linear-gradient(top,#f5f5f5,#f9f9f9);background-image:linear-gradient(top,#f5f5f5,#f9f9f9);background-repeat:repeat-x;-webkit-border-radius:4px;-moz-border-radius:4px;border-radius:4px;filter:progid:dximagetransform.microsoft.gradient(startColorstr='#f5f5f5',endColorstr='#f9f9f9',GradientType=0);-webkit-box-shadow:inset 0 1px 2px rgba(0,0,0,0.1);-moz-box-shadow:inset 0 1px 2px rgba(0,0,0,0.1);box-shadow:inset 0 1px 2px rgba(0,0,0,0.1)}.progress .bar{width:0;height:18px;font-size:12px;color:#fff;text-align:center;text-shadow:0 -1px 0 rgba(0,0,0,0.25);background-color:#0e90d2;background-image:-moz-linear-gradient(top,#149bdf,#0480be);background-image:-webkit-gradient(linear,0 0,0 100%,from(#149bdf),to(#0480be));background-image:-webkit-linear-gradient(top,#149bdf,#0480be);background-image:-o-linear-gradient(top,#149bdf,#0480be);background-image:linear-gradient(top,#149bdf,#0480be);background-image:-ms-linear-gradient(top,#149bdf,#0480be);background-repeat:repeat-x;filter:progid:dximagetransform.microsoft.gradient(startColorstr='#149bdf',endColorstr='#0480be',GradientType=0);-webkit-box-shadow:inset 0 -1px 0 rgba(0,0,0,0.15);-moz-box-shadow:inset 0 -1px 0 rgba(0,0,0,0.15);box-shadow:inset 0 -1px 0 rgba(0,0,0,0.15);-webkit-box-sizing:border-box;-moz-box-sizing:border-box;-ms-box-sizing:border-box;box-sizing:border-box;-webkit-transition:width .6s ease;-moz-transition:width .6s ease;-ms-transition:width .6s ease;-o-transition:width .6s ease;transition:width .6s ease}.progress-striped .bar{background-color:#149bdf;background-image:-o-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-webkit-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-moz-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-ms-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-webkit-gradient(linear,0 100%,100% 0,color-stop(0.25,rgba(255,255,255,0.15)),color-stop(0.25,transparent),color-stop(0.5,transparent),color-stop(0.5,rgba(255,255,255,0.15)),color-stop(0.75,rgba(255,255,255,0.15)),color-stop(0.75,transparent),to(transparent));background-image:linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);-webkit-background-size:40px 40px;-moz-background-size:40px 40px;-o-background-size:40px 40px;background-size:40px 40px}.progress.active .bar{-webkit-animation:progress-bar-stripes 2s linear infinite;-moz-animation:progress-bar-stripes 2s linear infinite;-ms-animation:progress-bar-stripes 2s linear infinite;-o-animation:progress-bar-stripes 2s linear infinite;animation:progress-bar-stripes 2s linear infinite}.progress-danger .bar{background-color:#dd514c;background-image:-moz-linear-gradient(top,#ee5f5b,#c43c35);background-image:-ms-linear-gradient(top,#ee5f5b,#c43c35);background-image:-webkit-gradient(linear,0 0,0 100%,from(#ee5f5b),to(#c43c35));background-image:-webkit-linear-gradient(top,#ee5f5b,#c43c35);background-image:-o-linear-gradient(top,#ee5f5b,#c43c35);background-image:linear-gradient(top,#ee5f5b,#c43c35);background-repeat:repeat-x;filter:progid:dximagetransform.microsoft.gradient(startColorstr='#ee5f5b',endColorstr='#c43c35',GradientType=0)}.progress-danger.progress-striped .bar{background-color:#ee5f5b;background-image:-webkit-gradient(linear,0 100%,100% 0,color-stop(0.25,rgba(255,255,255,0.15)),color-stop(0.25,transparent),color-stop(0.5,transparent),color-stop(0.5,rgba(255,255,255,0.15)),color-stop(0.75,rgba(255,255,255,0.15)),color-stop(0.75,transparent),to(transparent));background-image:-webkit-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-moz-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-ms-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-o-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent)}.progress-success .bar{background-color:#5eb95e;background-image:-moz-linear-gradient(top,#62c462,#57a957);background-image:-ms-linear-gradient(top,#62c462,#57a957);background-image:-webkit-gradient(linear,0 0,0 100%,from(#62c462),to(#57a957));background-image:-webkit-linear-gradient(top,#62c462,#57a957);background-image:-o-linear-gradient(top,#62c462,#57a957);background-image:linear-gradient(top,#62c462,#57a957);background-repeat:repeat-x;filter:progid:dximagetransform.microsoft.gradient(startColorstr='#62c462',endColorstr='#57a957',GradientType=0)}.progress-success.progress-striped .bar{background-color:#62c462;background-image:-webkit-gradient(linear,0 100%,100% 0,color-stop(0.25,rgba(255,255,255,0.15)),color-stop(0.25,transparent),color-stop(0.5,transparent),color-stop(0.5,rgba(255,255,255,0.15)),color-stop(0.75,rgba(255,255,255,0.15)),color-stop(0.75,transparent),to(transparent));background-image:-webkit-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-moz-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-ms-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-o-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent)}.progress-info .bar{background-color:#4bb1cf;background-image:-moz-linear-gradient(top,#5bc0de,#339bb9);background-image:-ms-linear-gradient(top,#5bc0de,#339bb9);background-image:-webkit-gradient(linear,0 0,0 100%,from(#5bc0de),to(#339bb9));background-image:-webkit-linear-gradient(top,#5bc0de,#339bb9);background-image:-o-linear-gradient(top,#5bc0de,#339bb9);background-image:linear-gradient(top,#5bc0de,#339bb9);background-repeat:repeat-x;filter:progid:dximagetransform.microsoft.gradient(startColorstr='#5bc0de',endColorstr='#339bb9',GradientType=0)}.progress-info.progress-striped .bar{background-color:#5bc0de;background-image:-webkit-gradient(linear,0 100%,100% 0,color-stop(0.25,rgba(255,255,255,0.15)),color-stop(0.25,transparent),color-stop(0.5,transparent),color-stop(0.5,rgba(255,255,255,0.15)),color-stop(0.75,rgba(255,255,255,0.15)),color-stop(0.75,transparent),to(transparent));background-image:-webkit-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-moz-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-ms-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-o-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent)}.progress-warning .bar{background-color:#faa732;background-image:-moz-linear-gradient(top,#fbb450,#f89406);background-image:-ms-linear-gradient(top,#fbb450,#f89406);background-image:-webkit-gradient(linear,0 0,0 100%,from(#fbb450),to(#f89406));background-image:-webkit-linear-gradient(top,#fbb450,#f89406);background-image:-o-linear-gradient(top,#fbb450,#f89406);background-image:linear-gradient(top,#fbb450,#f89406);background-repeat:repeat-x;filter:progid:dximagetransform.microsoft.gradient(startColorstr='#fbb450',endColorstr='#f89406',GradientType=0)}.progress-warning.progress-striped .bar{background-color:#fbb450;background-image:-webkit-gradient(linear,0 100%,100% 0,color-stop(0.25,rgba(255,255,255,0.15)),color-stop(0.25,transparent),color-stop(0.5,transparent),color-stop(0.5,rgba(255,255,255,0.15)),color-stop(0.75,rgba(255,255,255,0.15)),color-stop(0.75,transparent),to(transparent));background-image:-webkit-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-moz-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-ms-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:-o-linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent);background-image:linear-gradient(-45deg,rgba(255,255,255,0.15) 25%,transparent 25%,transparent 50%,rgba(255,255,255,0.15) 50%,rgba(255,255,255,0.15) 75%,transparent 75%,transparent)}.accordion{margin-bottom:18px}.accordion-group{margin-bottom:2px;border:1px solid #e5e5e5;-webkit-border-radius:4px;-moz-border-radius:4px;border-radius:4px}.accordion-heading{border-bottom:0}.accordion-heading .accordion-toggle{display:block;padding:8px 15px}.accordion-toggle{cursor:pointer}.accordion-inner{padding:9px 15px;border-top:1px solid #e5e5e5}.carousel{position:relative;margin-bottom:18px;line-height:1}.carousel-inner{position:relative;width:100%;overflow:hidden}.carousel .item{position:relative;display:none;-webkit-transition:.6s ease-in-out left;-moz-transition:.6s ease-in-out left;-ms-transition:.6s ease-in-out left;-o-transition:.6s ease-in-out left;transition:.6s ease-in-out left}.carousel .item>img{display:block;line-height:1}.carousel .active,.carousel .next,.carousel .prev{display:block}.carousel .active{left:0}.carousel .next,.carousel .prev{position:absolute;top:0;width:100%}.carousel .next{left:100%}.carousel .prev{left:-100%}.carousel .next.left,.carousel .prev.right{left:0}.carousel .active.left{left:-100%}.carousel .active.right{left:100%}.carousel-control{position:absolute;top:40%;left:15px;width:40px;height:40px;margin-top:-20px;font-size:60px;font-weight:100;line-height:30px;color:#fff;text-align:center;background:#222;border:3px solid #fff;-webkit-border-radius:23px;-moz-border-radius:23px;border-radius:23px;opacity:.5;filter:alpha(opacity=50)}.carousel-control.right{right:15px;left:auto}.carousel-control:hover{color:#fff;text-decoration:none;opacity:.9;filter:alpha(opacity=90)}.carousel-caption{position:absolute;right:0;bottom:0;left:0;padding:10px 15px 5px;background:#333;background:rgba(0,0,0,0.75)}.carousel-caption h4,.carousel-caption p{color:#fff}.hero-unit{padding:60px;margin-bottom:30px;background-color:#eee;-webkit-border-radius:6px;-moz-border-radius:6px;border-radius:6px}.hero-unit h1{margin-bottom:0;font-size:60px;line-height:1;letter-spacing:-1px;color:inherit}.hero-unit p{font-size:18px;font-weight:200;line-height:27px;color:inherit}.pull-right{float:right}.pull-left{float:left}.hide{display:none}.show{display:block}.invisible{visibility:hidden} diff --git a/_templates/bootstrap/static/bootstrap.js b/_templates/bootstrap/static/bootstrap.js new file mode 100644 index 000000000..1f87730a3 --- /dev/null +++ b/_templates/bootstrap/static/bootstrap.js @@ -0,0 +1,6 @@ +/*! +* Bootstrap.js by @fat & @mdo +* Copyright 2012 Twitter, Inc. +* http://www.apache.org/licenses/LICENSE-2.0.txt +*/ +!function(a){a(function(){"use strict",a.support.transition=function(){var a=function(){var a=document.createElement("bootstrap"),b={WebkitTransition:"webkitTransitionEnd",MozTransition:"transitionend",OTransition:"oTransitionEnd",msTransition:"MSTransitionEnd",transition:"transitionend"},c;for(c in b)if(a.style[c]!==undefined)return b[c]}();return a&&{end:a}}()})}(window.jQuery),!function(a){"use strict";var b='[data-dismiss="alert"]',c=function(c){a(c).on("click",b,this.close)};c.prototype.close=function(b){function f(){e.trigger("closed").remove()}var c=a(this),d=c.attr("data-target"),e;d||(d=c.attr("href"),d=d&&d.replace(/.*(?=#[^\s]*$)/,"")),e=a(d),b&&b.preventDefault(),e.length||(e=c.hasClass("alert")?c:c.parent()),e.trigger(b=a.Event("close"));if(b.isDefaultPrevented())return;e.removeClass("in"),a.support.transition&&e.hasClass("fade")?e.on(a.support.transition.end,f):f()},a.fn.alert=function(b){return this.each(function(){var d=a(this),e=d.data("alert");e||d.data("alert",e=new c(this)),typeof b=="string"&&e[b].call(d)})},a.fn.alert.Constructor=c,a(function(){a("body").on("click.alert.data-api",b,c.prototype.close)})}(window.jQuery),!function(a){"use strict";var b=function(b,c){this.$element=a(b),this.options=a.extend({},a.fn.button.defaults,c)};b.prototype.setState=function(a){var b="disabled",c=this.$element,d=c.data(),e=c.is("input")?"val":"html";a+="Text",d.resetText||c.data("resetText",c[e]()),c[e](d[a]||this.options[a]),setTimeout(function(){a=="loadingText"?c.addClass(b).attr(b,b):c.removeClass(b).removeAttr(b)},0)},b.prototype.toggle=function(){var a=this.$element.parent('[data-toggle="buttons-radio"]');a&&a.find(".active").removeClass("active"),this.$element.toggleClass("active")},a.fn.button=function(c){return this.each(function(){var d=a(this),e=d.data("button"),f=typeof c=="object"&&c;e||d.data("button",e=new b(this,f)),c=="toggle"?e.toggle():c&&e.setState(c)})},a.fn.button.defaults={loadingText:"loading..."},a.fn.button.Constructor=b,a(function(){a("body").on("click.button.data-api","[data-toggle^=button]",function(b){var c=a(b.target);c.hasClass("btn")||(c=c.closest(".btn")),c.button("toggle")})})}(window.jQuery),!function(a){"use strict";var b=function(b,c){this.$element=a(b),this.options=c,this.options.slide&&this.slide(this.options.slide),this.options.pause=="hover"&&this.$element.on("mouseenter",a.proxy(this.pause,this)).on("mouseleave",a.proxy(this.cycle,this))};b.prototype={cycle:function(b){return b||(this.paused=!1),this.options.interval&&!this.paused&&(this.interval=setInterval(a.proxy(this.next,this),this.options.interval)),this},to:function(b){var c=this.$element.find(".active"),d=c.parent().children(),e=d.index(c),f=this;if(b>d.length-1||b<0)return;return this.sliding?this.$element.one("slid",function(){f.to(b)}):e==b?this.pause().cycle():this.slide(b>e?"next":"prev",a(d[b]))},pause:function(a){return a||(this.paused=!0),clearInterval(this.interval),this.interval=null,this},next:function(){if(this.sliding)return;return this.slide("next")},prev:function(){if(this.sliding)return;return this.slide("prev")},slide:function(b,c){var d=this.$element.find(".active"),e=c||d[b](),f=this.interval,g=b=="next"?"left":"right",h=b=="next"?"first":"last",i=this,j=a.Event("slide");this.sliding=!0,f&&this.pause(),e=e.length?e:this.$element.find(".item")[h]();if(e.hasClass("active"))return;if(a.support.transition&&this.$element.hasClass("slide")){this.$element.trigger(j);if(j.isDefaultPrevented())return;e.addClass(b),e[0].offsetWidth,d.addClass(g),e.addClass(g),this.$element.one(a.support.transition.end,function(){e.removeClass([b,g].join(" ")).addClass("active"),d.removeClass(["active",g].join(" ")),i.sliding=!1,setTimeout(function(){i.$element.trigger("slid")},0)})}else{this.$element.trigger(j);if(j.isDefaultPrevented())return;d.removeClass("active"),e.addClass("active"),this.sliding=!1,this.$element.trigger("slid")}return f&&this.cycle(),this}},a.fn.carousel=function(c){return this.each(function(){var d=a(this),e=d.data("carousel"),f=a.extend({},a.fn.carousel.defaults,typeof c=="object"&&c);e||d.data("carousel",e=new b(this,f)),typeof c=="number"?e.to(c):typeof c=="string"||(c=f.slide)?e[c]():f.interval&&e.cycle()})},a.fn.carousel.defaults={interval:5e3,pause:"hover"},a.fn.carousel.Constructor=b,a(function(){a("body").on("click.carousel.data-api","[data-slide]",function(b){var c=a(this),d,e=a(c.attr("data-target")||(d=c.attr("href"))&&d.replace(/.*(?=#[^\s]+$)/,"")),f=!e.data("modal")&&a.extend({},e.data(),c.data());e.carousel(f),b.preventDefault()})})}(window.jQuery),!function(a){"use strict";var b=function(b,c){this.$element=a(b),this.options=a.extend({},a.fn.collapse.defaults,c),this.options.parent&&(this.$parent=a(this.options.parent)),this.options.toggle&&this.toggle()};b.prototype={constructor:b,dimension:function(){var a=this.$element.hasClass("width");return a?"width":"height"},show:function(){var b,c,d,e;if(this.transitioning)return;b=this.dimension(),c=a.camelCase(["scroll",b].join("-")),d=this.$parent&&this.$parent.find("> .accordion-group > .in");if(d&&d.length){e=d.data("collapse");if(e&&e.transitioning)return;d.collapse("hide"),e||d.data("collapse",null)}this.$element[b](0),this.transition("addClass",a.Event("show"),"shown"),this.$element[b](this.$element[0][c])},hide:function(){var b;if(this.transitioning)return;b=this.dimension(),this.reset(this.$element[b]()),this.transition("removeClass",a.Event("hide"),"hidden"),this.$element[b](0)},reset:function(a){var b=this.dimension();return this.$element.removeClass("collapse")[b](a||"auto")[0].offsetWidth,this.$element[a!==null?"addClass":"removeClass"]("collapse"),this},transition:function(b,c,d){var e=this,f=function(){c.type=="show"&&e.reset(),e.transitioning=0,e.$element.trigger(d)};this.$element.trigger(c);if(c.isDefaultPrevented())return;this.transitioning=1,this.$element[b]("in"),a.support.transition&&this.$element.hasClass("collapse")?this.$element.one(a.support.transition.end,f):f()},toggle:function(){this[this.$element.hasClass("in")?"hide":"show"]()}},a.fn.collapse=function(c){return this.each(function(){var d=a(this),e=d.data("collapse"),f=typeof c=="object"&&c;e||d.data("collapse",e=new b(this,f)),typeof c=="string"&&e[c]()})},a.fn.collapse.defaults={toggle:!0},a.fn.collapse.Constructor=b,a(function(){a("body").on("click.collapse.data-api","[data-toggle=collapse]",function(b){var c=a(this),d,e=c.attr("data-target")||b.preventDefault()||(d=c.attr("href"))&&d.replace(/.*(?=#[^\s]+$)/,""),f=a(e).data("collapse")?"toggle":c.data();a(e).collapse(f)})})}(window.jQuery),!function(a){function d(){a(b).parent().removeClass("open")}"use strict";var b='[data-toggle="dropdown"]',c=function(b){var c=a(b).on("click.dropdown.data-api",this.toggle);a("html").on("click.dropdown.data-api",function(){c.parent().removeClass("open")})};c.prototype={constructor:c,toggle:function(b){var c=a(this),e,f,g;if(c.is(".disabled, :disabled"))return;return f=c.attr("data-target"),f||(f=c.attr("href"),f=f&&f.replace(/.*(?=#[^\s]*$)/,"")),e=a(f),e.length||(e=c.parent()),g=e.hasClass("open"),d(),g||e.toggleClass("open"),!1}},a.fn.dropdown=function(b){return this.each(function(){var d=a(this),e=d.data("dropdown");e||d.data("dropdown",e=new c(this)),typeof b=="string"&&e[b].call(d)})},a.fn.dropdown.Constructor=c,a(function(){a("html").on("click.dropdown.data-api",d),a("body").on("click.dropdown",".dropdown form",function(a){a.stopPropagation()}).on("click.dropdown.data-api",b,c.prototype.toggle)})}(window.jQuery),!function(a){function c(){var b=this,c=setTimeout(function(){b.$element.off(a.support.transition.end),d.call(b)},500);this.$element.one(a.support.transition.end,function(){clearTimeout(c),d.call(b)})}function d(a){this.$element.hide().trigger("hidden"),e.call(this)}function e(b){var c=this,d=this.$element.hasClass("fade")?"fade":"";if(this.isShown&&this.options.backdrop){var e=a.support.transition&&d;this.$backdrop=a('
    ').appendTo(document.body),this.options.backdrop!="static"&&this.$backdrop.click(a.proxy(this.hide,this)),e&&this.$backdrop[0].offsetWidth,this.$backdrop.addClass("in"),e?this.$backdrop.one(a.support.transition.end,b):b()}else!this.isShown&&this.$backdrop?(this.$backdrop.removeClass("in"),a.support.transition&&this.$element.hasClass("fade")?this.$backdrop.one(a.support.transition.end,a.proxy(f,this)):f.call(this)):b&&b()}function f(){this.$backdrop.remove(),this.$backdrop=null}function g(){var b=this;this.isShown&&this.options.keyboard?a(document).on("keyup.dismiss.modal",function(a){a.which==27&&b.hide()}):this.isShown||a(document).off("keyup.dismiss.modal")}"use strict";var b=function(b,c){this.options=c,this.$element=a(b).delegate('[data-dismiss="modal"]',"click.dismiss.modal",a.proxy(this.hide,this))};b.prototype={constructor:b,toggle:function(){return this[this.isShown?"hide":"show"]()},show:function(){var b=this,c=a.Event("show");this.$element.trigger(c);if(this.isShown||c.isDefaultPrevented())return;a("body").addClass("modal-open"),this.isShown=!0,g.call(this),e.call(this,function(){var c=a.support.transition&&b.$element.hasClass("fade");b.$element.parent().length||b.$element.appendTo(document.body),b.$element.show(),c&&b.$element[0].offsetWidth,b.$element.addClass("in"),c?b.$element.one(a.support.transition.end,function(){b.$element.trigger("shown")}):b.$element.trigger("shown")})},hide:function(b){b&&b.preventDefault();var e=this;b=a.Event("hide"),this.$element.trigger(b);if(!this.isShown||b.isDefaultPrevented())return;this.isShown=!1,a("body").removeClass("modal-open"),g.call(this),this.$element.removeClass("in"),a.support.transition&&this.$element.hasClass("fade")?c.call(this):d.call(this)}},a.fn.modal=function(c){return this.each(function(){var d=a(this),e=d.data("modal"),f=a.extend({},a.fn.modal.defaults,d.data(),typeof c=="object"&&c);e||d.data("modal",e=new b(this,f)),typeof c=="string"?e[c]():f.show&&e.show()})},a.fn.modal.defaults={backdrop:!0,keyboard:!0,show:!0},a.fn.modal.Constructor=b,a(function(){a("body").on("click.modal.data-api",'[data-toggle="modal"]',function(b){var c=a(this),d,e=a(c.attr("data-target")||(d=c.attr("href"))&&d.replace(/.*(?=#[^\s]+$)/,"")),f=e.data("modal")?"toggle":a.extend({},e.data(),c.data());b.preventDefault(),e.modal(f)})})}(window.jQuery),!function(a){"use strict";var b=function(a,b){this.init("tooltip",a,b)};b.prototype={constructor:b,init:function(b,c,d){var e,f;this.type=b,this.$element=a(c),this.options=this.getOptions(d),this.enabled=!0,this.options.trigger!="manual"&&(e=this.options.trigger=="hover"?"mouseenter":"focus",f=this.options.trigger=="hover"?"mouseleave":"blur",this.$element.on(e,this.options.selector,a.proxy(this.enter,this)),this.$element.on(f,this.options.selector,a.proxy(this.leave,this))),this.options.selector?this._options=a.extend({},this.options,{trigger:"manual",selector:""}):this.fixTitle()},getOptions:function(b){return b=a.extend({},a.fn[this.type].defaults,b,this.$element.data()),b.delay&&typeof b.delay=="number"&&(b.delay={show:b.delay,hide:b.delay}),b},enter:function(b){var c=a(b.currentTarget)[this.type](this._options).data(this.type);if(!c.options.delay||!c.options.delay.show)return c.show();clearTimeout(this.timeout),c.hoverState="in",this.timeout=setTimeout(function(){c.hoverState=="in"&&c.show()},c.options.delay.show)},leave:function(b){var c=a(b.currentTarget)[this.type](this._options).data(this.type);if(!c.options.delay||!c.options.delay.hide)return c.hide();clearTimeout(this.timeout),c.hoverState="out",this.timeout=setTimeout(function(){c.hoverState=="out"&&c.hide()},c.options.delay.hide)},show:function(){var a,b,c,d,e,f,g;if(this.hasContent()&&this.enabled){a=this.tip(),this.setContent(),this.options.animation&&a.addClass("fade"),f=typeof this.options.placement=="function"?this.options.placement.call(this,a[0],this.$element[0]):this.options.placement,b=/in/.test(f),a.remove().css({top:0,left:0,display:"block"}).appendTo(b?this.$element:document.body),c=this.getPosition(b),d=a[0].offsetWidth,e=a[0].offsetHeight;switch(b?f.split(" ")[1]:f){case"bottom":g={top:c.top+c.height,left:c.left+c.width/2-d/2};break;case"top":g={top:c.top-e,left:c.left+c.width/2-d/2};break;case"left":g={top:c.top+c.height/2-e/2,left:c.left-d};break;case"right":g={top:c.top+c.height/2-e/2,left:c.left+c.width}}a.css(g).addClass(f).addClass("in")}},isHTML:function(a){return typeof a!="string"||a.charAt(0)==="<"&&a.charAt(a.length-1)===">"&&a.length>=3||/^(?:[^<]*<[\w\W]+>[^>]*$)/.exec(a)},setContent:function(){var a=this.tip(),b=this.getTitle();a.find(".tooltip-inner")[this.isHTML(b)?"html":"text"](b),a.removeClass("fade in top bottom left right")},hide:function(){function d(){var b=setTimeout(function(){c.off(a.support.transition.end).remove()},500);c.one(a.support.transition.end,function(){clearTimeout(b),c.remove()})}var b=this,c=this.tip();c.removeClass("in"),a.support.transition&&this.$tip.hasClass("fade")?d():c.remove()},fixTitle:function(){var a=this.$element;(a.attr("title")||typeof a.attr("data-original-title")!="string")&&a.attr("data-original-title",a.attr("title")||"").removeAttr("title")},hasContent:function(){return this.getTitle()},getPosition:function(b){return a.extend({},b?{top:0,left:0}:this.$element.offset(),{width:this.$element[0].offsetWidth,height:this.$element[0].offsetHeight})},getTitle:function(){var a,b=this.$element,c=this.options;return a=b.attr("data-original-title")||(typeof c.title=="function"?c.title.call(b[0]):c.title),a},tip:function(){return this.$tip=this.$tip||a(this.options.template)},validate:function(){this.$element[0].parentNode||(this.hide(),this.$element=null,this.options=null)},enable:function(){this.enabled=!0},disable:function(){this.enabled=!1},toggleEnabled:function(){this.enabled=!this.enabled},toggle:function(){this[this.tip().hasClass("in")?"hide":"show"]()}},a.fn.tooltip=function(c){return this.each(function(){var d=a(this),e=d.data("tooltip"),f=typeof c=="object"&&c;e||d.data("tooltip",e=new b(this,f)),typeof c=="string"&&e[c]()})},a.fn.tooltip.Constructor=b,a.fn.tooltip.defaults={animation:!0,placement:"top",selector:!1,template:'
    ',trigger:"hover",title:"",delay:0}}(window.jQuery),!function(a){"use strict";var b=function(a,b){this.init("popover",a,b)};b.prototype=a.extend({},a.fn.tooltip.Constructor.prototype,{constructor:b,setContent:function(){var a=this.tip(),b=this.getTitle(),c=this.getContent();a.find(".popover-title")[this.isHTML(b)?"html":"text"](b),a.find(".popover-content > *")[this.isHTML(c)?"html":"text"](c),a.removeClass("fade top bottom left right in")},hasContent:function(){return this.getTitle()||this.getContent()},getContent:function(){var a,b=this.$element,c=this.options;return a=b.attr("data-content")||(typeof c.content=="function"?c.content.call(b[0]):c.content),a},tip:function(){return this.$tip||(this.$tip=a(this.options.template)),this.$tip}}),a.fn.popover=function(c){return this.each(function(){var d=a(this),e=d.data("popover"),f=typeof c=="object"&&c;e||d.data("popover",e=new b(this,f)),typeof c=="string"&&e[c]()})},a.fn.popover.Constructor=b,a.fn.popover.defaults=a.extend({},a.fn.tooltip.defaults,{placement:"right",content:"",template:'

    '})}(window.jQuery),!function(a){function b(b,c){var d=a.proxy(this.process,this),e=a(b).is("body")?a(window):a(b),f;this.options=a.extend({},a.fn.scrollspy.defaults,c),this.$scrollElement=e.on("scroll.scroll.data-api",d),this.selector=(this.options.target||(f=a(b).attr("href"))&&f.replace(/.*(?=#[^\s]+$)/,"")||"")+" .nav li > a",this.$body=a("body"),this.refresh(),this.process()}"use strict",b.prototype={constructor:b,refresh:function(){var b=this,c;this.offsets=a([]),this.targets=a([]),c=this.$body.find(this.selector).map(function(){var b=a(this),c=b.data("target")||b.attr("href"),d=/^#\w/.test(c)&&a(c);return d&&c.length&&[[d.position().top,c]]||null}).sort(function(a,b){return a[0]-b[0]}).each(function(){b.offsets.push(this[0]),b.targets.push(this[1])})},process:function(){var a=this.$scrollElement.scrollTop()+this.options.offset,b=this.$scrollElement[0].scrollHeight||this.$body[0].scrollHeight,c=b-this.$scrollElement.height(),d=this.offsets,e=this.targets,f=this.activeTarget,g;if(a>=c)return f!=(g=e.last()[0])&&this.activate(g);for(g=d.length;g--;)f!=e[g]&&a>=d[g]&&(!d[g+1]||a<=d[g+1])&&this.activate(e[g])},activate:function(b){var c,d;this.activeTarget=b,a(this.selector).parent(".active").removeClass("active"),d=this.selector+'[data-target="'+b+'"],'+this.selector+'[href="'+b+'"]',c=a(d).parent("li").addClass("active"),c.parent(".dropdown-menu")&&(c=c.closest("li.dropdown").addClass("active")),c.trigger("activate")}},a.fn.scrollspy=function(c){return this.each(function(){var d=a(this),e=d.data("scrollspy"),f=typeof c=="object"&&c;e||d.data("scrollspy",e=new b(this,f)),typeof c=="string"&&e[c]()})},a.fn.scrollspy.Constructor=b,a.fn.scrollspy.defaults={offset:10},a(function(){a('[data-spy="scroll"]').each(function(){var b=a(this);b.scrollspy(b.data())})})}(window.jQuery),!function(a){"use strict";var b=function(b){this.element=a(b)};b.prototype={constructor:b,show:function(){var b=this.element,c=b.closest("ul:not(.dropdown-menu)"),d=b.attr("data-target"),e,f,g;d||(d=b.attr("href"),d=d&&d.replace(/.*(?=#[^\s]*$)/,""));if(b.parent("li").hasClass("active"))return;e=c.find(".active a").last()[0],g=a.Event("show",{relatedTarget:e}),b.trigger(g);if(g.isDefaultPrevented())return;f=a(d),this.activate(b.parent("li"),c),this.activate(f,f.parent(),function(){b.trigger({type:"shown",relatedTarget:e})})},activate:function(b,c,d){function g(){e.removeClass("active").find("> .dropdown-menu > .active").removeClass("active"),b.addClass("active"),f?(b[0].offsetWidth,b.addClass("in")):b.removeClass("fade"),b.parent(".dropdown-menu")&&b.closest("li.dropdown").addClass("active"),d&&d()}var e=c.find("> .active"),f=d&&a.support.transition&&e.hasClass("fade");f?e.one(a.support.transition.end,g):g(),e.removeClass("in")}},a.fn.tab=function(c){return this.each(function(){var d=a(this),e=d.data("tab");e||d.data("tab",e=new b(this)),typeof c=="string"&&e[c]()})},a.fn.tab.Constructor=b,a(function(){a("body").on("click.tab.data-api",'[data-toggle="tab"], [data-toggle="pill"]',function(b){b.preventDefault(),a(this).tab("show")})})}(window.jQuery),!function(a){"use strict";var b=function(b,c){this.$element=a(b),this.options=a.extend({},a.fn.typeahead.defaults,c),this.matcher=this.options.matcher||this.matcher,this.sorter=this.options.sorter||this.sorter,this.highlighter=this.options.highlighter||this.highlighter,this.updater=this.options.updater||this.updater,this.$menu=a(this.options.menu).appendTo("body"),this.source=this.options.source,this.shown=!1,this.listen()};b.prototype={constructor:b,select:function(){var a=this.$menu.find(".active").attr("data-value");return this.$element.val(this.updater(a)).change(),this.hide()},updater:function(a){return a},show:function(){var b=a.extend({},this.$element.offset(),{height:this.$element[0].offsetHeight});return this.$menu.css({top:b.top+b.height,left:b.left}),this.$menu.show(),this.shown=!0,this},hide:function(){return this.$menu.hide(),this.shown=!1,this},lookup:function(b){var c=this,d,e;return this.query=this.$element.val(),this.query?(d=a.grep(this.source,function(a){return c.matcher(a)}),d=this.sorter(d),d.length?this.render(d.slice(0,this.options.items)).show():this.shown?this.hide():this):this.shown?this.hide():this},matcher:function(a){return~a.toLowerCase().indexOf(this.query.toLowerCase())},sorter:function(a){var b=[],c=[],d=[],e;while(e=a.shift())e.toLowerCase().indexOf(this.query.toLowerCase())?~e.indexOf(this.query)?c.push(e):d.push(e):b.push(e);return b.concat(c,d)},highlighter:function(a){var b=this.query.replace(/[\-\[\]{}()*+?.,\\\^$|#\s]/g,"\\$&");return a.replace(new RegExp("("+b+")","ig"),function(a,b){return""+b+""})},render:function(b){var c=this;return b=a(b).map(function(b,d){return b=a(c.options.item).attr("data-value",d),b.find("a").html(c.highlighter(d)),b[0]}),b.first().addClass("active"),this.$menu.html(b),this},next:function(b){var c=this.$menu.find(".active").removeClass("active"),d=c.next();d.length||(d=a(this.$menu.find("li")[0])),d.addClass("active")},prev:function(a){var b=this.$menu.find(".active").removeClass("active"),c=b.prev();c.length||(c=this.$menu.find("li").last()),c.addClass("active")},listen:function(){this.$element.on("blur",a.proxy(this.blur,this)).on("keypress",a.proxy(this.keypress,this)).on("keyup",a.proxy(this.keyup,this)),(a.browser.webkit||a.browser.msie)&&this.$element.on("keydown",a.proxy(this.keypress,this)),this.$menu.on("click",a.proxy(this.click,this)).on("mouseenter","li",a.proxy(this.mouseenter,this))},keyup:function(a){switch(a.keyCode){case 40:case 38:break;case 9:case 13:if(!this.shown)return;this.select();break;case 27:if(!this.shown)return;this.hide();break;default:this.lookup()}a.stopPropagation(),a.preventDefault()},keypress:function(a){if(!this.shown)return;switch(a.keyCode){case 9:case 13:case 27:a.preventDefault();break;case 38:if(a.type!="keydown")break;a.preventDefault(),this.prev();break;case 40:if(a.type!="keydown")break;a.preventDefault(),this.next()}a.stopPropagation()},blur:function(a){var b=this;setTimeout(function(){b.hide()},150)},click:function(a){a.stopPropagation(),a.preventDefault(),this.select()},mouseenter:function(b){this.$menu.find(".active").removeClass("active"),a(b.currentTarget).addClass("active")}},a.fn.typeahead=function(c){return this.each(function(){var d=a(this),e=d.data("typeahead"),f=typeof c=="object"&&c;e||d.data("typeahead",e=new b(this,f)),typeof c=="string"&&e[c]()})},a.fn.typeahead.defaults={source:[],items:8,menu:'
      ',item:'
      • '},a.fn.typeahead.Constructor=b,a(function(){a("body").on("focus.typeahead.data-api",'[data-provide="typeahead"]',function(b){var c=a(this);if(c.data("typeahead"))return;b.preventDefault(),c.typeahead(c.data())})})}(window.jQuery); \ No newline at end of file diff --git a/_templates/bootstrap/static/img/glyphicons-halflings-white.png b/_templates/bootstrap/static/img/glyphicons-halflings-white.png new file mode 100644 index 000000000..3bf6484a2 Binary files /dev/null and b/_templates/bootstrap/static/img/glyphicons-halflings-white.png differ diff --git a/_templates/bootstrap/static/img/glyphicons-halflings.png b/_templates/bootstrap/static/img/glyphicons-halflings.png new file mode 100644 index 000000000..79bc568c2 Binary files /dev/null and b/_templates/bootstrap/static/img/glyphicons-halflings.png differ diff --git a/_templates/bootstrap/static/jquery.js b/_templates/bootstrap/static/jquery.js new file mode 100644 index 000000000..16ad06c5a --- /dev/null +++ b/_templates/bootstrap/static/jquery.js @@ -0,0 +1,4 @@ +/*! jQuery v1.7.2 jquery.com | jquery.org/license */ +(function(a,b){function cy(a){return f.isWindow(a)?a:a.nodeType===9?a.defaultView||a.parentWindow:!1}function cu(a){if(!cj[a]){var b=c.body,d=f("<"+a+">").appendTo(b),e=d.css("display");d.remove();if(e==="none"||e===""){ck||(ck=c.createElement("iframe"),ck.frameBorder=ck.width=ck.height=0),b.appendChild(ck);if(!cl||!ck.createElement)cl=(ck.contentWindow||ck.contentDocument).document,cl.write((f.support.boxModel?"":"")+""),cl.close();d=cl.createElement(a),cl.body.appendChild(d),e=f.css(d,"display"),b.removeChild(ck)}cj[a]=e}return cj[a]}function ct(a,b){var c={};f.each(cp.concat.apply([],cp.slice(0,b)),function(){c[this]=a});return c}function cs(){cq=b}function cr(){setTimeout(cs,0);return cq=f.now()}function ci(){try{return new a.ActiveXObject("Microsoft.XMLHTTP")}catch(b){}}function ch(){try{return new a.XMLHttpRequest}catch(b){}}function cb(a,c){a.dataFilter&&(c=a.dataFilter(c,a.dataType));var d=a.dataTypes,e={},g,h,i=d.length,j,k=d[0],l,m,n,o,p;for(g=1;g0){if(c!=="border")for(;e=0===c})}function S(a){return!a||!a.parentNode||a.parentNode.nodeType===11}function K(){return!0}function J(){return!1}function n(a,b,c){var d=b+"defer",e=b+"queue",g=b+"mark",h=f._data(a,d);h&&(c==="queue"||!f._data(a,e))&&(c==="mark"||!f._data(a,g))&&setTimeout(function(){!f._data(a,e)&&!f._data(a,g)&&(f.removeData(a,d,!0),h.fire())},0)}function m(a){for(var b in a){if(b==="data"&&f.isEmptyObject(a[b]))continue;if(b!=="toJSON")return!1}return!0}function l(a,c,d){if(d===b&&a.nodeType===1){var e="data-"+c.replace(k,"-$1").toLowerCase();d=a.getAttribute(e);if(typeof d=="string"){try{d=d==="true"?!0:d==="false"?!1:d==="null"?null:f.isNumeric(d)?+d:j.test(d)?f.parseJSON(d):d}catch(g){}f.data(a,c,d)}else d=b}return d}function h(a){var b=g[a]={},c,d;a=a.split(/\s+/);for(c=0,d=a.length;c)[^>]*$|#([\w\-]*)$)/,j=/\S/,k=/^\s+/,l=/\s+$/,m=/^<(\w+)\s*\/?>(?:<\/\1>)?$/,n=/^[\],:{}\s]*$/,o=/\\(?:["\\\/bfnrt]|u[0-9a-fA-F]{4})/g,p=/"[^"\\\n\r]*"|true|false|null|-?\d+(?:\.\d*)?(?:[eE][+\-]?\d+)?/g,q=/(?:^|:|,)(?:\s*\[)+/g,r=/(webkit)[ \/]([\w.]+)/,s=/(opera)(?:.*version)?[ \/]([\w.]+)/,t=/(msie) ([\w.]+)/,u=/(mozilla)(?:.*? rv:([\w.]+))?/,v=/-([a-z]|[0-9])/ig,w=/^-ms-/,x=function(a,b){return(b+"").toUpperCase()},y=d.userAgent,z,A,B,C=Object.prototype.toString,D=Object.prototype.hasOwnProperty,E=Array.prototype.push,F=Array.prototype.slice,G=String.prototype.trim,H=Array.prototype.indexOf,I={};e.fn=e.prototype={constructor:e,init:function(a,d,f){var g,h,j,k;if(!a)return this;if(a.nodeType){this.context=this[0]=a,this.length=1;return this}if(a==="body"&&!d&&c.body){this.context=c,this[0]=c.body,this.selector=a,this.length=1;return this}if(typeof a=="string"){a.charAt(0)!=="<"||a.charAt(a.length-1)!==">"||a.length<3?g=i.exec(a):g=[null,a,null];if(g&&(g[1]||!d)){if(g[1]){d=d instanceof e?d[0]:d,k=d?d.ownerDocument||d:c,j=m.exec(a),j?e.isPlainObject(d)?(a=[c.createElement(j[1])],e.fn.attr.call(a,d,!0)):a=[k.createElement(j[1])]:(j=e.buildFragment([g[1]],[k]),a=(j.cacheable?e.clone(j.fragment):j.fragment).childNodes);return e.merge(this,a)}h=c.getElementById(g[2]);if(h&&h.parentNode){if(h.id!==g[2])return f.find(a);this.length=1,this[0]=h}this.context=c,this.selector=a;return this}return!d||d.jquery?(d||f).find(a):this.constructor(d).find(a)}if(e.isFunction(a))return f.ready(a);a.selector!==b&&(this.selector=a.selector,this.context=a.context);return e.makeArray(a,this)},selector:"",jquery:"1.7.2",length:0,size:function(){return this.length},toArray:function(){return F.call(this,0)},get:function(a){return a==null?this.toArray():a<0?this[this.length+a]:this[a]},pushStack:function(a,b,c){var d=this.constructor();e.isArray(a)?E.apply(d,a):e.merge(d,a),d.prevObject=this,d.context=this.context,b==="find"?d.selector=this.selector+(this.selector?" ":"")+c:b&&(d.selector=this.selector+"."+b+"("+c+")");return d},each:function(a,b){return e.each(this,a,b)},ready:function(a){e.bindReady(),A.add(a);return this},eq:function(a){a=+a;return a===-1?this.slice(a):this.slice(a,a+1)},first:function(){return this.eq(0)},last:function(){return this.eq(-1)},slice:function(){return this.pushStack(F.apply(this,arguments),"slice",F.call(arguments).join(","))},map:function(a){return this.pushStack(e.map(this,function(b,c){return a.call(b,c,b)}))},end:function(){return this.prevObject||this.constructor(null)},push:E,sort:[].sort,splice:[].splice},e.fn.init.prototype=e.fn,e.extend=e.fn.extend=function(){var a,c,d,f,g,h,i=arguments[0]||{},j=1,k=arguments.length,l=!1;typeof i=="boolean"&&(l=i,i=arguments[1]||{},j=2),typeof i!="object"&&!e.isFunction(i)&&(i={}),k===j&&(i=this,--j);for(;j0)return;A.fireWith(c,[e]),e.fn.trigger&&e(c).trigger("ready").off("ready")}},bindReady:function(){if(!A){A=e.Callbacks("once memory");if(c.readyState==="complete")return setTimeout(e.ready,1);if(c.addEventListener)c.addEventListener("DOMContentLoaded",B,!1),a.addEventListener("load",e.ready,!1);else if(c.attachEvent){c.attachEvent("onreadystatechange",B),a.attachEvent("onload",e.ready);var b=!1;try{b=a.frameElement==null}catch(d){}c.documentElement.doScroll&&b&&J()}}},isFunction:function(a){return e.type(a)==="function"},isArray:Array.isArray||function(a){return e.type(a)==="array"},isWindow:function(a){return a!=null&&a==a.window},isNumeric:function(a){return!isNaN(parseFloat(a))&&isFinite(a)},type:function(a){return a==null?String(a):I[C.call(a)]||"object"},isPlainObject:function(a){if(!a||e.type(a)!=="object"||a.nodeType||e.isWindow(a))return!1;try{if(a.constructor&&!D.call(a,"constructor")&&!D.call(a.constructor.prototype,"isPrototypeOf"))return!1}catch(c){return!1}var d;for(d in a);return d===b||D.call(a,d)},isEmptyObject:function(a){for(var b in a)return!1;return!0},error:function(a){throw new Error(a)},parseJSON:function(b){if(typeof b!="string"||!b)return null;b=e.trim(b);if(a.JSON&&a.JSON.parse)return a.JSON.parse(b);if(n.test(b.replace(o,"@").replace(p,"]").replace(q,"")))return(new Function("return "+b))();e.error("Invalid JSON: "+b)},parseXML:function(c){if(typeof c!="string"||!c)return null;var d,f;try{a.DOMParser?(f=new DOMParser,d=f.parseFromString(c,"text/xml")):(d=new ActiveXObject("Microsoft.XMLDOM"),d.async="false",d.loadXML(c))}catch(g){d=b}(!d||!d.documentElement||d.getElementsByTagName("parsererror").length)&&e.error("Invalid XML: "+c);return d},noop:function(){},globalEval:function(b){b&&j.test(b)&&(a.execScript||function(b){a.eval.call(a,b)})(b)},camelCase:function(a){return a.replace(w,"ms-").replace(v,x)},nodeName:function(a,b){return a.nodeName&&a.nodeName.toUpperCase()===b.toUpperCase()},each:function(a,c,d){var f,g=0,h=a.length,i=h===b||e.isFunction(a);if(d){if(i){for(f in a)if(c.apply(a[f],d)===!1)break}else for(;g0&&a[0]&&a[j-1]||j===0||e.isArray(a));if(k)for(;i1?i.call(arguments,0):b,j.notifyWith(k,e)}}function l(a){return function(c){b[a]=arguments.length>1?i.call(arguments,0):c,--g||j.resolveWith(j,b)}}var b=i.call(arguments,0),c=0,d=b.length,e=Array(d),g=d,h=d,j=d<=1&&a&&f.isFunction(a.promise)?a:f.Deferred(),k=j.promise();if(d>1){for(;c
      a",d=p.getElementsByTagName("*"),e=p.getElementsByTagName("a")[0];if(!d||!d.length||!e)return{};g=c.createElement("select"),h=g.appendChild(c.createElement("option")),i=p.getElementsByTagName("input")[0],b={leadingWhitespace:p.firstChild.nodeType===3,tbody:!p.getElementsByTagName("tbody").length,htmlSerialize:!!p.getElementsByTagName("link").length,style:/top/.test(e.getAttribute("style")),hrefNormalized:e.getAttribute("href")==="/a",opacity:/^0.55/.test(e.style.opacity),cssFloat:!!e.style.cssFloat,checkOn:i.value==="on",optSelected:h.selected,getSetAttribute:p.className!=="t",enctype:!!c.createElement("form").enctype,html5Clone:c.createElement("nav").cloneNode(!0).outerHTML!=="<:nav>",submitBubbles:!0,changeBubbles:!0,focusinBubbles:!1,deleteExpando:!0,noCloneEvent:!0,inlineBlockNeedsLayout:!1,shrinkWrapBlocks:!1,reliableMarginRight:!0,pixelMargin:!0},f.boxModel=b.boxModel=c.compatMode==="CSS1Compat",i.checked=!0,b.noCloneChecked=i.cloneNode(!0).checked,g.disabled=!0,b.optDisabled=!h.disabled;try{delete p.test}catch(r){b.deleteExpando=!1}!p.addEventListener&&p.attachEvent&&p.fireEvent&&(p.attachEvent("onclick",function(){b.noCloneEvent=!1}),p.cloneNode(!0).fireEvent("onclick")),i=c.createElement("input"),i.value="t",i.setAttribute("type","radio"),b.radioValue=i.value==="t",i.setAttribute("checked","checked"),i.setAttribute("name","t"),p.appendChild(i),j=c.createDocumentFragment(),j.appendChild(p.lastChild),b.checkClone=j.cloneNode(!0).cloneNode(!0).lastChild.checked,b.appendChecked=i.checked,j.removeChild(i),j.appendChild(p);if(p.attachEvent)for(n in{submit:1,change:1,focusin:1})m="on"+n,o=m in p,o||(p.setAttribute(m,"return;"),o=typeof p[m]=="function"),b[n+"Bubbles"]=o;j.removeChild(p),j=g=h=p=i=null,f(function(){var d,e,g,h,i,j,l,m,n,q,r,s,t,u=c.getElementsByTagName("body")[0];!u||(m=1,t="padding:0;margin:0;border:",r="position:absolute;top:0;left:0;width:1px;height:1px;",s=t+"0;visibility:hidden;",n="style='"+r+t+"5px solid #000;",q="
      "+""+"
      ",d=c.createElement("div"),d.style.cssText=s+"width:0;height:0;position:static;top:0;margin-top:"+m+"px",u.insertBefore(d,u.firstChild),p=c.createElement("div"),d.appendChild(p),p.innerHTML="
      t
      ",k=p.getElementsByTagName("td"),o=k[0].offsetHeight===0,k[0].style.display="",k[1].style.display="none",b.reliableHiddenOffsets=o&&k[0].offsetHeight===0,a.getComputedStyle&&(p.innerHTML="",l=c.createElement("div"),l.style.width="0",l.style.marginRight="0",p.style.width="2px",p.appendChild(l),b.reliableMarginRight=(parseInt((a.getComputedStyle(l,null)||{marginRight:0}).marginRight,10)||0)===0),typeof p.style.zoom!="undefined"&&(p.innerHTML="",p.style.width=p.style.padding="1px",p.style.border=0,p.style.overflow="hidden",p.style.display="inline",p.style.zoom=1,b.inlineBlockNeedsLayout=p.offsetWidth===3,p.style.display="block",p.style.overflow="visible",p.innerHTML="
      ",b.shrinkWrapBlocks=p.offsetWidth!==3),p.style.cssText=r+s,p.innerHTML=q,e=p.firstChild,g=e.firstChild,i=e.nextSibling.firstChild.firstChild,j={doesNotAddBorder:g.offsetTop!==5,doesAddBorderForTableAndCells:i.offsetTop===5},g.style.position="fixed",g.style.top="20px",j.fixedPosition=g.offsetTop===20||g.offsetTop===15,g.style.position=g.style.top="",e.style.overflow="hidden",e.style.position="relative",j.subtractsBorderForOverflowNotVisible=g.offsetTop===-5,j.doesNotIncludeMarginInBodyOffset=u.offsetTop!==m,a.getComputedStyle&&(p.style.marginTop="1%",b.pixelMargin=(a.getComputedStyle(p,null)||{marginTop:0}).marginTop!=="1%"),typeof d.style.zoom!="undefined"&&(d.style.zoom=1),u.removeChild(d),l=p=d=null,f.extend(b,j))});return b}();var j=/^(?:\{.*\}|\[.*\])$/,k=/([A-Z])/g;f.extend({cache:{},uuid:0,expando:"jQuery"+(f.fn.jquery+Math.random()).replace(/\D/g,""),noData:{embed:!0,object:"clsid:D27CDB6E-AE6D-11cf-96B8-444553540000",applet:!0},hasData:function(a){a=a.nodeType?f.cache[a[f.expando]]:a[f.expando];return!!a&&!m(a)},data:function(a,c,d,e){if(!!f.acceptData(a)){var g,h,i,j=f.expando,k=typeof c=="string",l=a.nodeType,m=l?f.cache:a,n=l?a[j]:a[j]&&j,o=c==="events";if((!n||!m[n]||!o&&!e&&!m[n].data)&&k&&d===b)return;n||(l?a[j]=n=++f.uuid:n=j),m[n]||(m[n]={},l||(m[n].toJSON=f.noop));if(typeof c=="object"||typeof c=="function")e?m[n]=f.extend(m[n],c):m[n].data=f.extend(m[n].data,c);g=h=m[n],e||(h.data||(h.data={}),h=h.data),d!==b&&(h[f.camelCase(c)]=d);if(o&&!h[c])return g.events;k?(i=h[c],i==null&&(i=h[f.camelCase(c)])):i=h;return i}},removeData:function(a,b,c){if(!!f.acceptData(a)){var d,e,g,h=f.expando,i=a.nodeType,j=i?f.cache:a,k=i?a[h]:h;if(!j[k])return;if(b){d=c?j[k]:j[k].data;if(d){f.isArray(b)||(b in d?b=[b]:(b=f.camelCase(b),b in d?b=[b]:b=b.split(" ")));for(e=0,g=b.length;e1,null,!1)},removeData:function(a){return this.each(function(){f.removeData(this,a)})}}),f.extend({_mark:function(a,b){a&&(b=(b||"fx")+"mark",f._data(a,b,(f._data(a,b)||0)+1))},_unmark:function(a,b,c){a!==!0&&(c=b,b=a,a=!1);if(b){c=c||"fx";var d=c+"mark",e=a?0:(f._data(b,d)||1)-1;e?f._data(b,d,e):(f.removeData(b,d,!0),n(b,c,"mark"))}},queue:function(a,b,c){var d;if(a){b=(b||"fx")+"queue",d=f._data(a,b),c&&(!d||f.isArray(c)?d=f._data(a,b,f.makeArray(c)):d.push(c));return d||[]}},dequeue:function(a,b){b=b||"fx";var c=f.queue(a,b),d=c.shift(),e={};d==="inprogress"&&(d=c.shift()),d&&(b==="fx"&&c.unshift("inprogress"),f._data(a,b+".run",e),d.call(a,function(){f.dequeue(a,b)},e)),c.length||(f.removeData(a,b+"queue "+b+".run",!0),n(a,b,"queue"))}}),f.fn.extend({queue:function(a,c){var d=2;typeof a!="string"&&(c=a,a="fx",d--);if(arguments.length1)},removeAttr:function(a){return this.each(function(){f.removeAttr(this,a)})},prop:function(a,b){return f.access(this,f.prop,a,b,arguments.length>1)},removeProp:function(a){a=f.propFix[a]||a;return this.each(function(){try{this[a]=b,delete this[a]}catch(c){}})},addClass:function(a){var b,c,d,e,g,h,i;if(f.isFunction(a))return this.each(function(b){f(this).addClass(a.call(this,b,this.className))});if(a&&typeof a=="string"){b=a.split(p);for(c=0,d=this.length;c-1)return!0;return!1},val:function(a){var c,d,e,g=this[0];{if(!!arguments.length){e=f.isFunction(a);return this.each(function(d){var g=f(this),h;if(this.nodeType===1){e?h=a.call(this,d,g.val()):h=a,h==null?h="":typeof h=="number"?h+="":f.isArray(h)&&(h=f.map(h,function(a){return a==null?"":a+""})),c=f.valHooks[this.type]||f.valHooks[this.nodeName.toLowerCase()];if(!c||!("set"in c)||c.set(this,h,"value")===b)this.value=h}})}if(g){c=f.valHooks[g.type]||f.valHooks[g.nodeName.toLowerCase()];if(c&&"get"in c&&(d=c.get(g,"value"))!==b)return d;d=g.value;return typeof d=="string"?d.replace(q,""):d==null?"":d}}}}),f.extend({valHooks:{option:{get:function(a){var b=a.attributes.value;return!b||b.specified?a.value:a.text}},select:{get:function(a){var b,c,d,e,g=a.selectedIndex,h=[],i=a.options,j=a.type==="select-one";if(g<0)return null;c=j?g:0,d=j?g+1:i.length;for(;c=0}),c.length||(a.selectedIndex=-1);return c}}},attrFn:{val:!0,css:!0,html:!0,text:!0,data:!0,width:!0,height:!0,offset:!0},attr:function(a,c,d,e){var g,h,i,j=a.nodeType;if(!!a&&j!==3&&j!==8&&j!==2){if(e&&c in f.attrFn)return f(a)[c](d);if(typeof a.getAttribute=="undefined")return f.prop(a,c,d);i=j!==1||!f.isXMLDoc(a),i&&(c=c.toLowerCase(),h=f.attrHooks[c]||(u.test(c)?x:w));if(d!==b){if(d===null){f.removeAttr(a,c);return}if(h&&"set"in h&&i&&(g=h.set(a,d,c))!==b)return g;a.setAttribute(c,""+d);return d}if(h&&"get"in h&&i&&(g=h.get(a,c))!==null)return g;g=a.getAttribute(c);return g===null?b:g}},removeAttr:function(a,b){var c,d,e,g,h,i=0;if(b&&a.nodeType===1){d=b.toLowerCase().split(p),g=d.length;for(;i=0}})});var z=/^(?:textarea|input|select)$/i,A=/^([^\.]*)?(?:\.(.+))?$/,B=/(?:^|\s)hover(\.\S+)?\b/,C=/^key/,D=/^(?:mouse|contextmenu)|click/,E=/^(?:focusinfocus|focusoutblur)$/,F=/^(\w*)(?:#([\w\-]+))?(?:\.([\w\-]+))?$/,G=function( +a){var b=F.exec(a);b&&(b[1]=(b[1]||"").toLowerCase(),b[3]=b[3]&&new RegExp("(?:^|\\s)"+b[3]+"(?:\\s|$)"));return b},H=function(a,b){var c=a.attributes||{};return(!b[1]||a.nodeName.toLowerCase()===b[1])&&(!b[2]||(c.id||{}).value===b[2])&&(!b[3]||b[3].test((c["class"]||{}).value))},I=function(a){return f.event.special.hover?a:a.replace(B,"mouseenter$1 mouseleave$1")};f.event={add:function(a,c,d,e,g){var h,i,j,k,l,m,n,o,p,q,r,s;if(!(a.nodeType===3||a.nodeType===8||!c||!d||!(h=f._data(a)))){d.handler&&(p=d,d=p.handler,g=p.selector),d.guid||(d.guid=f.guid++),j=h.events,j||(h.events=j={}),i=h.handle,i||(h.handle=i=function(a){return typeof f!="undefined"&&(!a||f.event.triggered!==a.type)?f.event.dispatch.apply(i.elem,arguments):b},i.elem=a),c=f.trim(I(c)).split(" ");for(k=0;k=0&&(h=h.slice(0,-1),k=!0),h.indexOf(".")>=0&&(i=h.split("."),h=i.shift(),i.sort());if((!e||f.event.customEvent[h])&&!f.event.global[h])return;c=typeof c=="object"?c[f.expando]?c:new f.Event(h,c):new f.Event(h),c.type=h,c.isTrigger=!0,c.exclusive=k,c.namespace=i.join("."),c.namespace_re=c.namespace?new RegExp("(^|\\.)"+i.join("\\.(?:.*\\.)?")+"(\\.|$)"):null,o=h.indexOf(":")<0?"on"+h:"";if(!e){j=f.cache;for(l in j)j[l].events&&j[l].events[h]&&f.event.trigger(c,d,j[l].handle.elem,!0);return}c.result=b,c.target||(c.target=e),d=d!=null?f.makeArray(d):[],d.unshift(c),p=f.event.special[h]||{};if(p.trigger&&p.trigger.apply(e,d)===!1)return;r=[[e,p.bindType||h]];if(!g&&!p.noBubble&&!f.isWindow(e)){s=p.delegateType||h,m=E.test(s+h)?e:e.parentNode,n=null;for(;m;m=m.parentNode)r.push([m,s]),n=m;n&&n===e.ownerDocument&&r.push([n.defaultView||n.parentWindow||a,s])}for(l=0;le&&j.push({elem:this,matches:d.slice(e)});for(k=0;k0?this.on(b,null,a,c):this.trigger(b)},f.attrFn&&(f.attrFn[b]=!0),C.test(b)&&(f.event.fixHooks[b]=f.event.keyHooks),D.test(b)&&(f.event.fixHooks[b]=f.event.mouseHooks)}),function(){function x(a,b,c,e,f,g){for(var h=0,i=e.length;h0){k=j;break}}j=j[a]}e[h]=k}}}function w(a,b,c,e,f,g){for(var h=0,i=e.length;h+~,(\[\\]+)+|[>+~])(\s*,\s*)?((?:.|\r|\n)*)/g,d="sizcache"+(Math.random()+"").replace(".",""),e=0,g=Object.prototype.toString,h=!1,i=!0,j=/\\/g,k=/\r\n/g,l=/\W/;[0,0].sort(function(){i=!1;return 0});var m=function(b,d,e,f){e=e||[],d=d||c;var h=d;if(d.nodeType!==1&&d.nodeType!==9)return[];if(!b||typeof b!="string")return e;var i,j,k,l,n,q,r,t,u=!0,v=m.isXML(d),w=[],x=b;do{a.exec(""),i=a.exec(x);if(i){x=i[3],w.push(i[1]);if(i[2]){l=i[3];break}}}while(i);if(w.length>1&&p.exec(b))if(w.length===2&&o.relative[w[0]])j=y(w[0]+w[1],d,f);else{j=o.relative[w[0]]?[d]:m(w.shift(),d);while(w.length)b=w.shift(),o.relative[b]&&(b+=w.shift()),j=y(b,j,f)}else{!f&&w.length>1&&d.nodeType===9&&!v&&o.match.ID.test(w[0])&&!o.match.ID.test(w[w.length-1])&&(n=m.find(w.shift(),d,v),d=n.expr?m.filter(n.expr,n.set)[0]:n.set[0]);if(d){n=f?{expr:w.pop(),set:s(f)}:m.find(w.pop(),w.length===1&&(w[0]==="~"||w[0]==="+")&&d.parentNode?d.parentNode:d,v),j=n.expr?m.filter(n.expr,n.set):n.set,w.length>0?k=s(j):u=!1;while(w.length)q=w.pop(),r=q,o.relative[q]?r=w.pop():q="",r==null&&(r=d),o.relative[q](k,r,v)}else k=w=[]}k||(k=j),k||m.error(q||b);if(g.call(k)==="[object Array]")if(!u)e.push.apply(e,k);else if(d&&d.nodeType===1)for(t=0;k[t]!=null;t++)k[t]&&(k[t]===!0||k[t].nodeType===1&&m.contains(d,k[t]))&&e.push(j[t]);else for(t=0;k[t]!=null;t++)k[t]&&k[t].nodeType===1&&e.push(j[t]);else s(k,e);l&&(m(l,h,e,f),m.uniqueSort(e));return e};m.uniqueSort=function(a){if(u){h=i,a.sort(u);if(h)for(var b=1;b0},m.find=function(a,b,c){var d,e,f,g,h,i;if(!a)return[];for(e=0,f=o.order.length;e":function(a,b){var c,d=typeof b=="string",e=0,f=a.length;if(d&&!l.test(b)){b=b.toLowerCase();for(;e=0)?c||d.push(h):c&&(b[g]=!1));return!1},ID:function(a){return a[1].replace(j,"")},TAG:function(a,b){return a[1].replace(j,"").toLowerCase()},CHILD:function(a){if(a[1]==="nth"){a[2]||m.error(a[0]),a[2]=a[2].replace(/^\+|\s*/g,"");var b=/(-?)(\d*)(?:n([+\-]?\d*))?/.exec(a[2]==="even"&&"2n"||a[2]==="odd"&&"2n+1"||!/\D/.test(a[2])&&"0n+"+a[2]||a[2]);a[2]=b[1]+(b[2]||1)-0,a[3]=b[3]-0}else a[2]&&m.error(a[0]);a[0]=e++;return a},ATTR:function(a,b,c,d,e,f){var g=a[1]=a[1].replace(j,"");!f&&o.attrMap[g]&&(a[1]=o.attrMap[g]),a[4]=(a[4]||a[5]||"").replace(j,""),a[2]==="~="&&(a[4]=" "+a[4]+" ");return a},PSEUDO:function(b,c,d,e,f){if(b[1]==="not")if((a.exec(b[3])||"").length>1||/^\w/.test(b[3]))b[3]=m(b[3],null,null,c);else{var g=m.filter(b[3],c,d,!0^f);d||e.push.apply(e,g);return!1}else if(o.match.POS.test(b[0])||o.match.CHILD.test(b[0]))return!0;return b},POS:function(a){a.unshift(!0);return a}},filters:{enabled:function(a){return a.disabled===!1&&a.type!=="hidden"},disabled:function(a){return a.disabled===!0},checked:function(a){return a.checked===!0},selected:function(a){a.parentNode&&a.parentNode.selectedIndex;return a.selected===!0},parent:function(a){return!!a.firstChild},empty:function(a){return!a.firstChild},has:function(a,b,c){return!!m(c[3],a).length},header:function(a){return/h\d/i.test(a.nodeName)},text:function(a){var b=a.getAttribute("type"),c=a.type;return a.nodeName.toLowerCase()==="input"&&"text"===c&&(b===c||b===null)},radio:function(a){return a.nodeName.toLowerCase()==="input"&&"radio"===a.type},checkbox:function(a){return a.nodeName.toLowerCase()==="input"&&"checkbox"===a.type},file:function(a){return a.nodeName.toLowerCase()==="input"&&"file"===a.type},password:function(a){return a.nodeName.toLowerCase()==="input"&&"password"===a.type},submit:function(a){var b=a.nodeName.toLowerCase();return(b==="input"||b==="button")&&"submit"===a.type},image:function(a){return a.nodeName.toLowerCase()==="input"&&"image"===a.type},reset:function(a){var b=a.nodeName.toLowerCase();return(b==="input"||b==="button")&&"reset"===a.type},button:function(a){var b=a.nodeName.toLowerCase();return b==="input"&&"button"===a.type||b==="button"},input:function(a){return/input|select|textarea|button/i.test(a.nodeName)},focus:function(a){return a===a.ownerDocument.activeElement}},setFilters:{first:function(a,b){return b===0},last:function(a,b,c,d){return b===d.length-1},even:function(a,b){return b%2===0},odd:function(a,b){return b%2===1},lt:function(a,b,c){return bc[3]-0},nth:function(a,b,c){return c[3]-0===b},eq:function(a,b,c){return c[3]-0===b}},filter:{PSEUDO:function(a,b,c,d){var e=b[1],f=o.filters[e];if(f)return f(a,c,b,d);if(e==="contains")return(a.textContent||a.innerText||n([a])||"").indexOf(b[3])>=0;if(e==="not"){var g=b[3];for(var h=0,i=g.length;h=0}},ID:function(a,b){return a.nodeType===1&&a.getAttribute("id")===b},TAG:function(a,b){return b==="*"&&a.nodeType===1||!!a.nodeName&&a.nodeName.toLowerCase()===b},CLASS:function(a,b){return(" "+(a.className||a.getAttribute("class"))+" ").indexOf(b)>-1},ATTR:function(a,b){var c=b[1],d=m.attr?m.attr(a,c):o.attrHandle[c]?o.attrHandle[c](a):a[c]!=null?a[c]:a.getAttribute(c),e=d+"",f=b[2],g=b[4];return d==null?f==="!=":!f&&m.attr?d!=null:f==="="?e===g:f==="*="?e.indexOf(g)>=0:f==="~="?(" "+e+" ").indexOf(g)>=0:g?f==="!="?e!==g:f==="^="?e.indexOf(g)===0:f==="$="?e.substr(e.length-g.length)===g:f==="|="?e===g||e.substr(0,g.length+1)===g+"-":!1:e&&d!==!1},POS:function(a,b,c,d){var e=b[2],f=o.setFilters[e];if(f)return f(a,c,b,d)}}},p=o.match.POS,q=function(a,b){return"\\"+(b-0+1)};for(var r in o.match)o.match[r]=new RegExp(o.match[r].source+/(?![^\[]*\])(?![^\(]*\))/.source),o.leftMatch[r]=new RegExp(/(^(?:.|\r|\n)*?)/.source+o.match[r].source.replace(/\\(\d+)/g,q));o.match.globalPOS=p;var s=function(a,b){a=Array.prototype.slice.call(a,0);if(b){b.push.apply(b,a);return b}return a};try{Array.prototype.slice.call(c.documentElement.childNodes,0)[0].nodeType}catch(t){s=function(a,b){var c=0,d=b||[];if(g.call(a)==="[object Array]")Array.prototype.push.apply(d,a);else if(typeof a.length=="number")for(var e=a.length;c",e.insertBefore(a,e.firstChild),c.getElementById(d)&&(o.find.ID=function(a,c,d){if(typeof c.getElementById!="undefined"&&!d){var e=c.getElementById(a[1]);return e?e.id===a[1]||typeof e.getAttributeNode!="undefined"&&e.getAttributeNode("id").nodeValue===a[1]?[e]:b:[]}},o.filter.ID=function(a,b){var c=typeof a.getAttributeNode!="undefined"&&a.getAttributeNode("id");return a.nodeType===1&&c&&c.nodeValue===b}),e.removeChild(a),e=a=null}(),function(){var a=c.createElement("div");a.appendChild(c.createComment("")),a.getElementsByTagName("*").length>0&&(o.find.TAG=function(a,b){var c=b.getElementsByTagName(a[1]);if(a[1]==="*"){var d=[];for(var e=0;c[e];e++)c[e].nodeType===1&&d.push(c[e]);c=d}return c}),a.innerHTML="",a.firstChild&&typeof a.firstChild.getAttribute!="undefined"&&a.firstChild.getAttribute("href")!=="#"&&(o.attrHandle.href=function(a){return a.getAttribute("href",2)}),a=null}(),c.querySelectorAll&&function(){var a=m,b=c.createElement("div"),d="__sizzle__";b.innerHTML="

      ";if(!b.querySelectorAll||b.querySelectorAll(".TEST").length!==0){m=function(b,e,f,g){e=e||c;if(!g&&!m.isXML(e)){var h=/^(\w+$)|^\.([\w\-]+$)|^#([\w\-]+$)/.exec(b);if(h&&(e.nodeType===1||e.nodeType===9)){if(h[1])return s(e.getElementsByTagName(b),f);if(h[2]&&o.find.CLASS&&e.getElementsByClassName)return s(e.getElementsByClassName(h[2]),f)}if(e.nodeType===9){if(b==="body"&&e.body)return s([e.body],f);if(h&&h[3]){var i=e.getElementById(h[3]);if(!i||!i.parentNode)return s([],f);if(i.id===h[3])return s([i],f)}try{return s(e.querySelectorAll(b),f)}catch(j){}}else if(e.nodeType===1&&e.nodeName.toLowerCase()!=="object"){var k=e,l=e.getAttribute("id"),n=l||d,p=e.parentNode,q=/^\s*[+~]/.test(b);l?n=n.replace(/'/g,"\\$&"):e.setAttribute("id",n),q&&p&&(e=e.parentNode);try{if(!q||p)return s(e.querySelectorAll("[id='"+n+"'] "+b),f)}catch(r){}finally{l||k.removeAttribute("id")}}}return a(b,e,f,g)};for(var e in a)m[e]=a[e];b=null}}(),function(){var a=c.documentElement,b=a.matchesSelector||a.mozMatchesSelector||a.webkitMatchesSelector||a.msMatchesSelector;if(b){var d=!b.call(c.createElement("div"),"div"),e=!1;try{b.call(c.documentElement,"[test!='']:sizzle")}catch(f){e=!0}m.matchesSelector=function(a,c){c=c.replace(/\=\s*([^'"\]]*)\s*\]/g,"='$1']");if(!m.isXML(a))try{if(e||!o.match.PSEUDO.test(c)&&!/!=/.test(c)){var f=b.call(a,c);if(f||!d||a.document&&a.document.nodeType!==11)return f}}catch(g){}return m(c,null,null,[a]).length>0}}}(),function(){var a=c.createElement("div");a.innerHTML="
      ";if(!!a.getElementsByClassName&&a.getElementsByClassName("e").length!==0){a.lastChild.className="e";if(a.getElementsByClassName("e").length===1)return;o.order.splice(1,0,"CLASS"),o.find.CLASS=function(a,b,c){if(typeof b.getElementsByClassName!="undefined"&&!c)return b.getElementsByClassName(a[1])},a=null}}(),c.documentElement.contains?m.contains=function(a,b){return a!==b&&(a.contains?a.contains(b):!0)}:c.documentElement.compareDocumentPosition?m.contains=function(a,b){return!!(a.compareDocumentPosition(b)&16)}:m.contains=function(){return!1},m.isXML=function(a){var b=(a?a.ownerDocument||a:0).documentElement;return b?b.nodeName!=="HTML":!1};var y=function(a,b,c){var d,e=[],f="",g=b.nodeType?[b]:b;while(d=o.match.PSEUDO.exec(a))f+=d[0],a=a.replace(o.match.PSEUDO,"");a=o.relative[a]?a+"*":a;for(var h=0,i=g.length;h0)for(h=g;h=0:f.filter(a,this).length>0:this.filter(a).length>0)},closest:function(a,b){var c=[],d,e,g=this[0];if(f.isArray(a)){var h=1;while(g&&g.ownerDocument&&g!==b){for(d=0;d-1:f.find.matchesSelector(g,a)){c.push(g);break}g=g.parentNode;if(!g||!g.ownerDocument||g===b||g.nodeType===11)break}}c=c.length>1?f.unique(c):c;return this.pushStack(c,"closest",a)},index:function(a){if(!a)return this[0]&&this[0].parentNode?this.prevAll().length:-1;if(typeof a=="string")return f.inArray(this[0],f(a));return f.inArray(a.jquery?a[0]:a,this)},add:function(a,b){var c=typeof a=="string"?f(a,b):f.makeArray(a&&a.nodeType?[a]:a),d=f.merge(this.get(),c);return this.pushStack(S(c[0])||S(d[0])?d:f.unique(d))},andSelf:function(){return this.add(this.prevObject)}}),f.each({parent:function(a){var b=a.parentNode;return b&&b.nodeType!==11?b:null},parents:function(a){return f.dir(a,"parentNode")},parentsUntil:function(a,b,c){return f.dir(a,"parentNode",c)},next:function(a){return f.nth(a,2,"nextSibling")},prev:function(a){return f.nth(a,2,"previousSibling")},nextAll:function(a){return f.dir(a,"nextSibling")},prevAll:function(a){return f.dir(a,"previousSibling")},nextUntil:function(a,b,c){return f.dir(a,"nextSibling",c)},prevUntil:function(a,b,c){return f.dir(a,"previousSibling",c)},siblings:function(a){return f.sibling((a.parentNode||{}).firstChild,a)},children:function(a){return f.sibling(a.firstChild)},contents:function(a){return f.nodeName(a,"iframe")?a.contentDocument||a.contentWindow.document:f.makeArray(a.childNodes)}},function(a,b){f.fn[a]=function(c,d){var e=f.map(this,b,c);L.test(a)||(d=c),d&&typeof d=="string"&&(e=f.filter(d,e)),e=this.length>1&&!R[a]?f.unique(e):e,(this.length>1||N.test(d))&&M.test(a)&&(e=e.reverse());return this.pushStack(e,a,P.call(arguments).join(","))}}),f.extend({filter:function(a,b,c){c&&(a=":not("+a+")");return b.length===1?f.find.matchesSelector(b[0],a)?[b[0]]:[]:f.find.matches(a,b)},dir:function(a,c,d){var e=[],g=a[c];while(g&&g.nodeType!==9&&(d===b||g.nodeType!==1||!f(g).is(d)))g.nodeType===1&&e.push(g),g=g[c];return e},nth:function(a,b,c,d){b=b||1;var e=0;for(;a;a=a[c])if(a.nodeType===1&&++e===b)break;return a},sibling:function(a,b){var c=[];for(;a;a=a.nextSibling)a.nodeType===1&&a!==b&&c.push(a);return c}});var V="abbr|article|aside|audio|bdi|canvas|data|datalist|details|figcaption|figure|footer|header|hgroup|mark|meter|nav|output|progress|section|summary|time|video",W=/ jQuery\d+="(?:\d+|null)"/g,X=/^\s+/,Y=/<(?!area|br|col|embed|hr|img|input|link|meta|param)(([\w:]+)[^>]*)\/>/ig,Z=/<([\w:]+)/,$=/]","i"),bd=/checked\s*(?:[^=]|=\s*.checked.)/i,be=/\/(java|ecma)script/i,bf=/^\s*",""],legend:[1,"
      ","
      "],thead:[1,"","
      "],tr:[2,"","
      "],td:[3,"","
      "],col:[2,"","
      "],area:[1,"",""],_default:[0,"",""]},bh=U(c);bg.optgroup=bg.option,bg.tbody=bg.tfoot=bg.colgroup=bg.caption=bg.thead,bg.th=bg.td,f.support.htmlSerialize||(bg._default=[1,"div
      ","
      "]),f.fn.extend({text:function(a){return f.access(this,function(a){return a===b?f.text(this):this.empty().append((this[0]&&this[0].ownerDocument||c).createTextNode(a))},null,a,arguments.length)},wrapAll:function(a){if(f.isFunction(a))return this.each(function(b){f(this).wrapAll(a.call(this,b))});if(this[0]){var b=f(a,this[0].ownerDocument).eq(0).clone(!0);this[0].parentNode&&b.insertBefore(this[0]),b.map(function(){var a=this;while(a.firstChild&&a.firstChild.nodeType===1)a=a.firstChild;return a}).append(this)}return this},wrapInner:function(a){if(f.isFunction(a))return this.each(function(b){f(this).wrapInner(a.call(this,b))});return this.each(function(){var b=f(this),c=b.contents();c.length?c.wrapAll(a):b.append(a)})},wrap:function(a){var b=f.isFunction(a);return this.each(function(c){f(this).wrapAll(b?a.call(this,c):a)})},unwrap:function(){return this.parent().each(function(){f.nodeName(this,"body")||f(this).replaceWith(this.childNodes)}).end()},append:function(){return this.domManip(arguments,!0,function(a){this.nodeType===1&&this.appendChild(a)})},prepend:function(){return this.domManip(arguments,!0,function(a){this.nodeType===1&&this.insertBefore(a,this.firstChild)})},before:function(){if(this[0]&&this[0].parentNode)return this.domManip(arguments,!1,function(a){this.parentNode.insertBefore(a,this)});if(arguments.length){var a=f +.clean(arguments);a.push.apply(a,this.toArray());return this.pushStack(a,"before",arguments)}},after:function(){if(this[0]&&this[0].parentNode)return this.domManip(arguments,!1,function(a){this.parentNode.insertBefore(a,this.nextSibling)});if(arguments.length){var a=this.pushStack(this,"after",arguments);a.push.apply(a,f.clean(arguments));return a}},remove:function(a,b){for(var c=0,d;(d=this[c])!=null;c++)if(!a||f.filter(a,[d]).length)!b&&d.nodeType===1&&(f.cleanData(d.getElementsByTagName("*")),f.cleanData([d])),d.parentNode&&d.parentNode.removeChild(d);return this},empty:function(){for(var a=0,b;(b=this[a])!=null;a++){b.nodeType===1&&f.cleanData(b.getElementsByTagName("*"));while(b.firstChild)b.removeChild(b.firstChild)}return this},clone:function(a,b){a=a==null?!1:a,b=b==null?a:b;return this.map(function(){return f.clone(this,a,b)})},html:function(a){return f.access(this,function(a){var c=this[0]||{},d=0,e=this.length;if(a===b)return c.nodeType===1?c.innerHTML.replace(W,""):null;if(typeof a=="string"&&!ba.test(a)&&(f.support.leadingWhitespace||!X.test(a))&&!bg[(Z.exec(a)||["",""])[1].toLowerCase()]){a=a.replace(Y,"<$1>");try{for(;d1&&l0?this.clone(!0):this).get();f(e[h])[b](j),d=d.concat(j)}return this.pushStack(d,a,e.selector)}}),f.extend({clone:function(a,b,c){var d,e,g,h=f.support.html5Clone||f.isXMLDoc(a)||!bc.test("<"+a.nodeName+">")?a.cloneNode(!0):bo(a);if((!f.support.noCloneEvent||!f.support.noCloneChecked)&&(a.nodeType===1||a.nodeType===11)&&!f.isXMLDoc(a)){bk(a,h),d=bl(a),e=bl(h);for(g=0;d[g];++g)e[g]&&bk(d[g],e[g])}if(b){bj(a,h);if(c){d=bl(a),e=bl(h);for(g=0;d[g];++g)bj(d[g],e[g])}}d=e=null;return h},clean:function(a,b,d,e){var g,h,i,j=[];b=b||c,typeof b.createElement=="undefined"&&(b=b.ownerDocument||b[0]&&b[0].ownerDocument||c);for(var k=0,l;(l=a[k])!=null;k++){typeof l=="number"&&(l+="");if(!l)continue;if(typeof l=="string")if(!_.test(l))l=b.createTextNode(l);else{l=l.replace(Y,"<$1>");var m=(Z.exec(l)||["",""])[1].toLowerCase(),n=bg[m]||bg._default,o=n[0],p=b.createElement("div"),q=bh.childNodes,r;b===c?bh.appendChild(p):U(b).appendChild(p),p.innerHTML=n[1]+l+n[2];while(o--)p=p.lastChild;if(!f.support.tbody){var s=$.test(l),t=m==="table"&&!s?p.firstChild&&p.firstChild.childNodes:n[1]===""&&!s?p.childNodes:[];for(i=t.length-1;i>=0;--i)f.nodeName(t[i],"tbody")&&!t[i].childNodes.length&&t[i].parentNode.removeChild(t[i])}!f.support.leadingWhitespace&&X.test(l)&&p.insertBefore(b.createTextNode(X.exec(l)[0]),p.firstChild),l=p.childNodes,p&&(p.parentNode.removeChild(p),q.length>0&&(r=q[q.length-1],r&&r.parentNode&&r.parentNode.removeChild(r)))}var u;if(!f.support.appendChecked)if(l[0]&&typeof (u=l.length)=="number")for(i=0;i1)},f.extend({cssHooks:{opacity:{get:function(a,b){if(b){var c=by(a,"opacity");return c===""?"1":c}return a.style.opacity}}},cssNumber:{fillOpacity:!0,fontWeight:!0,lineHeight:!0,opacity:!0,orphans:!0,widows:!0,zIndex:!0,zoom:!0},cssProps:{"float":f.support.cssFloat?"cssFloat":"styleFloat"},style:function(a,c,d,e){if(!!a&&a.nodeType!==3&&a.nodeType!==8&&!!a.style){var g,h,i=f.camelCase(c),j=a.style,k=f.cssHooks[i];c=f.cssProps[i]||i;if(d===b){if(k&&"get"in k&&(g=k.get(a,!1,e))!==b)return g;return j[c]}h=typeof d,h==="string"&&(g=bu.exec(d))&&(d=+(g[1]+1)*+g[2]+parseFloat(f.css(a,c)),h="number");if(d==null||h==="number"&&isNaN(d))return;h==="number"&&!f.cssNumber[i]&&(d+="px");if(!k||!("set"in k)||(d=k.set(a,d))!==b)try{j[c]=d}catch(l){}}},css:function(a,c,d){var e,g;c=f.camelCase(c),g=f.cssHooks[c],c=f.cssProps[c]||c,c==="cssFloat"&&(c="float");if(g&&"get"in g&&(e=g.get(a,!0,d))!==b)return e;if(by)return by(a,c)},swap:function(a,b,c){var d={},e,f;for(f in b)d[f]=a.style[f],a.style[f]=b[f];e=c.call(a);for(f in b)a.style[f]=d[f];return e}}),f.curCSS=f.css,c.defaultView&&c.defaultView.getComputedStyle&&(bz=function(a,b){var c,d,e,g,h=a.style;b=b.replace(br,"-$1").toLowerCase(),(d=a.ownerDocument.defaultView)&&(e=d.getComputedStyle(a,null))&&(c=e.getPropertyValue(b),c===""&&!f.contains(a.ownerDocument.documentElement,a)&&(c=f.style(a,b))),!f.support.pixelMargin&&e&&bv.test(b)&&bt.test(c)&&(g=h.width,h.width=c,c=e.width,h.width=g);return c}),c.documentElement.currentStyle&&(bA=function(a,b){var c,d,e,f=a.currentStyle&&a.currentStyle[b],g=a.style;f==null&&g&&(e=g[b])&&(f=e),bt.test(f)&&(c=g.left,d=a.runtimeStyle&&a.runtimeStyle.left,d&&(a.runtimeStyle.left=a.currentStyle.left),g.left=b==="fontSize"?"1em":f,f=g.pixelLeft+"px",g.left=c,d&&(a.runtimeStyle.left=d));return f===""?"auto":f}),by=bz||bA,f.each(["height","width"],function(a,b){f.cssHooks[b]={get:function(a,c,d){if(c)return a.offsetWidth!==0?bB(a,b,d):f.swap(a,bw,function(){return bB(a,b,d)})},set:function(a,b){return bs.test(b)?b+"px":b}}}),f.support.opacity||(f.cssHooks.opacity={get:function(a,b){return bq.test((b&&a.currentStyle?a.currentStyle.filter:a.style.filter)||"")?parseFloat(RegExp.$1)/100+"":b?"1":""},set:function(a,b){var c=a.style,d=a.currentStyle,e=f.isNumeric(b)?"alpha(opacity="+b*100+")":"",g=d&&d.filter||c.filter||"";c.zoom=1;if(b>=1&&f.trim(g.replace(bp,""))===""){c.removeAttribute("filter");if(d&&!d.filter)return}c.filter=bp.test(g)?g.replace(bp,e):g+" "+e}}),f(function(){f.support.reliableMarginRight||(f.cssHooks.marginRight={get:function(a,b){return f.swap(a,{display:"inline-block"},function(){return b?by(a,"margin-right"):a.style.marginRight})}})}),f.expr&&f.expr.filters&&(f.expr.filters.hidden=function(a){var b=a.offsetWidth,c=a.offsetHeight;return b===0&&c===0||!f.support.reliableHiddenOffsets&&(a.style&&a.style.display||f.css(a,"display"))==="none"},f.expr.filters.visible=function(a){return!f.expr.filters.hidden(a)}),f.each({margin:"",padding:"",border:"Width"},function(a,b){f.cssHooks[a+b]={expand:function(c){var d,e=typeof c=="string"?c.split(" "):[c],f={};for(d=0;d<4;d++)f[a+bx[d]+b]=e[d]||e[d-2]||e[0];return f}}});var bC=/%20/g,bD=/\[\]$/,bE=/\r?\n/g,bF=/#.*$/,bG=/^(.*?):[ \t]*([^\r\n]*)\r?$/mg,bH=/^(?:color|date|datetime|datetime-local|email|hidden|month|number|password|range|search|tel|text|time|url|week)$/i,bI=/^(?:about|app|app\-storage|.+\-extension|file|res|widget):$/,bJ=/^(?:GET|HEAD)$/,bK=/^\/\//,bL=/\?/,bM=/)<[^<]*)*<\/script>/gi,bN=/^(?:select|textarea)/i,bO=/\s+/,bP=/([?&])_=[^&]*/,bQ=/^([\w\+\.\-]+:)(?:\/\/([^\/?#:]*)(?::(\d+))?)?/,bR=f.fn.load,bS={},bT={},bU,bV,bW=["*/"]+["*"];try{bU=e.href}catch(bX){bU=c.createElement("a"),bU.href="",bU=bU.href}bV=bQ.exec(bU.toLowerCase())||[],f.fn.extend({load:function(a,c,d){if(typeof a!="string"&&bR)return bR.apply(this,arguments);if(!this.length)return this;var e=a.indexOf(" ");if(e>=0){var g=a.slice(e,a.length);a=a.slice(0,e)}var h="GET";c&&(f.isFunction(c)?(d=c,c=b):typeof c=="object"&&(c=f.param(c,f.ajaxSettings.traditional),h="POST"));var i=this;f.ajax({url:a,type:h,dataType:"html",data:c,complete:function(a,b,c){c=a.responseText,a.isResolved()&&(a.done(function(a){c=a}),i.html(g?f("
      ").append(c.replace(bM,"")).find(g):c)),d&&i.each(d,[c,b,a])}});return this},serialize:function(){return f.param(this.serializeArray())},serializeArray:function(){return this.map(function(){return this.elements?f.makeArray(this.elements):this}).filter(function(){return this.name&&!this.disabled&&(this.checked||bN.test(this.nodeName)||bH.test(this.type))}).map(function(a,b){var c=f(this).val();return c==null?null:f.isArray(c)?f.map(c,function(a,c){return{name:b.name,value:a.replace(bE,"\r\n")}}):{name:b.name,value:c.replace(bE,"\r\n")}}).get()}}),f.each("ajaxStart ajaxStop ajaxComplete ajaxError ajaxSuccess ajaxSend".split(" "),function(a,b){f.fn[b]=function(a){return this.on(b,a)}}),f.each(["get","post"],function(a,c){f[c]=function(a,d,e,g){f.isFunction(d)&&(g=g||e,e=d,d=b);return f.ajax({type:c,url:a,data:d,success:e,dataType:g})}}),f.extend({getScript:function(a,c){return f.get(a,b,c,"script")},getJSON:function(a,b,c){return f.get(a,b,c,"json")},ajaxSetup:function(a,b){b?b$(a,f.ajaxSettings):(b=a,a=f.ajaxSettings),b$(a,b);return a},ajaxSettings:{url:bU,isLocal:bI.test(bV[1]),global:!0,type:"GET",contentType:"application/x-www-form-urlencoded; charset=UTF-8",processData:!0,async:!0,accepts:{xml:"application/xml, text/xml",html:"text/html",text:"text/plain",json:"application/json, text/javascript","*":bW},contents:{xml:/xml/,html:/html/,json:/json/},responseFields:{xml:"responseXML",text:"responseText"},converters:{"* text":a.String,"text html":!0,"text json":f.parseJSON,"text xml":f.parseXML},flatOptions:{context:!0,url:!0}},ajaxPrefilter:bY(bS),ajaxTransport:bY(bT),ajax:function(a,c){function w(a,c,l,m){if(s!==2){s=2,q&&clearTimeout(q),p=b,n=m||"",v.readyState=a>0?4:0;var o,r,u,w=c,x=l?ca(d,v,l):b,y,z;if(a>=200&&a<300||a===304){if(d.ifModified){if(y=v.getResponseHeader("Last-Modified"))f.lastModified[k]=y;if(z=v.getResponseHeader("Etag"))f.etag[k]=z}if(a===304)w="notmodified",o=!0;else try{r=cb(d,x),w="success",o=!0}catch(A){w="parsererror",u=A}}else{u=w;if(!w||a)w="error",a<0&&(a=0)}v.status=a,v.statusText=""+(c||w),o?h.resolveWith(e,[r,w,v]):h.rejectWith(e,[v,w,u]),v.statusCode(j),j=b,t&&g.trigger("ajax"+(o?"Success":"Error"),[v,d,o?r:u]),i.fireWith(e,[v,w]),t&&(g.trigger("ajaxComplete",[v,d]),--f.active||f.event.trigger("ajaxStop"))}}typeof a=="object"&&(c=a,a=b),c=c||{};var d=f.ajaxSetup({},c),e=d.context||d,g=e!==d&&(e.nodeType||e instanceof f)?f(e):f.event,h=f.Deferred(),i=f.Callbacks("once memory"),j=d.statusCode||{},k,l={},m={},n,o,p,q,r,s=0,t,u,v={readyState:0,setRequestHeader:function(a,b){if(!s){var c=a.toLowerCase();a=m[c]=m[c]||a,l[a]=b}return this},getAllResponseHeaders:function(){return s===2?n:null},getResponseHeader:function(a){var c;if(s===2){if(!o){o={};while(c=bG.exec(n))o[c[1].toLowerCase()]=c[2]}c=o[a.toLowerCase()]}return c===b?null:c},overrideMimeType:function(a){s||(d.mimeType=a);return this},abort:function(a){a=a||"abort",p&&p.abort(a),w(0,a);return this}};h.promise(v),v.success=v.done,v.error=v.fail,v.complete=i.add,v.statusCode=function(a){if(a){var b;if(s<2)for(b in a)j[b]=[j[b],a[b]];else b=a[v.status],v.then(b,b)}return this},d.url=((a||d.url)+"").replace(bF,"").replace(bK,bV[1]+"//"),d.dataTypes=f.trim(d.dataType||"*").toLowerCase().split(bO),d.crossDomain==null&&(r=bQ.exec(d.url.toLowerCase()),d.crossDomain=!(!r||r[1]==bV[1]&&r[2]==bV[2]&&(r[3]||(r[1]==="http:"?80:443))==(bV[3]||(bV[1]==="http:"?80:443)))),d.data&&d.processData&&typeof d.data!="string"&&(d.data=f.param(d.data,d.traditional)),bZ(bS,d,c,v);if(s===2)return!1;t=d.global,d.type=d.type.toUpperCase(),d.hasContent=!bJ.test(d.type),t&&f.active++===0&&f.event.trigger("ajaxStart");if(!d.hasContent){d.data&&(d.url+=(bL.test(d.url)?"&":"?")+d.data,delete d.data),k=d.url;if(d.cache===!1){var x=f.now(),y=d.url.replace(bP,"$1_="+x);d.url=y+(y===d.url?(bL.test(d.url)?"&":"?")+"_="+x:"")}}(d.data&&d.hasContent&&d.contentType!==!1||c.contentType)&&v.setRequestHeader("Content-Type",d.contentType),d.ifModified&&(k=k||d.url,f.lastModified[k]&&v.setRequestHeader("If-Modified-Since",f.lastModified[k]),f.etag[k]&&v.setRequestHeader("If-None-Match",f.etag[k])),v.setRequestHeader("Accept",d.dataTypes[0]&&d.accepts[d.dataTypes[0]]?d.accepts[d.dataTypes[0]]+(d.dataTypes[0]!=="*"?", "+bW+"; q=0.01":""):d.accepts["*"]);for(u in d.headers)v.setRequestHeader(u,d.headers[u]);if(d.beforeSend&&(d.beforeSend.call(e,v,d)===!1||s===2)){v.abort();return!1}for(u in{success:1,error:1,complete:1})v[u](d[u]);p=bZ(bT,d,c,v);if(!p)w(-1,"No Transport");else{v.readyState=1,t&&g.trigger("ajaxSend",[v,d]),d.async&&d.timeout>0&&(q=setTimeout(function(){v.abort("timeout")},d.timeout));try{s=1,p.send(l,w)}catch(z){if(s<2)w(-1,z);else throw z}}return v},param:function(a,c){var d=[],e=function(a,b){b=f.isFunction(b)?b():b,d[d.length]=encodeURIComponent(a)+"="+encodeURIComponent(b)};c===b&&(c=f.ajaxSettings.traditional);if(f.isArray(a)||a.jquery&&!f.isPlainObject(a))f.each(a,function(){e(this.name,this.value)});else for(var g in a)b_(g,a[g],c,e);return d.join("&").replace(bC,"+")}}),f.extend({active:0,lastModified:{},etag:{}});var cc=f.now(),cd=/(\=)\?(&|$)|\?\?/i;f.ajaxSetup({jsonp:"callback",jsonpCallback:function(){return f.expando+"_"+cc++}}),f.ajaxPrefilter("json jsonp",function(b,c,d){var e=typeof b.data=="string"&&/^application\/x\-www\-form\-urlencoded/.test(b.contentType);if(b.dataTypes[0]==="jsonp"||b.jsonp!==!1&&(cd.test(b.url)||e&&cd.test(b.data))){var g,h=b.jsonpCallback=f.isFunction(b.jsonpCallback)?b.jsonpCallback():b.jsonpCallback,i=a[h],j=b.url,k=b.data,l="$1"+h+"$2";b.jsonp!==!1&&(j=j.replace(cd,l),b.url===j&&(e&&(k=k.replace(cd,l)),b.data===k&&(j+=(/\?/.test(j)?"&":"?")+b.jsonp+"="+h))),b.url=j,b.data=k,a[h]=function(a){g=[a]},d.always(function(){a[h]=i,g&&f.isFunction(i)&&a[h](g[0])}),b.converters["script json"]=function(){g||f.error(h+" was not called");return g[0]},b.dataTypes[0]="json";return"script"}}),f.ajaxSetup({accepts:{script:"text/javascript, application/javascript, application/ecmascript, application/x-ecmascript"},contents:{script:/javascript|ecmascript/},converters:{"text script":function(a){f.globalEval(a);return a}}}),f.ajaxPrefilter("script",function(a){a.cache===b&&(a.cache=!1),a.crossDomain&&(a.type="GET",a.global=!1)}),f.ajaxTransport("script",function(a){if(a.crossDomain){var d,e=c.head||c.getElementsByTagName("head")[0]||c.documentElement;return{send:function(f,g){d=c.createElement("script"),d.async="async",a.scriptCharset&&(d.charset=a.scriptCharset),d.src=a.url,d.onload=d.onreadystatechange=function(a,c){if(c||!d.readyState||/loaded|complete/.test(d.readyState))d.onload=d.onreadystatechange=null,e&&d.parentNode&&e.removeChild(d),d=b,c||g(200,"success")},e.insertBefore(d,e.firstChild)},abort:function(){d&&d.onload(0,1)}}}});var ce=a.ActiveXObject?function(){for(var a in cg)cg[a](0,1)}:!1,cf=0,cg;f.ajaxSettings.xhr=a.ActiveXObject?function(){return!this.isLocal&&ch()||ci()}:ch,function(a){f.extend(f.support,{ajax:!!a,cors:!!a&&"withCredentials"in a})}(f.ajaxSettings.xhr()),f.support.ajax&&f.ajaxTransport(function(c){if(!c.crossDomain||f.support.cors){var d;return{send:function(e,g){var h=c.xhr(),i,j;c.username?h.open(c.type,c.url,c.async,c.username,c.password):h.open(c.type,c.url,c.async);if(c.xhrFields)for(j in c.xhrFields)h[j]=c.xhrFields[j];c.mimeType&&h.overrideMimeType&&h.overrideMimeType(c.mimeType),!c.crossDomain&&!e["X-Requested-With"]&&(e["X-Requested-With"]="XMLHttpRequest");try{for(j in e)h.setRequestHeader(j,e[j])}catch(k){}h.send(c.hasContent&&c.data||null),d=function(a,e){var j,k,l,m,n;try{if(d&&(e||h.readyState===4)){d=b,i&&(h.onreadystatechange=f.noop,ce&&delete cg[i]);if(e)h.readyState!==4&&h.abort();else{j=h.status,l=h.getAllResponseHeaders(),m={},n=h.responseXML,n&&n.documentElement&&(m.xml=n);try{m.text=h.responseText}catch(a){}try{k=h.statusText}catch(o){k=""}!j&&c.isLocal&&!c.crossDomain?j=m.text?200:404:j===1223&&(j=204)}}}catch(p){e||g(-1,p)}m&&g(j,k,m,l)},!c.async||h.readyState===4?d():(i=++cf,ce&&(cg||(cg={},f(a).unload(ce)),cg[i]=d),h.onreadystatechange=d)},abort:function(){d&&d(0,1)}}}});var cj={},ck,cl,cm=/^(?:toggle|show|hide)$/,cn=/^([+\-]=)?([\d+.\-]+)([a-z%]*)$/i,co,cp=[["height","marginTop","marginBottom","paddingTop","paddingBottom"],["width","marginLeft","marginRight","paddingLeft","paddingRight"],["opacity"]],cq;f.fn.extend({show:function(a,b,c){var d,e;if(a||a===0)return this.animate(ct("show",3),a,b,c);for(var g=0,h=this.length;g=i.duration+this.startTime){this.now=this.end,this.pos=this.state=1,this.update(),i.animatedProperties[this.prop]=!0;for(b in i.animatedProperties)i.animatedProperties[b]!==!0&&(g=!1);if(g){i.overflow!=null&&!f.support.shrinkWrapBlocks&&f.each(["","X","Y"],function(a,b){h.style["overflow"+b]=i.overflow[a]}),i.hide&&f(h).hide();if(i.hide||i.show)for(b in i.animatedProperties)f.style(h,b,i.orig[b]),f.removeData(h,"fxshow"+b,!0),f.removeData(h,"toggle"+b,!0);d=i.complete,d&&(i.complete=!1,d.call(h))}return!1}i.duration==Infinity?this.now=e:(c=e-this.startTime,this.state=c/i.duration,this.pos=f.easing[i.animatedProperties[this.prop]](this.state,c,0,1,i.duration),this.now=this.start+(this.end-this.start)*this.pos),this.update();return!0}},f.extend(f.fx,{tick:function(){var a,b=f.timers,c=0;for(;c-1,k={},l={},m,n;j?(l=e.position(),m=l.top,n=l.left):(m=parseFloat(h)||0,n=parseFloat(i)||0),f.isFunction(b)&&(b=b.call(a,c,g)),b.top!=null&&(k.top=b.top-g.top+m),b.left!=null&&(k.left=b.left-g.left+n),"using"in b?b.using.call(a,k):e.css(k)}},f.fn.extend({position:function(){if(!this[0])return null;var a=this[0],b=this.offsetParent(),c=this.offset(),d=cx.test(b[0].nodeName)?{top:0,left:0}:b.offset();c.top-=parseFloat(f.css(a,"marginTop"))||0,c.left-=parseFloat(f.css(a,"marginLeft"))||0,d.top+=parseFloat(f.css(b[0],"borderTopWidth"))||0,d.left+=parseFloat(f.css(b[0],"borderLeftWidth"))||0;return{top:c.top-d.top,left:c.left-d.left}},offsetParent:function(){return this.map(function(){var a=this.offsetParent||c.body;while(a&&!cx.test(a.nodeName)&&f.css(a,"position")==="static")a=a.offsetParent;return a})}}),f.each({scrollLeft:"pageXOffset",scrollTop:"pageYOffset"},function(a,c){var d=/Y/.test(c);f.fn[a]=function(e){return f.access(this,function(a,e,g){var h=cy(a);if(g===b)return h?c in h?h[c]:f.support.boxModel&&h.document.documentElement[e]||h.document.body[e]:a[e];h?h.scrollTo(d?f(h).scrollLeft():g,d?g:f(h).scrollTop()):a[e]=g},a,e,arguments.length,null)}}),f.each({Height:"height",Width:"width"},function(a,c){var d="client"+a,e="scroll"+a,g="offset"+a;f.fn["inner"+a]=function(){var a=this[0];return a?a.style?parseFloat(f.css(a,c,"padding")):this[c]():null},f.fn["outer"+a]=function(a){var b=this[0];return b?b.style?parseFloat(f.css(b,c,a?"margin":"border")):this[c]():null},f.fn[c]=function(a){return f.access(this,function(a,c,h){var i,j,k,l;if(f.isWindow(a)){i=a.document,j=i.documentElement[d];return f.support.boxModel&&j||i.body&&i.body[d]||j}if(a.nodeType===9){i=a.documentElement;if(i[d]>=i[e])return i[d];return Math.max(a.body[e],i[e],a.body[g],i[g])}if(h===b){k=f.css(a,c),l=parseFloat(k);return f.isNumeric(l)?l:k}f(a).css(c,h)},c,a,arguments.length,null)}}),a.jQuery=a.$=f,typeof define=="function"&&define.amd&&define.amd.jQuery&&define("jquery",[],function(){return f})})(window); \ No newline at end of file diff --git a/_templates/bootstrap/theme.conf b/_templates/bootstrap/theme.conf new file mode 100644 index 000000000..64f9efd56 --- /dev/null +++ b/_templates/bootstrap/theme.conf @@ -0,0 +1,5 @@ +# Twitter Bootstrap Theme +[theme] +inherit = basic +stylesheet = basic.css +pygments_style = tango diff --git a/_templates/layout.html b/_templates/layout.html deleted file mode 100644 index 98c0b0c84..000000000 --- a/_templates/layout.html +++ /dev/null @@ -1,38 +0,0 @@ -{# Import the theme's layout. #} -{% extends "!layout.html" %} - -{# Custom CSS overrides #} -{% set bootswatch_css_custom = ['_static/styles.css'] %} - -{% block footer %} -
      -
      -
      -
      - -
      - © 2005 — 2015 Mirantis, Inc.
      All rights reserved. "Mirantis" and "FUEL" are are registered trademarks of Mirantis, Inc. All other trademarks are the property of their respective owners.       -
      -
      -525 Almanor Ave, 4th Floor - Sunnyvale, CA 94085
      -+1-650-963-9828       -
      -
      -
      -
      -
      - - - - - -{% endblock %} \ No newline at end of file diff --git a/_templates/mirantis.style b/_templates/mirantis.style deleted file mode 100644 index d88295b5b..000000000 --- a/_templates/mirantis.style +++ /dev/null @@ -1,100 +0,0 @@ -#embeddedFonts: [ [ "PT Sans" ], [ "PT Mono" ], [ "PT Serif" ] ] -# ["PT_Sans-CaptionBold.ttf", "PT_Sans-Bold.ttf", PT_Sans-Italic.ttf, PTF75F.ttf, PT_Sans-BoldItalic.ttf, -# PT_Sans-Narrow.ttf, PTF76F.ttf, PT_Sans-Bold_0.ttf, PT_Sans-NarrowBold.ttf, -# PTZ55F.ttf, PT_Sans-Caption.ttf, PT_Sans-Regular.ttf] - -fontsAlias: - stdBold: PT Sans Bold - stdBoldItalic: PT Sans Bold Italic - stdFont: PT Sans - stdItalic: PT Sans Italic - stdMono: PT Mono - stdMonoBold: PT Mono Bold - stdMonoBoldItalic: PT Mono Bold - stdMonoItalic: PT Mono - stdSans: PT Sans - stdSansBold: PT Sans Bold - stdSansBoldItalic: PT Sans BoldItalic - stdSansItalic: PT Sans Italic - stdSerif: PT Serif - -pageSetup: - firstTemplate: coverPage -# size: LETTER - -pageTemplates: - coverPage: - frames: [] - [0cm, 0cm, 100%, 100%] - background : _images/fuel_reference_title.jpg - showHeader : false - showFooter : false - oneColumn: - frames: [] - [0cm, 0cm, 100%, 100%] - showHeader : true - showFooter : true -styles: - title: - parent: heading - fontName: PT Sans - fontSize: 400% - alignment: TA_RIGHT - keepWithNext: false - spaceBefore: 0 - spaceAfter: 10 - - subtitle: - parent: heading - fontName: PT Sans - fontSize: 300% - alignment: TA_RIGHT - keepWithNext: false - spaceBefore: 0 - spaceAfter: 10 - - seealso: - backColor: #FFFFCC - borderColor: #FFFF66 - parent: admonition - - seealso-heading: - parent: heading - fontName: PT Sans - fontSize: 150% - keepWithNext: true - spaceBefore: 0 - spaceAfter: 10 - - right: - parent: bodytext - alignment: right - centered: - parent: bodytext - alignment: center - - header-table: - parent: table - spaceBefore: 0 -# colWidths: [] -# [70%, 30%] - commands: [] - [GRID, [ 0, -1 ], [ -1, -1 ], 0.25, transparent] - [LINEBELOW, [ 0, -1 ], [ -1, -1 ], 0.25, black ] - - footer-table: - parent: table - spaceBefore: 0 -# colWidths: [] -# [70%, 30%] - commands: [] - [GRID, [ 0, -1 ], [ -1, -1 ], 0.25, transparent] - [LINEABOVE, [ 0, -1 ], [ -1, -1 ], 0.25, black ] - -# bodytext: -# parent: normal -# fontName: PT Sans -# spaceBefore: 6 -# alignment: TA_JUSTIFY -# hyphenation: true - diff --git a/_templates/mirantis/globaltoc.html b/_templates/mirantis/globaltoc.html deleted file mode 100644 index 1bb9f7240..000000000 --- a/_templates/mirantis/globaltoc.html +++ /dev/null @@ -1,107 +0,0 @@ - - -
        -
      • - Current Version -
        • -
      • - 7.0 Mirantis OpenStack -
        • -
      - -
        -
      • -
        - - - -
        • -
      - - - - - - - \ No newline at end of file diff --git a/_templates/mirantis/layout.html b/_templates/mirantis/layout.html deleted file mode 100644 index 1eb3efdbb..000000000 --- a/_templates/mirantis/layout.html +++ /dev/null @@ -1,170 +0,0 @@ -{% extends "basic/layout.html" %} - -{% set theme_css_files = [] %} -{% if theme_bootstrap_version == "3" %} - {% set bootstrap_version, bootstrap_additional_css, navbar_version = "3.2.0", "theme", "" %} - {% set bs_span_prefix = "col-md-" %} -{% else %} - {% set bootstrap_version, bootstrap_additional_css, navbar_version = "2.3.2", "responsive", "-2" %} - {% set bs_span_prefix = "span" %} -{% endif %} - -{% if theme_bootswatch_theme and theme_bootswatch_theme != "\"\"" %} - {# BS2 needs "bootstrap-responsive.css". BS3 doesn't. #} - {% if theme_bootstrap_version == "3" %} - {% set theme_css_files = theme_css_files + [ - 'https://maxcdn.bootstrapcdn.com/font-awesome/4.3.0/css/font-awesome.min.css', - '_static/bootstrap-sphinx.css' - ] - %} - {% else %} - {% set theme_css_files = theme_css_files + [ - '_static/bootstrap-sphinx.css' - ] - %} - {% endif %} -{% else %} - {% set theme_css_files = theme_css_files + [ - 'https://maxcdn.bootstrapcdn.com/font-awesome/4.3.0/css/font-awesome.min.css', - '_static/bootstrap-sphinx.css', - '_static/styles.css' - ] - %} -{% endif %} - -{% if not bootswatch_css_custom %} - {% set bootswatch_css_custom = [] %} -{% endif %} -{% set css_files = css_files + theme_css_files + bootswatch_css_custom %} - -{% set script_files = script_files + [ - 'https://cdnjs.cloudflare.com/ajax/libs/modernizr/2.8.3/modernizr.js', - 'https://cdnjs.cloudflare.com/ajax/libs/lunr.js/0.5.11/lunr.min.js', - 'https://cdnjs.cloudflare.com/ajax/libs/jquery-hashchange/v1.3/jquery.ba-hashchange.min.js', - '_static/bootstrap-dropdown.js', - '_static/bootstrap-sphinx.js', - '_static/abtest.js', - 'https://cdnjs.cloudflare.com/ajax/libs/zeroclipboard/2.2.0/ZeroClipboard.js' - ] -%} - -{%- set render_sidebar = (not embedded) and (not theme_nosidebar|tobool) and sidebars %} - -{%- set bs_content_width = render_sidebar and "9" or "12"%} - -{%- block doctype -%} - -{%- endblock %} - -{# Sidebar: Rework into our Bootstrap nav section. #} -{% macro navBar() %} -{% include "navbar" + navbar_version + ".html" %} -{% endmacro %} - -{% if theme_bootstrap_version == "3" %} - {%- macro bsidebar() %} - {%- if render_sidebar %} - {%- for sidebartemplate in sidebars %} - {%- include sidebartemplate %} - {%- endfor %} - {%- endif %} - {%- endmacro %} -{% else %} - {%- macro bsidebar() %} - {%- if render_sidebar %} -
      - -
      - {%- endif %} - {%- endmacro %} -{% endif %} - -{%- block extrahead %} - - - - -{% endblock %} - -{# Silence the sidebar's, relbar's #} -{% block header %}{% endblock %} -{% block relbar1 %}{% endblock %} -{% block relbar2 %}{% endblock %} -{% block sidebarsourcelink %}{% endblock %} - -{%- block content %} -{{ navBar() }} -
      -
      -
      -
      - {%- block sidebar1 %}{{ bsidebar() }}{% endblock %} -
      -
      -
      - {% block body %}{% endblock %} - {% if theme_navbar_sidebarrel %} - {% block sidebarrel %} - {% include "relations.html" %} - {% endblock %} - {% endif %} -
      -
      -
      -Share this page -
      -
      -
      - - - - - - -
      -
      -
      -Creative Commons License - This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License. -
      -
      -
      -
      -
      -
      -
      -
      -{%- endblock %} - -{%- block footer %} -
      -
      -

      - Back to top - {% if theme_source_link_position == "footer" %} -
      - {% include "sourcelink.html" %} - {% endif %} -

      -

      - {%- if show_copyright %} - {%- if hasdoc('copyright') %} - {% trans path=pathto('copyright'), copyright=copyright|e %}© Copyright {{ copyright }}.{% endtrans %}
      - {%- else %} - {% trans copyright=copyright|e %}© Copyright {{ copyright }}.{% endtrans %}
      - {%- endif %} - {%- endif %} - {%- if last_updated %} - {% trans last_updated=last_updated|e %}Last updated on {{ last_updated }}.{% endtrans %}
      - {%- endif %} - {%- if show_sphinx %} - {% trans sphinx_version=sphinx_version|e %}Created using Sphinx {{ sphinx_version }}.{% endtrans %}
      - {%- endif %} -

      -
      -
      -{%- endblock %} diff --git a/_templates/mirantis/localtoc.html b/_templates/mirantis/localtoc.html deleted file mode 100644 index 6e6c03b8a..000000000 --- a/_templates/mirantis/localtoc.html +++ /dev/null @@ -1 +0,0 @@ -{{ toc }} diff --git a/_templates/mirantis/navbar-2.html b/_templates/mirantis/navbar-2.html deleted file mode 100644 index 0fc3b0bce..000000000 --- a/_templates/mirantis/navbar-2.html +++ /dev/null @@ -1,50 +0,0 @@ -
      -
      -
      - - - - - {%- block sidebarlogo %} - {%- if logo %}{%- endif %} - {%- endblock %} - {% if theme_navbar_title -%}{{ theme_navbar_title|e }}{%- else -%}{{ project|e }}{%- endif -%} - - -
      -
        -
      • - {% if theme_navbar_links %} - {%- for link in theme_navbar_links %} -
      • {{ link[0] }}
        • - {%- endfor %} - {% endif %} - {% block navbartoc %} - {% include "globaltoc.html" %} - {% if theme_navbar_pagenav %} - {% include "navbartoc.html" %} - {% endif %} - {% endblock %} - {% if theme_navbar_sidebarrel %} - {% block sidebarrel %} - {% include "relations.html" %} - {% endblock %} - {% endif %} - {% block navbarextra %} - {% endblock %} - {% if theme_source_link_position == "nav" %} -
      • {% include "sourcelink.html" %}
        • - {% endif %} -
      - - {% block navbarsearch %} - {% include "navbarsearchbox.html" %} - {% endblock %} -
      -
      -
      -
      diff --git a/_templates/mirantis/navbar.html b/_templates/mirantis/navbar.html deleted file mode 100644 index bef6a009a..000000000 --- a/_templates/mirantis/navbar.html +++ /dev/null @@ -1,46 +0,0 @@ - diff --git a/_templates/mirantis/navbarsearchbox.html b/_templates/mirantis/navbarsearchbox.html deleted file mode 100644 index 82e93389d..000000000 --- a/_templates/mirantis/navbarsearchbox.html +++ /dev/null @@ -1,9 +0,0 @@ -{%- if pagename != "search" %} -
      -
      - -
      - - - -{%- endif %} diff --git a/_templates/mirantis/navbartoc.html b/_templates/mirantis/navbartoc.html deleted file mode 100644 index 8def043a6..000000000 --- a/_templates/mirantis/navbartoc.html +++ /dev/null @@ -1,10 +0,0 @@ -
    • - {{ _(theme_navbar_pagenav_name) }} - -
      • diff --git a/_templates/mirantis/relations.html b/_templates/mirantis/relations.html deleted file mode 100644 index 53b592a10..000000000 --- a/_templates/mirantis/relations.html +++ /dev/null @@ -1,31 +0,0 @@ -{# Switch to icon instead of text in `sm` view size for BS3 only. #} -
      -
      -
      -{%- if prev %} - -{%- endif %} -
      -
      -{%- if next %} - -{%- endif %} -
      -
      -
      \ No newline at end of file diff --git a/_templates/mirantis/search.html b/_templates/mirantis/search.html deleted file mode 100644 index 033263792..000000000 --- a/_templates/mirantis/search.html +++ /dev/null @@ -1,71 +0,0 @@ -{# - basic/search.html - ~~~~~~~~~~~~~~~~~ - - Template for the search page. - - :copyright: Copyright 2007-2013 by the Sphinx team, see AUTHORS. - :license: BSD, see LICENSE for details. -#} -{%- extends "layout.html" %} -{% set title = _('Search') %} -{% set script_files = script_files + ['_static/searchtools.js'] %} -{% block extrahead %} - - {# this is used when loading the search index using $.ajax fails, - such as on Chrome for documents on localhost #} - - {{ super() }} -{% endblock %} -{% block body %} -

      {{ _('Search') }}

      -
      - -

      - {% trans %}Please activate JavaScript to enable the search - functionality.{% endtrans %} -

      -
      -

      - {% trans %}From here you can search these documents. Enter your search - words into the box below and click "search". Note that the search - function will automatically search for all of the words. Pages - containing fewer words won't appear in the result list.{% endtrans %} -

      - - {% if theme_bootstrap_version == "3" %} -
      -
      - -
      - - - - {% else %} -
      - - - - - {% endif %} - - {% if search_performed %} -

      {{ _('Search Results') }}

      - {% if not search_results %} -

      {{ _('Your search did not match any documents. Please make sure that all words are spelled correctly and that you\'ve selected enough categories.') }}

      - {% endif %} - {% endif %} -
      - {% if search_results %} -
        - {% for href, caption, context in search_results %} -
      • {{ caption }} -
        {{ context|e }}
        -
        • - {% endfor %} -
      - {% endif %} -
      -{% endblock %} diff --git a/_templates/mirantis/searchbox.html b/_templates/mirantis/searchbox.html deleted file mode 100644 index 53755f37a..000000000 --- a/_templates/mirantis/searchbox.html +++ /dev/null @@ -1,9 +0,0 @@ -{%- if pagename != "search" %} -
      -
      - -
      - - - -{%- endif %} diff --git a/_templates/mirantis/searchresults.html b/_templates/mirantis/searchresults.html deleted file mode 100644 index cfb0aa404..000000000 --- a/_templates/mirantis/searchresults.html +++ /dev/null @@ -1,38 +0,0 @@ -{# - basic/searchresults.html - ~~~~~~~~~~~~~~~~~~~~~~~~ - - Template for the body of the search results page. - - :copyright: Copyright 2007-2011 by the Sphinx team, see AUTHORS. - :license: BSD, see LICENSE for details. -#} -

      Search

      -

      - From here you can search these documents. Enter your search - words into the box below and click "search". -

      - -
      - - - - - -{%- if search_performed %} -

      Search Results

      - {%- if not search_results %} -

      Your search did not match any results.

      - {%- endif %} -{%- endif %} -
      - {%- if search_results %} -
        - {% for href, caption, context in search_results %} -
      • {{ caption }} -
        {{ context|e }}
        -
        • - {% endfor %} -
      - {%- endif %} -
      diff --git a/_templates/mirantis/sourcelink.html b/_templates/mirantis/sourcelink.html deleted file mode 100644 index 3cf733582..000000000 --- a/_templates/mirantis/sourcelink.html +++ /dev/null @@ -1,6 +0,0 @@ -{%- if show_source and has_source and sourcename %} - -{%- endif %} diff --git a/_templates/mirantis/static/abtest.js b/_templates/mirantis/static/abtest.js deleted file mode 100644 index 1e8b71f47..000000000 --- a/_templates/mirantis/static/abtest.js +++ /dev/null @@ -1,160 +0,0 @@ -var _conv_host = (("https:" == document.location.protocol) ? "https://d9jmv9u00p0mv.cloudfront.net" : "http://cdn-1.convertexperiments.com"); -document.write(unescape("%3Cscript src='" + _conv_host + "/js/10012224-10012014.js' type='text/javascript'%3E%3C/script%3E")); - -jQuery.ajax({ - url: "https://mirantis.jira.com/s/4ed53ccf16578ed4b1d4b6b7efa13491-T/en_USltmd6x/65007/316/1.4.25/_/download/batch/com.atlassian.jira.collector.plugin.jira-issue-collector-plugin:issuecollector-embededjs/com.atlassian.jira.collector.plugin.jira-issue-collector-plugin:issuecollector-embededjs.js?locale=en-US&collectorId=23810080", - type: "get", - cache: true, - dataType: "script" -}); - -function getParameterByName(name) { - name = name.replace(/[\[]/, "\\[").replace(/[\]]/, "\\]"); - var regex = new RegExp("[\\?&]" + name + "=([^&#]*)"), - results = regex.exec(location.search); - return results === null ? "" : decodeURIComponent(results[1].replace(/\+/g, " ")); -} - - -function prepareList(){ - $('#contents ul.simple').find('li:has(ul)').unbind('click').click(function(event) { - if(this == event.target) { - $(this).toggleClass('expanded'); - $(this).children('ul').toggle('medium'); - } - return false; - }).addClass('collapsed').removeClass('expanded').children('ul').hide(); - - $('#contents ul.simple a').unbind('click').click(function() { - window.open($(this).attr('href'),'_self'); - return false; - }); -} - -$(document).ready(function () { - var url = window.location.pathname; - var filename = url.substring(url.lastIndexOf('/') + 1); - - $('#bottom-copy').attr('data-clipboard-text', window.location.href); - $('#bottom-facebook').on('click', function(){ - window.open('https://www.facebook.com/sharer/sharer.php?u=' + window.location.href); - }); - $('#bottom-google-plus').on('click', function(){ - window.open('https://plus.google.com/share?url=' + window.location.href); - }); - $('#bottom-twitter').on('click', function(){ - window.open('https://twitter.com/home?status=' + encodeURIComponent($( "h1" ).first().text()) + ' ' + encodeURIComponent(window.location.href)); - }); - $('#bottom-linkedin').on('click', function(){ - var params = { - mini: 'true', - url: window.location.href, - title: $( "h1" ).first().text(), - summary: $( "h2" ).first().text(), - source: '' - }; - - var queryString = $.param(params); - window.open('https://www.linkedin.com/shareArticle?' + queryString); - }); - $('#bottom-github').on('click', function(){ - window.open('https://github.com/openstack/fuel-docs'); - }); - $('.headerlink').each(function () { - $(this).empty(); - }); - - $('[data-toggle="tooltip"]').tooltip(); - - $('pre').each(function(){ - $('
      ').insertBefore(this); - }); - - ZeroClipboard.config({ - forceHandCursor: false, - swfPath: "https://cdnjs.cloudflare.com/ajax/libs/zeroclipboard/2.1.6/ZeroClipboard.swf" - }); - var client = new ZeroClipboard($('.copyMe')); - - client.on("ready", function (readyEvent) { - client.on("copy", function (event) { - var clipboard = event.clipboardData; - clipboard.setData("text/plain"); - }); - client.on('aftercopy', function (event) { - $(event.target).attr('title', 'Copied!').tooltip('fixTitle').tooltip('show'); - }); - }); - - $('a[data-toggle="tab"]').on('click', function (e) { - history.pushState({}, '', $(this).attr('href')); - }); - - $('a.toc-backref').contents().unwrap(); - - $('a[href="contents.html"]').attr('href', 'index.html'); - - prepareList(); - - showHashTab(); - - if(/search.html$/.test(window.location.pathname)) { - - var index = lunr(function () { - this.field('title', {boost: 10}); - this.field('body'); - this.field('href'); - this.ref('id'); - }); - - var store = {}; - - if (getParameterByName('q')) { - - $('#search-results').append('
      '); - - $.getJSON("_static/data.json", function (data) { - $(data).each(function (i, item) { - index.add({ - title: item.title, - body: item.body, - href: item.url, - guide: item.guide, - id: i - }); - store[i] = {title: item.title, body: item.body, guide: item.guide, href: item.url}; - }); - - var query = getParameterByName('q'); - var length = 210; - var bodyText = ''; - var results = index.search(query); - - $('#search-progress').hide(); - $('#search-results').empty().append( - results.length ? - results.map(function (result) { - var el = $('

      ') - .append($('') - .attr('href', store[result.ref].href) - .text(store[result.ref].title) - ); - var body = store[result.ref].body.toLowerCase(); - var bodySearch = body.search(query.toLowerCase()); - if (bodySearch > 100) { - bodyText = jQuery.trim(store[result.ref].body).substring(bodySearch, bodySearch + length).split(" ").slice(0, -1).join(" ") + "..."; - } else { - bodyText = jQuery.trim(store[result.ref].body).substring(0, length).split(" ").slice(0, -1).join(" ") + "..."; - } - el.append($('

      ').text()); - el.append($('

      ').html('Guide: ' + store[result.ref].guide + '
      ' + bodyText)); - return el; - }) : $('

      No results found

      ') - - ); - - }); - } - } - -}); diff --git a/_templates/mirantis/static/bootstrap-dropdown.js b/_templates/mirantis/static/bootstrap-dropdown.js deleted file mode 100644 index 6c5436186..000000000 --- a/_templates/mirantis/static/bootstrap-dropdown.js +++ /dev/null @@ -1,1045 +0,0 @@ -/* ======================================================================== - * Bootstrap: dropdown.js v3.3.2 - * http://getbootstrap.com/javascript/#dropdowns - * ======================================================================== - * Copyright 2011-2015 Twitter, Inc. - * Licensed under MIT (https://github.com/twbs/bootstrap/blob/master/LICENSE) - * ======================================================================== */ - - -+function ($) { - 'use strict'; - - // DROPDOWN CLASS DEFINITION - // ========================= - - var backdrop = '.dropdown-backdrop' - var toggle = '[data-toggle="dropdown"]' - var Dropdown = function (element) { - $(element).on('click.bs.dropdown', this.toggle) - } - - Dropdown.VERSION = '3.3.2' - - Dropdown.prototype.toggle = function (e) { - var $this = $(this) - - if ($this.is('.disabled, :disabled')) return - - var $parent = getParent($this) - var isActive = $parent.hasClass('open') - - clearMenus() - - if (!isActive) { - if ('ontouchstart' in document.documentElement && !$parent.closest('.navbar-nav').length) { - // if mobile we use a backdrop because click events don't delegate - $('
      ').insertAfter($(this)).on('click', clearMenus) - } - - var relatedTarget = { relatedTarget: this } - $parent.trigger(e = $.Event('show.bs.dropdown', relatedTarget)) - - if (e.isDefaultPrevented()) return - - $this - .trigger('focus') - .attr('aria-expanded', 'true') - - $parent - .toggleClass('open') - .trigger('shown.bs.dropdown', relatedTarget) - } - - return false - } - - Dropdown.prototype.keydown = function (e) { - if (!/(38|40|27|32)/.test(e.which) || /input|textarea/i.test(e.target.tagName)) return - - var $this = $(this) - - e.preventDefault() - e.stopPropagation() - - if ($this.is('.disabled, :disabled')) return - - var $parent = getParent($this) - var isActive = $parent.hasClass('open') - - if ((!isActive && e.which != 27) || (isActive && e.which == 27)) { - if (e.which == 27) $parent.find(toggle).trigger('focus') - return $this.trigger('click') - } - - var desc = ' li:not(.disabled):visible a' - var $items = $parent.find('[role="menu"]' + desc + ', [role="listbox"]' + desc) - - if (!$items.length) return - - var index = $items.index(e.target) - - if (e.which == 38 && index > 0) index-- // up - if (e.which == 40 && index < $items.length - 1) index++ // down - if (!~index) index = 0 - - $items.eq(index).trigger('focus') - } - - function clearMenus(e) { - if (e && e.which === 3) return - $(backdrop).remove() - $(toggle).each(function () { - var $this = $(this) - var $parent = getParent($this) - var relatedTarget = { relatedTarget: this } - - if (!$parent.hasClass('open')) return - - $parent.trigger(e = $.Event('hide.bs.dropdown', relatedTarget)) - - if (e.isDefaultPrevented()) return - - $this.attr('aria-expanded', 'false') - $parent.removeClass('open').trigger('hidden.bs.dropdown', relatedTarget) - }) - } - - function getParent($this) { - var selector = $this.attr('data-target') - - if (!selector) { - selector = $this.attr('href') - selector = selector && /#[A-Za-z]/.test(selector) && selector.replace(/.*(?=#[^\s]*$)/, '') // strip for ie7 - } - - var $parent = selector && $(selector) - - return $parent && $parent.length ? $parent : $this.parent() - } - - - // DROPDOWN PLUGIN DEFINITION - // ========================== - - function Plugin(option) { - return this.each(function () { - var $this = $(this) - var data = $this.data('bs.dropdown') - - if (!data) $this.data('bs.dropdown', (data = new Dropdown(this))) - if (typeof option == 'string') data[option].call($this) - }) - } - - var old = $.fn.dropdown - - $.fn.dropdown = Plugin - $.fn.dropdown.Constructor = Dropdown - - - // DROPDOWN NO CONFLICT - // ==================== - - $.fn.dropdown.noConflict = function () { - $.fn.dropdown = old - return this - } - - - // APPLY TO STANDARD DROPDOWN ELEMENTS - // =================================== - - $(document) - .on('click.bs.dropdown.data-api', clearMenus) - .on('click.bs.dropdown.data-api', '.dropdown form', function (e) { e.stopPropagation() }) - .on('click.bs.dropdown.data-api', toggle, Dropdown.prototype.toggle) - .on('keydown.bs.dropdown.data-api', toggle, Dropdown.prototype.keydown) - .on('keydown.bs.dropdown.data-api', '[role="menu"]', Dropdown.prototype.keydown) - .on('keydown.bs.dropdown.data-api', '[role="listbox"]', Dropdown.prototype.keydown) - -}(jQuery); - -/* ======================================================================== - * Bootstrap: collapse.js v3.3.2 - * http://getbootstrap.com/javascript/#collapse - * ======================================================================== - * Copyright 2011-2015 Twitter, Inc. - * Licensed under MIT (https://github.com/twbs/bootstrap/blob/master/LICENSE) - * ======================================================================== */ - - -+function ($) { - 'use strict'; - - // COLLAPSE PUBLIC CLASS DEFINITION - // ================================ - - var Collapse = function (element, options) { - this.$element = $(element) - this.options = $.extend({}, Collapse.DEFAULTS, options) - this.$trigger = $('[data-toggle="collapse"][href="#' + element.id + '"],' + - '[data-toggle="collapse"][data-target="#' + element.id + '"]') - this.transitioning = null - - if (this.options.parent) { - this.$parent = this.getParent() - } else { - this.addAriaAndCollapsedClass(this.$element, this.$trigger) - } - - if (this.options.toggle) this.toggle() - } - - Collapse.VERSION = '3.3.2' - - Collapse.TRANSITION_DURATION = 350 - - Collapse.DEFAULTS = { - toggle: true - } - - Collapse.prototype.dimension = function () { - var hasWidth = this.$element.hasClass('width') - return hasWidth ? 'width' : 'height' - } - - Collapse.prototype.show = function () { - if (this.transitioning || this.$element.hasClass('in')) return - - var activesData - var actives = this.$parent && this.$parent.children('.panel').children('.in, .collapsing') - - if (actives && actives.length) { - activesData = actives.data('bs.collapse') - if (activesData && activesData.transitioning) return - } - - var startEvent = $.Event('show.bs.collapse') - this.$element.trigger(startEvent) - if (startEvent.isDefaultPrevented()) return - - if (actives && actives.length) { - Plugin.call(actives, 'hide') - activesData || actives.data('bs.collapse', null) - } - - var dimension = this.dimension() - - this.$element - .removeClass('collapse') - .addClass('collapsing')[dimension](0) - .attr('aria-expanded', true) - - this.$trigger - .removeClass('collapsed') - .attr('aria-expanded', true) - - this.transitioning = 1 - - var complete = function () { - this.$element - .removeClass('collapsing') - .addClass('collapse in')[dimension]('') - this.transitioning = 0 - this.$element - .trigger('shown.bs.collapse') - } - - if (!$.support.transition) return complete.call(this) - - var scrollSize = $.camelCase(['scroll', dimension].join('-')) - - this.$element - .one('bsTransitionEnd', $.proxy(complete, this)) - .emulateTransitionEnd(Collapse.TRANSITION_DURATION)[dimension](this.$element[0][scrollSize]) - } - - Collapse.prototype.hide = function () { - if (this.transitioning || !this.$element.hasClass('in')) return - - var startEvent = $.Event('hide.bs.collapse') - this.$element.trigger(startEvent) - if (startEvent.isDefaultPrevented()) return - - var dimension = this.dimension() - - this.$element[dimension](this.$element[dimension]())[0].offsetHeight - - this.$element - .addClass('collapsing') - .removeClass('collapse in') - .attr('aria-expanded', false) - - this.$trigger - .addClass('collapsed') - .attr('aria-expanded', false) - - this.transitioning = 1 - - var complete = function () { - this.transitioning = 0 - this.$element - .removeClass('collapsing') - .addClass('collapse') - .trigger('hidden.bs.collapse') - } - - if (!$.support.transition) return complete.call(this) - - this.$element - [dimension](0) - .one('bsTransitionEnd', $.proxy(complete, this)) - .emulateTransitionEnd(Collapse.TRANSITION_DURATION) - } - - Collapse.prototype.toggle = function () { - this[this.$element.hasClass('in') ? 'hide' : 'show']() - } - - Collapse.prototype.getParent = function () { - return $(this.options.parent) - .find('[data-toggle="collapse"][data-parent="' + this.options.parent + '"]') - .each($.proxy(function (i, element) { - var $element = $(element) - this.addAriaAndCollapsedClass(getTargetFromTrigger($element), $element) - }, this)) - .end() - } - - Collapse.prototype.addAriaAndCollapsedClass = function ($element, $trigger) { - var isOpen = $element.hasClass('in') - - $element.attr('aria-expanded', isOpen) - $trigger - .toggleClass('collapsed', !isOpen) - .attr('aria-expanded', isOpen) - } - - function getTargetFromTrigger($trigger) { - var href - var target = $trigger.attr('data-target') - || (href = $trigger.attr('href')) && href.replace(/.*(?=#[^\s]+$)/, '') // strip for ie7 - - return $(target) - } - - - // COLLAPSE PLUGIN DEFINITION - // ========================== - - function Plugin(option) { - return this.each(function () { - var $this = $(this) - var data = $this.data('bs.collapse') - var options = $.extend({}, Collapse.DEFAULTS, $this.data(), typeof option == 'object' && option) - - if (!data && options.toggle && option == 'show') options.toggle = false - if (!data) $this.data('bs.collapse', (data = new Collapse(this, options))) - if (typeof option == 'string') data[option]() - }) - } - - var old = $.fn.collapse - - $.fn.collapse = Plugin - $.fn.collapse.Constructor = Collapse - - - // COLLAPSE NO CONFLICT - // ==================== - - $.fn.collapse.noConflict = function () { - $.fn.collapse = old - return this - } - - - // COLLAPSE DATA-API - // ================= - - $(document).on('click.bs.collapse.data-api', '[data-toggle="collapse"]', function (e) { - var $this = $(this) - - if (!$this.attr('data-target')) e.preventDefault() - - var $target = getTargetFromTrigger($this) - var data = $target.data('bs.collapse') - var option = data ? 'toggle' : $this.data() - - Plugin.call($target, option) - }) - -}(jQuery); - - -/* ======================================================================== - * Bootstrap: tooltip.js v3.3.4 - * http://getbootstrap.com/javascript/#tooltip - * Inspired by the original jQuery.tipsy by Jason Frame - * ======================================================================== - * Copyright 2011-2015 Twitter, Inc. - * Licensed under MIT (https://github.com/twbs/bootstrap/blob/master/LICENSE) - * ======================================================================== */ - - -+function ($) { - 'use strict'; - - // TOOLTIP PUBLIC CLASS DEFINITION - // =============================== - - var Tooltip = function (element, options) { - this.type = null - this.options = null - this.enabled = null - this.timeout = null - this.hoverState = null - this.$element = null - this.inState = null - - this.init('tooltip', element, options) - } - - Tooltip.VERSION = '3.3.4' - - Tooltip.TRANSITION_DURATION = 150 - - Tooltip.DEFAULTS = { - animation: true, - placement: 'top', - selector: false, - template: '', - trigger: 'hover focus', - title: '', - delay: 0, - html: false, - container: false, - viewport: { - selector: 'body', - padding: 0 - } - } - - Tooltip.prototype.init = function (type, element, options) { - this.enabled = true - this.type = type - this.$element = $(element) - this.options = this.getOptions(options) - this.$viewport = this.options.viewport && $($.isFunction(this.options.viewport) ? this.options.viewport.call(this, this.$element) : (this.options.viewport.selector || this.options.viewport)) - this.inState = { click: false, hover: false, focus: false } - - if (this.$element[0] instanceof document.constructor && !this.options.selector) { - throw new Error('`selector` option must be specified when initializing ' + this.type + ' on the window.document object!') - } - - var triggers = this.options.trigger.split(' ') - - for (var i = triggers.length; i--;) { - var trigger = triggers[i] - - if (trigger == 'click') { - this.$element.on('click.' + this.type, this.options.selector, $.proxy(this.toggle, this)) - } else if (trigger != 'manual') { - var eventIn = trigger == 'hover' ? 'mouseenter' : 'focusin' - var eventOut = trigger == 'hover' ? 'mouseleave' : 'focusout' - - this.$element.on(eventIn + '.' + this.type, this.options.selector, $.proxy(this.enter, this)) - this.$element.on(eventOut + '.' + this.type, this.options.selector, $.proxy(this.leave, this)) - } - } - - this.options.selector ? - (this._options = $.extend({}, this.options, { trigger: 'manual', selector: '' })) : - this.fixTitle() - } - - Tooltip.prototype.getDefaults = function () { - return Tooltip.DEFAULTS - } - - Tooltip.prototype.getOptions = function (options) { - options = $.extend({}, this.getDefaults(), this.$element.data(), options) - - if (options.delay && typeof options.delay == 'number') { - options.delay = { - show: options.delay, - hide: options.delay - } - } - - return options - } - - Tooltip.prototype.getDelegateOptions = function () { - var options = {} - var defaults = this.getDefaults() - - this._options && $.each(this._options, function (key, value) { - if (defaults[key] != value) options[key] = value - }) - - return options - } - - Tooltip.prototype.enter = function (obj) { - var self = obj instanceof this.constructor ? - obj : $(obj.currentTarget).data('bs.' + this.type) - - if (!self) { - self = new this.constructor(obj.currentTarget, this.getDelegateOptions()) - $(obj.currentTarget).data('bs.' + this.type, self) - } - - if (obj instanceof $.Event) { - self.inState[obj.type == 'focusin' ? 'focus' : 'hover'] = true - } - - if (self.tip().hasClass('in') || self.hoverState == 'in') { - self.hoverState = 'in' - return - } - - clearTimeout(self.timeout) - - self.hoverState = 'in' - - if (!self.options.delay || !self.options.delay.show) return self.show() - - self.timeout = setTimeout(function () { - if (self.hoverState == 'in') self.show() - }, self.options.delay.show) - } - - Tooltip.prototype.isInStateTrue = function () { - for (var key in this.inState) { - if (this.inState[key]) return true - } - - return false - } - - Tooltip.prototype.leave = function (obj) { - var self = obj instanceof this.constructor ? - obj : $(obj.currentTarget).data('bs.' + this.type) - - if (!self) { - self = new this.constructor(obj.currentTarget, this.getDelegateOptions()) - $(obj.currentTarget).data('bs.' + this.type, self) - } - - if (obj instanceof $.Event) { - self.inState[obj.type == 'focusout' ? 'focus' : 'hover'] = false - } - - if (self.isInStateTrue()) return - - clearTimeout(self.timeout) - - self.hoverState = 'out' - - if (!self.options.delay || !self.options.delay.hide) return self.hide() - - self.timeout = setTimeout(function () { - if (self.hoverState == 'out') self.hide() - }, self.options.delay.hide) - } - - Tooltip.prototype.show = function () { - var e = $.Event('show.bs.' + this.type) - - if (this.hasContent() && this.enabled) { - this.$element.trigger(e) - - var inDom = $.contains(this.$element[0].ownerDocument.documentElement, this.$element[0]) - if (e.isDefaultPrevented() || !inDom) return - var that = this - - var $tip = this.tip() - - var tipId = this.getUID(this.type) - - this.setContent() - $tip.attr('id', tipId) - this.$element.attr('aria-describedby', tipId) - - if (this.options.animation) $tip.addClass('fade') - - var placement = typeof this.options.placement == 'function' ? - this.options.placement.call(this, $tip[0], this.$element[0]) : - this.options.placement - - var autoToken = /\s?auto?\s?/i - var autoPlace = autoToken.test(placement) - if (autoPlace) placement = placement.replace(autoToken, '') || 'top' - - $tip - .detach() - .css({ top: 0, left: 0, display: 'block' }) - .addClass(placement) - .data('bs.' + this.type, this) - - this.options.container ? $tip.appendTo(this.options.container) : $tip.insertAfter(this.$element) - this.$element.trigger('inserted.bs.' + this.type) - - var pos = this.getPosition() - var actualWidth = $tip[0].offsetWidth - var actualHeight = $tip[0].offsetHeight - - if (autoPlace) { - var orgPlacement = placement - var viewportDim = this.getPosition(this.$viewport) - - placement = placement == 'bottom' && pos.bottom + actualHeight > viewportDim.bottom ? 'top' : - placement == 'top' && pos.top - actualHeight < viewportDim.top ? 'bottom' : - placement == 'right' && pos.right + actualWidth > viewportDim.width ? 'left' : - placement == 'left' && pos.left - actualWidth < viewportDim.left ? 'right' : - placement - - $tip - .removeClass(orgPlacement) - .addClass(placement) - } - - var calculatedOffset = this.getCalculatedOffset(placement, pos, actualWidth, actualHeight) - - this.applyPlacement(calculatedOffset, placement) - - var complete = function () { - var prevHoverState = that.hoverState - that.$element.trigger('shown.bs.' + that.type) - that.hoverState = null - - if (prevHoverState == 'out') that.leave(that) - } - - $.support.transition && this.$tip.hasClass('fade') ? - $tip - .one('bsTransitionEnd', complete) - .emulateTransitionEnd(Tooltip.TRANSITION_DURATION) : - complete() - } - } - - Tooltip.prototype.applyPlacement = function (offset, placement) { - var $tip = this.tip() - var width = $tip[0].offsetWidth - var height = $tip[0].offsetHeight - - // manually read margins because getBoundingClientRect includes difference - var marginTop = parseInt($tip.css('margin-top'), 10) - var marginLeft = parseInt($tip.css('margin-left'), 10) - - // we must check for NaN for ie 8/9 - if (isNaN(marginTop)) marginTop = 0 - if (isNaN(marginLeft)) marginLeft = 0 - - offset.top += marginTop - offset.left += marginLeft - - // $.fn.offset doesn't round pixel values - // so we use setOffset directly with our own function B-0 - $.offset.setOffset($tip[0], $.extend({ - using: function (props) { - $tip.css({ - top: Math.round(props.top), - left: Math.round(props.left) - }) - } - }, offset), 0) - - $tip.addClass('in') - - // check to see if placing tip in new offset caused the tip to resize itself - var actualWidth = $tip[0].offsetWidth - var actualHeight = $tip[0].offsetHeight - - if (placement == 'top' && actualHeight != height) { - offset.top = offset.top + height - actualHeight - } - - var delta = this.getViewportAdjustedDelta(placement, offset, actualWidth, actualHeight) - - if (delta.left) offset.left += delta.left - else offset.top += delta.top - - var isVertical = /top|bottom/.test(placement) - var arrowDelta = isVertical ? delta.left * 2 - width + actualWidth : delta.top * 2 - height + actualHeight - var arrowOffsetPosition = isVertical ? 'offsetWidth' : 'offsetHeight' - - $tip.offset(offset) - this.replaceArrow(arrowDelta, $tip[0][arrowOffsetPosition], isVertical) - } - - Tooltip.prototype.replaceArrow = function (delta, dimension, isVertical) { - this.arrow() - .css(isVertical ? 'left' : 'top', 50 * (1 - delta / dimension) + '%') - .css(isVertical ? 'top' : 'left', '') - } - - Tooltip.prototype.setContent = function () { - var $tip = this.tip() - var title = this.getTitle() - - $tip.find('.tooltip-inner')[this.options.html ? 'html' : 'text'](title) - $tip.removeClass('fade in top bottom left right') - } - - Tooltip.prototype.hide = function (callback) { - var that = this - var $tip = $(this.$tip) - var e = $.Event('hide.bs.' + this.type) - - function complete() { - if (that.hoverState != 'in') $tip.detach() - that.$element - .removeAttr('aria-describedby') - .trigger('hidden.bs.' + that.type) - callback && callback() - } - - this.$element.trigger(e) - - if (e.isDefaultPrevented()) return - - $tip.removeClass('in') - - $.support.transition && $tip.hasClass('fade') ? - $tip - .one('bsTransitionEnd', complete) - .emulateTransitionEnd(Tooltip.TRANSITION_DURATION) : - complete() - - this.hoverState = null - - return this - } - - Tooltip.prototype.fixTitle = function () { - var $e = this.$element - if ($e.attr('title') || typeof $e.attr('data-original-title') != 'string') { - $e.attr('data-original-title', $e.attr('title') || '').attr('title', '') - } - } - - Tooltip.prototype.hasContent = function () { - return this.getTitle() - } - - Tooltip.prototype.getPosition = function ($element) { - $element = $element || this.$element - - var el = $element[0] - var isBody = el.tagName == 'BODY' - - var elRect = el.getBoundingClientRect() - if (elRect.width == null) { - // width and height are missing in IE8, so compute them manually; see https://github.com/twbs/bootstrap/issues/14093 - elRect = $.extend({}, elRect, { width: elRect.right - elRect.left, height: elRect.bottom - elRect.top }) - } - var elOffset = isBody ? { top: 0, left: 0 } : $element.offset() - var scroll = { scroll: isBody ? document.documentElement.scrollTop || document.body.scrollTop : $element.scrollTop() } - var outerDims = isBody ? { width: $(window).width(), height: $(window).height() } : null - - return $.extend({}, elRect, scroll, outerDims, elOffset) - } - - Tooltip.prototype.getCalculatedOffset = function (placement, pos, actualWidth, actualHeight) { - return placement == 'bottom' ? { top: pos.top + pos.height, left: pos.left + pos.width / 2 - actualWidth / 2 } : - placement == 'top' ? { top: pos.top - actualHeight, left: pos.left + pos.width / 2 - actualWidth / 2 } : - placement == 'left' ? { top: pos.top + pos.height / 2 - actualHeight / 2, left: pos.left - actualWidth } : - /* placement == 'right' */ { top: pos.top + pos.height / 2 - actualHeight / 2, left: pos.left + pos.width } - - } - - Tooltip.prototype.getViewportAdjustedDelta = function (placement, pos, actualWidth, actualHeight) { - var delta = { top: 0, left: 0 } - if (!this.$viewport) return delta - - var viewportPadding = this.options.viewport && this.options.viewport.padding || 0 - var viewportDimensions = this.getPosition(this.$viewport) - - if (/right|left/.test(placement)) { - var topEdgeOffset = pos.top - viewportPadding - viewportDimensions.scroll - var bottomEdgeOffset = pos.top + viewportPadding - viewportDimensions.scroll + actualHeight - if (topEdgeOffset < viewportDimensions.top) { // top overflow - delta.top = viewportDimensions.top - topEdgeOffset - } else if (bottomEdgeOffset > viewportDimensions.top + viewportDimensions.height) { // bottom overflow - delta.top = viewportDimensions.top + viewportDimensions.height - bottomEdgeOffset - } - } else { - var leftEdgeOffset = pos.left - viewportPadding - var rightEdgeOffset = pos.left + viewportPadding + actualWidth - if (leftEdgeOffset < viewportDimensions.left) { // left overflow - delta.left = viewportDimensions.left - leftEdgeOffset - } else if (rightEdgeOffset > viewportDimensions.right) { // right overflow - delta.left = viewportDimensions.left + viewportDimensions.width - rightEdgeOffset - } - } - - return delta - } - - Tooltip.prototype.getTitle = function () { - var title - var $e = this.$element - var o = this.options - - title = $e.attr('data-original-title') - || (typeof o.title == 'function' ? o.title.call($e[0]) : o.title) - - return title - } - - Tooltip.prototype.getUID = function (prefix) { - do prefix += ~~(Math.random() * 1000000) - while (document.getElementById(prefix)) - return prefix - } - - Tooltip.prototype.tip = function () { - if (!this.$tip) { - this.$tip = $(this.options.template) - if (this.$tip.length != 1) { - throw new Error(this.type + ' `template` option must consist of exactly 1 top-level element!') - } - } - return this.$tip - } - - Tooltip.prototype.arrow = function () { - return (this.$arrow = this.$arrow || this.tip().find('.tooltip-arrow')) - } - - Tooltip.prototype.enable = function () { - this.enabled = true - } - - Tooltip.prototype.disable = function () { - this.enabled = false - } - - Tooltip.prototype.toggleEnabled = function () { - this.enabled = !this.enabled - } - - Tooltip.prototype.toggle = function (e) { - var self = this - if (e) { - self = $(e.currentTarget).data('bs.' + this.type) - if (!self) { - self = new this.constructor(e.currentTarget, this.getDelegateOptions()) - $(e.currentTarget).data('bs.' + this.type, self) - } - } - - if (e) { - self.inState.click = !self.inState.click - if (self.isInStateTrue()) self.enter(self) - else self.leave(self) - } else { - self.tip().hasClass('in') ? self.leave(self) : self.enter(self) - } - } - - Tooltip.prototype.destroy = function () { - var that = this - clearTimeout(this.timeout) - this.hide(function () { - that.$element.off('.' + that.type).removeData('bs.' + that.type) - if (that.$tip) { - that.$tip.detach() - } - that.$tip = null - that.$arrow = null - that.$viewport = null - }) - } - - - // TOOLTIP PLUGIN DEFINITION - // ========================= - - function Plugin(option) { - return this.each(function () { - var $this = $(this) - var data = $this.data('bs.tooltip') - var options = typeof option == 'object' && option - - if (!data && /destroy|hide/.test(option)) return - if (!data) $this.data('bs.tooltip', (data = new Tooltip(this, options))) - if (typeof option == 'string') data[option]() - }) - } - - var old = $.fn.tooltip - - $.fn.tooltip = Plugin - $.fn.tooltip.Constructor = Tooltip - - - // TOOLTIP NO CONFLICT - // =================== - - $.fn.tooltip.noConflict = function () { - $.fn.tooltip = old - return this - } - -}(jQuery); - -/* ======================================================================== - * Bootstrap: tab.js v3.3.4 - * http://getbootstrap.com/javascript/#tabs - * ======================================================================== - * Copyright 2011-2015 Twitter, Inc. - * Licensed under MIT (https://github.com/twbs/bootstrap/blob/master/LICENSE) - * ======================================================================== */ - - -+function ($) { - 'use strict'; - - // TAB CLASS DEFINITION - // ==================== - - var Tab = function (element) { - // jscs:disable requireDollarBeforejQueryAssignment - this.element = $(element) - // jscs:enable requireDollarBeforejQueryAssignment - } - - Tab.VERSION = '3.3.4' - - Tab.TRANSITION_DURATION = 150 - - Tab.prototype.show = function () { - var $this = this.element - var $ul = $this.closest('ul:not(.dropdown-menu)') - var selector = $this.data('target') - - if (!selector) { - selector = $this.attr('href') - selector = selector && selector.replace(/.*(?=#[^\s]*$)/, '') // strip for ie7 - } - - if ($this.parent('li').hasClass('active')) return - - var $previous = $ul.find('.active:last a') - var hideEvent = $.Event('hide.bs.tab', { - relatedTarget: $this[0] - }) - var showEvent = $.Event('show.bs.tab', { - relatedTarget: $previous[0] - }) - - $previous.trigger(hideEvent) - $this.trigger(showEvent) - - if (showEvent.isDefaultPrevented() || hideEvent.isDefaultPrevented()) return - - var $target = $(selector) - - this.activate($this.closest('li'), $ul) - this.activate($target, $target.parent(), function () { - $previous.trigger({ - type: 'hidden.bs.tab', - relatedTarget: $this[0] - }) - $this.trigger({ - type: 'shown.bs.tab', - relatedTarget: $previous[0] - }) - }) - } - - Tab.prototype.activate = function (element, container, callback) { - var $active = container.find('> .active') - var transition = callback - && $.support.transition - && ($active.length && $active.hasClass('fade') || !!container.find('> .fade').length) - - function next() { - $active - .removeClass('active') - .find('> .dropdown-menu > .active') - .removeClass('active') - .end() - .find('[data-toggle="tab"]') - .attr('aria-expanded', false) - - element - .addClass('active') - .find('[data-toggle="tab"]') - .attr('aria-expanded', true) - - if (transition) { - element[0].offsetWidth // reflow for transition - element.addClass('in') - } else { - element.removeClass('fade') - } - - if (element.parent('.dropdown-menu').length) { - element - .closest('li.dropdown') - .addClass('active') - .end() - .find('[data-toggle="tab"]') - .attr('aria-expanded', true) - } - - callback && callback() - } - - $active.length && transition ? - $active - .one('bsTransitionEnd', next) - .emulateTransitionEnd(Tab.TRANSITION_DURATION) : - next() - - $active.removeClass('in') - } - - - // TAB PLUGIN DEFINITION - // ===================== - - function Plugin(option) { - return this.each(function () { - var $this = $(this) - var data = $this.data('bs.tab') - - if (!data) $this.data('bs.tab', (data = new Tab(this))) - if (typeof option == 'string') data[option]() - }) - } - - var old = $.fn.tab - - $.fn.tab = Plugin - $.fn.tab.Constructor = Tab - - - // TAB NO CONFLICT - // =============== - - $.fn.tab.noConflict = function () { - $.fn.tab = old - return this - } - - - // TAB DATA-API - // ============ - - var clickHandler = function (e) { - e.preventDefault() - Plugin.call($(this), 'show') - } - - $(document) - .on('click.bs.tab.data-api', '[data-toggle="tab"]', clickHandler) - .on('click.bs.tab.data-api', '[data-toggle="pill"]', clickHandler) - -}(jQuery); \ No newline at end of file diff --git a/_templates/mirantis/static/bootstrap-sphinx.css_t b/_templates/mirantis/static/bootstrap-sphinx.css_t deleted file mode 100644 index 297031d74..000000000 --- a/_templates/mirantis/static/bootstrap-sphinx.css_t +++ /dev/null @@ -1,258 +0,0 @@ -/* - * bootstrap-sphinx.css - * ~~~~~~~~~~~~~~~~~~~~ - * - * Sphinx stylesheet -- Bootstrap theme. - */ - -.navbar-inverse .brand { - color: #FFF; -} - -/* - * Reset navbar styles from overrides in: - * https://bitbucket.org/birkenfeld/sphinx/commits/78d8ebf76b630ab4073a7328af9d91e8123b8d96 - */ -.navbar .container { - padding-top: 0; -} - -.page-top { - top: 0px; -} - -{% if theme_navbar_fixed_top|tobool %} - -{% if theme_bootstrap_version == "2" %} -@media (min-width: 980px) { -{% endif %} - - body { - {% if theme_bootswatch_theme and theme_bootswatch_theme != "\"\"" %} - padding-top: 60px; - {% else %} - padding-top: 40px; - {% endif %} - } - .page-top { - {% if theme_bootswatch_theme and theme_bootswatch_theme != "\"\"" %} - top: 60px; - {% else %} - top: 40px; - {% endif %} - } - -{% if theme_bootstrap_version == "2" %} -} -{% endif %} - -.navbar-inner { - padding-left: 12px !important; - padding-right: 12px !important; -} -{% else %} -{% if theme_bootstrap_version == "2" %} -@media (min-width: 980px) { - .navbar .container { - width: 940px; - } -} -{% endif %} -{% endif %} - -table { - border: 0; -} - -.highlighttable .code pre { - font-size: 12px; -} - -.highlighttable .linenos pre { - word-break: normal; - font-size: 12px; -} - -div.highlight { - background: none; -} - -a.footnote-reference { - vertical-align: super; - font-size: 75%; -} - -table.footnote td.label { - font-size: 100%; - display: block; - line-height: normal; - background: inherit; -} - -table.footnote { - width: auto; - margin-bottom: 0px; -} - -table.field-list { - width: auto; -} - -.footer { - width: 100%; - border-top: 1px solid #ccc; - padding-top: 10px; -} - -.bs-sidenav form, .bs-sidenav #sourcelink { - padding: 5px 20px; -} - -{% if theme_bootstrap_version == "3" %} - -/* The code below is based on the bootstrap website sidebar */ - -.bs-sidenav.affix { - position: static; -} - -/* First level of nav */ -.bs-sidenav { - margin-top: 30px; - margin-bottom: 30px; - padding-top: 10px; - padding-bottom: 10px; - text-shadow: 0 1px 0 #fff; - background-color: #f7f5fa; - border-radius: 5px; -} - -/* All levels of nav */ -.bs-sidenav .nav > li > a { - display: block; - color: #716b7a; - padding: 5px 20px; -} -.bs-sidenav .nav > li > a:hover, -.bs-sidenav .nav > li > a:focus { - text-decoration: none; - background-color: #e5e3e9; - border-right: 1px solid #dbd8e0; -} -.bs-sidenav .nav > .active > a, -.bs-sidenav .nav > .active:hover > a, -.bs-sidenav .nav > .active:focus > a { - font-weight: bold; - color: #563d7c; - background-color: transparent; - border-right: 1px solid #563d7c; -} - -.bs-sidenav .nav .nav > li > a { - padding-top: 3px; - padding-bottom: 3px; - padding-left: 30px; - font-size: 90%; -} - -.bs-sidenav .nav .nav .nav > li > a { - padding-top: 3px; - padding-bottom: 3px; - padding-left: 40px; - font-size: 90%; -} - -.bs-sidenav .nav .nav .nav .nav > li > a { - padding-top: 3px; - padding-bottom: 3px; - padding-left: 50px; - font-size: 90%; -} - -/* Show and affix the side nav when space allows it */ -@media screen and (min-width: 992px) { - .bs-sidenav .nav > .active > ul { - display: block; - } - /* Widen the fixed sidenav */ - .bs-sidenav.affix, - .bs-sidenav.affix-bottom { - width: 213px; - } - .bs-sidenav.affix { - position: fixed; /* Undo the static from mobile first approach */ - top: 80px; - } - .bs-sidenav.affix-bottom { - position: absolute; /* Undo the static from mobile first approach */ - } - .bs-sidenav.affix-bottom .bs-sidenav, - .bs-sidenav.affix .bs-sidenav { - margin-top: 0; - margin-bottom: 0; - } -} -@media screen and (min-width: 1200px) { - /* Widen the fixed sidenav again */ - .bs-sidenav.affix-bottom, - .bs-sidenav.affix { - width: 263px; - } -} - - -{% else %} - -.bs-sidenav { - width: 228px; - margin: 30px 0 0; - padding: 10px 0 0 5px; -} - -.bs-sidenav ul{ - list-style-type: none; - padding-left: 25px; - margin-left: 0; /* bootstrap 2 compatability. */ -} - -@media (min-width: 1200px) { - .bs-sidenav { - width: 258px; - } -} - -/* Desktop -------------------------- */ -@media (max-width: 980px) { - .bs-sidenav { - width: 218px; - margin-top: 30px; - margin-right: 0; - } -} - -/* Tablet to desktop -------------------------- */ -@media (min-width: 768px) and (max-width: 979px) { - .bs-sidenav { - width: 166px; - margin-top: 20px; - } -} - -/* Tablet -------------------------- */ -@media (max-width: 767px) { - .navbar-version { - padding-left: 5px; - } - .bs-sidenav { - width: auto; - margin-bottom: 20px; - } - .bs-sidenav.affix { - position: static; - top: 0; - } -} -{% endif %} diff --git a/_templates/mirantis/static/bootstrap-sphinx.js_t b/_templates/mirantis/static/bootstrap-sphinx.js_t deleted file mode 100644 index b2491f834..000000000 --- a/_templates/mirantis/static/bootstrap-sphinx.js_t +++ /dev/null @@ -1,324 +0,0 @@ -(function ($) { - /** - * Patch TOC list. - * - * Will mutate the underlying span to have a correct ul for nav. - * - * @param $span: Span containing nested UL's to mutate. - * @param minLevel: Starting level for nested lists. (1: global, 2: local). - */ - - var patchToc = function ($ul, minLevel) { - var findA, - patchTables, - $localLi; - - // Find all a "internal" tags, traversing recursively. - findA = function ($elem, level) { - level = level || 0; - var $items = $elem.find("> li > a.internal, > ul, > li > ul"); - - // Iterate everything in order. - $items.each(function (index, item) { - var $item = $(item), - tag = item.tagName.toLowerCase(), - $childrenLi = $item.children('li'), - $parentLi = $($item.parent('li'), $item.parent().parent('li')); - - // Add dropdowns if more children and above minimum level. - if (tag === 'ul' && level >= minLevel && $childrenLi.length > 0) { - $parentLi - .addClass('dropdown-submenu') - .children('a').first().attr('tabindex', -1); - - $item.addClass('dropdown-menu'); - } - - findA($item, level + 1); - }); - }; - - findA($ul); - }; - - /** - * Patch all tables to remove ``docutils`` class and add Bootstrap base - * ``table`` class. - */ - patchTables = function () { - $("table.docutils") - .removeClass("docutils") - .addClass("table") - .attr("border", 0); - }; - - $(window).load(function () { - /* - * Scroll the window to avoid the topnav bar - * https://github.com/twbs/bootstrap/issues/1768 - */ - if ($("#navbar.navbar-fixed-top").length > 0) { - var navHeight = $("#navbar").height(), - //shiftWindow = function() { scrollBy(0, -navHeight - 20); }; - shiftWindow = function() { console.log('shiftWindow'); window.scrollTo(0, 0); }; - - if (location.hash) { - setTimeout(shiftWindow, 1); - } - - window.addEventListener("hashchange", shiftWindow); - } - }); - - $(document).ready(function () { - // Add styling, structure to TOC's. - $(".dropdown-menu").each(function () { - $(this).find("ul").each(function (index, item){ - var $item = $(item); - $item.addClass('unstyled'); - }); - }); - - // Global TOC. - if ($("ul.globaltoc li").length) { - patchToc($("ul.globaltoc"), 1); - } else { - // Remove Global TOC. - $(".globaltoc-container").remove(); - } - - $('h1').first().addClass('page-header'); - - $('#contents').remove(); - - $('.center-col > .tab-content > .section > .section').each(function(){ - $(this).addClass('tab-pane fade'); - if($(this).hasClass('active')){ - $(this).addClass('in'); - } - }); - - if(!$('.center-col > .tab-content> .section > .section').hasClass('active')){ - $('.center-col > .tab-content> .section > .section').first().addClass('active in'); - } - - $('.center-col > .tab-content> .section > .section').unwrap(); - - // Local TOC. - //$(".bs-sidenav ul").addClass("nav nav-list"); - $("#nav-spy > ul").addClass("list-group list-group-accordion"); - $("#nav-spy > ul > li").addClass("list-group-item"); - $("#nav-spy > ul > li").each(function(){ - if($(this).hasClass('current')){ - $(this).addClass('active'); - } - }); - - $("#nav-spy > ul > li").each(function(){ - $(this).has('ul').children().first('a').addClass('sign-toggle').removeAttr("href"); - }); - $("#nav-spy > ul > li > ul").addClass("collapse"); - // $('#nav-spy > ul').prepend('
    • Documentation Menu
      • '); - - var scrollBtn = $('.scrollup'); - // on scoll toggle scrollTop in/out - $(window).scroll(function () { - if ($('body').hasClass('scrolling')) {return;} - if ($(this).scrollTop() > 300) { - scrollBtn.fadeIn(); - } else { - scrollBtn.fadeOut(); - } - }); - // on button click scrollTop - $('.scrollup, .return-top').on('click', function (e) { - e.preventDefault(); - scrollReset(); - }); - - // if link item clicked scrollTop - $('#nav-spy li a').on('click', function (e) { - - if ($(this).hasClass('sign-toggle')) { return; } - - var href = $(this).attr('href'); - if (!href.split('#')[0]) { e.preventDefault(); window.location.hash = href; } - - windowCheck(); - - }); - - function windowCheck(){ - if ($(window).scrollTop() > 234) { - scrollReset(135); - } - if($(document).width() < 941) { - - if ($('body.left-col-hidden').length == 0) { - $('body').addClass('left-col-hidden'); - } - } - } - - // scrollTop function - function scrollReset(pos) { - if(pos == undefined) { pos = 0; } - scrollBtn.fadeOut(); - $("html, body").addClass('scrolling').animate({ - scrollTop: pos - }, 320, function(){ - $("html, body").removeClass('scrolling') - }); - - return false; - } - - function nav(){ - - $('.dynamic-nav').remove(); - $('.sphinx-content').hide(); - var current_id = document.location.hash; - var current_page = $(current_id); - var prev_header = ''; - var next_header = ''; - - var prev = $(current_page).prev('div.section'); - var next = $(current_page).next('div.section'); - - if(prev.length == 0){ - $('#prev > .sphinx-content').show(); - } else { - prev_header = '« ' + $(prev).find(':header:first').text().replace(/[^\x00-\x7F]/g,''); - var prevEl = $('
      '+prev_header+'

      View Previous Section

      '); - $('#prev').append(prevEl); - prevEl.one('click', function(){ - windowCheck(); - }) - } - - if(next.length == 0){ - $('#next > .sphinx-content').show(); - } else { - next_header = $(next).find(':header:first').text().replace(/[^\x00-\x7F]/g,'') + ' »'; - var nextEl = $('
      '+next_header+'

      View Next Section

      '); - $('#next').append(nextEl); - nextEl.one('click', function(){ - windowCheck(); - }) - } - } - - nav(); - - showHashTab(); - - $(window).hashchange(function(){ nav(); showHashTab();}); - - function showHashTab(){ - console.log('showHashTab'); - if(location.hash){ - var activeTab = $('#nav-spy').find('[href=' + location.hash + ']'); - if (activeTab.length) { - activeTab.tab('show'); - } else { - //$('.nav-tabs a:first').tab('show'); - console.log('no length'); - var parentTab = $(location.hash).closest('.section.tab-pane'); - $('#nav-spy').find('[href=#' + $(parentTab).attr('id') + ']').tab('show'); - } - } - } - - // list-group-accordion functionality - var listAccordion = $('.list-group-accordion'); - var accordionItems = listAccordion.find('.list-group-item'); - var accordionLink = listAccordion.find('.sign-toggle'); - - accordionLink.on('click', function() { - var This = $(this); - var Parent = This.parent('.list-group-item'); - - if (Parent.hasClass('active')) { - Parent.toggleClass('active'); - } else { - accordionItems.removeClass('active'); - Parent.addClass('active'); - } - }); - - var toggleInput = $('#left-col-toggle'); - toggleInput.on('click', function() { - if ($('body.left-col-hidden').length) { - $('body').removeClass('left-col-hidden'); - } else { - $('body').addClass('left-col-hidden'); - } - }); - - if($(document).width() < 941) { - - if ($('body.left-col-hidden').length == 0) { - $('body').addClass('left-col-hidden'); - } - } - - - // Local TOC. - patchToc($("ul.localtoc"), 2); - - // Mutate sub-lists (for bs-2.3.0). - $(".dropdown-menu ul").not(".dropdown-menu").each(function () { - var $ul = $(this), - $parent = $ul.parent(), - tag = $parent[0].tagName.toLowerCase(), - $kids = $ul.children().detach(); - - // Replace list with items if submenu header. - if (tag === "ul") { - $ul.replaceWith($kids); - } else if (tag === "li") { - // Insert into previous list. - $parent.after($kids); - $ul.remove(); - } - }); - - // Add divider in page TOC. - $localLi = $("ul.localtoc li"); - if ($localLi.length > 2) { - $localLi.first().after('
    • '); - } - - // Manually add dropdown. - // Appears unnecessary as of: - // https://github.com/ryan-roemer/sphinx-bootstrap-theme/pull/90 - // Remove next time around... - // a.dropdown-toggle class needed in globaltoc.html - //$('.dropdown-toggle').dropdown(); - - // Patch tables. - patchTables(); - - // Add Note, Warning styles. (BS v2,3 compatible). - $('.admonition').addClass('alert alert-info') - .filter('.warning, .caution') - .removeClass('alert-info') - .addClass('alert-warning').end() - .filter('.error, .danger') - .removeClass('alert-info') - .addClass('alert-danger alert-error').end(); - - // Inline code styles to Bootstrap style. - $('tt.docutils.literal').not(".xref").each(function (i, e) { - // ignore references - if (!$(e).parent().hasClass("reference")) { - $(e).replaceWith(function () { - return $("").html($(this).html()); - }); - }}); - - // Update sourcelink to remove outerdiv (fixes appearance in navbar). - var $srcLink = $(".nav #sourcelink"); - $srcLink.parent().html($srcLink.html()); - }); -}(window.$jqTheme || window.jQuery)); \ No newline at end of file diff --git a/_templates/mirantis/static/cd-top-arrow.svg b/_templates/mirantis/static/cd-top-arrow.svg deleted file mode 100644 index 5468d9869..000000000 --- a/_templates/mirantis/static/cd-top-arrow.svg +++ /dev/null @@ -1,7 +0,0 @@ - - - - - - diff --git a/_templates/mirantis/static/collapsed.png b/_templates/mirantis/static/collapsed.png deleted file mode 100644 index 1e88b5252..000000000 Binary files a/_templates/mirantis/static/collapsed.png and /dev/null differ diff --git a/_templates/mirantis/static/expanded.png b/_templates/mirantis/static/expanded.png deleted file mode 100644 index 86a2a07ad..000000000 Binary files a/_templates/mirantis/static/expanded.png and /dev/null differ diff --git a/_templates/mirantis/static/footer_drivers_a.png b/_templates/mirantis/static/footer_drivers_a.png deleted file mode 100644 index f38b3abbd..000000000 Binary files a/_templates/mirantis/static/footer_drivers_a.png and /dev/null differ diff --git a/_templates/mirantis/static/footer_mos_a.png b/_templates/mirantis/static/footer_mos_a.png deleted file mode 100644 index aa2ab471c..000000000 Binary files a/_templates/mirantis/static/footer_mos_a.png and /dev/null differ diff --git a/_templates/mirantis/static/footer_murano_a.png b/_templates/mirantis/static/footer_murano_a.png deleted file mode 100644 index 16319f9a3..000000000 Binary files a/_templates/mirantis/static/footer_murano_a.png and /dev/null differ diff --git a/_templates/mirantis/static/footer_unlocked_a.png b/_templates/mirantis/static/footer_unlocked_a.png deleted file mode 100644 index cf3a6fbc8..000000000 Binary files a/_templates/mirantis/static/footer_unlocked_a.png and /dev/null differ diff --git a/_templates/mirantis/static/gearcloud_mosaas_footer1.jpg b/_templates/mirantis/static/gearcloud_mosaas_footer1.jpg deleted file mode 100644 index 4d090ce2f..000000000 Binary files a/_templates/mirantis/static/gearcloud_mosaas_footer1.jpg and /dev/null differ diff --git a/_templates/mirantis/static/search.html b/_templates/mirantis/static/search.html deleted file mode 100644 index 84a40c844..000000000 --- a/_templates/mirantis/static/search.html +++ /dev/null @@ -1,418 +0,0 @@ - - - - - - - - - Search — Mirantis OpenStack v6.1 | Documentation - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
      -
      -
      - -

      Search

      -
      - -

      - Please activate JavaScript to enable the search - functionality. -

      -
      -

      - From here you can search these documents. Enter your search - words into the box below and click "search". Note that the search - function will automatically search for all of the words. Pages - containing fewer words won't appear in the result list. -

      - - -
      -
      - -
      - - - - -
      -
      - -
      - -
      -
      -
      -
      - -
      -
      - - - - - - -Top - - - - - - - - - - - \ No newline at end of file diff --git a/_templates/mirantis/static/searchtools.js b/_templates/mirantis/static/searchtools.js deleted file mode 100644 index ff7643a2c..000000000 --- a/_templates/mirantis/static/searchtools.js +++ /dev/null @@ -1,5 +0,0 @@ -var Search = { - loadIndex : function(url) { - return false; - } -}; diff --git a/_templates/mirantis/static/styles.css b/_templates/mirantis/static/styles.css deleted file mode 100644 index 6be79f82f..000000000 --- a/_templates/mirantis/static/styles.css +++ /dev/null @@ -1 +0,0 @@ -@import url(https://fonts.googleapis.com/css?family=PT+Sans|PT+Sans+Caption|PT+Sans+Narrow);.animated-delay,.animated-waypoint{opacity:0}.sparkline-delay{position:absolute;bottom:0;width:40px;height:35px;line-height:24px}.animated.animated-short{-webkit-animation-duration:0.6s !important;animation-duration:0.6s !important}.animated.animated-shorter{-webkit-animation-duration:0.3s !important;animation-duration:0.3s !important}.animated.animated-long{-webkit-animation-duration:1.4s !important;animation-duration:1.4s !important}.animated.animated-longer{-webkit-animation-duration:2s !important;animation-duration:2s !important}.animated{-webkit-animation-duration:1s;animation-duration:1s;-webkit-animation-fill-mode:both;animation-fill-mode:both}.animated.infinite{-webkit-animation-iteration-count:infinite;animation-iteration-count:infinite}.animated.hinge{-webkit-animation-duration:2s;animation-duration:2s}@-webkit-keyframes fadeIn{0%{opacity:0}100%{opacity:1}}@keyframes fadeIn{0%{opacity:0}100%{opacity:1}}.fadeIn{-webkit-animation-name:fadeIn;animation-name:fadeIn}@-webkit-keyframes fadeInDown{0%{opacity:0;-webkit-transform:translate3d(0, -100%, 0);transform:translate3d(0, -100%, 0)}100%{opacity:1;-webkit-transform:none;transform:none}}@keyframes fadeInDown{0%{opacity:0;-webkit-transform:translate3d(0, -100%, 0);transform:translate3d(0, -100%, 0)}100%{opacity:1;-webkit-transform:none;transform:none}}.fadeInDown{-webkit-animation-name:fadeInDown;animation-name:fadeInDown}@-webkit-keyframes fadeInLeft{0%{opacity:0;-webkit-transform:translate3d(-100%, 0, 0);transform:translate3d(-100%, 0, 0)}100%{opacity:1;-webkit-transform:none;transform:none}}@keyframes fadeInLeft{0%{opacity:0;-webkit-transform:translate3d(-100%, 0, 0);transform:translate3d(-100%, 0, 0)}100%{opacity:1;-webkit-transform:none;transform:none}}.fadeInLeft{-webkit-animation-name:fadeInLeft;animation-name:fadeInLeft}@-webkit-keyframes fadeInRight{0%{opacity:0;-webkit-transform:translate3d(100%, 0, 0);transform:translate3d(100%, 0, 0)}100%{opacity:1;-webkit-transform:none;transform:none}}@keyframes fadeInRight{0%{opacity:0;-webkit-transform:translate3d(100%, 0, 0);transform:translate3d(100%, 0, 0)}100%{opacity:1;-webkit-transform:none;transform:none}}.fadeInRight{-webkit-animation-name:fadeInRight;animation-name:fadeInRight}@-webkit-keyframes fadeInUp{0%{opacity:0;-webkit-transform:translate3d(0, 100%, 0);transform:translate3d(0, 100%, 0)}100%{opacity:1;-webkit-transform:none;transform:none}}@keyframes fadeInUp{0%{opacity:0;-webkit-transform:translate3d(0, 100%, 0);transform:translate3d(0, 100%, 0)}100%{opacity:1;-webkit-transform:none;transform:none}}.fadeInUp{-webkit-animation-name:fadeInUp;animation-name:fadeInUp}@-webkit-keyframes flip{0%{-webkit-transform:perspective(400px) rotate3d(0, 1, 0, -360deg);transform:perspective(400px) rotate3d(0, 1, 0, -360deg);-webkit-animation-timing-function:ease-out;animation-timing-function:ease-out}40%{-webkit-transform:perspective(400px) translate3d(0, 0, 150px) rotate3d(0, 1, 0, -190deg);transform:perspective(400px) translate3d(0, 0, 150px) rotate3d(0, 1, 0, -190deg);-webkit-animation-timing-function:ease-out;animation-timing-function:ease-out}50%{-webkit-transform:perspective(400px) translate3d(0, 0, 150px) rotate3d(0, 1, 0, -170deg);transform:perspective(400px) translate3d(0, 0, 150px) rotate3d(0, 1, 0, -170deg);-webkit-animation-timing-function:ease-in;animation-timing-function:ease-in}80%{-webkit-transform:perspective(400px) scale3d(0.95, 0.95, 0.95);transform:perspective(400px) scale3d(0.95, 0.95, 0.95);-webkit-animation-timing-function:ease-in;animation-timing-function:ease-in}100%{-webkit-transform:perspective(400px);transform:perspective(400px);-webkit-animation-timing-function:ease-in;animation-timing-function:ease-in}}@keyframes flip{0%{-webkit-transform:perspective(400px) rotate3d(0, 1, 0, -360deg);transform:perspective(400px) rotate3d(0, 1, 0, -360deg);-webkit-animation-timing-function:ease-out;animation-timing-function:ease-out}40%{-webkit-transform:perspective(400px) translate3d(0, 0, 150px) rotate3d(0, 1, 0, -190deg);transform:perspective(400px) translate3d(0, 0, 150px) rotate3d(0, 1, 0, -190deg);-webkit-animation-timing-function:ease-out;animation-timing-function:ease-out}50%{-webkit-transform:perspective(400px) translate3d(0, 0, 150px) rotate3d(0, 1, 0, -170deg);transform:perspective(400px) translate3d(0, 0, 150px) rotate3d(0, 1, 0, -170deg);-webkit-animation-timing-function:ease-in;animation-timing-function:ease-in}80%{-webkit-transform:perspective(400px) scale3d(0.95, 0.95, 0.95);transform:perspective(400px) scale3d(0.95, 0.95, 0.95);-webkit-animation-timing-function:ease-in;animation-timing-function:ease-in}100%{-webkit-transform:perspective(400px);transform:perspective(400px);-webkit-animation-timing-function:ease-in;animation-timing-function:ease-in}}.animated.flip{-webkit-backface-visibility:visible;backface-visibility:visible;-webkit-animation-name:flip;animation-name:flip}@-webkit-keyframes flipInX{0%{-webkit-transform:perspective(400px) rotate3d(1, 0, 0, 90deg);transform:perspective(400px) rotate3d(1, 0, 0, 90deg);transition-timing-function:ease-in;opacity:0}40%{-webkit-transform:perspective(400px) rotate3d(1, 0, 0, -20deg);transform:perspective(400px) rotate3d(1, 0, 0, -20deg);transition-timing-function:ease-in}60%{-webkit-transform:perspective(400px) rotate3d(1, 0, 0, 10deg);transform:perspective(400px) rotate3d(1, 0, 0, 10deg);opacity:1}80%{-webkit-transform:perspective(400px) rotate3d(1, 0, 0, -5deg);transform:perspective(400px) rotate3d(1, 0, 0, -5deg)}100%{-webkit-transform:perspective(400px);transform:perspective(400px)}}@keyframes flipInX{0%{-webkit-transform:perspective(400px) rotate3d(1, 0, 0, 90deg);transform:perspective(400px) rotate3d(1, 0, 0, 90deg);transition-timing-function:ease-in;opacity:0}40%{-webkit-transform:perspective(400px) rotate3d(1, 0, 0, -20deg);transform:perspective(400px) rotate3d(1, 0, 0, -20deg);transition-timing-function:ease-in}60%{-webkit-transform:perspective(400px) rotate3d(1, 0, 0, 10deg);transform:perspective(400px) rotate3d(1, 0, 0, 10deg);opacity:1}80%{-webkit-transform:perspective(400px) rotate3d(1, 0, 0, -5deg);transform:perspective(400px) rotate3d(1, 0, 0, -5deg)}100%{-webkit-transform:perspective(400px);transform:perspective(400px)}}.flipInX{-webkit-backface-visibility:visible !important;backface-visibility:visible !important;-webkit-animation-name:flipInX;animation-name:flipInX}@-webkit-keyframes flipInY{0%{-webkit-transform:perspective(400px) rotate3d(0, 1, 0, 90deg);transform:perspective(400px) rotate3d(0, 1, 0, 90deg);transition-timing-function:ease-in;opacity:0}40%{-webkit-transform:perspective(400px) rotate3d(0, 1, 0, -20deg);transform:perspective(400px) rotate3d(0, 1, 0, -20deg);transition-timing-function:ease-in}60%{-webkit-transform:perspective(400px) rotate3d(0, 1, 0, 10deg);transform:perspective(400px) rotate3d(0, 1, 0, 10deg);opacity:1}80%{-webkit-transform:perspective(400px) rotate3d(0, 1, 0, -5deg);transform:perspective(400px) rotate3d(0, 1, 0, -5deg)}100%{-webkit-transform:perspective(400px);transform:perspective(400px)}}@keyframes flipInY{0%{-webkit-transform:perspective(400px) rotate3d(0, 1, 0, 90deg);transform:perspective(400px) rotate3d(0, 1, 0, 90deg);transition-timing-function:ease-in;opacity:0}40%{-webkit-transform:perspective(400px) rotate3d(0, 1, 0, -20deg);transform:perspective(400px) rotate3d(0, 1, 0, -20deg);transition-timing-function:ease-in}60%{-webkit-transform:perspective(400px) rotate3d(0, 1, 0, 10deg);transform:perspective(400px) rotate3d(0, 1, 0, 10deg);opacity:1}80%{-webkit-transform:perspective(400px) rotate3d(0, 1, 0, -5deg);transform:perspective(400px) rotate3d(0, 1, 0, -5deg)}100%{-webkit-transform:perspective(400px);transform:perspective(400px)}}.flipInY{-webkit-backface-visibility:visible !important;backface-visibility:visible !important;-webkit-animation-name:flipInY;animation-name:flipInY}@-webkit-keyframes slideInDown{0%{-webkit-transform:translateY(-100%);transform:translateY(-100%);visibility:visible}100%{-webkit-transform:translateY(0);transform:translateY(0)}}@keyframes slideInDown{0%{-webkit-transform:translateY(-100%);transform:translateY(-100%);visibility:visible}100%{-webkit-transform:translateY(0);transform:translateY(0)}}.slideInDown{-webkit-animation-name:slideInDown;animation-name:slideInDown}@-webkit-keyframes slideInLeft{0%{-webkit-transform:translateX(-100%);transform:translateX(-100%);visibility:visible}100%{-webkit-transform:translateX(0);transform:translateX(0)}}@keyframes slideInLeft{0%{-webkit-transform:translateX(-100%);transform:translateX(-100%);visibility:visible}100%{-webkit-transform:translateX(0);transform:translateX(0)}}.slideInLeft{-webkit-animation-name:slideInLeft;animation-name:slideInLeft}@-webkit-keyframes slideInRight{0%{-webkit-transform:translateX(100%);transform:translateX(100%);visibility:visible}100%{-webkit-transform:translateX(0);transform:translateX(0)}}@keyframes slideInRight{0%{-webkit-transform:translateX(100%);transform:translateX(100%);visibility:visible}100%{-webkit-transform:translateX(0);transform:translateX(0)}}.slideInRight{-webkit-animation-name:slideInRight;animation-name:slideInRight}@-webkit-keyframes slideInUp{0%{-webkit-transform:translateY(100%);transform:translateY(100%);visibility:visible}100%{-webkit-transform:translateY(0);transform:translateY(0)}}@keyframes slideInUp{0%{-webkit-transform:translateY(100%);transform:translateY(100%);visibility:visible}100%{-webkit-transform:translateY(0);transform:translateY(0)}}.slideInUp{-webkit-animation-name:slideInUp;animation-name:slideInUp}@-webkit-keyframes zoomIn{0%{opacity:0;-webkit-transform:scale3d(0.3, 0.3, 0.3);transform:scale3d(0.3, 0.3, 0.3)}50%{opacity:1}}@keyframes zoomIn{0%{opacity:0;-webkit-transform:scale3d(0.3, 0.3, 0.3);transform:scale3d(0.3, 0.3, 0.3)}50%{opacity:1}}.zoomIn{-webkit-animation-name:zoomIn;animation-name:zoomIn}@-webkit-keyframes zoomInDown{0%{opacity:0;-webkit-transform:scale3d(0.1, 0.1, 0.1) translate3d(0, -1000px, 0);transform:scale3d(0.1, 0.1, 0.1) translate3d(0, -1000px, 0);-webkit-animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19);animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19)}60%{opacity:1;-webkit-transform:scale3d(0.475, 0.475, 0.475) translate3d(0, 60px, 0);transform:scale3d(0.475, 0.475, 0.475) translate3d(0, 60px, 0);-webkit-animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1);animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1)}}@keyframes zoomInDown{0%{opacity:0;-webkit-transform:scale3d(0.1, 0.1, 0.1) translate3d(0, -1000px, 0);transform:scale3d(0.1, 0.1, 0.1) translate3d(0, -1000px, 0);-webkit-animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19);animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19)}60%{opacity:1;-webkit-transform:scale3d(0.475, 0.475, 0.475) translate3d(0, 60px, 0);transform:scale3d(0.475, 0.475, 0.475) translate3d(0, 60px, 0);-webkit-animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1);animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1)}}.zoomInDown{-webkit-animation-name:zoomInDown;animation-name:zoomInDown}@-webkit-keyframes zoomInLeft{0%{opacity:0;-webkit-transform:scale3d(0.1, 0.1, 0.1) translate3d(-1000px, 0, 0);transform:scale3d(0.1, 0.1, 0.1) translate3d(-1000px, 0, 0);-webkit-animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19);animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19)}60%{opacity:1;-webkit-transform:scale3d(0.475, 0.475, 0.475) translate3d(10px, 0, 0);transform:scale3d(0.475, 0.475, 0.475) translate3d(10px, 0, 0);-webkit-animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1);animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1)}}@keyframes zoomInLeft{0%{opacity:0;-webkit-transform:scale3d(0.1, 0.1, 0.1) translate3d(-1000px, 0, 0);transform:scale3d(0.1, 0.1, 0.1) translate3d(-1000px, 0, 0);-webkit-animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19);animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19)}60%{opacity:1;-webkit-transform:scale3d(0.475, 0.475, 0.475) translate3d(10px, 0, 0);transform:scale3d(0.475, 0.475, 0.475) translate3d(10px, 0, 0);-webkit-animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1);animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1)}}.zoomInLeft{-webkit-animation-name:zoomInLeft;animation-name:zoomInLeft}@-webkit-keyframes zoomInRight{0%{opacity:0;-webkit-transform:scale3d(0.1, 0.1, 0.1) translate3d(1000px, 0, 0);transform:scale3d(0.1, 0.1, 0.1) translate3d(1000px, 0, 0);-webkit-animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19);animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19)}60%{opacity:1;-webkit-transform:scale3d(0.475, 0.475, 0.475) translate3d(-10px, 0, 0);transform:scale3d(0.475, 0.475, 0.475) translate3d(-10px, 0, 0);-webkit-animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1);animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1)}}@keyframes zoomInRight{0%{opacity:0;-webkit-transform:scale3d(0.1, 0.1, 0.1) translate3d(1000px, 0, 0);transform:scale3d(0.1, 0.1, 0.1) translate3d(1000px, 0, 0);-webkit-animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19);animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19)}60%{opacity:1;-webkit-transform:scale3d(0.475, 0.475, 0.475) translate3d(-10px, 0, 0);transform:scale3d(0.475, 0.475, 0.475) translate3d(-10px, 0, 0);-webkit-animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1);animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1)}}.zoomInRight{-webkit-animation-name:zoomInRight;animation-name:zoomInRight}@-webkit-keyframes zoomInUp{0%{opacity:0;-webkit-transform:scale3d(0.1, 0.1, 0.1) translate3d(0, 1000px, 0);transform:scale3d(0.1, 0.1, 0.1) translate3d(0, 1000px, 0);-webkit-animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19);animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19)}60%{opacity:1;-webkit-transform:scale3d(0.475, 0.475, 0.475) translate3d(0, -60px, 0);transform:scale3d(0.475, 0.475, 0.475) translate3d(0, -60px, 0);-webkit-animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1);animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1)}}@keyframes zoomInUp{0%{opacity:0;-webkit-transform:scale3d(0.1, 0.1, 0.1) translate3d(0, 1000px, 0);transform:scale3d(0.1, 0.1, 0.1) translate3d(0, 1000px, 0);-webkit-animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19);animation-timing-function:cubic-bezier(0.55, 0.055, 0.675, 0.19)}60%{opacity:1;-webkit-transform:scale3d(0.475, 0.475, 0.475) translate3d(0, -60px, 0);transform:scale3d(0.475, 0.475, 0.475) translate3d(0, -60px, 0);-webkit-animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1);animation-timing-function:cubic-bezier(0.175, 0.885, 0.32, 1)}}.zoomInUp{-webkit-animation-name:zoomInUp;animation-name:zoomInUp}.fc button{display:inline-block;margin-bottom:0;font-weight:normal;text-align:center;vertical-align:middle;cursor:pointer;background-image:none;border:1px solid transparent;border-color:transparent;white-space:nowrap;padding:9px 12px;font-size:13px;line-height:1.49;border-radius:0px;-webkit-user-select:none;-moz-user-select:none;-ms-user-select:none;user-select:none;color:#666666;background-color:#f0f0f0;border-color:rgba(0,0,0,0.1);height:auto;padding:6px 12px}.fc button:focus,.fc button:active:focus,.fc button.active:focus{outline:0;outline-offset:-2px}.fc button:hover,.fc button:focus{color:#666666;text-decoration:none}.fc button:active,.fc button.active{outline:0;background-image:none;-webkit-box-shadow:inset 0 3px 5px rgba(0,0,0,0.125);box-shadow:inset 0 3px 5px rgba(0,0,0,0.125)}.fc button.disabled,.fc button[disabled],fieldset[disabled] .fc button{cursor:not-allowed;pointer-events:none;opacity:0.65;filter:alpha(opacity=65);-webkit-box-shadow:none;box-shadow:none}.fc button.btn-gradient{text-shadow:0 -1px 0 rgba(0,0,0,0.4);border-color:rgba(0,0,0,0.07) rgba(0,0,0,0.1) rgba(0,0,0,0.18);-webkit-box-shadow:inset 0 1px 0 rgba(255,255,255,0.2);box-shadow:inset 0 1px 0 rgba(255,255,255,0.2);background-repeat:repeat-x;background-image:-webkit-linear-gradient(top, rgba(255,255,255,0.3) 1%, rgba(255,255,255,0.15) 100%);background-image:linear-gradient(to bottom, rgba(255,255,255,0.3) 1%, rgba(255,255,255,0.15) 100%)}.fc button.btn-rounded{border-radius:20px}.fc button:hover,.fc button:focus,.fc button:active,.fc button.active,.open>.dropdown-toggle.fc button{color:#666666;background-color:#eaeaea}.fc button:active,.fc button.active,.open>.dropdown-toggle.fc button{background-image:none}.fc button.disabled,.fc button[disabled],fieldset[disabled] .fc button,.fc button.disabled:hover,.fc button[disabled]:hover,fieldset[disabled] .fc button:hover,.fc button.disabled:focus,.fc button[disabled]:focus,fieldset[disabled] .fc button:focus,.fc button.disabled:active,.fc button[disabled]:active,fieldset[disabled] .fc button:active,.fc button.disabled.active,.fc button[disabled].active,fieldset[disabled] .fc button.active{background-color:#f0f0f0;border-color:#dddddd}.fc button .badge{color:#f0f0f0;background-color:#666666}.fc button.btn-gradient{text-shadow:0 -1px 0 rgba(255,255,255,0.4);border-color:rgba(0,0,0,0.07) rgba(0,0,0,0.1) rgba(0,0,0,0.09);background-image:-webkit-linear-gradient(top, rgba(255,255,255,0.9) 10%, rgba(255,255,255,0.3) 100%);background-image:linear-gradient(to bottom, rgba(255,255,255,0.9) 10%, rgba(255,255,255,0.3) 100%);filter:progid:DXImageTransform.Microsoft.gradient(startColorstr='#80ffffff', endColorstr='#00ffffff', GradientType=0)}.fc button.light{background-color:#FAFAFA}.fc button.light:hover,.fc button.light:focus,.fc button.light:active,.fc button.light.active,.open>.dropdown-toggle.fc button.light{background-color:#ececec}.fc button.dark{background-color:#e8e8e8}.fc button.dark:hover,.fc button.dark:focus,.fc button.dark:active,.fc button.dark.active,.open>.dropdown-toggle.fc button.dark{background-color:#e1e1e1}.fc-state-default{border:1px solid}.fc-state-default.fc-corner-left{border-top-left-radius:1px;border-bottom-left-radius:1px}.fc-state-default.fc-corner-right{border-top-right-radius:1px;border-bottom-right-radius:1px}.fc button .fc-icon{position:relative;margin:0 0.1em}.fc-state-default{background-color:#f5f5f5;background-image:none;border-color:#e6e6e6 #e6e6e6 #bfbfbf;border-color:rgba(0,0,0,0.1) rgba(0,0,0,0.1) rgba(0,0,0,0.25);color:#333;text-shadow:0 1px 1px rgba(255,255,255,0.75);box-shadow:inset 0 1px 0 rgba(255,255,255,0.2),0 1px 2px rgba(0,0,0,0.05)}.fc-state-hover,.fc-state-down,.fc-state-active,.fc-state-disabled{color:#333333;background-color:#e6e6e6}.fc-state-hover{color:#333333;text-decoration:none}.fc-state-down,.fc-state-active{background-color:#cccccc;background-image:none;box-shadow:inset 0 2px 4px rgba(0,0,0,0.07),0 1px 2px rgba(0,0,0,0.05)}.fc-state-disabled{cursor:default;background-image:none;opacity:0.65;filter:alpha(opacity=65);box-shadow:none}.fc-toolbar .fc-state-active,.fc-toolbar .ui-state-active{z-index:1}.fc-button-group{display:inline-block}.fc .fc-button-group>*{float:left;margin:0 0 0 -1px}.fc .fc-button-group>:first-child{margin-left:0}.fc-basic-view td.fc-day-number{color:#777;padding-top:3px;padding-right:7px;font-size:12px}.fc-basic-view td.fc-today.fc-day-number{color:#444;font-weight:600}.minimal-mp .ui-datepicker{background:none;margin:0;border:0}.minimal-mp .ui-datepicker-header{display:none}.minimal-mp .ui-datepicker td{padding:8px 5px}.minimal-mp .ui-datepicker td span,.minimal-mp .ui-datepicker td a{background:#DDD;padding:0.5em 0.2em}.img-container,.img-preview{background-color:#f7f7f7;overflow:hidden;width:100%;text-align:center}.img-container{min-height:200px;max-height:466px;margin-bottom:20px}@media (min-width: 768px){.img-container{min-height:466px}}.img-container>img{max-width:100%}.img-preview{float:left;margin-right:10px;margin-bottom:10px}.img-preview>img{max-width:100%}.preview-lg{width:263px;height:148px}.preview-md{width:139px;height:78px}.preview-sm{width:69px;height:39px}.preview-xs{width:35px;height:20px;margin-right:0}.docs-data>.input-group{margin-bottom:10px}.docs-data>.input-group>label{min-width:80px}.docs-data>.input-group>span{min-width:50px}.docs-buttons>.btn,.docs-buttons>.btn-group,.docs-buttons>.form-control{margin-right:5px;margin-bottom:10px}.docs-toggles>.btn,.docs-toggles>.btn-group,.docs-toggles>.dropdown{margin-bottom:10px}.docs-tooltip{display:block;margin:-6px -12px;padding:6px 12px}.docs-tooltip>.icon{margin:0 -3px;vertical-align:top}.tooltip-inner{white-space:normal}.btn-upload .tooltip-inner{white-space:nowrap}@media (max-width: 400px){.btn-group-crop{margin-right:-15px !important}.btn-group-crop>.btn{padding-left:5px;padding-right:5px}.btn-group-crop .docs-tooltip{margin-left:-5px;margin-right:-5px;padding-left:5px;padding-right:5px}}.docs-options .dropdown-menu{width:100%}.docs-options .dropdown-menu>li{padding:3px 20px}.docs-options .dropdown-menu>li:hover{background-color:#f7f7f7}.docs-options .dropdown-menu>li>label{display:block}.docs-cropped .modal-body{text-align:center}.docs-cropped .modal-body>img,.docs-cropped .modal-body>canvas{max-width:100%}.admin-form .mfp-close,.admin-form .mfp-close-btn-in{font-size:26px;color:#999;text-shadow:none;font-weight:400;padding-top:5px}.mfp-with-fade .mfp-content,.mfp-with-fade.mfp-bg{opacity:0;-webkit-transition:opacity 0.5s ease-out;transition:opacity 0.5s ease-out}.mfp-with-fade.mfp-ready .mfp-content{opacity:1}.mfp-with-fade.mfp-ready.mfp-bg{opacity:0.8}.mfp-with-fade.mfp-removing .mfp-with-anim{opacity:0}.mfp-with-fade.mfp-removing.mfp-bg{opacity:0}.mfp-zoomIn .mfp-with-anim{opacity:0;transition:all 0.2s ease-in-out;transform:scale(0.8)}.mfp-zoomIn.mfp-bg{opacity:0;transition:all 0.3s ease-out}.mfp-zoomIn.mfp-ready .mfp-with-anim{opacity:1;transform:scale(1)}.mfp-zoomIn.mfp-ready.mfp-bg{opacity:0.8}.mfp-zoomIn.mfp-removing .mfp-with-anim{transform:scale(0.8);opacity:0}.mfp-zoomIn.mfp-removing.mfp-bg{opacity:0}.mfp-zoomOut .mfp-with-anim{opacity:0;transition:all 0.3s ease-in-out;transform:scale(1.3)}.mfp-zoomOut.mfp-bg{opacity:0;transition:all 0.3s ease-out}.mfp-zoomOut.mfp-ready .mfp-with-anim{opacity:1;transform:scale(1)}.mfp-zoomOut.mfp-ready.mfp-bg{opacity:0.8}.mfp-zoomOut.mfp-removing .mfp-with-anim{transform:scale(1.3);opacity:0}.mfp-zoomOut.mfp-removing.mfp-bg{opacity:0}.mfp-slideLeft .mfp-with-anim{opacity:0;transition:all 0.3s;transform:translateX(-50px)}.mfp-slideLeft.mfp-bg{opacity:0;transition:all 0.3s}.mfp-slideLeft.mfp-ready .mfp-with-anim{opacity:1;transform:translateX(0)}.mfp-slideLeft.mfp-ready.mfp-bg{opacity:0.8}.mfp-slideLeft.mfp-removing .mfp-with-anim{transform:translateX(50px);opacity:0}.mfp-slideLeft.mfp-removing.mfp-bg{opacity:0}.mfp-slideRight .mfp-with-anim{opacity:0;transition:all 0.3s;transform:translateX(50px)}.mfp-slideRight.mfp-bg{opacity:0;transition:all 0.3s}.mfp-slideRight.mfp-ready .mfp-with-anim{opacity:1;transform:translateX(0)}.mfp-slideRight.mfp-ready.mfp-bg{opacity:0.8}.mfp-slideRight.mfp-removing .mfp-with-anim{transform:translateX(-50px);opacity:0}.mfp-slideRight.mfp-removing.mfp-bg{opacity:0}.mfp-slideDown .mfp-content{vertical-align:middle}.mfp-slideDown .mfp-with-anim{opacity:0;transition:all 0.2s;transform:translateY(-100px)}.mfp-slideDown.mfp-bg{opacity:0;transition:all 0.2s}.mfp-slideDown.mfp-ready .mfp-with-anim{opacity:1;transform:translateY(0)}.mfp-slideDown.mfp-ready.mfp-bg{opacity:0.8}.mfp-slideDown.mfp-removing .mfp-with-anim{transform:translateY(-50px);opacity:0}.mfp-slideDown.mfp-removing.mfp-bg{opacity:0}.mfp-slideUp .mfp-content{vertical-align:middle}.mfp-slideUp .mfp-with-anim{opacity:0;transition:all 0.2s;transform:translateY(100px)}.mfp-slideUp.mfp-bg{opacity:0;transition:all 0.2s}.mfp-slideUp.mfp-ready .mfp-with-anim{opacity:1;transform:translateY(0)}.mfp-slideUp.mfp-ready.mfp-bg{opacity:0.8}.mfp-slideUp.mfp-removing .mfp-with-anim{transform:translateY(50px);opacity:0}.mfp-slideUp.mfp-removing.mfp-bg{opacity:0}.mfp-flipInX .mfp-content{perspective:2000px}.mfp-flipInX .mfp-with-anim{opacity:0;transition:all 0.3s ease-in-out;transform-style:preserve-3d;transform:rotateX(-60deg)}.mfp-flipInX.mfp-bg{opacity:0;transition:all 0.5s}.mfp-flipInX.mfp-ready .mfp-with-anim{opacity:1;transform:rotateX(0deg)}.mfp-flipInX.mfp-ready.mfp-bg{opacity:0.8}.mfp-flipInX.mfp-removing .mfp-with-anim{transform:rotateX(60deg);opacity:0}.mfp-flipInX.mfp-removing.mfp-bg{opacity:0}.mfp-flipInY .mfp-content{perspective:2000px}.mfp-flipInY .mfp-with-anim{opacity:0;transition:all 0.3s ease-in-out;transform-style:preserve-3d;transform:rotateY(-60deg)}.mfp-flipInY.mfp-bg{opacity:0;transition:all 0.5s}.mfp-flipInY.mfp-ready .mfp-with-anim{opacity:1;transform:rotateY(0deg)}.mfp-flipInY.mfp-ready.mfp-bg{opacity:0.8}.mfp-flipInY.mfp-removing .mfp-with-anim{transform:rotateY(60deg);opacity:0}.mfp-flipInY.mfp-removing.mfp-bg{opacity:0}.mfp-rotateDown .mfp-content{-webkit-perspective:1300px;perspective:1300px}.mfp-rotateDown .mfp-with-anim{-webkit-transform-style:preserve-3d;transform-style:preserve-3d;-webkit-transform:translateY(-100%) rotateX(-90deg);transform:translateY(-100%) rotateX(-90deg);-webkit-transform-origin:0 -100%;transform-origin:0 -100%;opacity:0;-webkit-transition:all 0.3s ease-out;transition:all 0.3s ease-out}.mfp-rotateDown.mfp-bg{opacity:0;transition:all 0.5s}.mfp-rotateDown.mfp-ready .mfp-with-anim{-webkit-transform:translateY(0%) rotateX(0deg);transform:translateY(0%) rotateX(0deg);opacity:1}.mfp-rotateDown.mfp-ready.mfp-bg{opacity:0.8}.mfp-rotateDown.mfp-removing .mfp-with-anim{-webkit-transform:translateY(-100%) rotateX(-90deg);transform:translateY(-100%) rotateX(-90deg);-webkit-transform-origin:0 -100%;transform-origin:0 -100%;opacity:0}.mfp-rotateDown.mfp-removing.mfp-bg{opacity:0}.mfp-rotateUp .mfp-content{-webkit-perspective:1300px;perspective:1300px}.mfp-rotateUp .mfp-with-anim{-webkit-transform-style:preserve-3d;transform-style:preserve-3d;-webkit-transform:translateY(100%) rotateX(90deg);transform:translateY(100%) rotateX(90deg);-webkit-transform-origin:0 100%;transform-origin:0 100%;opacity:0;-webkit-transition:all 0.3s ease-out;transition:all 0.3s ease-out}.mfp-rotateUp.mfp-bg{opacity:0;transition:all 0.5s}.mfp-rotateUp.mfp-ready .mfp-with-anim{-webkit-transform:translateY(0%) rotateX(0deg);transform:translateY(0%) rotateX(0deg);opacity:1}.mfp-rotateUp.mfp-ready.mfp-bg{opacity:0.8}.mfp-rotateUp.mfp-removing .mfp-with-anim{-webkit-transform:translateY(100%) rotateX(90deg);transform:translateY(100%) rotateX(90deg);-webkit-transform-origin:0 100%;transform-origin:0 100%;opacity:0}.mfp-rotateUp.mfp-removing.mfp-bg{opacity:0}.mfp-rotateRight .mfp-content{-webkit-perspective:1300px;perspective:1300px}.mfp-rotateRight .mfp-with-anim{opacity:0;-webkit-transform-style:preserve-3d;transform-style:preserve-3d;-webkit-transform:translateX(100%) rotateY(90deg);transform:translateX(100%) rotateY(90deg);-webkit-transform-origin:100% 0;transform-origin:100% 0;-webkit-transition:all 0.3s ease-out;transition:all 0.3s ease-out}.mfp-rotateRight.mfp-bg{opacity:0;transition:all 0.5s}.mfp-rotateRight.mfp-ready .mfp-with-anim{-webkit-transform:translateX(0%) rotateY(0deg);transform:translateX(0%) rotateY(0deg);opacity:1}.mfp-rotateRight.mfp-ready.mfp-bg{opacity:0.8}.mfp-rotateRight.mfp-removing .mfp-with-anim{-webkit-transform:translateX(-100%) rotateY(-90deg);transform:translateX(-100%) rotateY(-90deg);-webkit-transform-origin:-100% 0;transform-origin:-100% 0;opacity:0}.mfp-rotateRight.mfp-removing.mfp-bg{opacity:0}.mfp-rotateLeft .mfp-content{-webkit-perspective:1300px;perspective:1300px}.mfp-rotateLeft .mfp-with-anim{opacity:0;-webkit-transform-style:preserve-3d;transform-style:preserve-3d;-webkit-transform:translateX(-100%) rotateY(-90deg);transform:translateX(-100%) rotateY(-90deg);-webkit-transform-origin:-100% 0;transform-origin:-100% 0;-webkit-transition:all 0.3s ease-out;transition:all 0.3s ease-out}.mfp-rotateLeft.mfp-bg{opacity:0;transition:all 0.5s}.mfp-rotateLeft.mfp-ready .mfp-with-anim{-webkit-transform:translateX(0%) rotateY(0deg);transform:translateX(0%) rotateY(0deg);opacity:1}.mfp-rotateLeft.mfp-ready.mfp-bg{opacity:0.8}.mfp-rotateLeft.mfp-removing .mfp-with-anim{-webkit-transform:translateX(100%) rotateY(90deg);transform:translateX(100%) rotateY(90deg);-webkit-transform-origin:100% 0;transform-origin:100% 0;opacity:0}.mfp-rotateLeft.mfp-removing.mfp-bg{opacity:0}.mfp-fullscale .mfp-with-anim{-webkit-transform:scale(0.8);transform:scale(0.8);opacity:0;-webkit-transition:all 0.6s;transition:all 0.6s;-webkit-transition-delay:0.3s;transition-delay:0.3s}.mfp-fullscale.mfp-bg{background:#000;opacity:0;transition:all 0.35s}.mfp-fullscale.mfp-ready .mfp-with-anim{-webkit-transform:scale(1);transform:scale(1);opacity:1}.mfp-fullscale.mfp-ready.mfp-bg{background:#000;opacity:1}.mfp-fullscale.mfp-removing .mfp-with-anim{opacity:0;-webkit-transition:all 0.4s;transition:all 0.4s}.mfp-fullscale.mfp-removing.mfp-bg{background:#000\A;opacity:0;-webkit-transition:all 0.4s;transition:all 0.4s}.mfp-sign .mfp-content{perspective:1300px}.mfp-sign .mfp-with-anim{transform-style:preserve-3d;transform:rotateX(-60deg);transform-origin:50% 0;opacity:0;-webkit-transition:all 0.3s;transition:all 0.3s}.mfp-sign.mfp-bg{opacity:0;transition:all 0.5s}.mfp-sign.mfp-ready .mfp-with-anim{transform:rotateX(0deg);opacity:1}.mfp-sign.mfp-ready.mfp-bg{opacity:0.8}.mfp-sign.mfp-removing .mfp-with-anim{transform:rotateX(-60deg);opacity:0}.mfp-sign.mfp-removing.mfp-bg{opacity:0}.mfp-newspaper .mfp-with-anim{opacity:0;-webkit-transition:all 0.2s ease-in-out;transition:all 0.5s;transform:scale(0) rotate(500deg)}.mfp-newspaper.mfp-bg{opacity:0;transition:all 0.5s}.mfp-newspaper.mfp-ready .mfp-with-anim{opacity:1;transform:scale(1) rotate(0deg)}.mfp-newspaper.mfp-ready.mfp-bg{opacity:0.8}.mfp-newspaper.mfp-removing .mfp-with-anim{transform:scale(0) rotate(500deg);opacity:0}.mfp-newspaper.mfp-removing.mfp-bg{opacity:0}.fa-spin{-webkit-animation:fa-spin 2s infinite linear;animation:fa-spin 2s infinite linear}@-webkit-keyframes fa-spin{0%{-webkit-transform:rotate(0deg);transform:rotate(0deg)}100%{-webkit-transform:rotate(359deg);transform:rotate(359deg)}}@keyframes fa-spin{0%{-webkit-transform:rotate(0deg);transform:rotate(0deg)}100%{-webkit-transform:rotate(359deg);transform:rotate(359deg)}}/*! normalize.css v3.0.1 | MIT License | git.io/normalize */html{font-family:sans-serif;-ms-text-size-adjust:100%;-webkit-text-size-adjust:100%}body{margin:0}article,aside,details,figcaption,figure,footer,header,hgroup,main,nav,section,summary{display:block}audio,canvas,progress,video{display:inline-block;vertical-align:baseline}audio:not([controls]){display:none;height:0}[hidden],template{display:none}a{background:transparent}a:active,a:hover{outline:0}abbr[title]{border-bottom:1px dotted}b,strong{font-weight:600}dfn{font-style:italic}h1{font-size:2em;margin:0.67em 0}mark{background:#ff0;color:#000}small{font-size:80%}sub,sup{font-size:75%;line-height:0;position:relative;vertical-align:baseline}sup{top:-0.5em}sub{bottom:-0.25em}img{border:0}svg:not(:root){overflow:hidden}figure{margin:1em 40px}hr{-moz-box-sizing:content-box;box-sizing:content-box;height:0}pre{overflow:auto}code,kbd,pre,samp{font-family:monospace, monospace;font-size:1em}button,input,optgroup,select,textarea{color:inherit;font:inherit;margin:0}button{overflow:visible}button,select{text-transform:none}button,html input[type="button"],input[type="reset"],input[type="submit"]{-webkit-appearance:button;cursor:pointer}button[disabled],html input[disabled]{cursor:default}button::-moz-focus-inner,input::-moz-focus-inner{border:0;padding:0}input{line-height:normal}input[type="checkbox"],input[type="radio"]{box-sizing:border-box;padding:0}input[type="number"]::-webkit-inner-spin-button,input[type="number"]::-webkit-outer-spin-button{height:auto}input[type="search"]{-webkit-appearance:textfield;-moz-box-sizing:content-box;-webkit-box-sizing:content-box;box-sizing:content-box}input[type="search"]::-webkit-search-cancel-button,input[type="search"]::-webkit-search-decoration{-webkit-appearance:none}fieldset{border:1px solid #c0c0c0;margin:0 2px;padding:0.35em 0.625em 0.75em}legend{border:0;padding:0}textarea{overflow:auto}optgroup{font-weight:bold}table{border-collapse:collapse;border-spacing:0}td,th{padding:0}@media print{*{text-shadow:none !important;color:#000 !important;background:transparent !important;box-shadow:none !important}a,a:visited{text-decoration:underline}a[href]:after{content:" (" attr(href) ")"}abbr[title]:after{content:" (" attr(title) ")"}a[href^="javascript:"]:after,a[href^="#"]:after{content:""}pre,blockquote{border:1px solid #999;page-break-inside:avoid}thead{display:table-header-group}tr,img{page-break-inside:avoid}img{max-width:100% !important}p,h2,h3{orphans:3;widows:3}h2,h3{page-break-after:avoid}select{background:#fff !important}.navbar{display:none}.table td,.table th{background-color:#fff !important}.btn>.caret,.dropup>.btn>.caret{border-top-color:#000 !important}.label{border:1px solid #000}.table{border-collapse:collapse !important}.table-bordered th,.table-bordered td{border:1px solid #ddd !important}}*{-webkit-box-sizing:border-box;-moz-box-sizing:border-box;box-sizing:border-box}*:before,*:after{-webkit-box-sizing:border-box;-moz-box-sizing:border-box;box-sizing:border-box}html{font-size:10px;-webkit-tap-highlight-color:transparent}body{font-family:"Open Sans", Helvetica, Arial, sans-serif;font-size:13px;font-weight:400;line-height:1.49;color:#666666;background-color:#ffffff}input,button,select,textarea{font-family:inherit;font-size:inherit;line-height:inherit}a{color:#4a89dc;text-decoration:none}a:hover,a:focus{color:#2363b6;text-decoration:underline}a:focus{outline:0;outline-offset:-2px}figure{margin:0}img{vertical-align:middle}.img-responsive,.thumbnail>img,.thumbnail a>img,.carousel-inner>.item>img,.carousel-inner>.item>a>img{display:block;width:100% \9;max-width:100%;height:auto}.img-rounded{border-radius:3px}.img-thumbnail{padding:4px;line-height:1.49;background-color:#ffffff;border:1px solid #dddddd;border-radius:1px;-webkit-transition:all 0.2s ease-in-out;-o-transition:all 0.2s ease-in-out;transition:all 0.2s ease-in-out;display:inline-block;width:100% \9;max-width:100%;height:auto}.img-circle{border-radius:50%}hr{margin-top:19px;margin-bottom:19px;border:0;border-top:1px solid #eeeeee}.sr-only{position:absolute;width:1px;height:1px;margin:-1px;padding:0;overflow:hidden;clip:rect(0, 0, 0, 0);border:0}.sr-only-focusable:active,.sr-only-focusable:focus{position:static;width:auto;height:auto;margin:0;overflow:visible;clip:auto}a.link-unstyled{color:#666}a.link-unstyled:hover,a.link-unstyled:focus,a.link-unstyled:active{color:#222;text-decoration:none}h1,h2,h3,h4,h5,h6,.h1,.h2,.h3,.h4,.h5,.h6{font-family:inherit;font-weight:600;line-height:1.1;color:inherit;text-rendering:optimizelegibility}h1 small,h2 small,h3 small,h4 small,h5 small,h6 small,.h1 small,.h2 small,.h3 small,.h4 small,.h5 small,.h6 small,h1 .small,h2 .small,h3 .small,h4 .small,h5 .small,h6 .small,.h1 .small,.h2 .small,.h3 .small,.h4 .small,.h5 .small,.h6 .small{font-weight:normal;line-height:1;color:#999999}h1,.h1,h2,.h2,h3,.h3{margin-top:19px;margin-bottom:9.5px}h1 small,.h1 small,h2 small,.h2 small,h3 small,.h3 small,h1 .small,.h1 .small,h2 .small,.h2 .small,h3 .small,.h3 .small{font-size:75%}h4,.h4,h5,.h5,h6,.h6{margin-top:9.5px;margin-bottom:9.5px}h4 small,.h4 small,h5 small,.h5 small,h6 small,.h6 small,h4 .small,.h4 .small,h5 .small,.h5 .small,h6 .small,.h6 .small{font-size:88%}h1 small,.h1 .small{font-size:70%}h1,.h1{font-size:30px}h2,.h2{font-size:24px}h3,.h3{font-size:18px}h4,.h4{font-size:15px}h5,.h5{font-size:13px}h6,.h6{font-size:11px;color:#999999}p{margin:0 0 9.5px}.lead{margin-bottom:19px;font-size:14px;font-weight:300;line-height:1.4}@media (min-width: 768px){.lead{font-size:19.5px}}small,.small{font-size:92%}cite{font-style:normal}mark,.mark{background-color:#f8cd73;padding:.2em}.text-left{text-align:left !important}.text-right{text-align:right !important}.text-center{text-align:center !important}.text-justify{text-align:justify !important}.text-nowrap{white-space:nowrap !important}.text-lowercase{text-transform:lowercase}.text-uppercase{text-transform:uppercase}.text-capitalize{text-transform:capitalize}.page-header{font-size:18px;padding-bottom:16.5px;margin:5px 0 25px;border-bottom:1px solid #dddddd}.content-header{text-align:center;margin-top:15px;margin-bottom:40px}.content-header h1,.content-header h2,.content-header h3,.content-header h4{line-height:30px}.micro-header{color:#999;text-align:center;font-weight:400;margin-bottom:20px}ul,ol{margin-top:0;margin-bottom:9.5px}ul ul,ol ul,ul ol,ol ol{margin-bottom:0}.list-unstyled{padding-left:0;list-style:none}.list-inline{padding-left:0;list-style:none;margin-left:-5px}.list-inline>li{display:inline-block;padding-left:5px;padding-right:5px}dl{margin-top:0;margin-bottom:19px}dt,dd{line-height:1.49}dt{font-weight:bold}dd{margin-left:0}@media (min-width: 480px){.dl-horizontal dt{float:left;width:160px;clear:left;text-align:right;overflow:hidden;text-overflow:ellipsis;white-space:nowrap}.dl-horizontal dd{margin-left:180px}}abbr[title],abbr[data-original-title]{cursor:help;border-bottom:1px dotted #777777}.initialism{font-size:90%;text-transform:uppercase}blockquote{padding:9.5px 19px;margin:0 0 19px;font-size:16.25px;border-left:5px solid #eeeeee}blockquote p:last-child,blockquote ul:last-child,blockquote ol:last-child{margin-bottom:0}blockquote.blockquote-rounded{border-radius:11px}blockquote.blockquote-thin{border-width:3px}blockquote footer,blockquote small,blockquote .small{display:block;font-size:80%;line-height:1.49;color:#777777}blockquote footer:before,blockquote small:before,blockquote .small:before{content:'\2014 \00A0'}.blockquote-reverse,blockquote.pull-right{padding-right:15px;padding-left:0;border-right:5px solid #eeeeee;border-left:0;text-align:right}.blockquote-reverse footer:before,blockquote.pull-right footer:before,.blockquote-reverse small:before,blockquote.pull-right small:before,.blockquote-reverse .small:before,blockquote.pull-right .small:before{content:''}.blockquote-reverse footer:after,blockquote.pull-right footer:after,.blockquote-reverse small:after,blockquote.pull-right small:after,.blockquote-reverse .small:after,blockquote.pull-right .small:after{content:'\00A0 \2014'}blockquote:before,blockquote:after{content:""}address{margin-bottom:19px;font-style:normal;line-height:1.49}.dropcap{min-height:75px}.dropcap:first-letter{font-family:'Droid Serif', serif;float:left;color:#555;font-size:60px;font-weight:600;line-height:45px;padding:5px;margin:0px 5px 0 0}.dropcap.lead:first-letter{font-size:90px;line-height:25px}.dropcap.dropcap-fill:first-letter{border-radius:6px;color:#FFF;margin:0px 10px 0 0}.dropcap.lead.dropcap-fill:first-letter{border-radius:6px;color:#FFF;margin:0px 10px 0 0;padding-bottom:26px}hr{margin:35px 0;border-top:1px solid #DDD}hr.alt{border-top:1px dashed #cccccc}hr.short{margin:20px 0}hr.tall{margin:55px 0}hr.dotted{border-style:dotted}.divider{height:1px;margin:25px 0;background:#e2e2e2}code,kbd,pre,samp{font-family:Menlo, Monaco, Consolas, "Courier New", monospace}code{padding:2px 4px;font-size:90%;color:#c7254e;background-color:#f9f2f4;border-radius:1px}kbd{padding:2px 4px;font-size:90%;color:#ffffff;background-color:#333333;border-radius:0px;box-shadow:inset 0 -1px 0 rgba(0,0,0,0.25)}kbd kbd{padding:0;font-size:100%;box-shadow:none}pre{display:block;padding:9px;margin:0 0 9.5px;font-size:12px;line-height:1.49;word-break:break-all;word-wrap:break-word;color:#333333;background-color:#eaeef0;border:1px solid #cbd6d6;border-radius:1px}pre code{padding:0;font-size:inherit;color:inherit;white-space:pre-wrap;background-color:transparent;border-radius:0}.pre-scrollable{max-height:340px;overflow-y:scroll}.container{margin-right:auto;margin-left:auto;padding-left:11px;padding-right:11px}@media (min-width: 768px){.container{width:742px}}@media (min-width: 992px){.container{width:962px}}@media (min-width: 1140px){.container{width:1062px}}@media (min-width: 1400px){.container{width:1302px}}.container-sm{max-width:640px}.container-md{max-width:860px}.container-lg{max-width:1000px}.container-xl{max-width:1200px}.container-fluid{margin-right:auto;margin-left:auto;padding-left:11px;padding-right:11px}.row{margin-left:-11px;margin-right:-11px}.col-xs-1,.col-sm-1,.col-md-1,.col-lg-1,.col-xl-1,.col-xs-2,.col-sm-2,.col-md-2,.col-lg-2,.col-xl-2,.col-xs-3,.col-sm-3,.col-md-3,.col-lg-3,.col-xl-3,.col-xs-4,.col-sm-4,.col-md-4,.col-lg-4,.col-xl-4,.col-xs-5,.col-sm-5,.col-md-5,.col-lg-5,.col-xl-5,.col-xs-6,.col-sm-6,.col-md-6,.col-lg-6,.col-xl-6,.col-xs-7,.col-sm-7,.col-md-7,.col-lg-7,.col-xl-7,.col-xs-8,.col-sm-8,.col-md-8,.col-lg-8,.col-xl-8,.col-xs-9,.col-sm-9,.col-md-9,.col-lg-9,.col-xl-9,.col-xs-10,.col-sm-10,.col-md-10,.col-lg-10,.col-xl-10,.col-xs-11,.col-sm-11,.col-md-11,.col-lg-11,.col-xl-11,.col-xs-12,.col-sm-12,.col-md-12,.col-lg-12,.col-xl-12{position:relative;min-height:1px;padding-left:11px;padding-right:11px}.col-xs-1,.col-xs-2,.col-xs-3,.col-xs-4,.col-xs-5,.col-xs-6,.col-xs-7,.col-xs-8,.col-xs-9,.col-xs-10,.col-xs-11,.col-xs-12{float:left}.col-xs-12{width:100%}.col-xs-11{width:91.66666667%}.col-xs-10{width:83.33333333%}.col-xs-9{width:75%}.col-xs-8{width:66.66666667%}.col-xs-7{width:58.33333333%}.col-xs-6{width:50%}.col-xs-5{width:41.66666667%}.col-xs-4{width:33.33333333%}.col-xs-3{width:25%}.col-xs-2{width:16.66666667%}.col-xs-1{width:8.33333333%}.col-xs-pull-12{right:100%}.col-xs-pull-11{right:91.66666667%}.col-xs-pull-10{right:83.33333333%}.col-xs-pull-9{right:75%}.col-xs-pull-8{right:66.66666667%}.col-xs-pull-7{right:58.33333333%}.col-xs-pull-6{right:50%}.col-xs-pull-5{right:41.66666667%}.col-xs-pull-4{right:33.33333333%}.col-xs-pull-3{right:25%}.col-xs-pull-2{right:16.66666667%}.col-xs-pull-1{right:8.33333333%}.col-xs-pull-0{right:auto}.col-xs-push-12{left:100%}.col-xs-push-11{left:91.66666667%}.col-xs-push-10{left:83.33333333%}.col-xs-push-9{left:75%}.col-xs-push-8{left:66.66666667%}.col-xs-push-7{left:58.33333333%}.col-xs-push-6{left:50%}.col-xs-push-5{left:41.66666667%}.col-xs-push-4{left:33.33333333%}.col-xs-push-3{left:25%}.col-xs-push-2{left:16.66666667%}.col-xs-push-1{left:8.33333333%}.col-xs-push-0{left:auto}.col-xs-offset-12{margin-left:100%}.col-xs-offset-11{margin-left:91.66666667%}.col-xs-offset-10{margin-left:83.33333333%}.col-xs-offset-9{margin-left:75%}.col-xs-offset-8{margin-left:66.66666667%}.col-xs-offset-7{margin-left:58.33333333%}.col-xs-offset-6{margin-left:50%}.col-xs-offset-5{margin-left:41.66666667%}.col-xs-offset-4{margin-left:33.33333333%}.col-xs-offset-3{margin-left:25%}.col-xs-offset-2{margin-left:16.66666667%}.col-xs-offset-1{margin-left:8.33333333%}.col-xs-offset-0{margin-left:0%}@media (min-width: 768px){.col-sm-1,.col-sm-2,.col-sm-3,.col-sm-4,.col-sm-5,.col-sm-6,.col-sm-7,.col-sm-8,.col-sm-9,.col-sm-10,.col-sm-11,.col-sm-12{float:left}.col-sm-12{width:100%}.col-sm-11{width:91.66666667%}.col-sm-10{width:83.33333333%}.col-sm-9{width:75%}.col-sm-8{width:66.66666667%}.col-sm-7{width:58.33333333%}.col-sm-6{width:50%}.col-sm-5{width:41.66666667%}.col-sm-4{width:33.33333333%}.col-sm-3{width:25%}.col-sm-2{width:16.66666667%}.col-sm-1{width:8.33333333%}.col-sm-pull-12{right:100%}.col-sm-pull-11{right:91.66666667%}.col-sm-pull-10{right:83.33333333%}.col-sm-pull-9{right:75%}.col-sm-pull-8{right:66.66666667%}.col-sm-pull-7{right:58.33333333%}.col-sm-pull-6{right:50%}.col-sm-pull-5{right:41.66666667%}.col-sm-pull-4{right:33.33333333%}.col-sm-pull-3{right:25%}.col-sm-pull-2{right:16.66666667%}.col-sm-pull-1{right:8.33333333%}.col-sm-pull-0{right:auto}.col-sm-push-12{left:100%}.col-sm-push-11{left:91.66666667%}.col-sm-push-10{left:83.33333333%}.col-sm-push-9{left:75%}.col-sm-push-8{left:66.66666667%}.col-sm-push-7{left:58.33333333%}.col-sm-push-6{left:50%}.col-sm-push-5{left:41.66666667%}.col-sm-push-4{left:33.33333333%}.col-sm-push-3{left:25%}.col-sm-push-2{left:16.66666667%}.col-sm-push-1{left:8.33333333%}.col-sm-push-0{left:auto}.col-sm-offset-12{margin-left:100%}.col-sm-offset-11{margin-left:91.66666667%}.col-sm-offset-10{margin-left:83.33333333%}.col-sm-offset-9{margin-left:75%}.col-sm-offset-8{margin-left:66.66666667%}.col-sm-offset-7{margin-left:58.33333333%}.col-sm-offset-6{margin-left:50%}.col-sm-offset-5{margin-left:41.66666667%}.col-sm-offset-4{margin-left:33.33333333%}.col-sm-offset-3{margin-left:25%}.col-sm-offset-2{margin-left:16.66666667%}.col-sm-offset-1{margin-left:8.33333333%}.col-sm-offset-0{margin-left:0%}}@media (min-width: 992px){.col-md-1,.col-md-2,.col-md-3,.col-md-4,.col-md-5,.col-md-6,.col-md-7,.col-md-8,.col-md-9,.col-md-10,.col-md-11,.col-md-12{float:left}.col-md-12{width:100%}.col-md-11{width:91.66666667%}.col-md-10{width:83.33333333%}.col-md-9{width:75%}.col-md-8{width:66.66666667%}.col-md-7{width:58.33333333%}.col-md-6{width:50%}.col-md-5{width:41.66666667%}.col-md-4{width:33.33333333%}.col-md-3{width:25%}.col-md-2{width:16.66666667%}.col-md-1{width:8.33333333%}.col-md-pull-12{right:100%}.col-md-pull-11{right:91.66666667%}.col-md-pull-10{right:83.33333333%}.col-md-pull-9{right:75%}.col-md-pull-8{right:66.66666667%}.col-md-pull-7{right:58.33333333%}.col-md-pull-6{right:50%}.col-md-pull-5{right:41.66666667%}.col-md-pull-4{right:33.33333333%}.col-md-pull-3{right:25%}.col-md-pull-2{right:16.66666667%}.col-md-pull-1{right:8.33333333%}.col-md-pull-0{right:auto}.col-md-push-12{left:100%}.col-md-push-11{left:91.66666667%}.col-md-push-10{left:83.33333333%}.col-md-push-9{left:75%}.col-md-push-8{left:66.66666667%}.col-md-push-7{left:58.33333333%}.col-md-push-6{left:50%}.col-md-push-5{left:41.66666667%}.col-md-push-4{left:33.33333333%}.col-md-push-3{left:25%}.col-md-push-2{left:16.66666667%}.col-md-push-1{left:8.33333333%}.col-md-push-0{left:auto}.col-md-offset-12{margin-left:100%}.col-md-offset-11{margin-left:91.66666667%}.col-md-offset-10{margin-left:83.33333333%}.col-md-offset-9{margin-left:75%}.col-md-offset-8{margin-left:66.66666667%}.col-md-offset-7{margin-left:58.33333333%}.col-md-offset-6{margin-left:50%}.col-md-offset-5{margin-left:41.66666667%}.col-md-offset-4{margin-left:33.33333333%}.col-md-offset-3{margin-left:25%}.col-md-offset-2{margin-left:16.66666667%}.col-md-offset-1{margin-left:8.33333333%}.col-md-offset-0{margin-left:0%}}@media (min-width: 1140px){.col-lg-1,.col-lg-2,.col-lg-3,.col-lg-4,.col-lg-5,.col-lg-6,.col-lg-7,.col-lg-8,.col-lg-9,.col-lg-10,.col-lg-11,.col-lg-12{float:left}.col-lg-12{width:100%}.col-lg-11{width:91.66666667%}.col-lg-10{width:83.33333333%}.col-lg-9{width:75%}.col-lg-8{width:66.66666667%}.col-lg-7{width:58.33333333%}.col-lg-6{width:50%}.col-lg-5{width:41.66666667%}.col-lg-4{width:33.33333333%}.col-lg-3{width:25%}.col-lg-2{width:16.66666667%}.col-lg-1{width:8.33333333%}.col-lg-pull-12{right:100%}.col-lg-pull-11{right:91.66666667%}.col-lg-pull-10{right:83.33333333%}.col-lg-pull-9{right:75%}.col-lg-pull-8{right:66.66666667%}.col-lg-pull-7{right:58.33333333%}.col-lg-pull-6{right:50%}.col-lg-pull-5{right:41.66666667%}.col-lg-pull-4{right:33.33333333%}.col-lg-pull-3{right:25%}.col-lg-pull-2{right:16.66666667%}.col-lg-pull-1{right:8.33333333%}.col-lg-pull-0{right:auto}.col-lg-push-12{left:100%}.col-lg-push-11{left:91.66666667%}.col-lg-push-10{left:83.33333333%}.col-lg-push-9{left:75%}.col-lg-push-8{left:66.66666667%}.col-lg-push-7{left:58.33333333%}.col-lg-push-6{left:50%}.col-lg-push-5{left:41.66666667%}.col-lg-push-4{left:33.33333333%}.col-lg-push-3{left:25%}.col-lg-push-2{left:16.66666667%}.col-lg-push-1{left:8.33333333%}.col-lg-push-0{left:auto}.col-lg-offset-12{margin-left:100%}.col-lg-offset-11{margin-left:91.66666667%}.col-lg-offset-10{margin-left:83.33333333%}.col-lg-offset-9{margin-left:75%}.col-lg-offset-8{margin-left:66.66666667%}.col-lg-offset-7{margin-left:58.33333333%}.col-lg-offset-6{margin-left:50%}.col-lg-offset-5{margin-left:41.66666667%}.col-lg-offset-4{margin-left:33.33333333%}.col-lg-offset-3{margin-left:25%}.col-lg-offset-2{margin-left:16.66666667%}.col-lg-offset-1{margin-left:8.33333333%}.col-lg-offset-0{margin-left:0%}}@media (min-width: 1400px){.col-xl-1,.col-xl-2,.col-xl-3,.col-xl-4,.col-xl-5,.col-xl-6,.col-xl-7,.col-xl-8,.col-xl-9,.col-xl-10,.col-xl-11,.col-xl-12{float:left}.col-xl-12{width:100%}.col-xl-11{width:91.66666667%}.col-xl-10{width:83.33333333%}.col-xl-9{width:75%}.col-xl-8{width:66.66666667%}.col-xl-7{width:58.33333333%}.col-xl-6{width:50%}.col-xl-5{width:41.66666667%}.col-xl-4{width:33.33333333%}.col-xl-3{width:25%}.col-xl-2{width:16.66666667%}.col-xl-1{width:8.33333333%}.col-xl-pull-12{right:100%}.col-xl-pull-11{right:91.66666667%}.col-xl-pull-10{right:83.33333333%}.col-xl-pull-9{right:75%}.col-xl-pull-8{right:66.66666667%}.col-xl-pull-7{right:58.33333333%}.col-xl-pull-6{right:50%}.col-xl-pull-5{right:41.66666667%}.col-xl-pull-4{right:33.33333333%}.col-xl-pull-3{right:25%}.col-xl-pull-2{right:16.66666667%}.col-xl-pull-1{right:8.33333333%}.col-xl-pull-0{right:auto}.col-xl-push-12{left:100%}.col-xl-push-11{left:91.66666667%}.col-xl-push-10{left:83.33333333%}.col-xl-push-9{left:75%}.col-xl-push-8{left:66.66666667%}.col-xl-push-7{left:58.33333333%}.col-xl-push-6{left:50%}.col-xl-push-5{left:41.66666667%}.col-xl-push-4{left:33.33333333%}.col-xl-push-3{left:25%}.col-xl-push-2{left:16.66666667%}.col-xl-push-1{left:8.33333333%}.col-xl-push-0{left:auto}.col-xl-offset-12{margin-left:100%}.col-xl-offset-11{margin-left:91.66666667%}.col-xl-offset-10{margin-left:83.33333333%}.col-xl-offset-9{margin-left:75%}.col-xl-offset-8{margin-left:66.66666667%}.col-xl-offset-7{margin-left:58.33333333%}.col-xl-offset-6{margin-left:50%}.col-xl-offset-5{margin-left:41.66666667%}.col-xl-offset-4{margin-left:33.33333333%}.col-xl-offset-3{margin-left:25%}.col-xl-offset-2{margin-left:16.66666667%}.col-xl-offset-1{margin-left:8.33333333%}.col-xl-offset-0{margin-left:0%}}table{background-color:transparent}th{text-align:left}.table{width:100%;max-width:100%;margin-bottom:0}.table>thead>tr>th,.table>tbody>tr>th,.table>tfoot>tr>th,.table>thead>tr>td,.table>tbody>tr>td,.table>tfoot>tr>td{padding:9px;line-height:1.49;vertical-align:middle;border-top:1px solid #eeeeee}.table>thead>tr>th{font-weight:600;vertical-align:bottom;border-bottom:1px solid #eeeeee}.table>caption+thead>tr:first-child>th,.table>colgroup+thead>tr:first-child>th,.table>thead:first-child>tr:first-child>th,.table>caption+thead>tr:first-child>td,.table>colgroup+thead>tr:first-child>td,.table>thead:first-child>tr:first-child>td{border-top:0}.table>tbody+tbody{border-top:2px solid #eeeeee}.table tbody>tr:first-child>td{border-top:0}.table .table{margin-bottom:0;background-color:#ffffff}.table-condensed>thead>tr>th,.table-condensed>tbody>tr>th,.table-condensed>tfoot>tr>th,.table-condensed>thead>tr>td,.table-condensed>tbody>tr>td,.table-condensed>tfoot>tr>td{padding:5px}.table-bordered{border:1px solid #eeeeee}.table-bordered>thead>tr>th,.table-bordered>tbody>tr>th,.table-bordered>tfoot>tr>th,.table-bordered>thead>tr>td,.table-bordered>tbody>tr>td,.table-bordered>tfoot>tr>td{border:1px solid #eeeeee}.table-bordered>thead>tr>th,.table-bordered>thead>tr>td{border-bottom-width:2px}.table-striped>tbody>tr:nth-child(odd)>td,.table-striped>tbody>tr:nth-child(odd)>th{background-color:#f9f9f9}.table-hover>tbody>tr:hover>td,.table-hover>tbody>tr:hover>th{background-color:#f5f5f5}.table-curved>tbody>tr>td:first-child{border-radius:4px 0 0 4px}.table-curved>tbody>tr>td:last-child{border-radius:0 4px 4px 0}table col[class*="col-"]{position:static;float:none;display:table-column}table td[class*="col-"],table th[class*="col-"]{position:static;float:none;display:table-cell}.table>thead>tr>td.default,.table>tbody>tr>td.default,.table>tfoot>tr>td.default,.table>thead>tr>th.default,.table>tbody>tr>th.default,.table>tfoot>tr>th.default,.table>thead>tr.default>td,.table>tbody>tr.default>td,.table>tfoot>tr.default>td,.table>thead>tr.default>th,.table>tbody>tr.default>th,.table>tfoot>tr.default>th{color:#777;border-color:#ddd;background-color:#f0f0f0}.table-hover>tbody>tr>td.default:hover,.table-hover>tbody>tr>th.default:hover,.table-hover>tbody>tr.default:hover>td,.table-hover>tbody>tr:hover>.default,.table-hover>tbody>tr.default:hover>th{background-color:#fcfcfc}@media screen and (max-width: 767px){.table-responsive{width:100%;margin-bottom:14.25px;overflow-y:hidden;overflow-x:auto;-ms-overflow-style:-ms-autohiding-scrollbar;border:1px solid #eeeeee;-webkit-overflow-scrolling:touch}.table-responsive>.table{margin-bottom:0}.table-responsive>.table>thead>tr>th,.table-responsive>.table>tbody>tr>th,.table-responsive>.table>tfoot>tr>th,.table-responsive>.table>thead>tr>td,.table-responsive>.table>tbody>tr>td,.table-responsive>.table>tfoot>tr>td{white-space:nowrap}.table-responsive>.table-bordered{border:0}.table-responsive>.table-bordered>thead>tr>th:first-child,.table-responsive>.table-bordered>tbody>tr>th:first-child,.table-responsive>.table-bordered>tfoot>tr>th:first-child,.table-responsive>.table-bordered>thead>tr>td:first-child,.table-responsive>.table-bordered>tbody>tr>td:first-child,.table-responsive>.table-bordered>tfoot>tr>td:first-child{border-left:0}.table-responsive>.table-bordered>thead>tr>th:last-child,.table-responsive>.table-bordered>tbody>tr>th:last-child,.table-responsive>.table-bordered>tfoot>tr>th:last-child,.table-responsive>.table-bordered>thead>tr>td:last-child,.table-responsive>.table-bordered>tbody>tr>td:last-child,.table-responsive>.table-bordered>tfoot>tr>td:last-child{border-right:0}.table-responsive>.table-bordered>tbody>tr:last-child>th,.table-responsive>.table-bordered>tfoot>tr:last-child>th,.table-responsive>.table-bordered>tbody>tr:last-child>td,.table-responsive>.table-bordered>tfoot>tr:last-child>td{border-bottom:0}}fieldset{padding:0;margin:0;border:0;min-width:0}legend{display:block;width:100%;padding:0;margin-bottom:19px;font-size:19.5px;line-height:inherit;color:#333333;border:0;border-bottom:1px solid #e5e5e5}label{display:inline-block;max-width:100%;margin-bottom:5px;font-weight:600}input[type="search"]{-webkit-box-sizing:border-box;-moz-box-sizing:border-box;box-sizing:border-box}input[type="radio"],input[type="checkbox"]{margin:4px 0 0;margin-top:1px \9;line-height:normal}input[type="file"]{display:block}input[type="range"]{display:block;width:100%}select[multiple],select[size]{height:auto}input[type="file"]:focus,input[type="radio"]:focus,input[type="checkbox"]:focus{outline:0;outline-offset:-2px}output{display:block;padding-top:10px;font-size:13px;line-height:1.49;color:#555555}.form-control{display:block;width:100%;height:39px;padding:9px 12px;font-size:13px;line-height:1.49;color:#555555;background-color:#ffffff;background-image:none;border:1px solid #dddddd;border-radius:0px;-webkit-transition:border-color ease-in-out 0.15s;-o-transition:border-color ease-in-out 0.15s;transition:border-color ease-in-out 0.15s}.form-control:focus{border-color:#75a5e4;outline:0}.form-control::-moz-placeholder{color:#777777;opacity:1}.form-control:-ms-input-placeholder{color:#777777}.form-control::-webkit-input-placeholder{color:#777777}.form-control[disabled],.form-control[readonly],fieldset[disabled] .form-control{cursor:not-allowed;background-color:#fafafa;opacity:1}textarea.form-control{height:auto}textarea.form-control{resize:vertical}textarea.textarea-grow{height:39px;resize:none}textarea.textarea-grow:focus{height:auto;resize:vertical}.input-hero .form-control{padding:14px 25px;height:60px;background:#f9f9f9;border:1px solid #DDD;font-size:16px;border-radius:3px}input[type="search"]{-webkit-appearance:none}input[type="date"],input[type="time"],input[type="datetime-local"],input[type="month"]{line-height:39px;line-height:1.49 \0}input[type="date"].input-sm,input[type="time"].input-sm,input[type="datetime-local"].input-sm,input[type="month"].input-sm{line-height:30px}input[type="date"].input-lg,input[type="time"].input-lg,input[type="datetime-local"].input-lg,input[type="month"].input-lg{line-height:45px}.form-group{margin-bottom:15px}.radio,.checkbox{position:relative;display:block;min-height:19px;margin-top:10px;margin-bottom:10px}.radio label,.checkbox label{padding-left:20px;margin-bottom:0;font-weight:normal;cursor:pointer}.radio input[type="radio"],.radio-inline input[type="radio"],.checkbox input[type="checkbox"],.checkbox-inline input[type="checkbox"]{position:absolute;margin-left:-20px;margin-top:4px \9}.radio+.radio,.checkbox+.checkbox{margin-top:-5px}.radio-inline,.checkbox-inline{display:inline-block;padding-left:20px;margin-bottom:0;vertical-align:middle;font-weight:normal;cursor:pointer}.radio-inline+.radio-inline,.checkbox-inline+.checkbox-inline{margin-top:0;margin-left:10px}input[type="radio"][disabled],input[type="checkbox"][disabled],input[type="radio"].disabled,input[type="checkbox"].disabled,fieldset[disabled] input[type="radio"],fieldset[disabled] input[type="checkbox"]{cursor:not-allowed}.radio-inline.disabled,.checkbox-inline.disabled,fieldset[disabled] .radio-inline,fieldset[disabled] .checkbox-inline{cursor:not-allowed}.radio.disabled label,.checkbox.disabled label,fieldset[disabled] .radio label,fieldset[disabled] .checkbox label{cursor:not-allowed}.form-control-static{padding-top:10px;padding-bottom:10px;margin-bottom:0}.form-control-static.input-lg,.form-control-static.input-sm{padding-left:0;padding-right:0}.input-sm,.form-horizontal .form-group-sm .form-control{height:30px;padding:5px 10px;font-size:12px;line-height:1.5;border-radius:0px}select.input-sm{height:30px;line-height:30px}textarea.input-sm,select[multiple].input-sm{height:auto}.input-lg,.form-horizontal .form-group-lg .form-control{height:45px;padding:10px 16px;font-size:17px;line-height:1.33;border-radius:3px}select.input-lg{height:45px;line-height:45px}textarea.input-lg,select[multiple].input-lg{height:auto}.has-feedback{position:relative}.has-feedback .form-control{padding-right:48.75px}.form-control-feedback{position:absolute;top:24px;right:0;z-index:2;display:block;width:39px;height:39px;line-height:39px;text-align:center}.input-lg+.form-control-feedback{width:45px;height:45px;line-height:45px}.input-sm+.form-control-feedback{width:30px;height:30px;line-height:30px}.has-primary .help-block,.has-primary .control-label,.has-primary .radio,.has-primary .checkbox,.has-primary .radio-inline,.has-primary .checkbox-inline,.has-primary .append-icon{color:#4a89dc}.has-primary .form-control{border-color:#75a5e4;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.075);box-shadow:inset 0 1px 1px rgba(0,0,0,0.075)}.has-primary .form-control:focus{border-color:#276ecc;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.025),0 0 3px #9fc1ed;box-shadow:inset 0 1px 1px rgba(0,0,0,0.025),0 0 3px #9fc1ed}.has-primary .input-group-addon{color:#1f57a1;border-color:#4a89dc;background-color:#caddf5}.has-primary .form-control-feedback{color:#4a89dc}.has-success .help-block,.has-success .control-label,.has-success .radio,.has-success .checkbox,.has-success .radio-inline,.has-success .checkbox-inline,.has-success .append-icon{color:#70ca63}.has-success .form-control{border-color:#93d789;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.075);box-shadow:inset 0 1px 1px rgba(0,0,0,0.075)}.has-success .form-control:focus{border-color:#4fbb3f;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.025),0 0 3px #b6e4af;box-shadow:inset 0 1px 1px rgba(0,0,0,0.025),0 0 3px #b6e4af}.has-success .input-group-addon{color:#3f9532;border-color:#70ca63;background-color:#d9f1d5}.has-success .form-control-feedback{color:#70ca63}.has-info .help-block,.has-info .control-label,.has-info .radio,.has-info .checkbox,.has-info .radio-inline,.has-info .checkbox-inline,.has-info .append-icon{color:#3bafda}.has-info .form-control{border-color:#66c1e2;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.075);box-shadow:inset 0 1px 1px rgba(0,0,0,0.075)}.has-info .form-control:focus{border-color:#2494be;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.025),0 0 3px #91d2ea;box-shadow:inset 0 1px 1px rgba(0,0,0,0.025),0 0 3px #91d2ea}.has-info .input-group-addon{color:#1c7393;border-color:#3bafda;background-color:#bce4f2}.has-info .form-control-feedback{color:#3bafda}.has-warning .help-block,.has-warning .control-label,.has-warning .radio,.has-warning .checkbox,.has-warning .radio-inline,.has-warning .checkbox-inline,.has-warning .append-icon{color:#f6bb42}.has-warning .form-control{border-color:#f8cd73;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.075);box-shadow:inset 0 1px 1px rgba(0,0,0,0.075)}.has-warning .form-control:focus{border-color:#f4a911;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.025),0 0 3px #fbdea3;box-shadow:inset 0 1px 1px rgba(0,0,0,0.025),0 0 3px #fbdea3}.has-warning .input-group-addon{color:#c88a0a;border-color:#f6bb42;background-color:#fdf0d4}.has-warning .form-control-feedback{color:#f6bb42}.has-error .help-block,.has-error .control-label,.has-error .radio,.has-error .checkbox,.has-error .radio-inline,.has-error .checkbox-inline,.has-error .append-icon{color:#e9573f}.has-error .form-control{border-color:#ee7f6d;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.075);box-shadow:inset 0 1px 1px rgba(0,0,0,0.075)}.has-error .form-control:focus{border-color:#dc3519;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.025),0 0 3px #f3a79b;box-shadow:inset 0 1px 1px rgba(0,0,0,0.025),0 0 3px #f3a79b}.has-error .input-group-addon{color:#bc2d16;border-color:#e9573f;background-color:#fadbd6}.has-error .form-control-feedback{color:#e9573f}.has-alert .help-block,.has-alert .control-label,.has-alert .radio,.has-alert .checkbox,.has-alert .radio-inline,.has-alert .checkbox-inline,.has-alert .append-icon{color:#967adc}.has-alert .form-control{border-color:#b6a2e7;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.075);box-shadow:inset 0 1px 1px rgba(0,0,0,0.075)}.has-alert .form-control:focus{border-color:#7652d1;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.025),0 0 3px #d6cbf1;box-shadow:inset 0 1px 1px rgba(0,0,0,0.025),0 0 3px #d6cbf1}.has-alert .input-group-addon{color:#542fb2;border-color:#967adc;background-color:#ece7f9}.has-alert .form-control-feedback{color:#967adc}.has-system .help-block,.has-system .control-label,.has-system .radio,.has-system .checkbox,.has-system .radio-inline,.has-system .checkbox-inline,.has-system .append-icon{color:#37bc9b}.has-system .form-control{border-color:#58ceb1;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.075);box-shadow:inset 0 1px 1px rgba(0,0,0,0.075)}.has-system .form-control:focus{border-color:#2b957a;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.025),0 0 3px #7fdac3;box-shadow:inset 0 1px 1px rgba(0,0,0,0.025),0 0 3px #7fdac3}.has-system .input-group-addon{color:#206d5a;border-color:#37bc9b;background-color:#a7e5d6}.has-system .form-control-feedback{color:#37bc9b}.has-feedback label.sr-only ~ .form-control-feedback{top:0}.help-block{display:block;margin-top:5px;margin-bottom:10px;color:#a6a6a6}@media (min-width: 768px){.form-inline .form-group{display:inline-block;margin-bottom:0;vertical-align:middle}.form-inline .form-control{display:inline-block;width:auto;vertical-align:middle}.form-inline .input-group{display:inline-table;vertical-align:middle}.form-inline .input-group .input-group-addon,.form-inline .input-group .input-group-btn,.form-inline .input-group .form-control{width:auto}.form-inline .input-group>.form-control{width:100%}.form-inline .control-label{margin-bottom:0;vertical-align:middle}.form-inline .radio,.form-inline .checkbox{display:inline-block;margin-top:0;margin-bottom:0;vertical-align:middle}.form-inline .radio label,.form-inline .checkbox label{padding-left:0}.form-inline .radio input[type="radio"],.form-inline .checkbox input[type="checkbox"]{position:relative;margin-left:0}.form-inline .has-feedback .form-control-feedback{top:0}}.form-horizontal .radio,.form-horizontal .checkbox,.form-horizontal .radio-inline,.form-horizontal .checkbox-inline{margin-top:0;margin-bottom:0;padding-top:10px}.form-horizontal .radio,.form-horizontal .checkbox{min-height:29px}.form-horizontal .form-group{margin-left:-11px;margin-right:-11px}@media (min-width: 768px){.form-horizontal .control-label{text-align:right;margin-bottom:0;padding-top:10px}}.form-horizontal .has-feedback .form-control-feedback{top:0;right:11px}@media (min-width: 768px){.form-horizontal .form-group-lg .control-label{padding-top:14.3px}}@media (min-width: 768px){.form-horizontal .form-group-sm .control-label{padding-top:6px}}.form-bordered .form-group{border-bottom:1px solid #f2f2f2;padding-bottom:18px;margin-bottom:18px}.form-bordered .form-group:last-child{border-bottom:none;padding-bottom:0;margin-bottom:0}.append-icon{position:absolute;left:23px;top:8px;font-size:14px}.append-icon.right{left:auto;right:23px}.append-icon+input.form-control{padding-right:40px}.input-group-addon{color:#4a89dc;background-color:#fafafa;border-color:#DDD}.btn{display:inline-block;margin-bottom:0;font-weight:normal;text-align:center;vertical-align:middle;cursor:pointer;background-image:none;border:1px solid transparent;border-color:transparent;white-space:nowrap;padding:9px 12px;font-size:13px;line-height:1.49;border-radius:0px;-webkit-user-select:none;-moz-user-select:none;-ms-user-select:none;user-select:none}.btn:focus,.btn:active:focus,.btn.active:focus{outline:0;outline-offset:-2px}.btn:hover,.btn:focus{color:#666666;text-decoration:none}.btn:active,.btn.active{outline:0;background-image:none;-webkit-box-shadow:inset 0 3px 5px rgba(0,0,0,0.125);box-shadow:inset 0 3px 5px rgba(0,0,0,0.125)}.btn.disabled,.btn[disabled],fieldset[disabled] .btn{cursor:not-allowed;pointer-events:none;opacity:0.65;filter:alpha(opacity=65);-webkit-box-shadow:none;box-shadow:none}.btn.btn-gradient{text-shadow:0 -1px 0 rgba(0,0,0,0.4);border-color:rgba(0,0,0,0.07) rgba(0,0,0,0.1) rgba(0,0,0,0.18);-webkit-box-shadow:inset 0 1px 0 rgba(255,255,255,0.2);box-shadow:inset 0 1px 0 rgba(255,255,255,0.2);background-repeat:repeat-x;background-image:-webkit-linear-gradient(top, rgba(255,255,255,0.3) 1%, rgba(255,255,255,0.15) 100%);background-image:linear-gradient(to bottom, rgba(255,255,255,0.3) 1%, rgba(255,255,255,0.15) 100%)}.btn.btn-rounded{border-radius:20px}.btn-link{color:#4a89dc;font-weight:normal;cursor:pointer;border-radius:0}.btn-link,.btn-link:active,.btn-link[disabled],fieldset[disabled] .btn-link{background-color:transparent;-webkit-box-shadow:none;box-shadow:none}.btn-link,.btn-link:hover,.btn-link:focus,.btn-link:active{border-color:transparent}.btn-link:hover,.btn-link:focus{color:#2363b6;text-decoration:underline;background-color:transparent}.btn-link[disabled]:hover,fieldset[disabled] .btn-link:hover,.btn-link[disabled]:focus,fieldset[disabled] .btn-link:focus{color:#777777;text-decoration:none}.btn-lg,.btn-group-lg>.btn{padding:10px 16px;font-size:17px;line-height:1.33;border-radius:3px}.btn-sm,.btn-group-sm>.btn{padding:5px 10px;font-size:12px;line-height:1.5;border-radius:0px}.btn-xs,.btn-group-xs>.btn{padding:1px 5px;font-size:12px;line-height:1.5;border-radius:0px}.btn-block{display:block;width:100%}.btn-block+.btn-block{margin-top:5px}input[type="submit"].btn-block,input[type="reset"].btn-block,input[type="button"].btn-block{width:100%}.btn.btn-alt{position:relative;padding:7px 11px;margin:5px 3px;color:#999;font-size:11px;font-weight:600;text-decoration:none;background-color:#fbfbfb;border-radius:1px;border:1px solid #EEE;border-left:4px solid #EEE;-webkit-transition:opacity 0.1s ease;transition:opacity 0.1s ease}.btn.btn-alt.item-active,.btn.btn-alt:hover,.btn.btn-alt:focus{color:#666 !important;background-color:#fefefe !important}.btn.btn-alt.btn-gradient{background-color:#f0f0f0;text-shadow:0 -1px 0 rgba(255,255,255,0.4);-webkit-box-shadow:inset 0 1px 0 rgba(255,255,255,0.2);box-shadow:inset 0 1px 0 rgba(255,255,255,0.2);background-repeat:repeat-x;background-image:-webkit-linear-gradient(top, rgba(255,255,255,0.9) 10%, rgba(255,255,255,0.3) 100%);background-image:linear-gradient(to bottom, rgba(255,255,255,0.9) 10%, rgba(255,255,255,0.3) 100%);border-color:rgba(0,0,0,0.07) rgba(0,0,0,0.08) rgba(0,0,0,0.14);border-left:4px solid #DDD}.btn.btn-alt.btn-gradient:hover,.btn.btn-alt.btn-gradient:focus{background-color:#eee}.btn.btn-alt.item-checked{opacity:1;color:#666;border-left-color:#70ca63 !important;transition:all 0.2s ease}.holder-style{display:block;padding:9px 16px;color:#AAA;background-color:#f1f1f1;outline:2px dashed #d9d9d9;border:0;-webkit-transition:all 0.15s ease;-moz-transition:all 0.15s ease;transition:all 0.15s ease}.holder-style:hover,.holder-style:focus{cursor:pointer;color:#777;background-color:#EEE;outline:2px dashed #aaa;border:0;text-decoration:none}.holder-style.holder-active{background-color:#FFF;outline-color:#70ca63}.holder-style .holder-icon{color:#AAA;font-size:30px;padding-bottom:10px}.holder-style:hover .holder-icon,.holder-style:focus .holder-icon,.holder-style.holder-active .holder-icon{color:#70ca63}.btn-dimmer.btn,.btn-dimmer .btn{opacity:0.5}.btn-dimmer.btn:hover,.btn-dimmer .btn:hover,.btn-dimmer.btn.item-active,.btn-dimmer .btn.item-active{opacity:1}.fade{opacity:0;-webkit-transition:opacity 0.15s linear;-o-transition:opacity 0.15s linear;transition:opacity 0.15s linear}.fade.in{opacity:1}.collapse{display:none}.collapse.in{display:block}tr.collapse.in{display:table-row}tbody.collapse.in{display:table-row-group}.collapsing{position:relative;height:0;overflow:hidden;-webkit-transition:height 0.35s ease;-o-transition:height 0.35s ease;transition:height 0.35s ease}.caret{display:inline-block;width:0;height:0;margin-left:2px;vertical-align:middle;border-top:4px solid;border-right:4px solid transparent;border-left:4px solid transparent}.caret.caret-tp{border-top-color:rgba(0,0,0,0.2)}.caret.caret-xs{border-width:2px}.caret.caret-sm{border-width:3px}.caret.caret-lg{border-width:5px}.dropdown{position:relative}.dropdown-menu.dropdown-sm{min-width:120px}.dropdown-menu.dropdown-sm li{margin-bottom:0}.dropdown-menu.dropdown-sm li a{font-size:13px;padding:2px 12px}.dropdown-toggle:focus{outline:0}.dropdown-menu{position:absolute;top:100%;left:0;z-index:1000;display:none;float:left;min-width:160px;padding:5px 0;margin:2px 0 0;list-style:none;font-size:13px;text-align:left;background-color:#ffffff;border:1px solid #cccccc;border:1px solid rgba(0,0,0,0.15);border-radius:1px;-webkit-box-shadow:0 6px 12px rgba(0,0,0,0.175);box-shadow:0 6px 12px rgba(0,0,0,0.175);background-clip:padding-box}.dropdown-menu.pull-right{right:0;left:auto}.dropdown-menu .divider{height:1px;margin:8.5px 0;overflow:hidden;background-color:#e5e5e5}.dropdown-menu>li>a{display:block;padding:5px 15px;clear:both;color:#666666;font-weight:normal;line-height:1.49;white-space:nowrap}.dropdown-menu>li>a:hover,.dropdown-menu>li>a:focus{text-decoration:none;color:#595959;background-color:#f5f5f5}.dropdown-menu>.active>a,.dropdown-menu>.active>a:hover,.dropdown-menu>.active>a:focus{color:#ffffff;text-decoration:none;outline:0;background-color:#4a89dc}.dropdown-menu>.disabled>a,.dropdown-menu>.disabled>a:hover,.dropdown-menu>.disabled>a:focus{color:#777777}.dropdown-menu>.disabled>a:hover,.dropdown-menu>.disabled>a:focus{text-decoration:none;background-color:transparent;background-image:none;filter:progid:DXImageTransform.Microsoft.gradient(enabled = false);cursor:not-allowed}.open>.dropdown-menu{display:block}.open>a{outline:0}.dropdown-menu-right{left:auto;right:0}.dropdown-menu-left{left:0;right:auto}.dropdown-header{display:block;padding:3px 20px;font-size:12px;line-height:1.49;color:#777777;white-space:nowrap}.dropdown-backdrop{position:fixed;left:0;right:0;bottom:0;top:0;z-index:990}.pull-right>.dropdown-menu{right:0;left:auto}.dropup .caret,.navbar-fixed-bottom .dropdown .caret{border-top:0;border-bottom:4px solid;content:""}.dropup .dropdown-menu,.navbar-fixed-bottom .dropdown .dropdown-menu{top:auto;bottom:100%;margin-bottom:1px}@media (min-width: 480px){.navbar-right .dropdown-menu{left:auto;right:0}.navbar-right .dropdown-menu-left{left:0;right:auto}}.btn-group,.btn-group-vertical{position:relative;display:inline-block;vertical-align:middle}.btn-group>.btn,.btn-group-vertical>.btn{position:relative;float:left}.btn-group>.btn:hover,.btn-group-vertical>.btn:hover,.btn-group>.btn:focus,.btn-group-vertical>.btn:focus,.btn-group>.btn:active,.btn-group-vertical>.btn:active,.btn-group>.btn.active,.btn-group-vertical>.btn.active{z-index:2}.btn-group>.btn:focus,.btn-group-vertical>.btn:focus{outline:0}.btn-group .btn+.btn,.btn-group .btn+.btn-group,.btn-group .btn-group+.btn,.btn-group .btn-group+.btn-group{margin-left:-1px}.btn-toolbar{margin-left:-5px}.btn-toolbar .btn-group,.btn-toolbar .input-group{float:left}.btn-toolbar>.btn,.btn-toolbar>.btn-group,.btn-toolbar>.input-group{margin-left:5px}.btn-group>.btn:not(:first-child):not(:last-child):not(.dropdown-toggle){border-radius:0}.btn-group>.btn:first-child{margin-left:0}.btn-group>.btn:first-child:not(:last-child):not(.dropdown-toggle){border-bottom-right-radius:0;border-top-right-radius:0}.btn-group>.btn:last-child:not(:first-child),.btn-group>.dropdown-toggle:not(:first-child){border-bottom-left-radius:0;border-top-left-radius:0}.btn-group>.btn-group{float:left}.btn-group>.btn-group:not(:first-child):not(:last-child)>.btn{border-radius:0}.btn-group>.btn-group:first-child>.btn:last-child,.btn-group>.btn-group:first-child>.dropdown-toggle{border-bottom-right-radius:0;border-top-right-radius:0}.btn-group>.btn-group:last-child>.btn:first-child{border-bottom-left-radius:0;border-top-left-radius:0}.btn-group .dropdown-toggle:active,.btn-group.open .dropdown-toggle{outline:0}.btn-group>.btn+.dropdown-toggle{padding-left:8px;padding-right:8px;border-left:1px solid rgba(0,0,0,0.12)}.btn-group>.btn-lg+.dropdown-toggle{padding-left:12px;padding-right:12px}.btn-group.open .dropdown-toggle{-webkit-box-shadow:inset 0 3px 5px rgba(0,0,0,0.125);box-shadow:inset 0 3px 5px rgba(0,0,0,0.125)}.btn-group.open .dropdown-toggle.btn-link{-webkit-box-shadow:none;box-shadow:none}.btn .caret{margin-left:0}.btn-lg .caret{border-width:5px 5px 0;border-bottom-width:0}.dropup .btn-lg .caret{border-width:0 5px 5px}.btn-group-vertical>.btn,.btn-group-vertical>.btn-group,.btn-group-vertical>.btn-group>.btn{display:block;float:none;width:100%;max-width:100%}.btn-group-vertical>.btn-group>.btn{float:none}.btn-group-vertical>.btn+.btn,.btn-group-vertical>.btn+.btn-group,.btn-group-vertical>.btn-group+.btn,.btn-group-vertical>.btn-group+.btn-group{margin-top:-1px;margin-left:0}.btn-group-vertical>.btn:not(:first-child):not(:last-child){border-radius:0}.btn-group-vertical>.btn:first-child:not(:last-child){border-top-right-radius:1px;border-bottom-right-radius:0;border-bottom-left-radius:0}.btn-group-vertical>.btn:last-child:not(:first-child){border-bottom-left-radius:1px;border-top-right-radius:0;border-top-left-radius:0}.btn-group-vertical>.btn-group:not(:first-child):not(:last-child)>.btn{border-radius:0}.btn-group-vertical>.btn-group:first-child:not(:last-child)>.btn:last-child,.btn-group-vertical>.btn-group:first-child:not(:last-child)>.dropdown-toggle{border-bottom-right-radius:0;border-bottom-left-radius:0}.btn-group-vertical>.btn-group:last-child:not(:first-child)>.btn:first-child{border-top-right-radius:0;border-top-left-radius:0}.btn-group-justified{display:table;width:100%;table-layout:fixed;border-collapse:separate}.btn-group-justified>.btn,.btn-group-justified>.btn-group{float:none;display:table-cell;width:1%}.btn-group-justified>.btn-group .btn{width:100%}.btn-group-justified>.btn-group .dropdown-menu{left:auto}[data-toggle="buttons"]>.btn>input[type="radio"],[data-toggle="buttons"]>.btn>input[type="checkbox"]{position:absolute;z-index:-1;opacity:0;filter:alpha(opacity=0)}.input-group{position:relative;display:table;border-collapse:separate}.input-group[class*="col-"]{float:none;padding-left:0;padding-right:0}.input-group .form-control{position:relative;z-index:2;float:left;width:100%;margin-bottom:0}.input-group-lg>.form-control,.input-group-lg>.input-group-addon,.input-group-lg>.input-group-btn>.btn{height:45px;padding:10px 16px;font-size:17px;line-height:1.33;border-radius:3px}select.input-group-lg>.form-control,select.input-group-lg>.input-group-addon,select.input-group-lg>.input-group-btn>.btn{height:45px;line-height:45px}textarea.input-group-lg>.form-control,textarea.input-group-lg>.input-group-addon,textarea.input-group-lg>.input-group-btn>.btn,select[multiple].input-group-lg>.form-control,select[multiple].input-group-lg>.input-group-addon,select[multiple].input-group-lg>.input-group-btn>.btn{height:auto}.input-group-sm>.form-control,.input-group-sm>.input-group-addon,.input-group-sm>.input-group-btn>.btn{height:30px;padding:5px 10px;font-size:12px;line-height:1.5;border-radius:0px}select.input-group-sm>.form-control,select.input-group-sm>.input-group-addon,select.input-group-sm>.input-group-btn>.btn{height:30px;line-height:30px}textarea.input-group-sm>.form-control,textarea.input-group-sm>.input-group-addon,textarea.input-group-sm>.input-group-btn>.btn,select[multiple].input-group-sm>.form-control,select[multiple].input-group-sm>.input-group-addon,select[multiple].input-group-sm>.input-group-btn>.btn{height:auto}.input-group-addon,.input-group-btn,.input-group .form-control{display:table-cell}.input-group-addon:not(:first-child):not(:last-child),.input-group-btn:not(:first-child):not(:last-child),.input-group .form-control:not(:first-child):not(:last-child){border-radius:0}.input-group-addon,.input-group-btn{width:1%;white-space:nowrap;vertical-align:middle}.input-group-addon{min-width:40px;padding:9px 12px;font-size:13px;font-weight:normal;line-height:1;color:#4a89dc;text-align:center;background-color:#fafafa;border:1px solid #dddddd;border-radius:0px}.input-group-addon.input-sm{padding:5px 10px;font-size:12px;border-radius:0px}.input-group-addon.input-lg{padding:10px 16px;font-size:17px;border-radius:3px}.input-group-addon input[type="radio"],.input-group-addon input[type="checkbox"]{margin-top:0}.input-group .form-control:first-child,.input-group-addon:first-child,.input-group-btn:first-child>.btn,.input-group-btn:first-child>.btn-group>.btn,.input-group-btn:first-child>.dropdown-toggle,.input-group-btn:last-child>.btn:not(:last-child):not(.dropdown-toggle),.input-group-btn:last-child>.btn-group:not(:last-child)>.btn{border-bottom-right-radius:0;border-top-right-radius:0}.input-group-addon:first-child{border-right:0}.input-group .form-control:last-child,.input-group-addon:last-child,.input-group-btn:last-child>.btn,.input-group-btn:last-child>.btn-group>.btn,.input-group-btn:last-child>.dropdown-toggle,.input-group-btn:first-child>.btn:not(:first-child),.input-group-btn:first-child>.btn-group:not(:first-child)>.btn{border-bottom-left-radius:0;border-top-left-radius:0}.input-group-addon:last-child{border-left:0}.input-group-btn{position:relative;font-size:0;white-space:nowrap}.input-group-btn>.btn{position:relative}.input-group-btn>.btn+.btn{margin-left:-1px}.input-group-btn>.btn:hover,.input-group-btn>.btn:focus,.input-group-btn>.btn:active{z-index:2}.input-group-btn:first-child>.btn,.input-group-btn:first-child>.btn-group{margin-right:-1px}.input-group-btn:last-child>.btn,.input-group-btn:last-child>.btn-group{margin-left:-1px}.nav{margin-bottom:0;padding-left:0;list-style:none}.nav>li{position:relative;display:block}.nav>li>a{position:relative;display:block;padding:10px 15px}.nav>li>a:hover,.nav>li>a:focus{text-decoration:none;background-color:#eeeeee}.nav>li.disabled>a{color:#777777}.nav>li.disabled>a:hover,.nav>li.disabled>a:focus{color:#777777;text-decoration:none;background-color:transparent;cursor:not-allowed}.nav .open>a,.nav .open>a:hover,.nav .open>a:focus{background-color:#eeeeee;border-color:#CCC}.nav .nav-divider{height:1px;margin:8.5px 0;overflow:hidden;background-color:#e5e5e5}.nav>li>a>img{max-width:none}.nav-tabs{border-bottom:1px solid #dddddd}.nav-tabs>li{float:left;margin-bottom:-1px}.nav-tabs>li>a{margin-right:2px;line-height:1.49;border:1px solid transparent;border-radius:1px 1px 0 0}.nav-tabs>li>a:hover{border-color:#eeeeee #eeeeee #dddddd}.nav-tabs>li.active>a,.nav-tabs>li.active>a:hover,.nav-tabs>li.active>a:focus{color:#555555;background-color:transparent;border:1px solid #dddddd;border-bottom-color:transparent;cursor:default}.nav-tabs.nav-justified{width:100%;border-bottom:0}.nav-tabs.nav-justified>li{float:none}.nav-tabs.nav-justified>li>a{text-align:center;margin-bottom:5px}.nav-tabs.nav-justified>.dropdown .dropdown-menu{top:auto;left:auto}@media (min-width: 768px){.nav-tabs.nav-justified>li{display:table-cell;width:1%}.nav-tabs.nav-justified>li>a{margin-bottom:0}}.nav-tabs.nav-justified>li>a{margin-right:0;border-radius:1px}.nav-tabs.nav-justified>.active>a,.nav-tabs.nav-justified>.active>a:hover,.nav-tabs.nav-justified>.active>a:focus{border:1px solid #dddddd}@media (min-width: 768px){.nav-tabs.nav-justified>li>a{border-bottom:1px solid #dddddd;border-radius:1px 1px 0 0}.nav-tabs.nav-justified>.active>a,.nav-tabs.nav-justified>.active>a:hover,.nav-tabs.nav-justified>.active>a:focus{border-bottom-color:#ffffff}}.nav-pills.nav-pills-sm>li>a{font-size:12px;padding:4px 8px}.nav-pills.nav-pills-lg>li>a{font-size:14px;padding:12px 18px}.nav-pills>li{float:left}.nav-pills>li>a{color:#888;padding:8px 14px;border-radius:1px}.nav-pills>li+li{margin-left:7px}.nav-pills>li.active>a,.nav-pills>li.active>a:hover,.nav-pills>li.active>a:focus{color:#FFF;background-color:#4a89dc}.nav-stacked>li{float:none}.nav-stacked>li+li{margin-top:2px;margin-left:0}.page-heading{position:relative;padding:30px 40px;margin:-25px -20px 25px;border-bottom:1px solid #d9d9d9;background-color:#f2f2f2}.page-tabs{margin:-25px -20px 30px;padding:15px 25px 0;border-bottom:1px solid #ddd;background:#e9e9e9}.page-tabs .nav-tabs{border-bottom:0}.page-tabs .nav-tabs>li>a{color:#AAA;padding:10px 20px}.page-tabs .nav-tabs>li.active>a,.page-tabs .nav-tabs>li.active>a:hover,.page-tabs .nav-tabs>li.active>a:focus{color:#666;font-weight:600;background-color:#eee}.nav-justified{width:100%}.nav-justified>li{float:none}.nav-justified>li>a{text-align:center;margin-bottom:5px}.nav-justified>.dropdown .dropdown-menu{top:auto;left:auto}@media (min-width: 768px){.nav-justified>li{display:table-cell;width:1%}.nav-justified>li>a{margin-bottom:0}}.nav-tabs-justified{border-bottom:0}.nav-tabs-justified>li>a{margin-right:0;border-radius:1px}.nav-tabs-justified>.active>a,.nav-tabs-justified>.active>a:hover,.nav-tabs-justified>.active>a:focus{border:1px solid #dddddd}@media (min-width: 768px){.nav-tabs-justified>li>a{border-bottom:1px solid #dddddd;border-radius:1px 1px 0 0}.nav-tabs-justified>.active>a,.nav-tabs-justified>.active>a:hover,.nav-tabs-justified>.active>a:focus{border-bottom-color:#ffffff}}.tab-content>.tab-pane{display:none}.tab-content>.active{display:block}.nav-tabs .dropdown-menu{margin-top:-1px;border-top-right-radius:0;border-top-left-radius:0}.nav-list{margin-bottom:20px}.nav-list li{display:inline-block}.nav-list li.active a{color:#444;border-bottom:3px solid #4a89dc}.nav-list li a{color:#AAA;font-weight:600;border-bottom:3px solid transparent}.nav-list li a:hover,.nav-list li a:focus{color:#444;background-color:transparent}.nav-list.nav-list-sm li a{padding:10px 8px}.navbar{position:relative;margin-bottom:19px;border:1px solid transparent}@media (min-width: 480px){.navbar{border-radius:1px}}@media (min-width: 480px){.navbar-header{float:left}}.navbar-collapse{overflow-x:visible;padding-right:11px;padding-left:11px;border-top:1px solid transparent;box-shadow:inset 0 1px 0 rgba(255,255,255,0.1);-webkit-overflow-scrolling:touch}.navbar-collapse.in{overflow-y:auto}@media (min-width: 480px){.navbar-collapse{width:auto;border-top:0;box-shadow:none}.navbar-collapse.collapse{display:block !important;height:auto !important;padding-bottom:0;overflow:visible !important}.navbar-collapse.in{overflow-y:visible}.navbar-fixed-top .navbar-collapse,.navbar-static-top .navbar-collapse,.navbar-fixed-bottom .navbar-collapse{padding-left:0;padding-right:0}}.navbar-fixed-top .navbar-collapse,.navbar-fixed-bottom .navbar-collapse{max-height:340px}@media (max-width: 480px) and (orientation: landscape){.navbar-fixed-top .navbar-collapse,.navbar-fixed-bottom .navbar-collapse{max-height:200px}}.container>.navbar-header,.container-fluid>.navbar-header,.container>.navbar-collapse,.container-fluid>.navbar-collapse{margin-right:-11px;margin-left:-11px}@media (min-width: 480px){.container>.navbar-header,.container-fluid>.navbar-header,.container>.navbar-collapse,.container-fluid>.navbar-collapse{margin-right:0;margin-left:0}}.navbar-static-top{z-index:1000;border-width:0 0 1px}@media (min-width: 480px){.navbar-static-top{border-radius:0}}.navbar-fixed-top,.navbar-fixed-bottom{position:fixed;right:0;left:0;z-index:1030;-webkit-transform:translate3d(0, 0, 0);transform:translate3d(0, 0, 0)}@media (min-width: 480px){.navbar-fixed-top,.navbar-fixed-bottom{border-radius:0}}.navbar-fixed-top{top:0;border-width:0 0 1px}.navbar-fixed-bottom{bottom:0;margin-bottom:0;border-width:1px 0 0}.navbar-brand{float:left;padding:15.5px 11px;font-size:17px;line-height:19px;height:50px}.navbar-brand:hover,.navbar-brand:focus{text-decoration:none}@media (min-width: 480px){.navbar>.container .navbar-brand,.navbar>.container-fluid .navbar-brand{margin-left:-11px}}.navbar-toggle{position:relative;float:right;margin-right:11px;padding:9px 10px;margin-top:8px;margin-bottom:8px;background-color:transparent;background-image:none;border:1px solid transparent;border-radius:1px}.navbar-toggle:focus{outline:0}.navbar-toggle .icon-bar{display:block;width:22px;height:2px;border-radius:1px}.navbar-toggle .icon-bar+.icon-bar{margin-top:4px}@media (min-width: 480px){.navbar-toggle{display:none}}.navbar-nav{margin:7.75px -11px}.navbar-nav>li>a{padding-top:10px;padding-bottom:10px;line-height:40px}@media (max-width: 479px){.navbar-nav .open .dropdown-menu{position:static;float:none;width:auto;margin-top:0;background-color:transparent;border:0;box-shadow:none}.navbar-nav .open .dropdown-menu>li>a,.navbar-nav .open .dropdown-menu .dropdown-header{padding:5px 15px 5px 25px}.navbar-nav .open .dropdown-menu>li>a{line-height:19px}.navbar-nav .open .dropdown-menu>li>a:hover,.navbar-nav .open .dropdown-menu>li>a:focus{background-image:none}}@media (min-width: 480px){.navbar-nav{float:left;margin:0}.navbar-nav>li{float:left}.navbar-nav>li>a{padding-top:15.5px;padding-bottom:15.5px}.navbar-nav.navbar-right:last-child{margin-right:-11px}}@media (min-width: 480px){.navbar-left{float:left;float:left !important}.navbar-right{float:right;float:right !important}}.navbar-form{margin-left:-11px;margin-right:-11px;padding:10px 11px;border-top:1px solid transparent;border-bottom:1px solid transparent;-webkit-box-shadow:inset 0 1px 0 rgba(255,255,255,0.1),0 1px 0 rgba(255,255,255,0.1);box-shadow:inset 0 1px 0 rgba(255,255,255,0.1),0 1px 0 rgba(255,255,255,0.1);margin-top:5.5px;margin-bottom:5.5px}@media (min-width: 768px){.navbar-form .form-group{display:inline-block;margin-bottom:0;vertical-align:middle}.navbar-form .form-control{display:inline-block;width:auto;vertical-align:middle}.navbar-form .input-group{display:inline-table;vertical-align:middle}.navbar-form .input-group .input-group-addon,.navbar-form .input-group .input-group-btn,.navbar-form .input-group .form-control{width:auto}.navbar-form .input-group>.form-control{width:100%}.navbar-form .control-label{margin-bottom:0;vertical-align:middle}.navbar-form .radio,.navbar-form .checkbox{display:inline-block;margin-top:0;margin-bottom:0;vertical-align:middle}.navbar-form .radio label,.navbar-form .checkbox label{padding-left:0}.navbar-form .radio input[type="radio"],.navbar-form .checkbox input[type="checkbox"]{position:relative;margin-left:0}.navbar-form .has-feedback .form-control-feedback{top:0}}@media (max-width: 479px){.navbar-form .form-group{margin-bottom:5px}}@media (min-width: 480px){.navbar-form{width:auto;border:0;margin-left:0;margin-right:0;padding-top:0;padding-bottom:0;-webkit-box-shadow:none;box-shadow:none}.navbar-form.navbar-right:last-child{margin-right:-11px}}.navbar-nav>li>.dropdown-menu{margin-top:0;border-top-right-radius:0;border-top-left-radius:0}.navbar-fixed-bottom .navbar-nav>li>.dropdown-menu{border-bottom-right-radius:0;border-bottom-left-radius:0}.navbar-btn{margin-top:5.5px;margin-bottom:5.5px}.navbar-btn.btn-sm{margin-top:10px;margin-bottom:10px}.navbar-btn.btn-xs{margin-top:14px;margin-bottom:14px}.navbar-text{margin-top:15.5px;margin-bottom:15.5px}@media (min-width: 480px){.navbar-text{float:left;margin-left:11px;margin-right:11px}.navbar-text.navbar-right:last-child{margin-right:0}}.navbar-default{background-color:#f8f8f8;border-color:#e7e7e7}.navbar-default .navbar-brand{color:#777777}.navbar-default .navbar-brand:hover,.navbar-default .navbar-brand:focus{color:#5e5e5e;background-color:transparent}.navbar-default .navbar-text{color:#777777}.navbar-default .navbar-nav>li>a{color:#777777}.navbar-default .navbar-nav>li>a:hover,.navbar-default .navbar-nav>li>a:focus{color:#333333;background-color:transparent}.navbar-default .navbar-nav>.active>a,.navbar-default .navbar-nav>.active>a:hover,.navbar-default .navbar-nav>.active>a:focus{color:#555555;background-color:#e7e7e7}.navbar-default .navbar-nav>.disabled>a,.navbar-default .navbar-nav>.disabled>a:hover,.navbar-default .navbar-nav>.disabled>a:focus{color:#cccccc;background-color:transparent}.navbar-default .navbar-toggle{border-color:#dddddd}.navbar-default .navbar-toggle:hover,.navbar-default .navbar-toggle:focus{background-color:#dddddd}.navbar-default .navbar-toggle .icon-bar{background-color:#888888}.navbar-default .navbar-collapse,.navbar-default .navbar-form{border-color:#e7e7e7}.navbar-default .navbar-nav>.open>a,.navbar-default .navbar-nav>.open>a:hover,.navbar-default .navbar-nav>.open>a:focus{background-color:#e7e7e7;color:#555555}@media (max-width: 479px){.navbar-default .navbar-nav .open .dropdown-menu>li>a{color:#777777}.navbar-default .navbar-nav .open .dropdown-menu>li>a:hover,.navbar-default .navbar-nav .open .dropdown-menu>li>a:focus{color:#333333;background-color:transparent}.navbar-default .navbar-nav .open .dropdown-menu>.active>a,.navbar-default .navbar-nav .open .dropdown-menu>.active>a:hover,.navbar-default .navbar-nav .open .dropdown-menu>.active>a:focus{color:#555555;background-color:#e7e7e7}.navbar-default .navbar-nav .open .dropdown-menu>.disabled>a,.navbar-default .navbar-nav .open .dropdown-menu>.disabled>a:hover,.navbar-default .navbar-nav .open .dropdown-menu>.disabled>a:focus{color:#cccccc;background-color:transparent}}.navbar-default .navbar-link{color:#777777}.navbar-default .navbar-link:hover{color:#333333}.navbar-default .btn-link{color:#777777}.navbar-default .btn-link:hover,.navbar-default .btn-link:focus{color:#333333}.navbar-default .btn-link[disabled]:hover,fieldset[disabled] .navbar-default .btn-link:hover,.navbar-default .btn-link[disabled]:focus,fieldset[disabled] .navbar-default .btn-link:focus{color:#cccccc}.navbar-inverse{background-color:#222222;border-color:#080808}.navbar-inverse .navbar-brand{color:#777777}.navbar-inverse .navbar-brand:hover,.navbar-inverse .navbar-brand:focus{color:#ffffff;background-color:transparent}.navbar-inverse .navbar-text{color:#777777}.navbar-inverse .navbar-nav>li>a{color:#777777}.navbar-inverse .navbar-nav>li>a:hover,.navbar-inverse .navbar-nav>li>a:focus{color:#ffffff;background-color:transparent}.navbar-inverse .navbar-nav>.active>a,.navbar-inverse .navbar-nav>.active>a:hover,.navbar-inverse .navbar-nav>.active>a:focus{color:#ffffff;background-color:#080808}.navbar-inverse .navbar-nav>.disabled>a,.navbar-inverse .navbar-nav>.disabled>a:hover,.navbar-inverse .navbar-nav>.disabled>a:focus{color:#444444;background-color:transparent}.navbar-inverse .navbar-toggle{border-color:#333333}.navbar-inverse .navbar-toggle:hover,.navbar-inverse .navbar-toggle:focus{background-color:#333333}.navbar-inverse .navbar-toggle .icon-bar{background-color:#ffffff}.navbar-inverse .navbar-collapse,.navbar-inverse .navbar-form{border-color:#101010}.navbar-inverse .navbar-nav>.open>a,.navbar-inverse .navbar-nav>.open>a:hover,.navbar-inverse .navbar-nav>.open>a:focus{background-color:#080808;color:#ffffff}@media (max-width: 479px){.navbar-inverse .navbar-nav .open .dropdown-menu>.dropdown-header{border-color:#080808}.navbar-inverse .navbar-nav .open .dropdown-menu .divider{background-color:#080808}.navbar-inverse .navbar-nav .open .dropdown-menu>li>a{color:#777777}.navbar-inverse .navbar-nav .open .dropdown-menu>li>a:hover,.navbar-inverse .navbar-nav .open .dropdown-menu>li>a:focus{color:#ffffff;background-color:transparent}.navbar-inverse .navbar-nav .open .dropdown-menu>.active>a,.navbar-inverse .navbar-nav .open .dropdown-menu>.active>a:hover,.navbar-inverse .navbar-nav .open .dropdown-menu>.active>a:focus{color:#ffffff;background-color:#080808}.navbar-inverse .navbar-nav .open .dropdown-menu>.disabled>a,.navbar-inverse .navbar-nav .open .dropdown-menu>.disabled>a:hover,.navbar-inverse .navbar-nav .open .dropdown-menu>.disabled>a:focus{color:#444444;background-color:transparent}}.navbar-inverse .navbar-link{color:#777777}.navbar-inverse .navbar-link:hover{color:#ffffff}.navbar-inverse .btn-link{color:#777777}.navbar-inverse .btn-link:hover,.navbar-inverse .btn-link:focus{color:#ffffff}.navbar-inverse .btn-link[disabled]:hover,fieldset[disabled] .navbar-inverse .btn-link:hover,.navbar-inverse .btn-link[disabled]:focus,fieldset[disabled] .navbar-inverse .btn-link:focus{color:#444444}.breadcrumb{padding:8px 15px;margin-bottom:19px;list-style:none;background-color:#f5f5f5;border-radius:1px}.breadcrumb>li{display:inline-block}.breadcrumb>li+li:before{content:"/\00a0";padding:0 5px;color:#cccccc}.breadcrumb>.active{color:#777777}.pagination{display:inline-block;padding-left:0;margin:19px 0;border-radius:1px}.pagination>li{display:inline}.pagination>li>a,.pagination>li>span{position:relative;float:left;padding:5px 12px;line-height:1.49;text-decoration:none;color:#4a89dc;background-color:#ffffff;border:1px solid #dddddd;margin-left:-1px}.pagination>li:first-child>a,.pagination>li:first-child>span{margin-left:0;border-bottom-left-radius:1px;border-top-left-radius:1px}.pagination>li:last-child>a,.pagination>li:last-child>span{border-bottom-right-radius:1px;border-top-right-radius:1px}.pagination>li>a:hover,.pagination>li>span:hover,.pagination>li>a:focus,.pagination>li>span:focus{color:#2363b6;background-color:#eeeeee;border-color:#dddddd}.pagination>.active>a,.pagination>.active>span,.pagination>.active>a:hover,.pagination>.active>span:hover,.pagination>.active>a:focus,.pagination>.active>span:focus{z-index:2;color:#ffffff;background-color:#4a89dc;border-color:#4a89dc;cursor:default}.pagination>.disabled>span,.pagination>.disabled>span:hover,.pagination>.disabled>span:focus,.pagination>.disabled>a,.pagination>.disabled>a:hover,.pagination>.disabled>a:focus{color:#777777;background-color:#ffffff;border-color:#dddddd;cursor:not-allowed}.pagination-lg>li>a,.pagination-lg>li>span{padding:10px 16px;font-size:17px}.pagination-lg>li:first-child>a,.pagination-lg>li:first-child>span{border-bottom-left-radius:3px;border-top-left-radius:3px}.pagination-lg>li:last-child>a,.pagination-lg>li:last-child>span{border-bottom-right-radius:3px;border-top-right-radius:3px}.pagination-sm>li>a,.pagination-sm>li>span{padding:5px 10px;font-size:12px}.pagination-sm>li:first-child>a,.pagination-sm>li:first-child>span{border-bottom-left-radius:0px;border-top-left-radius:0px}.pagination-sm>li:last-child>a,.pagination-sm>li:last-child>span{border-bottom-right-radius:0px;border-top-right-radius:0px}.pager{padding-left:0;margin:19px 0;list-style:none;text-align:center}.pager li{display:inline}.pager li>a,.pager li>span{display:inline-block;padding:5px 14px;background-color:#ffffff;border:1px solid #dddddd;border-radius:15px}.pager li>a:hover,.pager li>a:focus{text-decoration:none;background-color:#eeeeee}.pager .next>a,.pager .next>span{float:right}.pager .previous>a,.pager .previous>span{float:left}.pager .disabled>a,.pager .disabled>a:hover,.pager .disabled>a:focus,.pager .disabled>span{color:#777777;background-color:#ffffff;cursor:not-allowed}.label{display:inline;padding:0.3em 0.7em 0.4em;font-size:84%;font-weight:600;line-height:24px;color:#ffffff;text-align:center;white-space:nowrap;vertical-align:baseline;border-radius:.25em}.label.label-xs{padding:0 0.35em 0.1em;font-size:75%}.label.label-sm{padding:0.1em 0.65em 0.2em;font-size:75%}.label.label-lg{padding:0.4em 0.9em 0.5em;font-size:95%}.label.label-rounded{padding:0.2em 0.85em 0.3em;border-radius:1em}.label.label-rounded.label-xs{padding:0 0.35em 0.1em}.label.label-rounded.label-sm{padding:0.1em 0.65em 0.2em}.label.label-rounded.label-lg{padding:0.4em 0.9em 0.5em}a.label:hover,a.label:focus{color:#ffffff;text-decoration:none;cursor:pointer}.label:empty{display:none}.btn .label{position:relative;top:-1px}.badge{display:inline-block;min-width:10px;padding:3px 7px;font-size:12px;font-weight:600;color:#ffffff;line-height:1;vertical-align:baseline;white-space:nowrap;text-align:center;background-color:#777777;border-radius:10px}.badge:empty{display:none}.btn .badge{position:relative;top:-1px}.btn-xs .badge{top:0;padding:1px 5px}a.badge:hover,a.badge:focus{color:#ffffff;text-decoration:none;cursor:pointer}a.list-group-item.active>.badge,.nav-pills>.active>a>.badge{color:#4a89dc;background-color:#ffffff}.nav-pills>li>a>.badge{margin-left:3px}.jumbotron{padding:30px;margin-bottom:30px;color:inherit;background-color:#eeeeee}.jumbotron h1,.jumbotron .h1{color:inherit}.jumbotron p{margin-bottom:15px;font-size:20px;font-weight:200}.jumbotron>hr{border-top-color:#d5d5d5}.container .jumbotron{border-radius:3px}.jumbotron .container{max-width:100%}@media screen and (min-width: 768px){.jumbotron{padding-top:48px;padding-bottom:48px}.container .jumbotron{padding-left:60px;padding-right:60px}.jumbotron h1,.jumbotron .h1{font-size:58.5px}}.thumbnail{display:block;padding:4px;margin-bottom:19px;line-height:1.49;background-color:#ffffff;border:1px solid #dddddd;border-radius:1px;-webkit-transition:all 0.2s ease-in-out;-o-transition:all 0.2s ease-in-out;transition:all 0.2s ease-in-out}.thumbnail>img,.thumbnail a>img{margin-left:auto;margin-right:auto}a.thumbnail:hover,a.thumbnail:focus,a.thumbnail.active{border-color:#4a89dc}.thumbnail .caption{padding:9px;color:#666666}.alert{color:#ffffff;font-size:14px;padding:15px;margin-bottom:19px;border:1px solid rgba(0,0,0,0.1);border-radius:1px}.alert .close{color:#666666}.alert .close:hover{color:#666666}.alert hr{border-top-color:rgba(0,0,0,0.1)}.alert h4{margin-top:0;color:inherit}.alert .alert-link{color:#ffffff;font-weight:bold}.alert>p,.alert>ul{margin-bottom:0}.alert>p+p{margin-top:5px}.alert.alert-micro,.alert .alert-sm{font-size:13px;padding:9px 35px 9px 9px;border-radius:0}.alert.alert-sm{padding:12px 35px 12px 12px}.alert.alert-border{border:1px solid transparent}.alert.alert-border-right{border-right-width:6px}.alert.alert-border-top{border-top-width:3px}.alert.alert-border-bottom{border-bottom-width:3px}.alert.alert-border-left{padding-left:15px;border-left-width:6px}.alert-dismissable,.alert-dismissible{padding-right:35px}.alert-dismissable .close,.alert-dismissible .close{position:relative;right:-21px;color:#FFF;opacity:0.3}.alert-dismissable .close:hover,.alert-dismissible .close:hover{color:#FFF;opacity:1}@-webkit-keyframes progress-bar-stripes{from{background-position:40px 0}to{background-position:0 0}}@keyframes progress-bar-stripes{from{background-position:40px 0}to{background-position:0 0}}.progress{overflow:hidden;height:19px;margin-bottom:19px;background-color:#ececec;border-radius:1px;box-shadow:none}.progress-bar{float:left;width:0%;height:100%;font-size:12px;font-weight:600;line-height:19px;color:#ffffff;text-align:center;background-color:#999999;-webkit-box-shadow:inset 0 -1px 0 rgba(0,0,0,0.15);box-shadow:inset 0 -1px 0 rgba(0,0,0,0.15);-webkit-transition:width 0.6s ease;-o-transition:width 0.6s ease;transition:width 0.6s ease}.progress-striped .progress-bar,.progress-bar-striped{background-image:-webkit-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:-o-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-size:40px 40px}.progress.active .progress-bar,.progress-bar.active{-webkit-animation:progress-bar-stripes 2s linear infinite;-o-animation:progress-bar-stripes 2s linear infinite;animation:progress-bar-stripes 2s linear infinite}.progress-bar[aria-valuenow="1"],.progress-bar[aria-valuenow="2"]{min-width:30px}.progress-bar[aria-valuenow="0"]{color:#777777;min-width:30px;background-color:transparent;background-image:none;box-shadow:none}.progress{height:18px;border-radius:2px}.progress.progress-bar-xxs{height:3px;border-radius:2px}.progress.progress-bar-xxs .progress-bar{line-height:3px}.progress.progress-bar-xs{height:6px;border-radius:2px}.progress.progress-bar-xs .progress-bar{line-height:6px}.progress.progress-bar-sm{height:10px;border-radius:2px}.progress.progress-bar-sm .progress-bar{line-height:10px}.progress.progress-bar-lg{height:20px}.progress.progress-bar-lg .progress-bar{line-height:20px}.progress.progress-bar-xl{height:24px}.progress.progress-bar-xl .progress-bar{line-height:24px}.progress.right .progress-bar{float:right}.progress.vertical{height:100%;min-height:200px;width:22px;position:relative}.progress.vertical .progress-bar{width:100%;position:absolute;font-size:11px;line-height:20px}.progress.vertical.bottom .progress-bar{bottom:0}.progress{height:18px;border-radius:2px}.progress.vertical.progress-bar-sm{width:16px}.progress.vertical.progress-bar-lg{width:30px}.progress.vertical.progress-bar-xl{width:40px}.media{color:#999999;font-weight:600;margin-top:15px}.media:first-child{margin-top:0}.media-right,.media>.pull-right{padding-left:10px}.media-left,.media>.pull-left{padding-right:10px}.media-left,.media-right,.media-body{display:table-cell;vertical-align:top}.media-middle{vertical-align:middle}.media-bottom{vertical-align:bottom}.media-heading{color:#555555;margin-top:0;margin-bottom:5px}.media-list{padding-left:0;list-style:none}.list-group{margin-bottom:20px;padding-left:0}.list-group-item{position:relative;display:block;padding:10px 15px;margin-bottom:-1px;background-color:#ffffff;border:1px solid #e7e7e7}.list-group-item:first-child{border-top-right-radius:2px;border-top-left-radius:2px}.list-group-item:last-child{margin-bottom:0;border-bottom-right-radius:2px;border-bottom-left-radius:2px}.list-group-item>.badge{float:right}.list-group-item>.badge+.badge{margin-right:5px}a.list-group-item{color:#4a89dc}a.list-group-item .list-group-item-heading{color:#333333}a.list-group-item:hover,a.list-group-item:focus{text-decoration:none;color:#4a89dc;background-color:#f5f5f5}.list-group-item.disabled,.list-group-item.disabled:hover,.list-group-item.disabled:focus{background-color:#eeeeee;color:#777777}.list-group-item.disabled .list-group-item-heading,.list-group-item.disabled:hover .list-group-item-heading,.list-group-item.disabled:focus .list-group-item-heading{color:inherit}.list-group-item.disabled .list-group-item-text,.list-group-item.disabled:hover .list-group-item-text,.list-group-item.disabled:focus .list-group-item-text{color:#777777}.list-group-item.active,.list-group-item.active:hover,.list-group-item.active:focus{z-index:2;color:#ffffff;background-color:#4a89dc;border-color:#4a89dc}.list-group-item.active .list-group-item-heading,.list-group-item.active:hover .list-group-item-heading,.list-group-item.active:focus .list-group-item-heading,.list-group-item.active .list-group-item-heading>small,.list-group-item.active:hover .list-group-item-heading>small,.list-group-item.active:focus .list-group-item-heading>small,.list-group-item.active .list-group-item-heading>.small,.list-group-item.active:hover .list-group-item-heading>.small,.list-group-item.active:focus .list-group-item-heading>.small{color:inherit}.list-group-item.active .list-group-item-text,.list-group-item.active:hover .list-group-item-text,.list-group-item.active:focus .list-group-item-text{color:#f5f8fd}.list-group.list-group-links .list-group-header{list-style:none;font-size:15px;font-weight:600;padding-left:7px;margin-bottom:5px;padding-bottom:10px;border-bottom:1px solid #e5e5e5}.list-group.list-group-links .list-group-item{color:#AAA;font-weight:600;background:transparent;border:0;padding:8px 9px}.list-group.list-group-links .list-group-item .label{float:right;line-height:inherit;padding:0.1em 0.6em 0.2em}.list-group.list-group-links .list-group-item i.fa{padding-right:5px}.list-group.list-group-links .list-group-item .fa-circle{float:right;font-size:14px}.list-group.list-group-links.list-group-spacing-sm>a{padding:6px 9px}.list-group.list-group-links.list-group-spacing-xs>a{padding:4px 9px}.list-group.list-group-links .list-group-divider{border-bottom:1px dashed #DDD;padding-bottom:6px;margin-bottom:6px}.list-group-item-heading{margin-top:0;margin-bottom:5px}.list-group-item-text{margin-bottom:0;line-height:1.3}.panel{position:relative;margin-bottom:20px;background-color:#ffffff;border-radius:2px}.panel.panel-transparent{background:none;border:0;margin:0;padding:0}.panel.panel-border{border-style:solid;border-width:0}.panel.panel-border.top{border-top-width:5px}.panel.panel-border.right{border-right-width:5px}.panel.panel-border.bottom{border-bottom-width:5px}.panel.panel-border.left{border-left-width:5px}.panel.panel-border>.panel-heading{background-color:#fafafa;border-color:#e5e5e5;border-top:1px solid transparent}.panel.panel-border>.panel-heading>.panel-title{color:#666666}.panel.panel-border.panel-default{border-color:#DDD}.panel.panel-border.panel-default>.panel-heading{border-top:1px solid transparent}.panel-menu{background-color:#fafafa;padding:12px;border:1px solid #e5e5e5}.panel-menu.dark{background-color:#f8f8f8}.panel-body .panel-menu{border-left:0;border-right:0}.panel-heading+.panel-menu,.panel-menu+.panel-body,.panel-body+.panel-menu,.panel-body+.panel-body{border-top:0}.panel-body{position:relative;padding:15px;border:1px solid #e5e5e5}.panel-body+.panel-footer{border-top:0}.panel-heading{position:relative;height:40px;line-height:36px;background:#fafafa;color:#666666;font-size:13px;font-weight:600;padding:0 8px;border:1px solid #e5e5e5;border-top-right-radius:1px;border-top-left-radius:1px}.panel-heading+.panel-body{border-top:0}.panel-heading>.dropdown .dropdown-toggle{color:inherit}.panel-heading .widget-menu .btn-group{margin-top:-3px}.panel-heading .widget-menu .form-control{margin-top:6px;font-size:11px;height:27px;padding:2px 10px;border-radius:1px}.panel-heading .widget-menu .form-control.input-sm{margin-top:9px;height:22px}.panel-heading .widget-menu .progress{margin-top:11px;margin-bottom:0}.panel-heading .widget-menu .progress-bar-lg{margin-top:10px}.panel-heading .widget-menu .progress-bar-sm{margin-top:15px}.panel-heading .widget-menu .progress-bar-xs{margin-top:17px}.panel-icon{padding-left:5px}.panel-title{padding-left:6px;margin-top:0;margin-bottom:0}.panel-title>.fa,.panel-title>.glyphicon,.panel-title>.glyphicons,.panel-title>.imoon{top:2px;min-width:22px;color:inherit;font-size:14px}.panel-title>a{color:inherit}.panel-footer{padding:10px 15px;background-color:#fafafa;border:1px solid #e5e5e5;border-bottom-right-radius:1px;border-bottom-left-radius:1px}.panel>.list-group{margin-bottom:0}.panel>.list-group .list-group-item{border-radius:0}.panel>.list-group:first-child .list-group-item:first-child{border-top-right-radius:1px;border-top-left-radius:1px}.panel>.list-group:last-child .list-group-item:last-child{border-bottom-right-radius:1px;border-bottom-left-radius:1px}.panel-heading+.list-group .list-group-item:first-child{border-top-width:0}.panel-body+.list-group .list-group-item:first-child{border-top-width:0}.list-group+.panel-footer{border-top-width:0}.panel>.table,.panel>.table-responsive>.table,.panel>.panel-collapse>.table{margin-bottom:0}.panel>.table:first-child,.panel>.table-responsive:first-child>.table:first-child{border-top-right-radius:1px;border-top-left-radius:1px}.panel>.table:first-child>thead:first-child>tr:first-child td:first-child,.panel>.table-responsive:first-child>.table:first-child>thead:first-child>tr:first-child td:first-child,.panel>.table:first-child>tbody:first-child>tr:first-child td:first-child,.panel>.table-responsive:first-child>.table:first-child>tbody:first-child>tr:first-child td:first-child,.panel>.table:first-child>thead:first-child>tr:first-child th:first-child,.panel>.table-responsive:first-child>.table:first-child>thead:first-child>tr:first-child th:first-child,.panel>.table:first-child>tbody:first-child>tr:first-child th:first-child,.panel>.table-responsive:first-child>.table:first-child>tbody:first-child>tr:first-child th:first-child{border-top-left-radius:1px}.panel>.table:first-child>thead:first-child>tr:first-child td:last-child,.panel>.table-responsive:first-child>.table:first-child>thead:first-child>tr:first-child td:last-child,.panel>.table:first-child>tbody:first-child>tr:first-child td:last-child,.panel>.table-responsive:first-child>.table:first-child>tbody:first-child>tr:first-child td:last-child,.panel>.table:first-child>thead:first-child>tr:first-child th:last-child,.panel>.table-responsive:first-child>.table:first-child>thead:first-child>tr:first-child th:last-child,.panel>.table:first-child>tbody:first-child>tr:first-child th:last-child,.panel>.table-responsive:first-child>.table:first-child>tbody:first-child>tr:first-child th:last-child{border-top-right-radius:1px}.panel>.table:last-child,.panel>.table-responsive:last-child>.table:last-child{border-bottom-right-radius:1px;border-bottom-left-radius:1px}.panel>.table:last-child>tbody:last-child>tr:last-child td:first-child,.panel>.table-responsive:last-child>.table:last-child>tbody:last-child>tr:last-child td:first-child,.panel>.table:last-child>tfoot:last-child>tr:last-child td:first-child,.panel>.table-responsive:last-child>.table:last-child>tfoot:last-child>tr:last-child td:first-child,.panel>.table:last-child>tbody:last-child>tr:last-child th:first-child,.panel>.table-responsive:last-child>.table:last-child>tbody:last-child>tr:last-child th:first-child,.panel>.table:last-child>tfoot:last-child>tr:last-child th:first-child,.panel>.table-responsive:last-child>.table:last-child>tfoot:last-child>tr:last-child th:first-child{border-bottom-left-radius:1px}.panel>.table:last-child>tbody:last-child>tr:last-child td:last-child,.panel>.table-responsive:last-child>.table:last-child>tbody:last-child>tr:last-child td:last-child,.panel>.table:last-child>tfoot:last-child>tr:last-child td:last-child,.panel>.table-responsive:last-child>.table:last-child>tfoot:last-child>tr:last-child td:last-child,.panel>.table:last-child>tbody:last-child>tr:last-child th:last-child,.panel>.table-responsive:last-child>.table:last-child>tbody:last-child>tr:last-child th:last-child,.panel>.table:last-child>tfoot:last-child>tr:last-child th:last-child,.panel>.table-responsive:last-child>.table:last-child>tfoot:last-child>tr:last-child th:last-child{border-bottom-right-radius:1px}.panel>.panel-body+.table,.panel>.panel-body+.table-responsive{border-top:1px solid #eeeeee}.panel>.table>tbody:first-child>tr:first-child th,.panel>.table>tbody:first-child>tr:first-child td{border-top:0}.panel>.table-bordered,.panel>.table-responsive>.table-bordered{border:0}.panel>.table-bordered>thead>tr>th:first-child,.panel>.table-responsive>.table-bordered>thead>tr>th:first-child,.panel>.table-bordered>tbody>tr>th:first-child,.panel>.table-responsive>.table-bordered>tbody>tr>th:first-child,.panel>.table-bordered>tfoot>tr>th:first-child,.panel>.table-responsive>.table-bordered>tfoot>tr>th:first-child,.panel>.table-bordered>thead>tr>td:first-child,.panel>.table-responsive>.table-bordered>thead>tr>td:first-child,.panel>.table-bordered>tbody>tr>td:first-child,.panel>.table-responsive>.table-bordered>tbody>tr>td:first-child,.panel>.table-bordered>tfoot>tr>td:first-child,.panel>.table-responsive>.table-bordered>tfoot>tr>td:first-child{border-left:0}.panel>.table-bordered>thead>tr>th:last-child,.panel>.table-responsive>.table-bordered>thead>tr>th:last-child,.panel>.table-bordered>tbody>tr>th:last-child,.panel>.table-responsive>.table-bordered>tbody>tr>th:last-child,.panel>.table-bordered>tfoot>tr>th:last-child,.panel>.table-responsive>.table-bordered>tfoot>tr>th:last-child,.panel>.table-bordered>thead>tr>td:last-child,.panel>.table-responsive>.table-bordered>thead>tr>td:last-child,.panel>.table-bordered>tbody>tr>td:last-child,.panel>.table-responsive>.table-bordered>tbody>tr>td:last-child,.panel>.table-bordered>tfoot>tr>td:last-child,.panel>.table-responsive>.table-bordered>tfoot>tr>td:last-child{border-right:0}.panel>.table-bordered>thead>tr:first-child>td,.panel>.table-responsive>.table-bordered>thead>tr:first-child>td,.panel>.table-bordered>tbody>tr:first-child>td,.panel>.table-responsive>.table-bordered>tbody>tr:first-child>td,.panel>.table-bordered>thead>tr:first-child>th,.panel>.table-responsive>.table-bordered>thead>tr:first-child>th,.panel>.table-bordered>tbody>tr:first-child>th,.panel>.table-responsive>.table-bordered>tbody>tr:first-child>th{border-bottom:0}.panel>.table-bordered>tbody>tr:last-child>td,.panel>.table-responsive>.table-bordered>tbody>tr:last-child>td,.panel>.table-bordered>tfoot>tr:last-child>td,.panel>.table-responsive>.table-bordered>tfoot>tr:last-child>td,.panel>.table-bordered>tbody>tr:last-child>th,.panel>.table-responsive>.table-bordered>tbody>tr:last-child>th,.panel>.table-bordered>tfoot>tr:last-child>th,.panel>.table-responsive>.table-bordered>tfoot>tr:last-child>th{border-bottom:0}.panel>.table-responsive{border:0;margin-bottom:0}.panel-group{margin-bottom:19px}.panel-group .panel-title{padding-left:0}.panel-group .panel-heading,.panel-group .panel-heading a{position:relative;display:block;width:100%}.panel-group.accordion-lg .panel+.panel{margin-top:12px}.panel-group.accordion-lg .panel-heading{font-size:14px;height:54px;line-height:52px}.panel-group .accordion-icon{padding-left:35px}.panel-group .accordion-icon:after{position:absolute;content:"\f068";font-family:"FontAwesome";font-size:12px;font-style:normal;font-weight:normal;-webkit-font-smoothing:antialiased;color:#555;left:10px;top:0}.panel-group .accordion-icon.collapsed:after{content:"\f067"}.panel-group .accordion-icon.icon-right{padding-left:10px;padding-right:30px}.panel-group .accordion-icon.icon-right:after{left:auto;right:5px}.panel-group .panel{margin-bottom:0;border-radius:2px}.panel-group .panel+.panel{margin-top:5px}.panel-group .panel-heading+.panel-collapse>.panel-body{border-top:0}.panel-group .panel-footer{border-top:0}.panel-group .panel-footer+.panel-collapse .panel-body{border-bottom:1px solid #eeeeee}.embed-responsive{position:relative;display:block;height:0;padding:0;overflow:hidden}.embed-responsive .embed-responsive-item,.embed-responsive iframe,.embed-responsive embed,.embed-responsive object{position:absolute;top:0;left:0;bottom:0;height:100%;width:100%;border:0}.embed-responsive.embed-responsive-16by9{padding-bottom:56.25%}.embed-responsive.embed-responsive-4by3{padding-bottom:75%}.well{min-height:20px;padding:19px;margin-bottom:20px;background-color:#f5f5f5;border:1px solid #e3e3e3;border-radius:1px;-webkit-box-shadow:inset 0 1px 1px rgba(0,0,0,0.05);box-shadow:inset 0 1px 1px rgba(0,0,0,0.05)}.well blockquote{border-color:#ddd;border-color:rgba(0,0,0,0.15)}.well-lg{padding:24px;border-radius:3px}.well-sm{padding:9px;border-radius:0px}.well.well-xs{padding:6px;border-radius:0px}.well.well-clean{border-radius:0;border-color:#DDD;box-shadow:none}.close{float:right;font-size:19.5px;font-weight:bold;line-height:1;color:#000000;text-shadow:0 1px 0 #fff;opacity:0.2;filter:alpha(opacity=20)}.close:hover,.close:focus{color:#000000;text-decoration:none;cursor:pointer;opacity:0.5;filter:alpha(opacity=50)}button.close{padding:0;cursor:pointer;background:transparent;border:0;-webkit-appearance:none}.tab-block{position:relative}.tab-block .tab-content{overflow:auto;position:relative;z-index:10;min-height:125px;padding:16px 12px;border:1px solid #e5e5e5;background-color:#FFF}.tab-block .nav-tabs{position:relative;border:0}.tab-block .nav-tabs>li{float:left;margin-bottom:-1px}.tab-block .nav-tabs>li>a{position:relative;z-index:9;padding:9px 16px;margin-right:-1px;font-weight:600;color:#777;border-color:#e5e5e5;border-radius:0;background:#fafafa}.tab-block .nav-tabs>li:first-child>a{margin-left:0}.tab-block .nav-tabs>li>a:hover{background-color:#eeeeee}.tab-block .nav-tabs>li.active>a,.tab-block .nav-tabs>li.active>a:hover,.tab-block .nav-tabs>li.active>a:focus{cursor:default;position:relative;z-index:12;color:#555555;background:#FFF;border-color:#e5e5e5;border-bottom:1px solid #FFF}.tabs-left{float:left}.tabs-left>li{float:none;margin:0 -1px -1px 0}.tabs-left>li>a{padding:12px 16px;color:#777;font-weight:600;border:1px solid transparent;border-color:#DDD;background:#fafafa}.tab-block .tabs-left>li.active>a,.tab-block .tabs-left>li.active>a:hover,.tab-block .tabs-left>li.active>a:focus{color:#555;border-color:#DDD #FFF #DDD #DDD;cursor:default;position:relative;z-index:12;background:#FFF}.tabs-right{float:right}.tabs-right>li{float:none;margin:0 0 -1px -1px}.tabs-right>li>a{padding:12px 16px;color:#777;font-weight:600;border:1px solid transparent;border-color:#DDD;background:#fafafa}.tab-block .tabs-right>li.active>a,.tab-block .tabs-right>li.active>a:hover,.tab-block .tabs-right>li.active>a:focus{color:#555;border-color:#DDD #DDD #DDD #FFF;cursor:default;position:relative;z-index:12;background:#FFF}.tabs-below{position:relative}.tabs-below>li{float:left;margin-top:-1px}.tabs-below>li>a{position:relative;z-index:9;margin-right:-1px;padding:11px 16px;color:#777;font-weight:600;border:1px solid #DDD;background:#fafafa}.tab-block .tabs-below>li.active>a,.tab-block .tabs-below>li.active>a:hover,.tab-block .tabs-below>li.active>a:focus{cursor:default;position:relative;z-index:12;color:#555555;background:#FFF;border-color:#DDD;border-top:1px solid #FFF}.panel-tabs{position:absolute;bottom:0;right:0}.panel-tabs>li{position:relative;float:left;margin-bottom:-1px}.panel-tabs>li>a{line-height:18px;border-radius:0;padding:10px 18px;border-left:1px solid #DDD;font-size:12px;color:#777}.panel-tabs>li>a:hover{background-color:transparent}.panel-tabs>li.active>a,.panel-tabs>li.active>a:hover,.panel-tabs>li.active>a:focus{color:#555555;cursor:default;background:#ffffff}.panel-tabs-left{left:0}.panel-tabs-left>li>a{border-right:1px solid #DDD;border-left:1px solid transparent}.tab-block .nav-tabs.nav-justified{top:1px;margin-top:-1px}.tab-block .nav-tabs.nav-justified>li{float:none}.tab-block .nav-tabs.nav-justified>li>a{padding:11px}.tab-block .tab-content+.nav-tabs.nav-justified{top:-1px;margin-top:0}.tab-block .tab-content+.nav-tabs.nav-justified>li.active>a{border-top-color:#fff;border-bottom-color:#DDD}.nav-tabs.nav-tabs-right>li{float:right}.nav-tabs.nav-tabs-right>li:first-child>a{margin-right:0}.tab-block .tabs-border.nav-tabs>li.active>a{margin-top:-1px;border-top:2px solid #4a89dc}.tab-block .tabs-border.tabs-left>li.active>a{margin-left:-1px;border-left:2px solid #4a89dc}.tab-block .tabs-border.tabs-right>li.active>a{margin-right:-1px;border-right:2px solid #4a89dc}.tab-block .tabs-border.tabs-below>li.active>a{margin-bottom:-1px;border-bottom:2px solid #4a89dc}.panel-tabs.panel-tabs-border>li.active>a{margin-top:-1px;border-top:2px solid #4a89dc}.tab-block .tab-content+.tabs-border.nav-justified>li.active>a{border-bottom:2px solid #4a89dc}.tab-block .tabs-border-bottom.nav-tabs>li.active>a,.tab-block .tabs-border-bottom .nav-tabs>li.active>a{color:#555;font-weight:600;margin-bottom:-1px;background:#f7f7f7;border-color:#DDD;border-bottom:2px solid #4a89dc}.tabs-bg.nav-tabs{background:#f5f5f5;border:1px solid #DDD;border-bottom:none;padding:10px 10px 0}.tabs-bg.tabs-below{background:#f5f5f5;border:1px solid #DDD;border-top:none;padding:0 10px 6px}.tab-block.sidebar-block .nav-tabs>li>a{border:0;background:#ececec;padding:16px 11px}.tab-block.sidebar-block .nav-tabs>li.active>a{border:0;background:#f8f8f8}.tab-block.sidebar-block .tab-content{border:0;background:transparent}.panel-tabs.panel-tabs-merge>li.active>a,.panel-tabs.panel-tabs-merge>li.active>a:hover,.panel-tabs.panel-tabs-merge>li.active>a:focus{background:#FAFAFA}.radio-custom,.checkbox-custom{background-color:transparent;color:inherit}.radio-custom input,.checkbox-custom input{display:none}.checkbox-custom label:empty,.radio-custom label:empty{padding-left:10px}.radio-custom label{cursor:pointer;position:relative;padding-left:32px;margin-right:15px;margin-bottom:5px}.radio-custom label:before{content:"";position:absolute;top:0;left:0;border-radius:64px;width:20px;height:20px;border:2px solid #666}.radio-custom input[type=radio]:checked+label:after,.radio-custom input[type=checkbox]:checked+label:after{content:"";position:absolute;top:5px;left:5px;border-radius:64px;width:10px;height:10px;color:#666;background-color:#666}.radio-custom.square label:before{border-radius:2px}.radio-custom.square input[type=radio]:checked+label:after,.radio-custom.square input[type=checkbox]:checked+label:after{border-radius:2px}.checkbox-custom label{cursor:pointer;position:relative;padding-left:32px;margin-right:15px;margin-bottom:5px}.checkbox-custom label:before{content:"";position:absolute;top:0;left:0;width:22px;height:21px;background-color:#FFF;border:1px solid #666;border-width:2px;border-radius:1px}.checkbox-custom input[type=checkbox]:checked+label:after,.checkbox-custom input[type=radio]:checked+label:after{position:absolute;font-family:"FontAwesome";content:"\f00c";font-size:12px;top:4px;left:4px;width:0;height:0;transform:rotate(-13deg)}.checkbox-custom.fill label{cursor:pointer;position:relative;padding-left:32px;margin-right:15px;margin-bottom:5px}.checkbox-custom.fill label:before{content:"";position:absolute;top:0;left:0;border-radius:2px;width:22px;height:21px;background-color:#666}.checkbox-custom.fill input[type=checkbox]:checked+label:after,.checkbox-custom.fill input[type=radio]:checked+label:after{position:absolute;font-family:"FontAwesome";content:"\f00c";font-size:12px;top:3px;left:3px;width:0;height:0;color:#fff !important;transform:rotate(-13deg)}.wf-loading .glyphicons,.wf-loading .glyphicon,.wf-loading .imoon,.wf-loading .fa,.wf-loading .iconsweets{opacity:0 !important}.fs15.fa-fw{width:35px}.fs16.fa-fw{width:40px}.fs17.fa-fw{width:43px}.fs18.fa-fw{width:46px}.glyphicon,.glyphicons,.imoon,.fa,.iconsweets{opacity:1;transition:opacity 0.1s ease-in;-moz-transition:opacity 0.1s ease-in;-webkit-transition:opacity 0.1s ease-in}.glyphicons-2x,.glyphicon-2x{font-size:2em}.glyphicons-3x,.glyphicon-3x{font-size:3em}.glyphicons-4x,.glyphicon-4x{font-size:4em}.glyphicons-5x,.glyphicon-5x{font-size:5em}.imoon-2x{font-size:2em}.imoon-3x{font-size:3em}.imoon-4x{font-size:4em}.imoon-5x{font-size:5em}.iconsweets-2x{font-size:2em}.iconsweets-3x{font-size:3em}.iconsweets-4x{font-size:4em}.iconsweets-5x{font-size:5em}.btn .glyphicon,.btn .glyphicons{top:-1px;vertical-align:middle;line-height:0;font-size:1.1em}span.field-icon-right,i.field-icon-right{position:absolute;right:10px;top:8px}.icon-circle{top:0;padding:9px;position:relative;overflow:visible;border-radius:64px}.icon-square{top:0;padding:9px;border-radius:4px}.icon-circle.glyphicon-2x,.icon-circle.glyphicons-2x{padding:12px}.icon-circle.glyphicon-3x,.icon-circle.glyphicons-3x{padding:20px}.icon-circle.glyphicon-4x,.icon-circle.glyphicons-4x{padding:35px}.icon-square.glyphicon-2x,.icon-square.glyphicons-2x{padding:12px}.icon-square.glyphicon-3x,.icon-square.glyphicons-3x{padding:20px}.icon-square.glyphicon-4x,.icon-square.glyphicons-4x{padding:35px}.navbar-menus>div>button>span,.navbar-menus>div>button>i{font-size:15px;vertical-align:middle}.user-menu ul.dropdown-items>li:hover .glyphicon{color:#d9534f}.user-menu ul.dropdown-items>li:last-child:hover .glyphicon{color:#888}.user-menu ul.dropdown-items>li:last-child>div:hover .glyphicon{color:#d9534f}.breadcrumb .glyphicon,.breadcrumb .glyphicons{color:#777;font-size:11px;margin-left:1px;top:0}.panel-sidemenu ul.nav li.active .fa{color:#4a89dc}.panel-sidemenu ul.nav li a:hover{background:none}.panel-sidemenu ul.nav li .fa{width:28px;color:#BBB;font-size:18px}.panel-tabs li .glyphicon,.panel-tabs li .glyphicons,.panel-tabs li .fa{font-size:14px}.panel-tabs .imoon,.panel-tabs .iconsweets{font-size:14px;vertical-align:middle}.mini-action-icons .fa{position:relative;top:2px;padding-right:10px;color:#777;font-size:16px;cursor:pointer}.pricing-tables .pricing-icons li .fa-times{color:#e74a4a}.pricing-tables .pricing-icons li .fa-ellipsis-h{color:#555555}.nav-tabs li .fa{font-size:14px}.nav-tabs li .fa.fa-caret-down{font-size:12px}.panel-tile{position:relative;overflow:hidden}.panel-tile .panel-body,.panel-tile .panel-footer{border:0}.icon-bg{position:absolute;opacity:0.8;right:0;top:0;line-height:100px;font-size:100px}.icon-bg.left{right:auto;left:0}.modal-open{overflow:hidden}.modal{display:none;overflow:hidden;position:fixed;top:0;right:0;bottom:0;left:0;z-index:1050;-webkit-overflow-scrolling:touch;outline:0}.modal.fade .modal-dialog{-webkit-transform:translate3d(0, -25%, 0);transform:translate3d(0, -25%, 0);-webkit-transition:-webkit-transform 0.3s ease-out;-moz-transition:-moz-transform 0.3s ease-out;-o-transition:-o-transform 0.3s ease-out;transition:transform 0.3s ease-out}.modal.in .modal-dialog{z-index:1050;-webkit-transform:translate3d(0, 0, 0);transform:translate3d(0, 0, 0)}.modal-open .modal{overflow-x:hidden;overflow-y:auto}.modal-dialog{position:relative;width:auto;margin:10px}.modal-content{position:relative;background-color:#ffffff;border:1px solid #999999;border:1px solid rgba(0,0,0,0.2);border-radius:3px;-webkit-box-shadow:0 3px 9px rgba(0,0,0,0.5);box-shadow:0 3px 9px rgba(0,0,0,0.5);background-clip:padding-box;outline:0}.modal-backdrop{position:fixed;top:0;right:0;bottom:0;left:0;z-index:1040;background-color:#000000}.modal-backdrop.fade{opacity:0;filter:alpha(opacity=0)}.modal-backdrop.in{opacity:0.5;filter:alpha(opacity=50)}.modal-header{padding:15px;border-bottom:1px solid #e5e5e5;min-height:16.49px}.modal-header .close{margin-top:-2px}.modal-title{margin:0;line-height:1.49}.modal-body{position:relative;padding:15px}.modal-footer{padding:15px;padding:10px;text-align:right;border-top:1px solid #e5e5e5;background:#f2f2f2}.modal-footer .btn+.btn{margin-left:5px;margin-bottom:0}.modal-footer .btn-group .btn+.btn{margin-left:-1px}.modal-footer .btn-block+.btn-block{margin-left:0}.modal-scrollbar-measure{position:absolute;top:-9999px;width:50px;height:50px;overflow:scroll}@media (min-width: 768px){.modal-dialog{width:600px;margin:30px auto}.modal-content{-webkit-box-shadow:0 5px 15px rgba(0,0,0,0.5);box-shadow:0 5px 15px rgba(0,0,0,0.5)}.modal-sm{width:300px}}@media (min-width: 992px){.modal-lg{width:900px}}.tooltip{position:absolute;z-index:1070;display:block;visibility:visible;font-size:12px;line-height:1.4;opacity:0;filter:alpha(opacity=0)}.tooltip.in{opacity:0.9;filter:alpha(opacity=90)}.tooltip.top{margin-top:-3px;padding:5px 0}.tooltip.right{margin-left:3px;padding:0 5px}.tooltip.bottom{margin-top:3px;padding:5px 0}.tooltip.left{margin-left:-3px;padding:0 5px}.tooltip-inner{max-width:200px;padding:3px 8px;color:#ffffff;text-align:center;text-decoration:none;background-color:#000000;border-radius:1px}.tooltip-arrow{position:absolute;width:0;height:0;border-color:transparent;border-style:solid}.tooltip.top .tooltip-arrow{bottom:0;left:50%;margin-left:-5px;border-width:5px 5px 0;border-top-color:#000000}.tooltip.top-left .tooltip-arrow{bottom:0;left:5px;border-width:5px 5px 0;border-top-color:#000000}.tooltip.top-right .tooltip-arrow{bottom:0;right:5px;border-width:5px 5px 0;border-top-color:#000000}.tooltip.right .tooltip-arrow{top:50%;left:0;margin-top:-5px;border-width:5px 5px 5px 0;border-right-color:#000000}.tooltip.left .tooltip-arrow{top:50%;right:0;margin-top:-5px;border-width:5px 0 5px 5px;border-left-color:#000000}.tooltip.bottom .tooltip-arrow{top:0;left:50%;margin-left:-5px;border-width:0 5px 5px;border-bottom-color:#000000}.tooltip.bottom-left .tooltip-arrow{top:0;left:5px;border-width:0 5px 5px;border-bottom-color:#000000}.tooltip.bottom-right .tooltip-arrow{top:0;right:5px;border-width:0 5px 5px;border-bottom-color:#000000}.tooltip-white.in{opacity:1}.tooltip-white{min-width:60px;transition:opacity 0.3s ease}.tooltip-white .tooltip-inner{background-color:#FFF;color:#555;font-weight:600;border-radius:2px}.tooltip-white.top .tooltip-arrow{border-top-color:#FFF}.tooltip-white.bottom .tooltip-arrow{border-bottom-color:#FFF}.tooltip-white.right .tooltip-arrow{border-right-color:#FFF}.tooltip.left .tooltip-arrow{border-left-color:#FFF}.popover{position:absolute;top:0;left:0;z-index:1060;display:none;max-width:276px;padding:1px;text-align:left;background-color:#ffffff;background-clip:padding-box;border:1px solid #cccccc;border:1px solid rgba(0,0,0,0.2);border-radius:3px;-webkit-box-shadow:0 5px 10px rgba(0,0,0,0.2);box-shadow:0 5px 10px rgba(0,0,0,0.2);white-space:normal}.popover.top{margin-top:-10px}.popover.right{margin-left:10px}.popover.bottom{margin-top:10px}.popover.left{margin-left:-10px}.popover-title{margin:0;padding:8px 14px;font-size:13px;font-weight:normal;line-height:18px;background-color:#f7f7f7;border-bottom:1px solid #ebebeb;border-radius:2px 2px 0 0}.popover-content{padding:9px 14px}.popover>.arrow,.popover>.arrow:after{position:absolute;display:block;width:0;height:0;border-color:transparent;border-style:solid}.popover>.arrow{border-width:11px}.popover>.arrow:after{border-width:10px;content:""}.popover.top>.arrow{left:50%;margin-left:-11px;border-bottom-width:0;border-top-color:#999999;border-top-color:rgba(0,0,0,0.25);bottom:-11px}.popover.top>.arrow:after{content:" ";bottom:1px;margin-left:-10px;border-bottom-width:0;border-top-color:#ffffff}.popover.right>.arrow{top:50%;left:-11px;margin-top:-11px;border-left-width:0;border-right-color:#999999;border-right-color:rgba(0,0,0,0.25)}.popover.right>.arrow:after{content:" ";left:1px;bottom:-10px;border-left-width:0;border-right-color:#ffffff}.popover.bottom>.arrow{left:50%;margin-left:-11px;border-top-width:0;border-bottom-color:#999999;border-bottom-color:rgba(0,0,0,0.25);top:-11px}.popover.bottom>.arrow:after{content:" ";top:1px;margin-left:-10px;border-top-width:0;border-bottom-color:#ffffff}.popover.left>.arrow{top:50%;right:-11px;margin-top:-11px;border-right-width:0;border-left-color:#999999;border-left-color:rgba(0,0,0,0.25)}.popover.left>.arrow:after{content:" ";right:1px;border-right-width:0;border-left-color:#ffffff;bottom:-10px}.clearfix:before,.clearfix:after,.dl-horizontal dd:before,.dl-horizontal dd:after,.container:before,.container:after,.container-fluid:before,.container-fluid:after,.row:before,.row:after,.form-horizontal .form-group:before,.form-horizontal .form-group:after,.btn-toolbar:before,.btn-toolbar:after,.btn-group-vertical>.btn-group:before,.btn-group-vertical>.btn-group:after,.nav:before,.nav:after,.navbar:before,.navbar:after,.navbar-header:before,.navbar-header:after,.navbar-collapse:before,.navbar-collapse:after,.pager:before,.pager:after,.panel-body:before,.panel-body:after,.modal-footer:before,.modal-footer:after,#topbar:before,#topbar:after{content:" ";display:table}.clearfix:after,.dl-horizontal dd:after,.container:after,.container-fluid:after,.row:after,.form-horizontal .form-group:after,.btn-toolbar:after,.btn-group-vertical>.btn-group:after,.nav:after,.navbar:after,.navbar-header:after,.navbar-collapse:after,.pager:after,.panel-body:after,.modal-footer:after,#topbar:after{clear:both}.center-block{float:none;display:block;margin-left:auto;margin-right:auto}.center-children>div{float:none;display:block;margin-left:auto;margin-right:auto}.pull-right{float:right !important}.pull-left{float:left !important}.hide{display:none !important}.show{display:block !important}.invisible{visibility:hidden}.text-hide{font:0/0 a;color:transparent;text-shadow:none;background-color:transparent;border:0}.hidden{display:none !important;visibility:hidden !important}.affix{position:fixed;-webkit-transform:translate3d(0, 0, 0);transform:translate3d(0, 0, 0)}@-ms-viewport{width:device-width}@media (max-width: 768px){h1{font-size:25px}h2{font-size:20px}h3{font-size:16px}}.visible-xs,.visible-sm,.visible-md,.visible-lg,.visible-xl{display:none !important}.visible-xs-block,.visible-xs-inline,.visible-xs-inline-block,.visible-sm-block,.visible-sm-inline,.visible-sm-inline-block,.visible-md-block,.visible-md-inline,.visible-md-inline-block,.visible-lg-block,.visible-lg-inline,.visible-lg-inline-block,.visible-xl-block,.visible-xl-inline,.visible-xl-inline-block{display:none !important}@media (max-width: 767px){.visible-xs{display:block !important}table.visible-xs{display:table}tr.visible-xs{display:table-row !important}th.visible-xs,td.visible-xs{display:table-cell !important}}@media (max-width: 767px){.visible-xs-block{display:block !important}}@media (max-width: 767px){.visible-xs-inline{display:inline !important}}@media (max-width: 767px){.visible-xs-inline-block{display:inline-block !important}}@media (min-width: 768px) and (max-width: 991px){.visible-sm{display:block !important}table.visible-sm{display:table}tr.visible-sm{display:table-row !important}th.visible-sm,td.visible-sm{display:table-cell !important}}@media (min-width: 768px) and (max-width: 991px){.visible-sm-block{display:block !important}}@media (min-width: 768px) and (max-width: 991px){.visible-sm-inline{display:inline !important}}@media (min-width: 768px) and (max-width: 991px){.visible-sm-inline-block{display:inline-block !important}}@media (min-width: 992px) and (max-width: 1139px){.visible-md{display:block !important}table.visible-md{display:table}tr.visible-md{display:table-row !important}th.visible-md,td.visible-md{display:table-cell !important}}@media (min-width: 992px) and (max-width: 1139px){.visible-md-block{display:block !important}}@media (min-width: 992px) and (max-width: 1139px){.visible-md-inline{display:inline !important}}@media (min-width: 992px) and (max-width: 1139px){.visible-md-inline-block{display:inline-block !important}}@media (min-width: 1140px){.visible-lg{display:block !important}table.visible-lg{display:table}tr.visible-lg{display:table-row !important}th.visible-lg,td.visible-lg{display:table-cell !important}}@media (min-width: 1140px){.visible-lg-block{display:block !important}}@media (min-width: 1140px){.visible-lg-inline{display:inline !important}}@media (min-width: 1140px){.visible-lg-inline-block{display:inline-block !important}}@media (min-width: 1400px){.visible-xl{display:block !important}table.visible-xl{display:table}tr.visible-xl{display:table-row !important}th.visible-xl,td.visible-xl{display:table-cell !important}}@media (min-width: 1400px){.visible-xl-block{display:block !important}}@media (min-width: 1400px){.visible-xl-inline{display:inline !important}}@media (min-width: 1400px){.visible-xl-inline-block{display:inline-block !important}}@media (max-width: 767px){.hidden-xs{display:none !important}}@media (min-width: 768px) and (max-width: 991px){.hidden-sm{display:none !important}}@media (min-width: 992px) and (max-width: 1139px){.hidden-md{display:none !important}}@media (min-width: 1140px){.hidden-lg{display:none !important}}@media (min-width: 1400px){.hidden-xl{display:none !important}}.visible-print{display:none !important}@media print{.visible-print{display:block !important}table.visible-print{display:table}tr.visible-print{display:table-row !important}th.visible-print,td.visible-print{display:table-cell !important}}.visible-print-block{display:none !important}@media print{.visible-print-block{display:block !important}}.visible-print-inline{display:none !important}@media print{.visible-print-inline{display:inline !important}}.visible-print-inline-block{display:none !important}@media print{.visible-print-inline-block{display:inline-block !important}}@media print{.hidden-print{display:none !important}}.list-spacing-3 li+li{padding-top:3px}.list-spacing-5 li+li{padding-top:5px}.list-spacing-8 li+li{padding-top:8px}.list-spacing-10 li+li{padding-top:10px}.list-spacing-15 li+li{padding-top:15px}.list-divide-items{margin:0;padding-left:10px;list-style:none}.list-divide-items li+li{margin-top:13px;padding-top:13px;border-top:1px solid #EEE}.fixed-height .panel-body{overflow:auto}.hover-height{overflow:hidden;transition:all 0.2s ease}.mh-20{max-height:20px !important}.mh-25{max-height:25px !important}.mh-30{max-height:30px !important}.mh-35{max-height:35px !important}.mh-40{max-height:40px !important}.mh-50{max-height:50px !important}.mh-100{max-height:100px !important}.mh-200{max-height:200px !important}.mh-300{max-height:300px !important}.mh-400{max-height:400px !important}.mh-500{max-height:500px !important}.mh-600{max-height:600px !important}.mh-700{max-height:700px !important}.mh-800{max-height:800px !important}.mh-900{max-height:900px !important}.mh-1000{max-height:1000px !important}.h-20{height:20px !important}.h-25{height:25px !important}.h-30{height:30px !important}.h-35{height:35px !important}.h-40{height:40px !important}.h-50{height:50px !important}.h-80{height:80px !important}.h-100{height:100px !important}.h-120{height:120px !important}.h-150{height:150px !important}.h-170{height:170px !important}.h-200{height:200px !important}.h-300{height:300px !important}.h-400{height:400px !important}.h-500{height:500px !important}.h-600{height:600px !important}.h-700{height:700px !important}.h-800{height:800px !important}.h-900{height:900px !important}.h-1000{height:1000px !important}.t-center{text-align:center;position:absolute;top:50%;left:50%;transform:translate(-50%, -50%)}.bg-none{background-color:transparent !important}.no-boxshadow{box-shadow:none !important}.h-a{height:auto !important}.of-a{overflow:auto !important}.of-h{overflow:hidden !important}.of-v{overflow:visible !important}.of-x-a{overflow-x:auto !important}.of-x-h{overflow-x:hidden !important}.of-x-v{overflow-x:visible !important}.of-y-a{overflow-y:auto !important}.of-y-h{overflow-y:hidden !important}.of-y-v{overflow-y:visible !important}.center-column{float:none !important;margin-left:auto !important;margin-right:auto !important;display:block !important}.va-t{vertical-align:top !important}.va-m{vertical-align:middle !important}.va-b{vertical-align:bottom !important}.va-s{vertical-align:super !important}.posr{position:relative !important}.ib,.inline-object{display:inline-block !important}.cursor{cursor:pointer !important}.option-disabled{opacity:0.6 !important}.input-unstyled,.input-unstyled:hover,.input-unstyled:focus{border:none !important;background:none !important;box-shadow:none !important;outline:none !important}.panel-group.table-layout>.panel+.panel{border-left:0}.panel-group.table-layout+.panel-group.table-layout>.panel{border-top:0}.row.table-layout{margin-left:0;margin-right:0}.table-layout{display:table;table-layout:fixed;width:100%;margin:0}.table-layout>div,.table-layout>aside,.table-layout>section{vertical-align:middle;display:table-cell;float:none}@media (max-width: 1300px){.table-layout.table-clear-md,.table-layout.table-clear-md>div,.table-layout.table-clear-md>aside,.table-layout.table-clear-md>section{display:block;float:none}}@media (max-width: 992px){.table-layout.table-clear-sm,.table-layout.table-clear-sm>div,.table-layout.table-clear-sm>aside,.table-layout.table-clear-sm>section{display:block;float:none}}@media (max-width: 767px){.table-layout.table-clear-xs,.table-layout.table-clear-xs>div,.table-layout.table-clear-xs>aside,.table-layout.table-clear-xs>section{display:block;float:none}}.text-uppercase{text-transform:uppercase !important}.fw200{font-weight:200 !important}.fw300{font-weight:300 !important}.fw400{font-weight:400 !important}.fw600{font-weight:600 !important}.fs3{font-size:4px !important}.fs4{font-size:4px !important}.fs5{font-size:5px !important}.fs6{font-size:6px !important}.fs7{font-size:7px !important}.fs8{font-size:8px !important}.fs9{font-size:9px !important}.fs10{font-size:10px !important}.fs11{font-size:11px !important}.fs12{font-size:12px !important}.fs13{font-size:13px !important}.fs14{font-size:14px !important}.fs15{font-size:15px !important}.fs16{font-size:16px !important}.fs17{font-size:17px !important}.fs18{font-size:18px !important}.fs20{font-size:20px !important}.fs22{font-size:22px !important}.fs24{font-size:24px !important}.fs26{font-size:26px !important}.fs28{font-size:28px !important}.fs30{font-size:30px !important}.fs35{font-size:35px !important}.fs40{font-size:40px !important}.fs45{font-size:45px !important}.fs50{font-size:50px !important}.fs60{font-size:60px !important}.fs70{font-size:70px !important}.fs80{font-size:80px !important}.fs90{font-size:90px !important}.fs100{font-size:100px !important}.pn{padding:0 !important}.p1{padding:1px !important}.p2{padding:2px !important}.p3{padding:3px !important}.p4{padding:4px !important}.p5{padding:5px !important}.p6{padding:6px !important}.p7{padding:7px !important}.p8{padding:8px !important}.p10{padding:10px !important}.p12{padding:12px !important}.p15{padding:15px !important}.p20{padding:20px !important}.p25{padding:25px !important}.p30{padding:30px !important}.p35{padding:35px !important}.p40{padding:40px !important}.p50{padding:50px !important}.ptn{padding-top:0 !important}.pt5{padding-top:5px !important}.pt10{padding-top:10px !important}.pt15{padding-top:15px !important}.pt20{padding-top:20px !important}.pt25{padding-top:25px !important}.pt30{padding-top:30px !important}.pt35{padding-top:35px !important}.pt40{padding-top:40px !important}.pt50{padding-top:50px !important}.prn{padding-right:0 !important}.pr5{padding-right:5px !important}.pr10{padding-right:10px !important}.pr15{padding-right:15px !important}.pr20{padding-right:20px !important}.pr25{padding-right:25px !important}.pr30{padding-right:30px !important}.pr35{padding-right:35px !important}.pr40{padding-right:40px !important}.pr50{padding-right:50px !important}.pbn{padding-bottom:0 !important}.pb5{padding-bottom:5px !important}.pb10{padding-bottom:10px !important}.pb15{padding-bottom:15px !important}.pb20{padding-bottom:20px !important}.pb25{padding-bottom:25px !important}.pb30{padding-bottom:30px !important}.pb35{padding-bottom:35px !important}.pb40{padding-bottom:40px !important}.pb50{padding-bottom:50px !important}.pln{padding-left:0 !important}.pl5{padding-left:5px !important}.pl10{padding-left:10px !important}.pl15{padding-left:15px !important}.pl20{padding-left:20px !important}.pl25{padding-left:25px !important}.pl30{padding-left:30px !important}.pl35{padding-left:35px !important}.pl40{padding-left:40px !important}.pl50{padding-left:50px !important}.pv5{padding-top:5px !important;padding-bottom:5px !important}.pv8{padding-top:8px !important;padding-bottom:8px !important}.pv10{padding-top:10px !important;padding-bottom:10px !important}.pv15{padding-top:15px !important;padding-bottom:15px !important}.pv20{padding-top:20px !important;padding-bottom:20px !important}.pv25{padding-top:25px !important;padding-bottom:25px !important}.pv30{padding-top:30px !important;padding-bottom:30px !important}.pv40{padding-top:40px !important;padding-bottom:40px !important}.pv50{padding-top:50px !important;padding-bottom:50px !important}.ph5{padding-left:5px !important;padding-right:5px !important}.ph8{padding-left:8px !important;padding-right:8px !important}.ph10{padding-left:10px !important;padding-right:10px !important}.ph15{padding-left:15px !important;padding-right:15px !important}.ph20{padding-left:20px !important;padding-right:20px !important}.ph25{padding-left:25px !important;padding-right:25px !important}.ph30{padding-left:30px !important;padding-right:30px !important}.ph40{padding-left:40px !important;padding-right:40px !important}.ph50{padding-left:50px !important;padding-right:50px !important}@media (min-width: 1140px){.ptn-lg{padding-top:0 !important}.prn-lg{padding-right:0 !important}.pbn-lg{padding-bottom:0 !important}.pln-lg{padding-left:0 !important}.pt5-lg{padding-top:5px !important}.pr5-lg{padding-right:5px !important}.pb5-lg{padding-bottom:5px !important}.pl5-lg{padding-left:5px !important}}@media (min-width: 992px){.ptn-md{padding-top:0 !important}.prn-md{padding-right:0 !important}.pbn-md{padding-bottom:0 !important}.pln-md{padding-left:0 !important}.pt5-md{padding-top:5px !important}.pr5-md{padding-right:5px !important}.pb5-md{padding-bottom:5px !important}.pl5-md{padding-left:5px !important}}.mauto{margin-left:auto;margin-right:auto}.mn{margin:0 !important}.m1{margin:1px !important}.m2{margin:2px !important}.m3{margin:3px !important}.m4{margin:4px !important}.m5{margin:5px !important}.m8{margin:8px !important}.m10{margin:10px !important}.m15{margin:15px !important}.m20{margin:20px !important}.m25{margin:25px !important}.m30{margin:30px !important}.m35{margin:35px !important}.m40{margin:40px !important}.m50{margin:50px !important}.mtn{margin-top:0 !important}.mt5{margin-top:5px !important}.mt10{margin-top:10px !important}.mt15{margin-top:15px !important}.mt20{margin-top:20px !important}.mt25{margin-top:25px !important}.mt30{margin-top:30px !important}.mt35{margin-top:35px !important}.mt40{margin-top:40px !important}.mt50{margin-top:50px !important}.mt70{margin-top:70px !important}.mrn{margin-right:0 !important}.mr5{margin-right:5px !important}.mr10{margin-right:10px !important}.mr15{margin-right:15px !important}.mr20{margin-right:20px !important}.mr25{margin-right:25px !important}.mr30{margin-right:30px !important}.mr35{margin-right:35px !important}.mr40{margin-right:40px !important}.mr50{margin-right:50px !important}.mbn{margin-bottom:0 !important}.mb5{margin-bottom:5px !important}.mb10{margin-bottom:10px !important}.mb15{margin-bottom:15px !important}.mb20{margin-bottom:20px !important}.mb25{margin-bottom:25px !important}.mb30{margin-bottom:30px !important}.mb35{margin-bottom:35px !important}.mb40{margin-bottom:40px !important}.mb50{margin-bottom:50px !important}.mb70{margin-bottom:70px !important}.mln{margin-left:0 !important}.ml5{margin-left:5px !important}.ml10{margin-left:10px !important}.ml15{margin-left:15px !important}.ml20{margin-left:20px !important}.ml25{margin-left:25px !important}.ml30{margin-left:30px !important}.ml35{margin-left:35px !important}.ml40{margin-left:40px !important}.ml50{margin-left:50px !important}.mv5{margin-top:5px !important;margin-bottom:5px !important}.mv10{margin-top:10px !important;margin-bottom:10px !important}.mv15{margin-top:15px !important;margin-bottom:15px !important}.mv20{margin-top:20px !important;margin-bottom:20px !important}.mv25{margin-top:25px !important;margin-bottom:25px !important}.mv30{margin-top:30px !important;margin-bottom:30px !important}.mv40{margin-top:40px !important;margin-bottom:40px !important}.mv50{margin-top:50px !important;margin-bottom:50px !important}.mv70{margin-top:70px !important;margin-bottom:70px !important}.mh5{margin-left:5px !important;margin-right:5px !important}.mh10{margin-left:10px !important;margin-right:10px !important}.mh15{margin-left:15px !important;margin-right:15px !important}.mh20{margin-left:20px !important;margin-right:20px !important}.mh25{margin-left:25px !important;margin-right:25px !important}.mh30{margin-left:30px !important;margin-right:30px !important}.mh40{margin-left:40px !important;margin-right:40px !important}.mh50{margin-left:50px !important;margin-right:50px !important}.mh70{margin-left:70px !important;margin-right:70px !important}.mtn5{margin-top:-5px !important}.mtn10{margin-top:-10px !important}.mtn15{margin-top:-15px !important}.mtn20{margin-top:-20px !important}.mtn30{margin-top:-30px !important}.mrn5{margin-right:-5px !important}.mrn10{margin-right:-10px !important}.mrn15{margin-right:-15px !important}.mrn20{margin-right:-20px !important}.mrn30{margin-right:-30px !important}.mbn5{margin-bottom:-5px !important}.mbn10{margin-bottom:-10px !important}.mbn15{margin-bottom:-15px !important}.mbn20{margin-bottom:-20px !important}.mbn30{margin-bottom:-30px !important}.mln5{margin-left:-5px !important}.mln10{margin-left:-10px !important}.mln15{margin-left:-15px !important}.mln20{margin-left:-20px !important}.mln30{margin-left:-30px !important}.mvn5{margin-top:-5px !important;margin-bottom:-5px !important}.mvn10{margin-top:-10px !important;margin-bottom:-10px !important}.mvn15{margin-top:-15px !important;margin-bottom:-15px !important}.mvn20{margin-top:-20px !important;margin-bottom:-20px !important}.mvn30{margin-top:-30px !important;margin-bottom:-30px !important}.mhn5{margin-left:-5px !important;margin-right:-5px !important}.mhn10{margin-left:-10px !important;margin-right:-10px !important}.mhn15{margin-left:-15px !important;margin-right:-15px !important}.mhn20{margin-left:-20px !important;margin-right:-20px !important}.mhn30{margin-left:-30px !important;margin-right:-30px !important}.lh0{line-height:0 !important}.lh5{line-height:5px !important}.lh10{line-height:10px !important}.lh15{line-height:15px !important}.lh20{line-height:20px !important}.lh25{line-height:25px !important}.lh30{line-height:30px !important}.lh35{line-height:35px !important}.lh40{line-height:40px !important}.br-l-n{border-left:none !important}.br-r-n{border-right:none !important}.br-t-n{border-top:none !important}.br-b-n{border-bottom:none !important}.br-n{border:none !important}.br-v-n{border-top:none !important;border-bottom:none !important}.br-h-n{border-left:none !important;border-right:none !important}.br-a{border:1px solid #eeeeee !important}.br-l{border-left:1px solid #eeeeee !important}.br-r{border-right:1px solid #eeeeee !important}.br-t{border-top:1px solid #eeeeee !important}.br-b{border-bottom:1px solid #eeeeee !important}.br-dashed{border-style:dotted !important}.br0{border-radius:0px !important}.br1{border-radius:1px !important}.br2{border-radius:2px !important}.br3{border-radius:3px !important}.br4{border-radius:4px !important}.br6{border-radius:6px !important}.br8{border-radius:8px !important}.br12{border-radius:12px !important}.br24{border-radius:24px !important}.br64{border-radius:64px !important}.bw1{border-width:1px !important}.bw2{border-width:2px !important}.bw3{border-width:3px !important}.bw4{border-width:4px !important}.bw5{border-width:5px !important}.bw8{border-width:8px !important}.bw10{border-width:10px !important}.bw15{border-width:15px !important}.br-white{border-color:#ffffff !important}.br-lighter{border-color:#eeeeee !important}.br-light{border-color:#e7e7e7 !important}.br-grey{border-color:#d9d9d9 !important}.br-greyer{border-color:#cccccc !important}.br-dark{border-color:#3b3f4f !important}.br-dark-light{border-color:#51566c !important}.br-primary{border-color:#4a89dc !important}.br-primary-light{border-color:#75a5e4 !important}.br-info{border-color:#3bafda !important}.br-info-light{border-color:#66c1e2 !important}.br-success{border-color:#70ca63 !important}.br-success-light{border-color:#93d789 !important}.br-warning{border-color:#f6bb42 !important}.br-warning-light{border-color:#f8cd73 !important}.br-danger{border-color:#e9573f !important}.br-danger-light{border-color:#ee7f6d !important}.br-alert{border-color:#967adc !important}.br-alert-light{border-color:#b6a2e7 !important}.br-system{border-color:#37bc9b !important}.br-system-light{border-color:#58ceb1 !important}.br-tp-top{border-top-color:rgba(0,0,0,0.1)}.br-tp-right{border-right-color:rgba(0,0,0,0.1)}.br-tp-left{border-left-color:rgba(0,0,0,0.1)}.fluid-width{width:100% !important}.mw10{max-width:10px !important}.mw20{max-width:20px !important}.mw30{max-width:30px !important}.mw35{max-width:35px !important}.mw40{max-width:40px !important}.mw45{max-width:45px !important}.mw50{max-width:50px !important}.mw60{max-width:60px !important}.mw80{max-width:80px !important}.mw100{max-width:100px !important}.mw140{max-width:140px !important}.mw160{max-width:160px !important}.mw180{max-width:180px !important}.mw200{max-width:200px !important}.mw240{max-width:240px !important}.mw280{max-width:280px !important}.mw320{max-width:320px !important}.mw400{max-width:400px !important}.mw450{max-width:450px !important}.mw500{max-width:500px !important}.mw600{max-width:600px !important}.mw700{max-width:700px !important}.mw800{max-width:800px !important}.mw900{max-width:900px !important}.mw1000{max-width:1000px !important}.mw1100{max-width:1100px !important}.mw1200{max-width:1200px !important}.w20{width:20px !important}.w30{width:30px !important}.w40{width:40px !important}.w50{width:50px !important}.w75{width:75px !important}.w100{width:100px !important}.w125{width:125px !important}.w150{width:150px !important}.w175{width:175px !important}.w200{width:200px !important}.w225{width:225px !important}.w250{width:250px !important}.w300{width:300px !important}.w320{width:320px !important}.w350{width:350px !important}.w400{width:400px !important}.w450{width:450px !important}.mnw20{min-width:20px !important}.mnw30{min-width:30px !important}.mnw40{min-width:40px !important}.mnw50{min-width:50px !important}.mnw75{min-width:75px !important}.mnw100{min-width:100px !important}.mnw125{min-width:125px !important}.mnw150{min-width:150px !important}.mnw175{min-width:175px !important}.mnw200{min-width:200px !important}.mnw250{min-width:250px !important}.mnw300{min-width:300px !important}.mnw500{min-width:500px !important}.mnw700{min-width:700px !important}.mnw1000{min-width:1000px !important}table tbody tr.message-read td{color:#999;background-color:#fbfbfb}table tbody tr.message-unread td{background-color:#fff}table.tc-text-center-head thead th,table.tc-text-center-head tfoot th{text-align:center}table.tc-fs11-head thead th,table.tc-fs11-head tfoot th{font-size:12px}table.tc-fs12-head thead th,table.tc-fs12-head tfoot th{font-size:12px}table.tc-checkbox-1 tbody td:first-child,table.tc-checkbox-2 tbody td:nth-child(2),table.tc-checkbox-3 tbody td:nth-child(3),table.tc-checkbox-last tbody td:last-child{text-align:center;padding:11px}table.tc-list-1 tbody td:first-child,table.tc-list-2 tbody td:nth-child(2),table.tc-list-3 tbody td:nth-child(3),table.tc-list-last tbody td:last-child{font-weight:600;font-size:14px;text-align:center;width:45px;padding:0 10px;border-right:1px solid #e5e5e5;background:#fdfdfd}table.tc-bold-1 tbody td:first-child,table.tc-bold-2 tbody td:nth-child(2),table.tc-bold-3 tbody td:nth-child(3),table.tc-bold-last tbody td:last-child{font-weight:600;text-align:right;font-size:14px}table.tc-med-1 tbody td:first-child,table.tc-med-2 tbody td:nth-child(2),table.tc-med-3 tbody td:nth-child(3),table.tc-med-last tbody td:last-child{font-weight:400;color:#999}table.tc-icon-1 tbody td:first-child,table.tc-icon-2 tbody td:nth-child(2),table.tc-icon-3 tbody td:nth-child(3),table.tc-icon-last tbody td:last-child{font-size:18px;text-align:center;color:#999}table.tc-text-muted-1 tbody td:first-child,table.tc-text-muted-2 tbody td:nth-child(2),table.tc-text-muted-3 tbody td:nth-child(3),table.tc-text-muted-last tbody td:last-child{color:#999}table.tc-text-primary-1 tbody td:first-child,table.tc-text-primary-2 tbody td:nth-child(2),table.tc-text-primary-3 tbody td:nth-child(3),table.tc-text-primary-last tbody td:last-child{color:#4a89dc}table.tc-fw600-1 tbody td:first-child,table.tc-fw600-2 tbody td:nth-child(2),table.tc-fw600-3 tbody td:nth-child(3),table.tc-fw600-last tbody td:last-child{font-weight:600}table.tc-fw600-1 tbody td:first-child,table.tc-fw600-2 tbody td:nth-child(2),table.tc-fw600-3 tbody td:nth-child(3),table.tc-fw600-last tbody td:last-child{font-weight:600}table.tc-fs13-1 tbody td:first-child,table.tc-fs13-2 tbody td:nth-child(2),table.tc-fs13-3 tbody td:nth-child(3),table.tc-fs13-last tbody td:last-child{font-size:13px}table.tc-text-left-1 tbody td:first-child,table.tc-text-left-2 tbody td:nth-child(2),table.tc-text-left-3 tbody td:nth-child(3),table.tc-text-left-last tbody td:last-child{text-align:right}table.tc-text-center-1 tbody td:first-child,table.tc-text-center-2 tbody td:nth-child(2),table.tc-text-center-3 tbody td:nth-child(3),table.tc-text-center-last tbody td:last-child{text-align:center}table.tc-text-right-1 tbody td:first-child,table.tc-text-right-2 tbody td:nth-child(2),table.tc-text-right-3 tbody td:nth-child(3),table.tc-text-right-last tbody td:last-child{text-align:right}table.tc-va-t-1 tbody td:first-child,table.tc-va-t-2 tbody td:nth-child(2),table.tc-va-t-3 tbody td:nth-child(3),table.tc-va-t-last tbody td:last-child{vertical-align:top}table.tc-va-m-1 tbody td:first-child,table.tc-va-m-2 tbody td:nth-child(2),table.tc-va-m-3 tbody td:nth-child(3),table.tc-va-m-last tbody td:last-child{vertical-align:middle}table.tc-va-b-1 tbody td:first-child,table.tc-va-b-2 tbody td:nth-child(2),table.tc-va-b-3 tbody td:nth-child(3),table.tc-va-b-last tbody td:last-child{vertical-align:bottom}.table-checklist td{cursor:pointer}.table-widget .tab-content{padding:0;border:0;overflow:hidden}.table-widget .progress{width:80%;height:13px;margin:0}.table-widget .label,.table-widget .badge{margin-right:7px}.table-checklist tr.task-checked{color:#bbbbbb}.table-checklist tr.task-checked .text-slash{text-decoration:line-through}.table-checklist tr.task-checked .label,.table-checklist tr.task-checked .progress{opacity:0.3}html{height:100%;background:#efefef}body{width:100%;height:100%;min-height:1100px;margin:0;padding:0;background:#e9e9e9;-webkit-font-smoothing:antialiased;-webkit-text-size-adjust:100%;font-size-adjust:100%}#main{position:relative;min-height:100%;background:#eeeeee}#main:before{content:"";position:fixed;top:0;right:0;bottom:0;left:0;background:#eeeeee}#content_wrapper{position:relative;left:0px;margin-left:230px}body.onload-check .navbar,body.onload-check .navbar-branding,body.onload-check #sidebar_left,body.onload-check #sidebar_right,body.onload-check #content_wrapper,body.onload-check #topbar{-webkit-transition:all 0.2s ease;transition:all 0.2s ease}.navbar.navbar-fixed-top+#sidebar_left+#content_wrapper{padding-top:60px}#sidebar_left.affix{position:fixed;height:100%}#sidebar_left.affix>.sidebar-menu{overflow-x:hidden;position:absolute;width:100%;top:85px;bottom:52px;transition:top 0.2s ease-in-out}#sidebar_left.affix>.email-menu+.sidebar-menu{overflow-x:hidden;position:absolute;width:100%;top:485px;bottom:52px;transition:top 0.2s ease-in-out}#sidebar_left.affix:before{left:0}body.sidebar-hidden #sidebar_left.affix:before,body.sidebar-rtl #sidebar_left.affix:before{left:-230px}.user-info.hidden,.user-info.hidden+.user-divider{display:none}body.usermenu-hidden .user-info,body.usermenu-hidden .user-info+.user-divider{display:none}body.usermenu-hidden #sidebar_left.affix .user-info+.user-divider+.sidebar-menu,body.usermenu-hidden #sidebar_left.affix .user-info+.user-divider+.user-menu+.sidebar-menu{top:0}#sidebar_left.affix>.user-menu.usermenu-open+.sidebar-menu{top:250px}#topbar.affix{z-index:1029;width:auto;left:0;right:0;margin-left:230px;position:fixed;-webkit-transform:translate3d(0, 0, 0);transform:translate3d(0, 0, 0)}body.sb-l-m #topbar.affix,body.sb-l-o.sb-l-m #topbar.affix{margin-left:60px}body.sb-l-c #topbar.affix{margin-left:0px}#topbar.affix+#content{margin-top:51px}#topbar.affix.hidden+#content{margin-top:0}body.hidden-breadcrumbs #topbar{display:none}body.sidebar-collapsed #sidebar:before{width:40px}.ajax-loading{overflow-y:scroll}ul.sidebar-nav ul#sideEight.sub-nav>li>a:hover{background-color:transparent}.panel-tabs>li>a:hover{background-color:#f2f2f2}#return-arrow{color:#555;padding-left:15px;padding-top:15px;position:fixed;opacity:0.7;cursor:pointer;display:block;z-index:1050}#return-arrow i.fa{float:left;padding-top:2px}#return-arrow span{float:left;padding-left:15px;padding-top:0px;font-size:16px}#return-arrow:hover{opacity:1}.bs-component{position:relative}#source-button{position:absolute;top:0;right:0;z-index:100;font-weight:600}#source-modal .modal-header{background-color:#fafafa}#source-modal .btn-clipboard{letter-spacing:0.5px}#source-modal .hljs{padding:10px 13px}#content{padding:15px 8px 40px 11px}@media (min-width: 1100px){#content{padding:25px 20px 50px 21px}}@media (max-width: 991px){#content .col-md-2+.col-md-2,#content .col-md-2+.col-md-4,#content .col-md-2+.col-md-6,#content .col-md-4+.col-md-2,#content .col-md-4+.col-md-4,#content .col-md-4+.col-md-6,#content .col-md-6+.col-md-2,#content .col-md-6+.col-md-4,#content .col-md-6+.col-md-6{padding-top:10px}}@media (max-width: 815px){#content .panel .panel-body{overflow:hidden !important;min-width:0 !important}}@media (max-width: 815px){#topbar{padding:10px 6px 10px 14px !important}#topbar .topbar-dropdown{display:none !important}}.navbar{z-index:1030;margin-bottom:0;border:0;border-radius:0;box-shadow:none}.navbar .nav{margin:0}.navbar .nav>li{float:left}.navbar .nav>li>a{color:#777;font-size:15px;padding-top:20px;padding-bottom:20px;height:78px;max-height:78px}.navbar .nav>li.open>a,.navbar .nav>li:hover>a,.navbar .nav>li:focus>a,.navbar .nav>li.active>a,.navbar .nav>li>a:hover,.navbar .nav>li>a:focus{color:#333;background-color:#DDD}.navbar .nav>li.dropdown.open .dropdown-menu{padding:0;margin-top:10px;border-radius:2px;border-top:3px solid #4a89dc}.navbar .nav>li.dropdown.open .dropdown-menu:after{content:"";position:absolute;width:0;height:0;border-color:transparent;border-style:solid;right:8px;bottom:100%;border-width:0 10px 10px;border-bottom-color:#4a89dc}.navbar .nav .menu-divider{color:rgba(0,0,0,0.2);font-size:8px;padding:25px 10px}.navbar .dropdown-menu>li>a{font-weight:600}.navbar .dropdown-menu>li.dropdown-header{padding:8px;background:#fafafa;border-bottom:1px solid #e5e5e5}.navbar .dropdown-menu>li.dropdown-header .dropdown-title{color:#666;font-size:13px;font-weight:600;padding-left:5px;line-height:30px}.navbar .dropdown-menu>li.dropdown-header .label{font-size:75%;padding:0.1em 0.6em 0.2em;float:right;height:20px;line-height:20px;margin-top:5px;margin-right:5px}.navbar .media-list>li.media{margin:0;padding:10px}.navbar .media-list>li.media+li.media{border-top:1px solid #EEE}.navbar .media-list>li.media>a{padding:0;padding-right:10px;display:table-cell}.navbar .media-list>li.media .media-heading small{color:#AAA}.navbar .list-group>li.list-group-item{padding:0}.navbar .list-group>li.list-group-item>a{padding:12px}.navbar .list-group>li.list-group-item>a .label{font-size:75%;padding:0.1em 0.65em 0.2em;float:right;height:20px;line-height:20px}.navbar .list-group>li.list-group-item>a .fa,.navbar .list-group>li.list-group-item>a .glyphicon,.navbar .list-group>li.list-group-item>a .glyphicons{padding-right:5px}.navbar .list-group>li.dropdown-header+li.list-group-item{border-top:0}.navbar-branding{position:relative;overflow:hidden;float:left;width:230px;height:60px;background-color:#1f70a8;margin-right:10px}.navbar-branding a.navbar-brand{height:60px;line-height:58px;padding:0;padding-left:18px;color:#777;font-size:17px;font-weight:400;letter-spacing:0.5px}.navbar-branding a.navbar-brand b{font-weight:bold}#toggle_sidemenu_l{float:right;cursor:pointer;font-size:16px;color:#fff;line-height:58px;max-height:60px;width:60px;text-align:center;-webkit-touch-callout:none;-webkit-user-select:none;-khtml-user-select:none;-moz-user-select:none;-ms-user-select:none;user-select:none}#toggle_sidemenu_l:hover{color:#DDD}.navbar-nav.navbar-left{float:left;position:relative;max-height:60px}.navbar-nav.navbar-left>li>a{padding-right:12px;padding-left:12px}.navbar-nav.navbar-right,.navbar-nav.navbar-right:last-child{float:right;margin:0 15px 0 0}.navbar-form{margin-top:17px;margin-bottom:17px}.navbar-form.navbar-search input{height:26px;padding:0 12px;border-radius:20px;border-color:transparent;box-shadow:none;-webkit-transition:all 0.2s ease;-o-transition:all 0.2s ease;transition:all 0.2s ease}li.dropdown-border-hover,.dropdown-border-hover li{border-left:3px solid transparent}li.dropdown-border-hover:hover,.dropdown-border-hover li:hover{background:#f8f8f8;border-left-color:#4a89dc;-webkit-transition-delay:0s !important;-o-transition-delay:0s !important;transition-delay:0s !important;-webkit-transition:all linear 0s !important;-o-transition:all linear 0s !important;transition:all linear 0s !important}.navbar .dropdown.open .btn-group.open .multiselect-container.dropdown-menu{margin-top:0;border-top:1px solid rgba(0,0,0,0.1) !important;border-color:rgba(0,0,0,0.1)}.navbar .dropdown.open .btn-group.open .multiselect-container.dropdown-menu:after{display:none}#user-role+.btn-group>button.multiselect{overflow:hidden;text-overflow:ellipsis}#user-status+.btn-group .multiselect-container.dropdown-menu{right:auto !important;left:0 !important}#user-status+.btn-group .multiselect-container.dropdown-menu,#user-role+.btn-group .multiselect-container.dropdown-menu{top:0 !important;position:relative !important;margin-top:9px;margin-bottom:3px;width:212px}#user-status+.btn-group .multiselect-container.dropdown-menu>li:first-child,#user-role+.btn-group .multiselect-container.dropdown-menu>li:first-child,#user-status+.btn-group .multiselect-container.dropdown-menu>li:first-child label,#user-role+.btn-group .multiselect-container.dropdown-menu>li:first-child label{cursor:pointer;position:relative}#user-status+.btn-group .multiselect-container.dropdown-menu>li:first-child:after,#user-role+.btn-group .multiselect-container.dropdown-menu>li:first-child:after{content:"\f00d";font-family:"FontAwesome";position:absolute;width:15px;height:15px;top:6px;right:8px;font-size:13px;font-weight:600;color:#AAA;-webkit-transition:color 0.15s ease;transition:color 0.15s ease}#user-status+.btn-group .multiselect-container.dropdown-menu>li:first-child:hover:after,#user-role+.btn-group .multiselect-container.dropdown-menu>li:first-child:hover:after{color:#4a89dc}.navbar[class*='bg-'] .navbar-brand,.navbar[class*='bg-'] .nav>li>a,.navbar[class*='bg-'] .nav>li.open>a{color:#fff}.navbar.bg-primary{background-color:#4a89dc !important;color:#f5f8fd}.navbar.bg-primary.navbar .nav>li.open>a,.navbar.bg-primary.navbar .nav>li:hover>a,.navbar.bg-primary.navbar .nav>li:focus>a,.navbar.bg-primary.navbar .nav>li.active>a,.navbar.bg-primary.navbar .nav>li>a:hover,.navbar.bg-primary.navbar .nav>li>a:focus{color:#FFF;background-color:#3078d7}.navbar.bg-primary.navbar .nav>li.dropdown.open .dropdown-menu{border-top-color:#4a89dc}.navbar.bg-primary.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#4a89dc}.navbar.bg-primary.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#4a89dc}.navbar.bg-primary.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a,.navbar.bg-primary.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:hover,.navbar.bg-primary.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#4a89dc}.navbar.bg-success{background-color:#70ca63 !important;color:#fcfefb}.navbar.bg-success.navbar .nav>li.open>a,.navbar.bg-success.navbar .nav>li:hover>a,.navbar.bg-success.navbar .nav>li:focus>a,.navbar.bg-success.navbar .nav>li.active>a,.navbar.bg-success.navbar .nav>li>a:hover,.navbar.bg-success.navbar .nav>li>a:focus{color:#FFF;background-color:#5bc24c}.navbar.bg-success.navbar .nav>li.dropdown.open .dropdown-menu{border-top-color:#70ca63}.navbar.bg-success.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#70ca63}.navbar.bg-success.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#70ca63}.navbar.bg-success.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a,.navbar.bg-success.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:hover,.navbar.bg-success.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#70ca63}.navbar.bg-info{background-color:#3bafda !important;color:#e7f5fa}.navbar.bg-info.navbar .nav>li.open>a,.navbar.bg-info.navbar .nav>li:hover>a,.navbar.bg-info.navbar .nav>li:focus>a,.navbar.bg-info.navbar .nav>li.active>a,.navbar.bg-info.navbar .nav>li>a:hover,.navbar.bg-info.navbar .nav>li>a:focus{color:#FFF;background-color:#27a2cf}.navbar.bg-info.navbar .nav>li.dropdown.open .dropdown-menu{border-top-color:#3bafda}.navbar.bg-info.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#3bafda}.navbar.bg-info.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#3bafda}.navbar.bg-info.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a,.navbar.bg-info.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:hover,.navbar.bg-info.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#3bafda}.navbar.bg-warning{background-color:#f6bb42 !important;color:#ffffff}.navbar.bg-warning.navbar .nav>li.open>a,.navbar.bg-warning.navbar .nav>li:hover>a,.navbar.bg-warning.navbar .nav>li:focus>a,.navbar.bg-warning.navbar .nav>li.active>a,.navbar.bg-warning.navbar .nav>li>a:hover,.navbar.bg-warning.navbar .nav>li>a:focus{color:#FFF;background-color:#f5b025}.navbar.bg-warning.navbar .nav>li.dropdown.open .dropdown-menu{border-top-color:#f6bb42}.navbar.bg-warning.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#f6bb42}.navbar.bg-warning.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#f6bb42}.navbar.bg-warning.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a,.navbar.bg-warning.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:hover,.navbar.bg-warning.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#f6bb42}.navbar.bg-danger{background-color:#e9573f !important;color:#fef7f6}.navbar.bg-danger.navbar .nav>li.open>a,.navbar.bg-danger.navbar .nav>li:hover>a,.navbar.bg-danger.navbar .nav>li:focus>a,.navbar.bg-danger.navbar .nav>li.active>a,.navbar.bg-danger.navbar .nav>li>a:hover,.navbar.bg-danger.navbar .nav>li>a:focus{color:#FFF;background-color:#e63f24}.navbar.bg-danger.navbar .nav>li.dropdown.open .dropdown-menu{border-top-color:#e9573f}.navbar.bg-danger.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#e9573f}.navbar.bg-danger.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#e9573f}.navbar.bg-danger.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a,.navbar.bg-danger.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:hover,.navbar.bg-danger.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#e9573f}.navbar.bg-alert{background-color:#967adc !important;color:#ffffff}.navbar.bg-alert.navbar .nav>li.open>a,.navbar.bg-alert.navbar .nav>li:hover>a,.navbar.bg-alert.navbar .nav>li:focus>a,.navbar.bg-alert.navbar .nav>li.active>a,.navbar.bg-alert.navbar .nav>li>a:hover,.navbar.bg-alert.navbar .nav>li>a:focus{color:#FFF;background-color:#8362d6}.navbar.bg-alert.navbar .nav>li.dropdown.open .dropdown-menu{border-top-color:#967adc}.navbar.bg-alert.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#967adc}.navbar.bg-alert.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#967adc}.navbar.bg-alert.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a,.navbar.bg-alert.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:hover,.navbar.bg-alert.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#967adc}.navbar.bg-system{background-color:#37bc9b !important;color:#cef1e8}.navbar.bg-system.navbar .nav>li.open>a,.navbar.bg-system.navbar .nav>li:hover>a,.navbar.bg-system.navbar .nav>li:focus>a,.navbar.bg-system.navbar .nav>li.active>a,.navbar.bg-system.navbar .nav>li>a:hover,.navbar.bg-system.navbar .nav>li>a:focus{color:#FFF;background-color:#30a487}.navbar.bg-system.navbar .nav>li.dropdown.open .dropdown-menu{border-top-color:#37bc9b}.navbar.bg-system.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#37bc9b}.navbar.bg-system.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#37bc9b}.navbar.bg-system.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a,.navbar.bg-system.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:hover,.navbar.bg-system.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#37bc9b}.navbar.bg-dark{background-color:#3b3f4f !important;color:#9fa4b7}.navbar.bg-dark.navbar .nav>li.open>a,.navbar.bg-dark.navbar .nav>li:hover>a,.navbar.bg-dark.navbar .nav>li:focus>a,.navbar.bg-dark.navbar .nav>li.active>a,.navbar.bg-dark.navbar .nav>li>a:hover,.navbar.bg-dark.navbar .nav>li>a:focus{color:#FFF;background-color:#2e313d}.navbar.bg-dark.navbar .nav>li.dropdown.open .dropdown-menu{border-top-color:#3b3f4f}.navbar.bg-dark.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#3b3f4f}.navbar.bg-dark.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#3b3f4f}.navbar.bg-dark.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a,.navbar.bg-dark.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:hover,.navbar.bg-dark.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#3b3f4f}.navbar.bg-light{color:#666;background-color:#28292a !important;border-bottom:1px solid #E2E2E2}.navbar.bg-light .navbar-branding{background-color:#FFF !important;border-bottom:1px solid #E6E6E6}.navbar.bg-light .navbar-form.navbar-search input{border-color:#EEE}.navbar.bg-light .navbar-form.navbar-search input:focus{background-color:#fafafa;border-color:#f0f0f0}.navbar.bg-light .navbar-brand,.navbar.bg-light .nav>li>a,.navbar.bg-light .nav>li.open>a{color:#666}.navbar.bg-light #toggle_sidemenu_l,.navbar.bg-light #toggle_sidemenu_l:hover,.navbar.bg-light #toggle_sidemenu_l:focus{color:#666}.navbar.bg-light.navbar .nav>li.open>a,.navbar.bg-light.navbar .nav>li:hover>a,.navbar.bg-light.navbar .nav>li:focus>a,.navbar.bg-light.navbar .nav>li.active>a,.navbar.bg-light.navbar .nav>li>a:hover,.navbar.bg-light.navbar .nav>li>a:focus{color:#222;background-color:#f7f7f7}.navbar.bg-light.navbar .nav>li.dropdown.open .dropdown-menu{border-top-color:#4a89dc}.navbar.bg-light.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#4a89dc}.navbar.bg-light.navbar .nav>li.dropdown.open .dropdown-menu:after{border-bottom-color:#4a89dc}.navbar.bg-light.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a,.navbar.bg-light.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:hover,.navbar.bg-light.navbar .nav>li .dropdown-toggle+.dropdown-menu>.active>a:focus{color:#ffffff;background-color:#4a89dc}.navbar .navbar-right>li:last-child>.dropdown-menu>li>a{white-space:inherit}@media (max-width: 1100px){.navbar .navbar-right:last-child{margin-right:5px}.navbar .navbar-right>li:last-child>a>img{margin-right:5px !important}.navbar .navbar-right>li:last-child>a>span{display:none}.navbar .navbar-right>li:last-child>a>span.caret{display:inline-block}.navbar-form.navbar-search{padding:21px 6px 19px;margin:0;cursor:pointer;width:auto;float:left}.navbar-form.navbar-search .form-group{margin:0 !important}.navbar-form.navbar-search:after{content:"\f02e";position:relative;font:normal normal 16px octicons;line-height:1;display:inline-block;text-decoration:none;-webkit-font-smoothing:antialiased;-moz-osx-font-smoothing:grayscale;-webkit-user-select:none;-moz-user-select:none;-ms-user-select:none;user-select:none}.navbar-form.navbar-search input{opacity:0;z-index:-1;visibility:hidden;position:absolute;top:-60px;left:0;width:100%;height:60px;margin:0;font-size:24px;color:#AAA;border-radius:0;border:0;border-bottom:1px solid #EEE;text-align:center;-webkit-transition:all 0.3s ease;transition:all 0.3s ease}.navbar-form.navbar-search input:focus,.navbar.bg-light .navbar-form.navbar-search input:focus{background-color:#FFF}.navbar-form.navbar-search.search-open input{top:0;opacity:1;visibility:visible;z-index:1040}.navbar-form.navbar-search .search-remove{display:none;z-index:1040;position:absolute;color:#AAA;top:0;right:0;height:60px;line-height:59px;padding-left:15px;padding-right:25px}.navbar-form.navbar-search.search-open .search-remove:hover{color:#ee7f6d}}@media (max-width: 599px){.sb-l-m .navbar>.navbar-right,.navbar .navbar-nav>li.dropdown{position:static !important}.navbar .navbar-right:last-child{margin-right:0}.navbar-left .dropdown-menu,.navbar-right .dropdown-menu,.navbar-left .open .dropdown-menu,.navbar-right .open .dropdown-menu{z-index:1000;margin-top:0 !important;float:left;position:absolute;top:100%;left:-1px;min-width:101%;list-style:none;background-color:#FFF;border:1px solid rgba(0,0,0,0.15);background-clip:padding-box;-webkit-box-shadow:0 6px 12px rgba(0,0,0,0.175);box-shadow:0 6px 12px rgba(0,0,0,0.175)}#user-status+.btn-group .multiselect-container.dropdown-menu,#user-role+.btn-group .multiselect-container.dropdown-menu{top:34px !important;position:absolute !important;right:0;left:auto}}#content.table-layout{padding:0}#content.table-layout>div,#content.table-layout>section{vertical-align:top;padding:25px 20px 50px}#content.table-layout>aside{vertical-align:top}.tray-left,.tray-right{position:relative;width:250px;min-height:100%;padding:15px;border-right:1px solid #DDD;background:#f5f5f5}.tray-right{border-left:1px solid #DDD;border-right:0}.tray-top{position:relative;width:100%;min-height:150px;border-bottom:1px solid #DDD;background-color:#f2f2f2;padding:15px}.tray-top.light{background-color:#fafafa}.tray200{width:200px}.tray240{width:240px}.tray270{width:270px}.tray290{width:290px}.tray300{width:300px}.tray320{width:320px}.tray350{width:350px}.tray400{width:400px}.tray200 .tray-nav.affix{width:199px}.tray200 .tray-nav.affix{width:239px}.tray270 .tray-nav.affix{width:269px}.tray290 .tray-nav.affix{width:289px}.tray300 .tray-nav.affix{width:299px}.tray320 .tray-nav.affix{width:319px}.tray350 .tray-nav.affix{width:349px}.tray400 .tray-nav.affix{width:399px}.tray-bin{min-height:65px;padding:7px;margin:0 -15px 15px;border:1px dashed #CCC;background:#eee}.tray-bin.stretch{border-left:0;border-right:0}.tray-bin div[class*='col-']{padding-left:5px;padding-right:5px}.tray-bin .nav-label{text-align:center;font-size:12px;color:#999999;padding-left:5px;margin-top:20px;margin-bottom:10px}.tray-title{margin-top:10px;margin-bottom:15px;padding:0 5px 15px;border-bottom:1px solid #e5e5e5}.icon-list{margin:20px 0 30px;font-size:14px;padding-left:5px;list-style:none}.icon-list li+li{padding-top:10px}#sidebar_left{color:#fff;font-size:13px;position:absolute;top:0;left:0;width:230px;min-height:100%;padding-top:60px;padding-bottom:40px;background-color:#30363e}.sidebar-left-content{height:100%}.sidebar-menu{padding-bottom:20px}.sidebar-menu>li{margin:0}.sidebar-menu>li:first-child{padding-top:4px}.sidebar-menu>li a{color:#fff}.sidebar-menu>li>a{padding:0;line-height:35px;height:35px;overflow:hidden}.sidebar-menu>li>a>span:nth-child(1){float:left;top:0;line-height:35px;width:38px;font-size:13px;text-align:center;padding-left:13px}.sidebar-menu>li>a>span:nth-child(2){font-weight:600;padding-left:6px}.sidebar-menu li>a>.sidebar-title-tray{position:absolute;right:10px;top:-2px}.sidebar-menu li>a>.sidebar-title-tray .label{padding:0em 0.4em 0.2em;font-size:11px}.sidebar-menu li>a>span.caret{position:absolute;top:45%;right:13px;border-top:5px solid;border-right:5px solid transparent;border-left:5px solid transparent}.sidebar-menu li>a.menu-open>span.caret{border-top:0;border-bottom:5px solid}.sidebar-menu>li>ul{clear:both;display:none;width:230px;height:auto;background-color:#282d33}.sidebar-menu li>a.menu-open+ul{display:block}.sidebar-menu>li>ul>li>a{color:#d1d1d1;padding:11px 20px 11px 30px}.sidebar-menu>li>ul>li:first-child>a{padding-top:14px}.sidebar-menu>li>ul>li:last-child>a{padding-bottom:17px}.sidebar-menu>li>ul>li>a>span:nth-child(1){margin-right:10px;font-size:11px}.sidebar-menu>li>ul>li>a>span.label{float:right;line-height:17px}.sidebar-menu>li>ul>li ul{clear:both;display:none;width:230px;height:auto;background-color:#22262c}.sidebar-menu>li>ul>li>ul li a{padding:9px 20px 9px 50px}.sidebar-menu>li>ul>li>ul li:last-child a{padding-bottom:13px}.sidebar-menu>li>ul>li>ul li a .label.label-xs{float:right;line-height:17px}.sidebar-menu>li>a.menu-open:after,.sidebar-menu>li.active>a:after,.sidebar-menu>li:hover>a:after,.sidebar-menu>li:focus>a:after{content:"";position:absolute;left:0;top:0;height:100%;width:3px;background:#AAA}.sidebar-menu>li>ul>li>a.menu-open:after,.sidebar-menu>li>ul>li.active>a:after,.sidebar-menu>li>ul>li:hover>a:after,.sidebar-menu>li>ul>li:focus>a:after{content:"";position:absolute;left:0;top:0;height:100%;width:3px;background:#AAA}.sidebar-menu>li>ul>li>ul>li.active>a:after,.sidebar-menu>li>ul>li>ul>li:hover>a:after,.sidebar-menu>li>ul>li>ul>li:focus>a:after{content:"";position:absolute;left:0;top:5%;height:90%;width:3px;background:#999}.sidebar-menu .sidebar-label{text-transform:uppercase;color:#70829a;font-weight:600;padding-left:18px;padding-bottom:3px;font-size:12px}.sidebar-menu .sidebar-stat .progress{clear:both;background-color:#26292e}.sidebar-menu .sidebar-stat>a{height:auto;overflow:visible}.user-menu{display:none;position:relative;left:0;top:0;height:130px;width:100%;padding:10px;background-color:#282d33}.user-menu a{position:relative;display:block;padding:12px 5px 12px;margin-bottom:3px;transition:all 0.2s ease}.user-menu a:hover{background-color:rgba(255,255,255,0.1)}.user-menu a span{font-size:24px;transition:all 0.3s ease}.user-menu a:hover span{color:#3078d7}.user-menu a h5{display:none}.user-divider{height:4px;width:100%;background-color:#e5e5e5;border-bottom:1px solid #CCC}.sidebar-toggle-mini{width:35px;height:32px;padding:7px 0}.sidebar-toggle-mini a{position:absolute;right:0;display:block;text-align:center;padding:6px 6px 5px;border:1px solid #444;border-radius:2px 0 0 2px;background-color:#26292e}.sidebar-toggle-mini:hover span{color:#DDD;transition:all ease-in-out 0.3s}.sidebar-toggle-mini span{position:relative;color:#888;font-size:16px;transform:rotate(180deg)}body.sb-l-m #sidebar_left{z-index:1028;overflow:visible;width:60px;height:100%;left:0;background-color:#30363e}body.sb-l-m #sidebar_left:before{width:60px}body.sb-l-m .sidebar-header{display:none}body.sb-l-m #sidebar_left .sidebar-label,body.sb-l-m #sidebar_left .sidebar-title-tray,body.sb-l-m #sidebar_left .sidebar-title,body.sb-l-m #sidebar_left .caret{display:none}body.sb-l-m #sidebar_left .sidebar-proj,body.sb-l-m #sidebar_left .sidebar-stat{display:none}body.sb-l-m .sidebar-menu>li{padding:7px 0}body.sb-l-m .sidebar-menu>li>a{overflow:visible}body.sb-l-m .sidebar-menu>li>a>span:nth-child(1){color:#ccc;left:-1px;width:60px;font-size:18px;padding-left:0}body.sb-l-m .sidebar-menu>li.active>a>span:nth-child(1){color:#2f87c1}body.sb-l-m .sidebar-menu>li>a>.sidebar-title{position:absolute;left:60px;top:-4px;width:180px;height:44px;line-height:44px;font-size:14px;padding-left:15px;border-left:1px solid #222;background-color:#282d33}body.sb-l-m .sidebar-menu>li>a.menu-open+ul{display:none}body.sb-l-m .sidebar-menu>li:hover>a+ul,body.sb-l-m .sidebar-menu>li:hover>a>.sidebar-title{display:block !important}body.sb-l-m .sidebar-menu>li>ul li a>.caret{display:block !important}body.sb-l-m .sidebar-menu>li>ul{position:absolute;left:60px;top:38px;width:180px;height:auto;border-left:1px solid #222;padding-bottom:7px;overflow:hidden}body.sb-l-m .sidebar-menu>li>ul>li ul{width:180px}body.sb-l-m .sidebar-menu>li>ul>li{overflow:hidden}body.sb-l-m .sidebar-menu li>ul>li>a{padding:8px 20px 8px 20px}body.sb-l-m .sidebar-menu li>ul>li>ul>li a{padding:8px 20px 8px 35px}body.sb-l-m #content_wrapper{margin-left:60px}body.sb-l-c.sb-l-m #content_wrapper{margin-left:0}body.sb-l-m .navbar-branding{width:60px}body.sb-l-m .navbar-brand{display:none}#sidebar_left.nano>.nano-content{padding-top:60px}#sidebar_left.affix.nano .tooltip{z-index:9999 !important}body.sb-l-m #sidebar_left.nano{position:absolute}body.sb-l-m #sidebar_left.nano>.nano-content{overflow:visible;right:0 !important}body.sb-l-m.mobile-view .nano>.nano-pane{display:none !important}.sidebar-menu>li>a:hover,.sidebar-menu>li>a:focus,.sidebar-menu>li>a:active{background-color:transparent}.sidebar-menu>li:hover>a:after,.sidebar-menu>li:focus>a:after{background:transparent}.sidebar-menu>li.active>a{background-color:transparent}.sidebar-menu>li.active>a>span:nth-child(1){color:#4a89dc}.sidebar-menu>li.active>a:after,.sidebar-menu>li>a.menu-open:after{background:transparent}.sidebar-menu>li>ul{background-color:#282d33}.sidebar-menu>li>ul>li>a:hover,.sidebar-menu>li>ul>li>a:focus{background-color:#22262c}.sidebar-menu>li>ul>li:hover>a:after,.sidebar-menu>li>ul>li:focus>a:after{background:#4a89dc}.sidebar-menu>li>ul>li.active>a{background-color:transparent}.sidebar-menu>li>ul>li.active>a>span:nth-child(1),.sidebar-menu>li>ul>li>a.menu-open>span:nth-child(1){color:#4a89dc}.sidebar-menu>li>ul>li.active>a:after,.sidebar-menu>li>ul>li>a.menu-open:after{background:#4a89dc}.sidebar-menu>li>ul>li ul{background-color:#22262c}.sidebar-menu>li>ul>li>ul>li>a:hover,.sidebar-menu>li>ul>li>ul>li>a:focus{background-color:transparent}.sidebar-menu>li>ul>li>ul>li:hover>a:after,.sidebar-menu>li>ul>li>ul>li:focus>a:after{background:#967adc}.sidebar-menu>li>ul>li>ul>li.active>a{background:transparent}.sidebar-menu>li>ul>li>ul>li.active>a>span:nth-child(1),.sidebar-menu>li>ul>li>ul>li>a.menu-open>span:nth-child(1){color:#ffffff}.sidebar-menu>li>ul>li>ul>li.active>a:after{background:#967adc}.sidebar-menu .sidebar-label{color:#70829a}.sidebar-menu>li a{color:#ffffff}.sidebar-menu li>a>span.caret{color:#ffffff}.sidebar-menu li>a.menu-open>span.caret{color:#4a89dc}.user-menu{background-color:#282d33}.user-menu a span{color:#dddddd}.user-menu a:hover{background-color:rgba(255,255,255,0.1)}.user-menu a:hover span{color:#4a89dc}#sidebar_left.sidebar-light{color:#666;background-color:#fafafa;border-right:1px solid #DDD}#sidebar_left.sidebar-light .sidebar-menu .sidebar-label{color:#AAA;font-size:11px;font-weight:500}#sidebar_left.sidebar-light .sidebar-menu li>a>span.caret{color:#BBB}#sidebar_left.sidebar-light .sidebar-menu li>a.menu-open>span.caret{color:#999}#sidebar_left.sidebar-light .sidebar-menu>li a{color:#888}#sidebar_left.sidebar-light .sidebar-menu>li>a:hover,#sidebar_left.sidebar-light .sidebar-menu>li>a:focus,#sidebar_left.sidebar-light .sidebar-menu>li>a:active{background-color:transparent}#sidebar_left.sidebar-light .sidebar-menu>li>a>span:nth-child(1){color:#888}#sidebar_left.sidebar-light .sidebar-menu>li>a>span:nth-child(2){color:#555;font-weight:500;letter-spacing:0.4px}#sidebar_left.sidebar-light .sidebar-menu>li.active>a>span:nth-child(1){color:#4a89dc}#sidebar_left.sidebar-light .sidebar-menu>li>ul{background-color:#f2f2f2;box-shadow:0 1px 0 #e5e5e5 inset,0 -1px 0 #e5e5e5 inset}#sidebar_left.sidebar-light .sidebar-menu>li>ul>li>a:hover,#sidebar_left.sidebar-light .sidebar-menu>li>ul>li>a:focus{background-color:transparent}#sidebar_left.sidebar-light .sidebar-menu>li>ul>li.active>a>span:nth-child(1),#sidebar_left.sidebar-light .sidebar-menu>li>ul>li>a.menu-open>span:nth-child(1){color:#4a89dc}#sidebar_left.sidebar-light .sidebar-menu>li>ul>li ul{background-color:#eaeaea;box-shadow:0 1px 0 #d9d9d9 inset,0 -1px 0 #d9d9d9 inset}#sidebar_left.sidebar-light .sidebar-menu>li>ul>li>ul>li>a:hover,#sidebar_left.sidebar-light .sidebar-menu>li>ul>li>ul>li>a:focus{background-color:transparent}#sidebar_left.sidebar-light .sidebar-menu>li>a.menu-open:after,#sidebar_left.sidebar-light .sidebar-menu>li>ul>li>a.menu-open:after{background:transparent}#sidebar_left.sidebar-light .sidebar-menu>li>ul>li>a.menu-open:after,#sidebar_left.sidebar-light .sidebar-menu>li>ul>li>ul>li>a.menu-open:after{background:#3bafda}#sidebar_left.sidebar-light .sidebar-menu>li>ul>li>ul>li.active>a:after,#sidebar_left.sidebar-light .sidebar-menu>li>ul>li>ul>li:hover>a:after,#sidebar_left.sidebar-light .sidebar-menu>li>ul>li>ul>li:focus>a:after{background:#f6bb42}#sidebar_left.sidebar-light .sidebar-menu>li>ul>li.active>a>span.caret{color:#AAA}#sidebar_left.sidebar-light .sidebar-menu .sidebar-stat .progress{background-color:#ddd}#sidebar_left.sidebar-light .sidebar-toggle-mini a{background-color:#f7f7f7;border-color:#eaeaea}#sidebar_left.sidebar-light.light{background-color:#fff}#sidebar_left.sidebar-light.light .sidebar-menu>li>ul{background-color:#fbfbfb}#sidebar_left.sidebar-light.light .sidebar-menu>li>ul>li ul{background-color:#f5f5f5}#sidebar_left.sidebar-light .user-menu{background-color:#f2f2f2;box-shadow:0 -1px 0 #e6e6e6 inset}#sidebar_left.sidebar-light .user-menu a span{color:#777}body.sb-l-m #sidebar_left.sidebar-light{background-color:#FAFAFA}body.sb-l-m #sidebar_left.sidebar-light.light{background-color:#FFF}body.sb-l-m #sidebar_left.sidebar-light .sidebar-menu>li>a>.sidebar-title,body.sb-l-m #sidebar_left.sidebar-light .sidebar-menu>li>ul{border:1px solid #DDD;border-top:0;background-color:#f8f8f8;left:59px;box-shadow:none}body.sb-l-m #sidebar_left.sidebar-light .sidebar-menu>li>a>.sidebar-title{border-top:1px solid #DDD}@media (max-width: 900px){body.sb-l-m #sidebar_left{width:45px}body.sb-l-m #sidebar_left:before{width:45px}body.sb-l-m .sidebar-menu>li>a>span:nth-child(1){left:-1px;width:45px;font-size:18px}body.sb-l-m .sidebar-menu>li>a>.sidebar-title{position:absolute;left:45px;top:-4px;width:180px;height:44px;line-height:44px;font-size:14px;padding-left:15px;border-left:1px solid #222;background-color:#282d33}body.sb-l-m .sidebar-menu>li>ul{position:absolute;left:45px;top:38px;width:180px;height:auto;border-left:1px solid #222;padding-bottom:7px;overflow:hidden}body.sb-l-m .sidebar-menu>li>ul>li ul{width:180px}body.sb-l-m .sidebar-menu li>ul>li>a{padding:8px 20px 8px 20px}body.sb-l-m .sidebar-menu li>ul>li>ul>li a{padding:8px 20px 8px 35px}body.sb-l-m #content_wrapper{margin-left:45px}body.sb-l-c.sb-l-m #content_wrapper{margin-left:0}body.sb-l-o .navbar-brand,body.sb-l-m .navbar-brand{display:none}body.sb-l-o .navbar-branding,body.sb-l-m .navbar-branding{max-width:45px;margin-right:5px}body.sb-l-o .navbar #toggle_sidemenu_l{transform:rotate(90deg)}body.sb-l-o.sb-l-m .navbar #toggle_sidemenu_l{transform:rotate(0deg)}body.sb-l-o .navbar #toggle_sidemenu_l,body.sb-l-m .navbar #toggle_sidemenu_l{width:45px}.sb-l-o .navbar .sidebar-menu-toggle,.sb-l-c .navbar .sidebar-menu-toggle{margin-left:10px;display:none}#toggle_sidemenu_r{margin-top:4px}}#sidebar_right{position:fixed;width:300px;height:100%;top:60px;right:-300px;border-left:1px solid #ddd;background:#f8f8f8}#sidebar_right .sidebar-right-header{width:100%;height:59px;padding:4px 10px 4px 20px}#sidebar_right .sidebar_right_content a:hover{text-decoration:none}.title-divider{border-bottom:1px solid #e8e8e8;padding:0 5px 9px 5px}#sidebar_right .panel{-webkit-box-shadow:none;box-shadow:none}#sidebar_right .panel-heading{height:51px;min-height:51px;overflow:hidden}#sidebar_right .panel-tabs li a{padding:17px 18px;border-right:1px solid transparent}#sidebar_right .panel-tabs li:first-child a{border-left:1px solid transparent}#sidebar_right.nano>.nano-pane{background:rgba(0,0,0,0.07)}#sidebar_right.nano>.nano-pane>.nano-slider{background:#444;background:#CCC}.sb-l-o #sidebar_left{left:0;overflow:hidden}.sb-l-o #content_wrapper{margin-left:230px}.sb-l-c #sidebar_left{left:-230px;overflow:hidden}.sb-l-c #content_wrapper{margin-left:0}.sb-l-c .navbar-branding{width:60px}.sb-l-c .navbar-brand{display:none}.sb-r-o #sidebar_right{right:0}.sb-r-o #content_wrapper{margin-right:300px}.sb-r-c #sidebar_right{right:-300px}.sb-r-c #content_wrapper{margin-right:0}.sb-l-c.sb-l-m #sidebar_left{left:-60px}.sb-l-m .navbar .sidebar-menu-toggle,.sb-l-c .navbar .sidebar-menu-toggle{margin-left:10px;display:none}@media (max-width: 1100px){#content_wrapper,.sb-l-o #content_wrapper{margin-left:0;left:230px}.sb-l-m #content_wrapper{left:0}.sb-l-c #content_wrapper{margin-left:0;left:0}.sb-r-o #content_wrapper{margin-right:0;left:-300px}}#topbar{z-index:2;position:relative;width:100%;min-height:51px;padding:10px 21px;background:#fafafa;border-bottom:1px solid #e0e0e0}.topbar-right{float:right}.breadcrumb{float:left;position:relative;padding:1px 25px 0 0;margin-bottom:0;font-size:14px;border-radius:0;background-color:transparent}.breadcrumb>li{color:#888;font-size:12px}.breadcrumb>li.crumb-active>a{color:#555;font-size:18px}#toggle_sidemenu_r i.fa,#toggle_sidemenu_r span.glyphicon,#toggle_sidemenu_r span.glyphicons{margin-top:2px}body.sb-r-o #toggle_sidemenu_r i.fa,body.sb-r-o #toggle_sidemenu_r span.glyphicon,body.sb-r-o #toggle_sidemenu_r span.glyphicons{-webkit-transform:scale(-1, 1);transform:scale(-1, 1);color:#999}.badge.badge-hero{position:relative;top:-12px;margin-left:-10px;padding:2px 5px;font-size:11px}#topbar-dropmenu{z-index:9999;overflow:hidden;display:none;position:relative;padding:17px 20px 10px;height:auto;width:100%;background:url("../../../img/patterns/topbar-bg.jpg") repeat -60px top;-webkit-box-shadow:0 0 4px rgba(0,0,0,0.4) inset;box-shadow:0 0 4px rgba(0,0,0,0.4) inset}#topbar-dropmenu:before{content:"";position:absolute;top:0;bottom:0;right:0;left:0;background:rgba(0,0,0,0.4)}.topbar-menu .metro-tile{opacity:0;display:block;color:#FFF;height:95px;position:relative;padding:15px 5px 0;margin-bottom:8px;border-radius:4px;text-align:center;background:rgba(255,255,255,0.25) !important;transition:background 0.2s ease}.topbar-menu .metro-tile:hover,.topbar-menu .metro-tile:focus,.topbar-menu .metro-tile:active{color:#fff;background:rgba(255,255,255,0.4) !important}.topbar-menu .metro-tile span:first-child{font-size:44px}.topbar-menu .metro-tile .metro-title{position:absolute;bottom:10px;left:10px;font-size:11px;font-weight:600}.metro-modal{cursor:pointer;position:fixed;display:none;left:0;right:0;top:0;bottom:0;z-index:9998;background:rgba(0,0,0,0.6)}@media (max-width: 700px){#topbar .breadcrumb{padding-top:3px;padding-left:2px}#topbar .breadcrumb .crumb-active{display:none}#topbar .breadcrumb>li.crumb-active+li:before{display:none}}@media (max-width: 900px){body.sb-l-m #topbar.affix,body.sb-l-o.sb-l-m #topbar.affix{margin-left:45px;width:auto}body.sb-l-o #topbar.affix{margin-left:230px;width:100%}}#topbar .nav.nav-list-topbar{margin:-10px 15px}#topbar .nav.nav-list-topbar li a{padding:16px 14px 12px}#topbar .nav.nav-list-topbar li.active a{border-bottom:3px solid #4a89dc}.search-results-page .search-result+.search-result{margin-top:31px;padding-top:20px;border-top:1px dashed #DDD}.search-results-page .search-result h3,.search-results-page .search-result>a{display:block;margin-bottom:5px}.search-results-page ul.result-meta{list-style:none;padding-left:0;margin-left:-5px;margin-bottom:5px}.search-results-page ul.result-meta>li{position:relative;display:inline-block;padding-left:5px;padding-right:5px}.search-results-page ul.result-meta>li+li{padding-left:12px}.search-results-page ul.result-meta>li+li:after{content:"-";position:absolute;top:0;left:0}.search-results-page ul.result-meta>li>a{font-size:13px;color:#999}#session-timeout-dialog .modal-dialog{width:102%;height:100%;background:rgba(255,255,255,0.93);margin-top:0;margin-bottom:0;padding-top:15%;text-align:center;border-radius:1px}#session-timeout-dialog .modal-content{background:none;box-shadow:none;border:1px solid #DDD;width:600px;margin:0 auto}#session-timeout-dialog .modal-header{background-color:#f6f6f6}#session-timeout-dialog .modal-body{padding:30px 20px;font-size:16px;background-color:#fff}#session-timeout-dialog .modal-footer{text-align:center;background-color:#f6f6f6}.bg-primary{background-color:#4a89dc !important;color:#f5f8fd}a.bg-primary:hover{background-color:#276ecc !important}.bg-primary .text-muted{color:#c5dcfa}.bg-primary .text-darken{color:#276ecc}.bg-primary.light{background-color:#649ae1 !important}.bg-primary.lighter{background-color:#75a5e4 !important}.bg-primary.dark{background-color:#3078d7 !important}.bg-primary.darker{background-color:#276ecc !important}.bg-primary .open>a,.bg-primary .open>a:hover,.bg-primary .open>a:focus{color:#ffffff}.bg-success{background-color:#70ca63 !important;color:#fcfefb}a.bg-success:hover{background-color:#4fbb3f !important}.bg-success .text-muted{color:#d6f5d1}.bg-success .text-darken{color:#4fbb3f}.bg-success.light{background-color:#85d27a !important}.bg-success.lighter{background-color:#93d789 !important}.bg-success.dark{background-color:#5bc24c !important}.bg-success.darker{background-color:#4fbb3f !important}.bg-success .open>a,.bg-success .open>a:hover,.bg-success .open>a:focus{color:#ffffff}.bg-info{background-color:#3bafda !important;color:#e7f5fa}a.bg-info:hover{background-color:#2494be !important}.bg-info .text-muted{color:#b6e6f8}.bg-info .text-darken{color:#2494be}.bg-info.light{background-color:#55badf !important}.bg-info.lighter{background-color:#66c1e2 !important}.bg-info.dark{background-color:#27a2cf !important}.bg-info.darker{background-color:#2494be !important}.bg-info .open>a,.bg-info .open>a:hover,.bg-info .open>a:focus{color:#ffffff}.bg-warning{background-color:#f6bb42 !important;color:#ffffff}a.bg-warning:hover{background-color:#f4a911 !important}.bg-warning .text-muted{color:#fff0d2}.bg-warning .text-darken{color:#f4a911}.bg-warning.light{background-color:#f7c65f !important}.bg-warning.lighter{background-color:#f8cd73 !important}.bg-warning.dark{background-color:#f5b025 !important}.bg-warning.darker{background-color:#f4a911 !important}.bg-warning .open>a,.bg-warning .open>a:hover,.bg-warning .open>a:focus{color:#ffffff}.bg-danger{background-color:#e9573f !important;color:#fef7f6}a.bg-danger:hover{background-color:#dc3519 !important}.bg-danger .text-muted{color:#fdccc4}.bg-danger .text-darken{color:#dc3519}.bg-danger.light{background-color:#ec6f5a !important}.bg-danger.lighter{background-color:#ee7f6d !important}.bg-danger.dark{background-color:#e63f24 !important}.bg-danger.darker{background-color:#dc3519 !important}.bg-danger .open>a,.bg-danger .open>a:hover,.bg-danger .open>a:focus{color:#ffffff}.bg-alert{background-color:#967adc !important;color:#ffffff}a.bg-alert:hover{background-color:#7652d1 !important}.bg-alert .text-muted{color:#f5f2fd}.bg-alert .text-darken{color:#7652d1}.bg-alert.light{background-color:#a992e2 !important}.bg-alert.lighter{background-color:#b6a2e7 !important}.bg-alert.dark{background-color:#8362d6 !important}.bg-alert.darker{background-color:#7652d1 !important}.bg-alert .open>a,.bg-alert .open>a:hover,.bg-alert .open>a:focus{color:#ffffff}.bg-system{background-color:#37bc9b !important;color:#cef1e8}a.bg-system:hover{background-color:#2b957a !important}.bg-system .text-muted{color:#9eeeda}.bg-system .text-darken{color:#2b957a}.bg-system.light{background-color:#48c9a9 !important}.bg-system.lighter{background-color:#58ceb1 !important}.bg-system.dark{background-color:#30a487 !important}.bg-system.darker{background-color:#2b957a !important}.bg-system .open>a,.bg-system .open>a:hover,.bg-system .open>a:focus{color:#ffffff}.bg-dark{background-color:#3b3f4f !important;color:#9fa4b7}a.bg-dark:hover{background-color:#252832 !important}.bg-dark .text-muted{color:#717eb2}.bg-dark .text-darken{color:#252832}.bg-dark.light{background-color:#484d61 !important}.bg-dark.lighter{background-color:#51566c !important}.bg-dark.dark{background-color:#2e313d !important}.bg-dark.darker{background-color:#252832 !important}.bg-dark .open>a,.bg-dark .open>a:hover,.bg-dark .open>a:focus{color:#ffffff}.bg-light{background-color:#FAFAFA;color:#666}a.bg-light:hover{background-color:#e8e8e8 !important}.bg-light .text-muted{color:#999}.bg-light .text-darken{color:#222}.bg-light.light{background-color:#FEFEFE}.bg-light.lighter{background-color:#FFF}.bg-light.dark{background-color:#F2F2F2}.bg-light.darker{background-color:#E7E7E7}.bg-white{background-color:#FAFAFA;color:#666;background-color:#FFF !important}a.bg-white:hover{background-color:#ededed !important}.bg-white .text-muted{color:#999}.bg-white .text-darken{color:#222}.bg-white.light{background-color:#FEFEFE}.bg-white.lighter{background-color:#FFF}.bg-white.dark{background-color:#F2F2F2}.bg-white.darker{background-color:#E7E7E7}.badge-default{background-color:#777777}.badge-default[href]:hover,.badge-default[href]:focus{background-color:#5e5e5e}.badge-primary{background-color:#4a89dc}.badge-primary[href]:hover,.badge-primary[href]:focus{background-color:#276ecc}.badge-success{background-color:#70ca63}.badge-success[href]:hover,.badge-success[href]:focus{background-color:#4fbb3f}.badge-info{background-color:#3bafda}.badge-info[href]:hover,.badge-info[href]:focus{background-color:#2494be}.badge-warning{background-color:#f6bb42}.badge-warning[href]:hover,.badge-warning[href]:focus{background-color:#f4a911}.badge-danger{background-color:#e9573f}.badge-danger[href]:hover,.badge-danger[href]:focus{background-color:#dc3519}.badge-alert{background-color:#967adc}.badge-alert[href]:hover,.badge-alert[href]:focus{background-color:#7652d1}.badge-system{background-color:#37bc9b}.badge-system[href]:hover,.badge-system[href]:focus{background-color:#2b957a}.badge-dark{background-color:#3b3f4f}.badge-dark[href]:hover,.badge-dark[href]:focus{background-color:#252832}.label-muted{background-color:#aaaaaa}.label-muted[href]:hover,.label-muted[href]:focus{background-color:#919191}.label-default{background-color:#777777}.label-default[href]:hover,.label-default[href]:focus{background-color:#5e5e5e}.label-primary{background-color:#4a89dc}.label-primary[href]:hover,.label-primary[href]:focus{background-color:#276ecc}.label-success{background-color:#70ca63}.label-success[href]:hover,.label-success[href]:focus{background-color:#4fbb3f}.label-info{background-color:#3bafda}.label-info[href]:hover,.label-info[href]:focus{background-color:#2494be}.label-warning{background-color:#f6bb42}.label-warning[href]:hover,.label-warning[href]:focus{background-color:#f4a911}.label-danger{background-color:#e9573f}.label-danger[href]:hover,.label-danger[href]:focus{background-color:#dc3519}.label-alert{background-color:#967adc}.label-alert[href]:hover,.label-alert[href]:focus{background-color:#7652d1}.label-system{background-color:#37bc9b}.label-system[href]:hover,.label-system[href]:focus{background-color:#2b957a}.label-dark{background-color:#3b3f4f}.label-dark[href]:hover,.label-dark[href]:focus{background-color:#252832}.btn-default{color:#666666;background-color:#f0f0f0;border-color:rgba(0,0,0,0.1)}.btn-default:hover,.btn-default:focus,.btn-default:active,.btn-default.active,.open>.dropdown-toggle.btn-default{color:#666666;background-color:#eaeaea}.btn-default:active,.btn-default.active,.open>.dropdown-toggle.btn-default{background-image:none}.btn-default.disabled,.btn-default[disabled],fieldset[disabled] .btn-default,.btn-default.disabled:hover,.btn-default[disabled]:hover,fieldset[disabled] .btn-default:hover,.btn-default.disabled:focus,.btn-default[disabled]:focus,fieldset[disabled] .btn-default:focus,.btn-default.disabled:active,.btn-default[disabled]:active,fieldset[disabled] .btn-default:active,.btn-default.disabled.active,.btn-default[disabled].active,fieldset[disabled] .btn-default.active{background-color:#f0f0f0;border-color:#dddddd}.btn-default .badge{color:#f0f0f0;background-color:#666666}.btn-default.btn-gradient{text-shadow:0 -1px 0 rgba(255,255,255,0.4);border-color:rgba(0,0,0,0.07) rgba(0,0,0,0.1) rgba(0,0,0,0.09);background-image:-webkit-linear-gradient(top, rgba(255,255,255,0.9) 10%, rgba(255,255,255,0.3) 100%);background-image:linear-gradient(to bottom, rgba(255,255,255,0.9) 10%, rgba(255,255,255,0.3) 100%);filter:progid:DXImageTransform.Microsoft.gradient(startColorstr='#80ffffff', endColorstr='#00ffffff', GradientType=0)}.btn-default.light{background-color:#FAFAFA}.btn-default.light:hover,.btn-default.light:focus,.btn-default.light:active,.btn-default.light.active,.open>.dropdown-toggle.btn-default.light{background-color:#ececec}.btn-default.dark{background-color:#e8e8e8}.btn-default.dark:hover,.btn-default.dark:focus,.btn-default.dark:active,.btn-default.dark.active,.open>.dropdown-toggle.btn-default.dark{background-color:#e1e1e1}.btn-primary{color:#ffffff;background-color:#4a89dc}.btn-primary:hover,.btn-primary:focus,.btn-primary:active,.btn-primary.active,.open>.dropdown-toggle.btn-primary{color:#ffffff;background-color:#2a74d6;border-color:rgba(0,0,0,0.05)}.btn-primary:active,.btn-primary.active,.open>.dropdown-toggle.btn-primary{background-image:none}.btn-primary.disabled,.btn-primary[disabled],fieldset[disabled] .btn-primary,.btn-primary.disabled:hover,.btn-primary[disabled]:hover,fieldset[disabled] .btn-primary:hover,.btn-primary.disabled:focus,.btn-primary[disabled]:focus,fieldset[disabled] .btn-primary:focus,.btn-primary.disabled:active,.btn-primary[disabled]:active,fieldset[disabled] .btn-primary:active,.btn-primary.disabled.active,.btn-primary[disabled].active,fieldset[disabled] .btn-primary.active{background-color:#4a89dc;border-color:#4a89dc}.btn-primary .badge{color:#4a89dc;background-color:#ffffff}.btn-primary.light{background-color:#649ae1}.btn-primary.light:hover,.btn-primary.light:focus,.btn-primary.light:active,.btn-primary.light.active,.open>.dropdown-toggle.btn-primary.light{background-color:#3078d7}.btn-primary.dark{background-color:#3078d7}.btn-primary.dark:hover,.btn-primary.dark:focus,.btn-primary.dark:active,.btn-primary.dark.active,.open>.dropdown-toggle.btn-primary.dark{background-color:#266ac3}.btn-success{color:#ffffff;background-color:#70ca63}.btn-success:hover,.btn-success:focus,.btn-success:active,.btn-success.active,.open>.dropdown-toggle.btn-success{color:#ffffff;background-color:#56c046;border-color:rgba(0,0,0,0.05)}.btn-success:active,.btn-success.active,.open>.dropdown-toggle.btn-success{background-image:none}.btn-success.disabled,.btn-success[disabled],fieldset[disabled] .btn-success,.btn-success.disabled:hover,.btn-success[disabled]:hover,fieldset[disabled] .btn-success:hover,.btn-success.disabled:focus,.btn-success[disabled]:focus,fieldset[disabled] .btn-success:focus,.btn-success.disabled:active,.btn-success[disabled]:active,fieldset[disabled] .btn-success:active,.btn-success.disabled.active,.btn-success[disabled].active,fieldset[disabled] .btn-success.active{background-color:#70ca63;border-color:#70ca63}.btn-success .badge{color:#70ca63;background-color:#ffffff}.btn-success.light{background-color:#85d27a}.btn-success.light:hover,.btn-success.light:focus,.btn-success.light:active,.btn-success.light.active,.open>.dropdown-toggle.btn-success.light{background-color:#5bc24c}.btn-success.dark{background-color:#5bc24c}.btn-success.dark:hover,.btn-success.dark:focus,.btn-success.dark:active,.btn-success.dark.active,.open>.dropdown-toggle.btn-success.dark{background-color:#4cb33d}.btn-info{color:#ffffff;background-color:#3bafda}.btn-info:hover,.btn-info:focus,.btn-info:active,.btn-info.active,.open>.dropdown-toggle.btn-info{color:#ffffff;background-color:#269dc9;border-color:rgba(0,0,0,0.05)}.btn-info:active,.btn-info.active,.open>.dropdown-toggle.btn-info{background-image:none}.btn-info.disabled,.btn-info[disabled],fieldset[disabled] .btn-info,.btn-info.disabled:hover,.btn-info[disabled]:hover,fieldset[disabled] .btn-info:hover,.btn-info.disabled:focus,.btn-info[disabled]:focus,fieldset[disabled] .btn-info:focus,.btn-info.disabled:active,.btn-info[disabled]:active,fieldset[disabled] .btn-info:active,.btn-info.disabled.active,.btn-info[disabled].active,fieldset[disabled] .btn-info.active{background-color:#3bafda;border-color:#3bafda}.btn-info .badge{color:#3bafda;background-color:#ffffff}.btn-info.light{background-color:#55badf}.btn-info.light:hover,.btn-info.light:focus,.btn-info.light:active,.btn-info.light.active,.open>.dropdown-toggle.btn-info.light{background-color:#27a2cf}.btn-info.dark{background-color:#27a2cf}.btn-info.dark:hover,.btn-info.dark:focus,.btn-info.dark:active,.btn-info.dark.active,.open>.dropdown-toggle.btn-info.dark{background-color:#228eb6}.btn-warning{color:#ffffff;background-color:#f6bb42}.btn-warning:hover,.btn-warning:focus,.btn-warning:active,.btn-warning.active,.open>.dropdown-toggle.btn-warning{color:#ffffff;background-color:#f4ae1d;border-color:rgba(0,0,0,0.05)}.btn-warning:active,.btn-warning.active,.open>.dropdown-toggle.btn-warning{background-image:none}.btn-warning.disabled,.btn-warning[disabled],fieldset[disabled] .btn-warning,.btn-warning.disabled:hover,.btn-warning[disabled]:hover,fieldset[disabled] .btn-warning:hover,.btn-warning.disabled:focus,.btn-warning[disabled]:focus,fieldset[disabled] .btn-warning:focus,.btn-warning.disabled:active,.btn-warning[disabled]:active,fieldset[disabled] .btn-warning:active,.btn-warning.disabled.active,.btn-warning[disabled].active,fieldset[disabled] .btn-warning.active{background-color:#f6bb42;border-color:#f6bb42}.btn-warning .badge{color:#f6bb42;background-color:#ffffff}.btn-warning.light{background-color:#f7c65f}.btn-warning.light:hover,.btn-warning.light:focus,.btn-warning.light:active,.btn-warning.light.active,.open>.dropdown-toggle.btn-warning.light{background-color:#f5b025}.btn-warning.dark{background-color:#f5b025}.btn-warning.dark:hover,.btn-warning.dark:focus,.btn-warning.dark:active,.btn-warning.dark.active,.open>.dropdown-toggle.btn-warning.dark{background-color:#efa50b}.btn-danger{color:#ffffff;background-color:#e9573f}.btn-danger:hover,.btn-danger:focus,.btn-danger:active,.btn-danger.active,.open>.dropdown-toggle.btn-danger{color:#ffffff;background-color:#e5391d;border-color:rgba(0,0,0,0.05)}.btn-danger:active,.btn-danger.active,.open>.dropdown-toggle.btn-danger{background-image:none}.btn-danger.disabled,.btn-danger[disabled],fieldset[disabled] .btn-danger,.btn-danger.disabled:hover,.btn-danger[disabled]:hover,fieldset[disabled] .btn-danger:hover,.btn-danger.disabled:focus,.btn-danger[disabled]:focus,fieldset[disabled] .btn-danger:focus,.btn-danger.disabled:active,.btn-danger[disabled]:active,fieldset[disabled] .btn-danger:active,.btn-danger.disabled.active,.btn-danger[disabled].active,fieldset[disabled] .btn-danger.active{background-color:#e9573f;border-color:#e9573f}.btn-danger .badge{color:#e9573f;background-color:#ffffff}.btn-danger.light{background-color:#ec6f5a}.btn-danger.light:hover,.btn-danger.light:focus,.btn-danger.light:active,.btn-danger.light.active,.open>.dropdown-toggle.btn-danger.light{background-color:#e63f24}.btn-danger.dark{background-color:#e63f24}.btn-danger.dark:hover,.btn-danger.dark:focus,.btn-danger.dark:active,.btn-danger.dark.active,.open>.dropdown-toggle.btn-danger.dark{background-color:#d33218}.btn-alert{color:#ffffff;background-color:#967adc}.btn-alert:hover,.btn-alert:focus,.btn-alert:active,.btn-alert.active,.open>.dropdown-toggle.btn-alert{color:#ffffff;background-color:#7e5cd4;border-color:rgba(0,0,0,0.05)}.btn-alert:active,.btn-alert.active,.open>.dropdown-toggle.btn-alert{background-image:none}.btn-alert.disabled,.btn-alert[disabled],fieldset[disabled] .btn-alert,.btn-alert.disabled:hover,.btn-alert[disabled]:hover,fieldset[disabled] .btn-alert:hover,.btn-alert.disabled:focus,.btn-alert[disabled]:focus,fieldset[disabled] .btn-alert:focus,.btn-alert.disabled:active,.btn-alert[disabled]:active,fieldset[disabled] .btn-alert:active,.btn-alert.disabled.active,.btn-alert[disabled].active,fieldset[disabled] .btn-alert.active{background-color:#967adc;border-color:#967adc}.btn-alert .badge{color:#967adc;background-color:#ffffff}.btn-alert.light{background-color:#a992e2}.btn-alert.light:hover,.btn-alert.light:focus,.btn-alert.light:active,.btn-alert.light.active,.open>.dropdown-toggle.btn-alert.light{background-color:#8362d6}.btn-alert.dark{background-color:#8362d6}.btn-alert.dark:hover,.btn-alert.dark:focus,.btn-alert.dark:active,.btn-alert.dark.active,.open>.dropdown-toggle.btn-alert.dark{background-color:#704acf}.btn-system{color:#ffffff;background-color:#37bc9b}.btn-system:hover,.btn-system:focus,.btn-system:active,.btn-system.active,.open>.dropdown-toggle.btn-system{color:#ffffff;background-color:#2e9e83;border-color:rgba(0,0,0,0.05)}.btn-system:active,.btn-system.active,.open>.dropdown-toggle.btn-system{background-image:none}.btn-system.disabled,.btn-system[disabled],fieldset[disabled] .btn-system,.btn-system.disabled:hover,.btn-system[disabled]:hover,fieldset[disabled] .btn-system:hover,.btn-system.disabled:focus,.btn-system[disabled]:focus,fieldset[disabled] .btn-system:focus,.btn-system.disabled:active,.btn-system[disabled]:active,fieldset[disabled] .btn-system:active,.btn-system.disabled.active,.btn-system[disabled].active,fieldset[disabled] .btn-system.active{background-color:#37bc9b;border-color:#37bc9b}.btn-system .badge{color:#37bc9b;background-color:#ffffff}.btn-system.light{background-color:#48c9a9}.btn-system.light:hover,.btn-system.light:focus,.btn-system.light:active,.btn-system.light.active,.open>.dropdown-toggle.btn-system.light{background-color:#30a487}.btn-system.dark{background-color:#30a487}.btn-system.dark:hover,.btn-system.dark:focus,.btn-system.dark:active,.btn-system.dark.active,.open>.dropdown-toggle.btn-system.dark{background-color:#298d74}.btn-dark{color:#ffffff;background-color:#3b3f4f}.btn-dark:hover,.btn-dark:focus,.btn-dark:active,.btn-dark.active,.open>.dropdown-toggle.btn-dark{color:#ffffff;background-color:#2b2e39;border-color:rgba(0,0,0,0.05)}.btn-dark:active,.btn-dark.active,.open>.dropdown-toggle.btn-dark{background-image:none}.btn-dark.disabled,.btn-dark[disabled],fieldset[disabled] .btn-dark,.btn-dark.disabled:hover,.btn-dark[disabled]:hover,fieldset[disabled] .btn-dark:hover,.btn-dark.disabled:focus,.btn-dark[disabled]:focus,fieldset[disabled] .btn-dark:focus,.btn-dark.disabled:active,.btn-dark[disabled]:active,fieldset[disabled] .btn-dark:active,.btn-dark.disabled.active,.btn-dark[disabled].active,fieldset[disabled] .btn-dark.active{background-color:#3b3f4f;border-color:#3b3f4f}.btn-dark .badge{color:#3b3f4f;background-color:#ffffff}.btn-dark.light{background-color:#484d61}.btn-dark.light:hover,.btn-dark.light:focus,.btn-dark.light:active,.btn-dark.light.active,.open>.dropdown-toggle.btn-dark.light{background-color:#2e313d}.btn-dark.dark{background-color:#2e313d}.btn-dark.dark:hover,.btn-dark.dark:focus,.btn-dark.dark:active,.btn-dark.dark.active,.open>.dropdown-toggle.btn-dark.dark{background-color:#21232c}.btn.btn-alt.btn-default{border-left-color:#AAA}.btn.btn-alt.btn-primary{border-left-color:#4a89dc}.btn.btn-alt.btn-success{border-left-color:#70ca63}.btn.btn-alt.btn-info{border-left-color:#3bafda}.btn.btn-alt.btn-warning{border-left-color:#f6bb42}.btn.btn-alt.btn-danger{border-left-color:#e9573f}.btn.btn-alt.btn-alert{border-left-color:#967adc}.btn.btn-alt.btn-system{border-left-color:#37bc9b}.btn.btn-alt.btn-dark{border-left-color:#3b3f4f}.radio-custom.radio-primary label:before,.checkbox-custom.checkbox-primary label:before{border-color:#649ae1}.radio-custom.radio-primary input[type=radio]:checked+label:after,.radio-custom.radio-primary input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-primary input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-primary input[type=radio]:checked+label:after{background-color:#649ae1;color:#649ae1}.checkbox-custom.fill.checkbox-primary label:before{background-color:#649ae1}.radio-custom.radio-success label:before,.checkbox-custom.checkbox-success label:before{border-color:#85d27a}.radio-custom.radio-success input[type=radio]:checked+label:after,.radio-custom.radio-success input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-success input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-success input[type=radio]:checked+label:after{background-color:#85d27a;color:#85d27a}.checkbox-custom.fill.checkbox-success label:before{background-color:#85d27a}.radio-custom.radio-info label:before,.checkbox-custom.checkbox-info label:before{border-color:#55badf}.radio-custom.radio-info input[type=radio]:checked+label:after,.radio-custom.radio-info input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-info input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-info input[type=radio]:checked+label:after{background-color:#55badf;color:#55badf}.checkbox-custom.fill.checkbox-info label:before{background-color:#55badf}.radio-custom.radio-warning label:before,.checkbox-custom.checkbox-warning label:before{border-color:#f7c65f}.radio-custom.radio-warning input[type=radio]:checked+label:after,.radio-custom.radio-warning input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-warning input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-warning input[type=radio]:checked+label:after{background-color:#f7c65f;color:#f7c65f}.checkbox-custom.fill.checkbox-warning label:before{background-color:#f7c65f}.radio-custom.radio-danger label:before,.checkbox-custom.checkbox-danger label:before{border-color:#ec6f5a}.radio-custom.radio-danger input[type=radio]:checked+label:after,.radio-custom.radio-danger input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-danger input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-danger input[type=radio]:checked+label:after{background-color:#ec6f5a;color:#ec6f5a}.checkbox-custom.fill.checkbox-danger label:before{background-color:#ec6f5a}.radio-custom.radio-alert label:before,.checkbox-custom.checkbox-alert label:before{border-color:#a992e2}.radio-custom.radio-alert input[type=radio]:checked+label:after,.radio-custom.radio-alert input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-alert input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-alert input[type=radio]:checked+label:after{background-color:#a992e2;color:#a992e2}.checkbox-custom.fill.checkbox-alert label:before{background-color:#a992e2}.radio-custom.radio-system label:before,.checkbox-custom.checkbox-system label:before{border-color:#48c9a9}.radio-custom.radio-system input[type=radio]:checked+label:after,.radio-custom.radio-system input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-system input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-system input[type=radio]:checked+label:after{background-color:#48c9a9;color:#48c9a9}.checkbox-custom.fill.checkbox-system label:before{background-color:#48c9a9}.radio-custom.radio-dark label:before,.checkbox-custom.checkbox-dark label:before{border-color:#484d61}.radio-custom.radio-dark input[type=radio]:checked+label:after,.radio-custom.radio-dark input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-dark input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-dark input[type=radio]:checked+label:after{background-color:#484d61;color:#484d61}.checkbox-custom.fill.checkbox-dark label:before{background-color:#484d61}.radio-custom.radio-light label:before,.checkbox-custom.checkbox-light label:before{border-color:#eee}.radio-custom.radio-light input[type=radio]:checked+label:after,.radio-custom.radio-light input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-light input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-light input[type=radio]:checked+label:after{background-color:#666;color:#666 !important}.checkbox-custom.fill.checkbox-light label:before{background-color:#eee}.radio-custom.radio-disabled label:before,.checkbox-custom.checkbox-disabled label:before{border-color:#b9b9b9}.radio-custom.radio-disabled input[type=radio]:checked+label:after,.radio-custom.radio-disabled input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-disabled input[type=checkbox]:checked+label:after,.checkbox-custom.checkbox-disabled input[type=radio]:checked+label:after{background-color:#b9b9b9;color:#b9b9b9}.checkbox-custom.fill.checkbox-disabled label:before{background-color:#b9b9b9}.list-group-item-primary{color:#1f57a1;border-color:#97bbeb;background-color:#caddf5}a.list-group-item-primary{color:#1f57a1}a.list-group-item-primary .list-group-item-heading{color:inherit}a.list-group-item-primary:hover,a.list-group-item-primary:focus{color:#1f57a1;background-color:#dbe8f8}a.list-group-item-primary.active,a.list-group-item-primary.active:hover,a.list-group-item-primary.active:focus{color:#fff;background-color:#4a89dc;border-color:#4a89dc}.list-group-item-success{color:#3f9532;border-color:#afe1a8;background-color:#d9f1d5}a.list-group-item-success{color:#3f9532}a.list-group-item-success .list-group-item-heading{color:inherit}a.list-group-item-success:hover,a.list-group-item-success:focus{color:#3f9532;background-color:#e7f6e4}a.list-group-item-success.active,a.list-group-item-success.active:hover,a.list-group-item-success.active:focus{color:#fff;background-color:#70ca63;border-color:#70ca63}.list-group-item-info{color:#1c7393;border-color:#88cfe9;background-color:#bce4f2}a.list-group-item-info{color:#1c7393}a.list-group-item-info .list-group-item-heading{color:inherit}a.list-group-item-info:hover,a.list-group-item-info:focus{color:#1c7393;background-color:#cdebf6}a.list-group-item-info.active,a.list-group-item-info.active:hover,a.list-group-item-info.active:focus{color:#fff;background-color:#3bafda;border-color:#3bafda}.list-group-item-warning{color:#c88a0a;border-color:#fadb9a;background-color:#fdf0d4}a.list-group-item-warning{color:#c88a0a}a.list-group-item-warning .list-group-item-heading{color:inherit}a.list-group-item-warning:hover,a.list-group-item-warning:focus{color:#c88a0a;background-color:#fef7e8}a.list-group-item-warning.active,a.list-group-item-warning.active:hover,a.list-group-item-warning.active:focus{color:#fff;background-color:#f6bb42;border-color:#f6bb42}.list-group-item-danger{color:#bc2d16;border-color:#f4ab9f;background-color:#fadbd6}a.list-group-item-danger{color:#bc2d16}a.list-group-item-danger .list-group-item-heading{color:inherit}a.list-group-item-danger:hover,a.list-group-item-danger:focus{color:#bc2d16;background-color:#fcebe8}a.list-group-item-danger.active,a.list-group-item-danger.active:hover,a.list-group-item-danger.active:focus{color:#fff;background-color:#e9573f;border-color:#e9573f}.list-group-item-alert{color:#542fb2;border-color:#c6b7ec;background-color:#ece7f9}a.list-group-item-alert{color:#542fb2}a.list-group-item-alert .list-group-item-heading{color:inherit}a.list-group-item-alert:hover,a.list-group-item-alert:focus{color:#542fb2;background-color:#f9f7fd}a.list-group-item-alert.active,a.list-group-item-alert.active:hover,a.list-group-item-alert.active:focus{color:#fff;background-color:#967adc;border-color:#967adc}.list-group-item-system{color:#206d5a;border-color:#77d7c0;background-color:#a7e5d6}a.list-group-item-system{color:#206d5a}a.list-group-item-system .list-group-item-heading{color:inherit}a.list-group-item-system:hover,a.list-group-item-system:focus{color:#206d5a;background-color:#b7eadd}a.list-group-item-system.active,a.list-group-item-system.active:hover,a.list-group-item-system.active:focus{color:#fff;background-color:#37bc9b;border-color:#37bc9b}.list-group-item-dark{color:#3b3f4f;border-color:#999eb3;background-color:#bcbfcd}a.list-group-item-dark{color:#3b3f4f}a.list-group-item-dark .list-group-item-heading{color:inherit}a.list-group-item-dark:hover,a.list-group-item-dark:focus{color:#3b3f4f;background-color:#c8cbd6}a.list-group-item-dark.active,a.list-group-item-dark.active:hover,a.list-group-item-dark.active:focus{color:#fff;background-color:#3b3f4f;border-color:#3b3f4f}.panel-primary.panel-border{border-color:#4a89dc}.panel-primary>.panel-heading{color:#ffffff;background-color:#4a89dc;border-color:#4a89dc}.panel-primary>.panel-heading+.panel-collapse>.panel-body{border-top-color:#4a89dc}.panel-primary>.panel-heading .badge{color:#4a89dc;background-color:#ffffff}.panel-primary>.panel-heading>.panel-title{color:#ffffff}.panel-primary>.panel-footer+.panel-collapse>.panel-body{border-bottom-color:#4a89dc}.panel-primary>.panel-body.fill{color:#FFF;border-color:#82ade7;background-color:#82ade7}.panel-primary>.panel-body.border{border:3px solid #4a89dc}.panel-success.panel-border{border-color:#70ca63}.panel-success>.panel-heading{color:#ffffff;background-color:#70ca63;border-color:#70ca63}.panel-success>.panel-heading+.panel-collapse>.panel-body{border-top-color:#70ca63}.panel-success>.panel-heading .badge{color:#70ca63;background-color:#ffffff}.panel-success>.panel-heading>.panel-title{color:#ffffff}.panel-success>.panel-footer+.panel-collapse>.panel-body{border-bottom-color:#70ca63}.panel-success>.panel-body.fill{color:#FFF;border-color:#9ddb94;background-color:#9ddb94}.panel-success>.panel-body.border{border:3px solid #70ca63}.panel-info.panel-border{border-color:#3bafda}.panel-info>.panel-heading{color:#ffffff;background-color:#3bafda;border-color:#3bafda}.panel-info>.panel-heading+.panel-collapse>.panel-body{border-top-color:#3bafda}.panel-info>.panel-heading .badge{color:#3bafda;background-color:#ffffff}.panel-info>.panel-heading>.panel-title{color:#ffffff}.panel-info>.panel-footer+.panel-collapse>.panel-body{border-bottom-color:#3bafda}.panel-info>.panel-body.fill{color:#FFF;border-color:#73c6e5;background-color:#73c6e5}.panel-info>.panel-body.border{border:3px solid #3bafda}.panel-warning.panel-border{border-color:#f6bb42}.panel-warning>.panel-heading{color:#ffffff;background-color:#f6bb42;border-color:#f6bb42}.panel-warning>.panel-heading+.panel-collapse>.panel-body{border-top-color:#f6bb42}.panel-warning>.panel-heading .badge{color:#f6bb42;background-color:#ffffff}.panel-warning>.panel-heading>.panel-title{color:#ffffff}.panel-warning>.panel-footer+.panel-collapse>.panel-body{border-bottom-color:#f6bb42}.panel-warning>.panel-body.fill{color:#FFF;border-color:#f9d281;background-color:#f9d281}.panel-warning>.panel-body.border{border:3px solid #f6bb42}.panel-danger.panel-border{border-color:#e9573f}.panel-danger>.panel-heading{color:#ffffff;background-color:#e9573f;border-color:#e9573f}.panel-danger>.panel-heading+.panel-collapse>.panel-body{border-top-color:#e9573f}.panel-danger>.panel-heading .badge{color:#e9573f;background-color:#ffffff}.panel-danger>.panel-heading>.panel-title{color:#ffffff}.panel-danger>.panel-footer+.panel-collapse>.panel-body{border-bottom-color:#e9573f}.panel-danger>.panel-body.fill{color:#FFF;border-color:#f08b7a;background-color:#f08b7a}.panel-danger>.panel-body.border{border:3px solid #e9573f}.panel-alert.panel-border{border-color:#967adc}.panel-alert>.panel-heading{color:#ffffff;background-color:#967adc;border-color:#967adc}.panel-alert>.panel-heading+.panel-collapse>.panel-body{border-top-color:#967adc}.panel-alert>.panel-heading .badge{color:#967adc;background-color:#ffffff}.panel-alert>.panel-heading>.panel-title{color:#ffffff}.panel-alert>.panel-footer+.panel-collapse>.panel-body{border-bottom-color:#967adc}.panel-alert>.panel-body.fill{color:#FFF;border-color:#bfaeea;background-color:#bfaeea}.panel-alert>.panel-body.border{border:3px solid #967adc}.panel-system.panel-border{border-color:#37bc9b}.panel-system>.panel-heading{color:#ffffff;background-color:#37bc9b;border-color:#37bc9b}.panel-system>.panel-heading+.panel-collapse>.panel-body{border-top-color:#37bc9b}.panel-system>.panel-heading .badge{color:#37bc9b;background-color:#ffffff}.panel-system>.panel-heading>.panel-title{color:#ffffff}.panel-system>.panel-footer+.panel-collapse>.panel-body{border-bottom-color:#37bc9b}.panel-system>.panel-body.fill{color:#FFF;border-color:#64d2b6;background-color:#64d2b6}.panel-system>.panel-body.border{border:3px solid #37bc9b}.panel-dark.panel-border{border-color:#3b3f4f}.panel-dark>.panel-heading{color:#ffffff;background-color:#3b3f4f;border-color:#3b3f4f}.panel-dark>.panel-heading+.panel-collapse>.panel-body{border-top-color:#3b3f4f}.panel-dark>.panel-heading .badge{color:#3b3f4f;background-color:#ffffff}.panel-dark>.panel-heading>.panel-title{color:#ffffff}.panel-dark>.panel-footer+.panel-collapse>.panel-body{border-bottom-color:#3b3f4f}.panel-dark>.panel-body.fill{color:#FFF;border-color:#575d75;background-color:#575d75}.panel-dark>.panel-body.border{border:3px solid #3b3f4f}.progress-bar-default{background-color:#999999}.progress-bar-default.light{background-color:#a2a2a2}.progress-bar-default.dark{background-color:#909090}.progress-striped .progress-bar-default{background-image:-webkit-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:-o-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent)}.progress-bar-primary{background-color:#4a89dc}.progress-bar-primary.light{background-color:#5993df}.progress-bar-primary.dark{background-color:#3b7fd9}.progress-striped .progress-bar-primary{background-image:-webkit-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:-o-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent)}.progress-bar-success{background-color:#70ca63}.progress-bar-success.light{background-color:#7ccf70}.progress-bar-success.dark{background-color:#64c556}.progress-striped .progress-bar-success{background-image:-webkit-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:-o-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent)}.progress-bar-info{background-color:#3bafda}.progress-bar-info.light{background-color:#4ab5dd}.progress-bar-info.dark{background-color:#2ca9d7}.progress-striped .progress-bar-info{background-image:-webkit-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:-o-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent)}.progress-bar-warning{background-color:#f6bb42}.progress-bar-warning.light{background-color:#f7c153}.progress-bar-warning.dark{background-color:#f5b531}.progress-striped .progress-bar-warning{background-image:-webkit-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:-o-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent)}.progress-bar-danger{background-color:#e9573f}.progress-bar-danger.light{background-color:#eb654f}.progress-bar-danger.dark{background-color:#e7492f}.progress-striped .progress-bar-danger{background-image:-webkit-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:-o-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent)}.progress-bar-alert{background-color:#967adc}.progress-bar-alert.light{background-color:#a188e0}.progress-bar-alert.dark{background-color:#8b6cd8}.progress-striped .progress-bar-alert{background-image:-webkit-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:-o-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent)}.progress-bar-system{background-color:#37bc9b}.progress-bar-system.light{background-color:#3ec7a5}.progress-bar-system.dark{background-color:#33ae90}.progress-striped .progress-bar-system{background-image:-webkit-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:-o-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent)}.progress-bar-dark{background-color:#3b3f4f}.progress-bar-dark.light{background-color:#434759}.progress-bar-dark.dark{background-color:#333745}.progress-striped .progress-bar-dark{background-image:-webkit-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:-o-linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent);background-image:linear-gradient(45deg, rgba(255,255,255,0.15) 25%, transparent 25%, transparent 50%, rgba(255,255,255,0.15) 50%, rgba(255,255,255,0.15) 75%, transparent 75%, transparent)}div.switch.switch-primary input:checked+label{background-color:#4a89dc}div.switch.switch-success input:checked+label{background-color:#70ca63}div.switch.switch-info input:checked+label{background-color:#3bafda}div.switch.switch-warning input:checked+label{background-color:#f6bb42}div.switch.switch-danger input:checked+label{background-color:#e9573f}div.switch.switch-alert input:checked+label{background-color:#967adc}div.switch.switch-system input:checked+label{background-color:#37bc9b}div.switch.switch-dark input:checked+label{background-color:#3b3f4f}.table>thead>tr>td.active,.table>tbody>tr>td.active,.table>tfoot>tr>td.active,.table>thead>tr>th.active,.table>tbody>tr>th.active,.table>tfoot>tr>th.active,.table>thead>tr.active>td,.table>tbody>tr.active>td,.table>tfoot>tr.active>td,.table>thead>tr.active>th,.table>tbody>tr.active>th,.table>tfoot>tr.active>th{color:#a9a9a9;border-color:#ffffff;background-color:#ffffff}.table>thead>tr.active+tr>th,.table>tbody>tr.active+tr>th,.table>tfoot>tr.active+tr>th,.table>thead>tr.active+tr>td,.table>tbody>tr.active+tr>td,.table>tfoot>tr.active+tr>td{border-top:1px solid #ffffff}.table-hover>tbody>tr>td.active:hover,.table-hover>tbody>tr>th.active:hover,.table-hover>tbody>tr.active:hover>td,.table-hover>tbody>tr:hover>.active,.table-hover>tbody>tr.active:hover>th{background-color:#ffffff}.table>thead>tr>td.default,.table>tbody>tr>td.default,.table>tfoot>tr>td.default,.table>thead>tr>th.default,.table>tbody>tr>th.default,.table>tfoot>tr>th.default,.table>thead>tr.default>td,.table>tbody>tr.default>td,.table>tfoot>tr.default>td,.table>thead>tr.default>th,.table>tbody>tr.default>th,.table>tfoot>tr.default>th{color:#b3b3b3;border-color:#ffffff;background-color:#ffffff}.table>thead>tr.default+tr>th,.table>tbody>tr.default+tr>th,.table>tfoot>tr.default+tr>th,.table>thead>tr.default+tr>td,.table>tbody>tr.default+tr>td,.table>tfoot>tr.default+tr>td{border-top:1px solid #ffffff}.table-hover>tbody>tr>td.default:hover,.table-hover>tbody>tr>th.default:hover,.table-hover>tbody>tr.default:hover>td,.table-hover>tbody>tr:hover>.default,.table-hover>tbody>tr.default:hover>th{background-color:#ffffff}.table>thead>tr>td.primary,.table>tbody>tr>td.primary,.table>tfoot>tr>td.primary,.table>thead>tr>th.primary,.table>tbody>tr>th.primary,.table>tfoot>tr>th.primary,.table>thead>tr.primary>td,.table>tbody>tr.primary>td,.table>tfoot>tr.primary>td,.table>thead>tr.primary>th,.table>tbody>tr.primary>th,.table>tfoot>tr.primary>th{color:#1f57a1;border-color:#97bbeb;background-color:#caddf5}.table>thead>tr.primary+tr>th,.table>tbody>tr.primary+tr>th,.table>tfoot>tr.primary+tr>th,.table>thead>tr.primary+tr>td,.table>tbody>tr.primary+tr>td,.table>tfoot>tr.primary+tr>td{border-top:1px solid #97bbeb}.table-hover>tbody>tr>td.primary:hover,.table-hover>tbody>tr>th.primary:hover,.table-hover>tbody>tr.primary:hover>td,.table-hover>tbody>tr:hover>.primary,.table-hover>tbody>tr.primary:hover>th{background-color:#dbe8f8}.table>thead>tr>td.success,.table>tbody>tr>td.success,.table>tfoot>tr>td.success,.table>thead>tr>th.success,.table>tbody>tr>th.success,.table>tfoot>tr>th.success,.table>thead>tr.success>td,.table>tbody>tr.success>td,.table>tfoot>tr.success>td,.table>thead>tr.success>th,.table>tbody>tr.success>th,.table>tfoot>tr.success>th{color:#3f9532;border-color:#afe1a8;background-color:#d9f1d5}.table>thead>tr.success+tr>th,.table>tbody>tr.success+tr>th,.table>tfoot>tr.success+tr>th,.table>thead>tr.success+tr>td,.table>tbody>tr.success+tr>td,.table>tfoot>tr.success+tr>td{border-top:1px solid #afe1a8}.table-hover>tbody>tr>td.success:hover,.table-hover>tbody>tr>th.success:hover,.table-hover>tbody>tr.success:hover>td,.table-hover>tbody>tr:hover>.success,.table-hover>tbody>tr.success:hover>th{background-color:#e7f6e4}.table>thead>tr>td.info,.table>tbody>tr>td.info,.table>tfoot>tr>td.info,.table>thead>tr>th.info,.table>tbody>tr>th.info,.table>tfoot>tr>th.info,.table>thead>tr.info>td,.table>tbody>tr.info>td,.table>tfoot>tr.info>td,.table>thead>tr.info>th,.table>tbody>tr.info>th,.table>tfoot>tr.info>th{color:#1c7393;border-color:#88cfe9;background-color:#bce4f2}.table>thead>tr.info+tr>th,.table>tbody>tr.info+tr>th,.table>tfoot>tr.info+tr>th,.table>thead>tr.info+tr>td,.table>tbody>tr.info+tr>td,.table>tfoot>tr.info+tr>td{border-top:1px solid #88cfe9}.table-hover>tbody>tr>td.info:hover,.table-hover>tbody>tr>th.info:hover,.table-hover>tbody>tr.info:hover>td,.table-hover>tbody>tr:hover>.info,.table-hover>tbody>tr.info:hover>th{background-color:#cdebf6}.table>thead>tr>td.warning,.table>tbody>tr>td.warning,.table>tfoot>tr>td.warning,.table>thead>tr>th.warning,.table>tbody>tr>th.warning,.table>tfoot>tr>th.warning,.table>thead>tr.warning>td,.table>tbody>tr.warning>td,.table>tfoot>tr.warning>td,.table>thead>tr.warning>th,.table>tbody>tr.warning>th,.table>tfoot>tr.warning>th{color:#c88a0a;border-color:#fadb9a;background-color:#fdf0d4}.table>thead>tr.warning+tr>th,.table>tbody>tr.warning+tr>th,.table>tfoot>tr.warning+tr>th,.table>thead>tr.warning+tr>td,.table>tbody>tr.warning+tr>td,.table>tfoot>tr.warning+tr>td{border-top:1px solid #fadb9a}.table-hover>tbody>tr>td.warning:hover,.table-hover>tbody>tr>th.warning:hover,.table-hover>tbody>tr.warning:hover>td,.table-hover>tbody>tr:hover>.warning,.table-hover>tbody>tr.warning:hover>th{background-color:#fef7e8}.table>thead>tr>td.danger,.table>tbody>tr>td.danger,.table>tfoot>tr>td.danger,.table>thead>tr>th.danger,.table>tbody>tr>th.danger,.table>tfoot>tr>th.danger,.table>thead>tr.danger>td,.table>tbody>tr.danger>td,.table>tfoot>tr.danger>td,.table>thead>tr.danger>th,.table>tbody>tr.danger>th,.table>tfoot>tr.danger>th{color:#bc2d16;border-color:#f4ab9f;background-color:#fadbd6}.table>thead>tr.danger+tr>th,.table>tbody>tr.danger+tr>th,.table>tfoot>tr.danger+tr>th,.table>thead>tr.danger+tr>td,.table>tbody>tr.danger+tr>td,.table>tfoot>tr.danger+tr>td{border-top:1px solid #f4ab9f}.table-hover>tbody>tr>td.danger:hover,.table-hover>tbody>tr>th.danger:hover,.table-hover>tbody>tr.danger:hover>td,.table-hover>tbody>tr:hover>.danger,.table-hover>tbody>tr.danger:hover>th{background-color:#fcebe8}.table>thead>tr>td.alert,.table>tbody>tr>td.alert,.table>tfoot>tr>td.alert,.table>thead>tr>th.alert,.table>tbody>tr>th.alert,.table>tfoot>tr>th.alert,.table>thead>tr.alert>td,.table>tbody>tr.alert>td,.table>tfoot>tr.alert>td,.table>thead>tr.alert>th,.table>tbody>tr.alert>th,.table>tfoot>tr.alert>th{color:#542fb2;border-color:#c6b7ec;background-color:#ece7f9}.table>thead>tr.alert+tr>th,.table>tbody>tr.alert+tr>th,.table>tfoot>tr.alert+tr>th,.table>thead>tr.alert+tr>td,.table>tbody>tr.alert+tr>td,.table>tfoot>tr.alert+tr>td{border-top:1px solid #c6b7ec}.table-hover>tbody>tr>td.alert:hover,.table-hover>tbody>tr>th.alert:hover,.table-hover>tbody>tr.alert:hover>td,.table-hover>tbody>tr:hover>.alert,.table-hover>tbody>tr.alert:hover>th{background-color:#f9f7fd}.table>thead>tr>td.system,.table>tbody>tr>td.system,.table>tfoot>tr>td.system,.table>thead>tr>th.system,.table>tbody>tr>th.system,.table>tfoot>tr>th.system,.table>thead>tr.system>td,.table>tbody>tr.system>td,.table>tfoot>tr.system>td,.table>thead>tr.system>th,.table>tbody>tr.system>th,.table>tfoot>tr.system>th{color:#206d5a;border-color:#77d7c0;background-color:#a7e5d6}.table>thead>tr.system+tr>th,.table>tbody>tr.system+tr>th,.table>tfoot>tr.system+tr>th,.table>thead>tr.system+tr>td,.table>tbody>tr.system+tr>td,.table>tfoot>tr.system+tr>td{border-top:1px solid #77d7c0}.table-hover>tbody>tr>td.system:hover,.table-hover>tbody>tr>th.system:hover,.table-hover>tbody>tr.system:hover>td,.table-hover>tbody>tr:hover>.system,.table-hover>tbody>tr.system:hover>th{background-color:#b7eadd}.table>thead>tr>td.dark,.table>tbody>tr>td.dark,.table>tfoot>tr>td.dark,.table>thead>tr>th.dark,.table>tbody>tr>th.dark,.table>tfoot>tr>th.dark,.table>thead>tr.dark>td,.table>tbody>tr.dark>td,.table>tfoot>tr.dark>td,.table>thead>tr.dark>th,.table>tbody>tr.dark>th,.table>tfoot>tr.dark>th{color:#3b3f4f;border-color:#999eb3;background-color:#bcbfcd}.table>thead>tr.dark+tr>th,.table>tbody>tr.dark+tr>th,.table>tfoot>tr.dark+tr>th,.table>thead>tr.dark+tr>td,.table>tbody>tr.dark+tr>td,.table>tfoot>tr.dark+tr>td{border-top:1px solid #999eb3}.table-hover>tbody>tr>td.dark:hover,.table-hover>tbody>tr>th.dark:hover,.table-hover>tbody>tr.dark:hover>td,.table-hover>tbody>tr:hover>.dark,.table-hover>tbody>tr.dark:hover>th{background-color:#c8cbd6}.text-white{color:#ffffff}a.text-white:hover{color:#808080}.text-white-light{color:#ffffff}.text-white-lighter{color:#ffffff}.text-white-dark{color:#f6f6f6}.text-white-darker{color:#ececec}.text-muted{color:#999999}a.text-muted:hover{color:#191919}.text-muted-light{color:#a2a2a2}.text-muted-lighter{color:#acacac}.text-muted-dark{color:#909090}.text-muted-darker{color:#868686}.text-primary{color:#4a89dc}a.text-primary:hover{color:#061221}.text-primary-light{color:#5993df}.text-primary-lighter{color:#6a9ee2}.text-primary-dark{color:#3b7fd9}.text-primary-darker{color:#2a74d6}.text-success{color:#70ca63}a.text-success:hover{color:#0f220c}.text-success-light{color:#7ccf70}.text-success-lighter{color:#8ad480}.text-success-dark{color:#64c556}.text-success-darker{color:#56c046}.text-info{color:#3bafda}a.text-info:hover{color:#030e13}.text-info-light{color:#4ab5dd}.text-info-lighter{color:#5bbce0}.text-info-dark{color:#2ca9d7}.text-info-darker{color:#269dc9}.text-warning{color:#f6bb42}a.text-warning:hover{color:#362503}.text-warning-light{color:#f7c153}.text-warning-lighter{color:#f8c867}.text-warning-dark{color:#f5b531}.text-warning-darker{color:#f4ae1d}.text-danger{color:#e9573f}a.text-danger:hover{color:#250904}.text-danger-light{color:#eb654f}.text-danger-lighter{color:#ed7561}.text-danger-dark{color:#e7492f}.text-danger-darker{color:#e5391d}.text-alert{color:#967adc}a.text-alert:hover{color:#211245}.text-alert-light{color:#a188e0}.text-alert-lighter{color:#ae98e4}.text-alert-dark{color:#8b6cd8}.text-alert-darker{color:#7e5cd4}.text-system{color:#37bc9b}a.text-system:hover{color:#000000}.text-system-light{color:#3ec7a5}.text-system-lighter{color:#4ecbac}.text-system-dark{color:#33ae90}.text-system-darker{color:#2e9e83}.text-dark{color:#3b3f4f}a.text-dark:hover{color:#000000}.text-dark-light{color:#434759}.text-dark-lighter{color:#4b5065}.text-dark-dark{color:#333745}.text-dark-darker{color:#2b2e39}.text-tp{color:rgba(0,0,0,0.2)}a.text-tp:hover{color:rgba(0,0,0,0.3)}blockquote.blockquote-primary{border-color:#4a89dc}blockquote.blockquote-success{border-color:#70ca63}blockquote.blockquote-info{border-color:#3bafda}blockquote.blockquote-warning{border-color:#f6bb42}blockquote.blockquote-danger{border-color:#e9573f}blockquote.blockquote-alert{border-color:#967adc}blockquote.blockquote-system{border-color:#37bc9b}blockquote.blockquote-dark{border-color:#3b3f4f}.dropcap.dropcap-default:first-letter{color:#666}.dropcap.dropcap-primary:first-letter{color:#4a89dc}.dropcap.dropcap-success:first-letter{color:#70ca63}.dropcap.dropcap-info:first-letter{color:#3bafda}.dropcap.dropcap-warning:first-letter{color:#f6bb42}.dropcap.dropcap-danger:first-letter{color:#e9573f}.dropcap.dropcap-alert:first-letter{color:#967adc}.dropcap.dropcap-system:first-letter{color:#37bc9b}.dropcap.dropcap-dark:first-letter{color:#111}.dropcap.dropcap-muted:first-letter{color:#AAA}.dropcap.dropcap-fill:first-letter{color:#FFF}.dropcap.dropcap-fill.dropcap-default:first-letter{color:#444;background-color:#f0f0f0}.dropcap.dropcap-fill.dropcap-primary:first-letter{background-color:#4a89dc}.dropcap.dropcap-fill.dropcap-success:first-letter{background-color:#70ca63}.dropcap.dropcap-fill.dropcap-info:first-letter{background-color:#3bafda}.dropcap.dropcap-fill.dropcap-warning:first-letter{background-color:#f6bb42}.dropcap.dropcap-fill.dropcap-danger:first-letter{background-color:#e9573f}.dropcap.dropcap-fill.dropcap-alert:first-letter{background-color:#967adc}.dropcap.dropcap-fill.dropcap-system:first-letter{background-color:#37bc9b}.dropcap.dropcap-fill.dropcap-dark:first-letter{background-color:#3b3f4f}.dropcap.dropcap-fill.dropcap-muted:first-letter{color:#888;background-color:#f0f0f0}.alert-primary{background-color:#6c9fe3}.alert-primary.alert-border-right{border-right-color:#2567bf}.alert-primary.alert-border-top{border-top-color:#2567bf}.alert-primary.alert-border-bottom{border-bottom-color:#2567bf}.alert-primary.alert-border-left{border-left-color:#2567bf}.alert-primary.light{background-color:#8ab3e8}.alert-primary.dark{background-color:#3d81da}.alert-primary.pastel{color:#2363b6;background-color:#caddf5;border-color:rgba(0,0,0,0.1)}.alert-primary.pastel .alert-link{color:#2363b6}.alert-primary.pastel.alert-micro{border-color:#75a5e4}.alert-primary.pastel .close{color:#2363b6}.alert-primary.pastel .close:hover{color:#2363b6}.alert-success{background-color:#8cd481}.alert-success.alert-border-right{border-right-color:#4aaf3c}.alert-success.alert-border-top{border-top-color:#4aaf3c}.alert-success.alert-border-bottom{border-bottom-color:#4aaf3c}.alert-success.alert-border-left{border-left-color:#4aaf3c}.alert-success.light{background-color:#a4dd9c}.alert-success.dark{background-color:#66c658}.alert-success.pastel{color:#47a839;background-color:#d9f1d5;border-color:rgba(0,0,0,0.1)}.alert-success.pastel .alert-link{color:#47a839}.alert-success.pastel.alert-micro{border-color:#93d789}.alert-success.pastel .close{color:#47a839}.alert-success.pastel .close:hover{color:#47a839}.alert-info{background-color:#6C9FE3;border-bottom-color:#2567BF;border-bottom-width:3px}.alert-info p{color:#fff}.alert-info a{color:#164079}.alert-info.alert-border-right{border-right-color:#218ab1}.alert-info.alert-border-top{border-top-color:#218ab1}.alert-info.alert-border-bottom{border-bottom-color:#218ab1}.alert-info.alert-border-left{border-left-color:#218ab1}.alert-info.light{background-color:#7bc9e6}.alert-info.dark{background-color:#2eaad8}.alert-info.pastel{color:#2084a9;background-color:#bce4f2;border-color:rgba(0,0,0,0.1)}.alert-info.pastel .alert-link{color:#2084a9}.alert-info.pastel.alert-micro{border-color:#66c1e2}.alert-info.pastel .close{color:#2084a9}.alert-info.pastel .close:hover{color:#2084a9}.alert-warning{background-color:#f8c969}.alert-warning p{color:#fff}.alert-warning.alert-border-right{border-right-color:#eba10b}.alert-warning.alert-border-top{border-top-color:#eba10b}.alert-warning.alert-border-bottom{border-bottom-color:#eba10b}.alert-warning.alert-border-left{border-left-color:#eba10b}.alert-warning.light{background-color:#f9d58b}.alert-warning.dark{background-color:#f5b633}.alert-warning.pastel{color:#e19b0b;background-color:#fdf0d4;border-color:rgba(0,0,0,0.1)}.alert-warning.pastel .alert-link{color:#e19b0b}.alert-warning.pastel.alert-micro{border-color:#f8cd73}.alert-warning.pastel .close{color:#e19b0b}.alert-warning.pastel .close:hover{color:#e19b0b}.alert-danger{background-color:#ed7764}.alert-danger.alert-border-right{border-right-color:#ce3118}.alert-danger.alert-border-top{border-top-color:#ce3118}.alert-danger.alert-border-bottom{border-bottom-color:#ce3118}.alert-danger.alert-border-left{border-left-color:#ce3118}.alert-danger.light{background-color:#f19384}.alert-danger.dark{background-color:#e74b31}.alert-danger.pastel{color:#c52f17;background-color:#f9cfc8;border-color:rgba(0,0,0,0.1)}.alert-danger.pastel .alert-link{color:#c52f17}.alert-danger.pastel.alert-micro{border-color:#ee7f6d}.alert-danger.pastel .close{color:#c52f17}.alert-danger.pastel .close:hover{color:#c52f17}.alert-alert{background-color:#b09ae4}.alert-alert.alert-border-right{border-right-color:#6d46ce}.alert-alert.alert-border-top{border-top-color:#6d46ce}.alert-alert.alert-border-bottom{border-bottom-color:#6d46ce}.alert-alert.alert-border-left{border-left-color:#6d46ce}.alert-alert.light{background-color:#c6b7ec}.alert-alert.dark{background-color:#8c6ed9}.alert-alert.pastel{color:#663dcc;background-color:#f6f3fc;border-color:rgba(0,0,0,0.1)}.alert-alert.pastel .alert-link{color:#663dcc}.alert-alert.pastel.alert-micro{border-color:#b6a2e7}.alert-alert.pastel .close{color:#663dcc}.alert-alert.pastel .close:hover{color:#663dcc}.alert-system{background-color:#50ccad}.alert-system.alert-border-right{border-right-color:#288971}.alert-system.alert-border-top{border-top-color:#288971}.alert-system.alert-border-bottom{border-bottom-color:#288971}.alert-system.alert-border-left{border-left-color:#288971}.alert-system.light{background-color:#6cd4ba}.alert-system.dark{background-color:#34b091}.alert-system.pastel{color:#26816a;background-color:#a7e5d6;border-color:rgba(0,0,0,0.1)}.alert-system.pastel .alert-link{color:#26816a}.alert-system.pastel.alert-micro{border-color:#58ceb1}.alert-system.pastel .close{color:#26816a}.alert-system.pastel .close:hover{color:#26816a}.alert-default{color:#888;background-color:#f0f0f0}.alert-default .alert-link{color:#777}.alert-default.alert-border-right{border-right-color:#cfcfcf}.alert-default.alert-border-top{border-top-color:#cfcfcf}.alert-default.alert-border-bottom{border-bottom-color:#cfcfcf}.alert-default.alert-border-left{border-left-color:#cfcfcf}.alert-default.pastel,.alert-default.light{background-color:#fdfdfd;border-color:rgba(0,0,0,0.15)}.alert-default.dark{background-color:#e6e6e6}.alert-dark{background-color:#626984}.alert-dark.alert-border-right{border-right-color:#1f2129}.alert-dark.alert-border-top{border-top-color:#1f2129}.alert-dark.alert-border-bottom{border-bottom-color:#1f2129}.alert-dark.alert-border-left{border-left-color:#1f2129}.alert-dark.pastel,.alert-dark.light{color:#676e89;background-color:#d0d3dc}.alert-dark.pastel .alert-link,.alert-dark.light .alert-link{color:#51566c}.alert-dark.dark{background-color:#4a4f63}.dropdown-toggle.btn-primary+.dropdown-menu>.active>a,.dropdown-toggle.btn-primary+.dropdown-menu>.active>a:hover,.dropdown-toggle.btn-primary+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#4a89dc}.dropdown-toggle.btn-success+.dropdown-menu>.active>a,.dropdown-toggle.btn-success+.dropdown-menu>.active>a:hover,.dropdown-toggle.btn-success+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#70ca63}.dropdown-toggle.btn-info+.dropdown-menu>.active>a,.dropdown-toggle.btn-info+.dropdown-menu>.active>a:hover,.dropdown-toggle.btn-info+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#3bafda}.dropdown-toggle.btn-warning+.dropdown-menu>.active>a,.dropdown-toggle.btn-warning+.dropdown-menu>.active>a:hover,.dropdown-toggle.btn-warning+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#f6bb42}.dropdown-toggle.btn-danger+.dropdown-menu>.active>a,.dropdown-toggle.btn-danger+.dropdown-menu>.active>a:hover,.dropdown-toggle.btn-danger+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#e9573f}.dropdown-toggle.btn-alert+.dropdown-menu>.active>a,.dropdown-toggle.btn-alert+.dropdown-menu>.active>a:hover,.dropdown-toggle.btn-alert+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#967adc}.dropdown-toggle.btn-system+.dropdown-menu>.active>a,.dropdown-toggle.btn-system+.dropdown-menu>.active>a:hover,.dropdown-toggle.btn-system+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#37bc9b}.dropdown-toggle.btn-dark+.dropdown-menu>.active>a,.dropdown-toggle.btn-dark+.dropdown-menu>.active>a:hover,.dropdown-toggle.btn-dark+.dropdown-menu>.active>a:focus{color:#FFF;background-color:#3b3f4f}.nav-pills.nav-primary>li.active>a,.nav-pills.nav-primary>li.active>a:hover,.nav-pills.nav-primary>li.active>a:focus{background-color:#4a89dc}.nav-pills.nav-success>li.active>a,.nav-pills.nav-success>li.active>a:hover,.nav-pills.nav-success>li.active>a:focus{background-color:#70ca63}.nav-pills.nav-info>li.active>a,.nav-pills.nav-info>li.active>a:hover,.nav-pills.nav-info>li.active>a:focus{background-color:#3bafda}.nav-pills.nav-warning>li.active>a,.nav-pills.nav-warning>li.active>a:hover,.nav-pills.nav-warning>li.active>a:focus{background-color:#f6bb42}.nav-pills.nav-danger>li.active>a,.nav-pills.nav-danger>li.active>a:hover,.nav-pills.nav-danger>li.active>a:focus{background-color:#e9573f}.nav-pills.nav-alert>li.active>a,.nav-pills.nav-alert>li.active>a:hover,.nav-pills.nav-alert>li.active>a:focus{background-color:#967adc}.nav-pills.nav-system>li.active>a,.nav-pills.nav-system>li.active>a:hover,.nav-pills.nav-system>li.active>a:focus{background-color:#37bc9b}.nav-pills.nav-dark>li.active>a,.nav-pills.nav-dark>li.active>a:hover,.nav-pills.nav-dark>li.active>a:focus{background-color:#3b3f4f}.tab-block .tabs-border.nav-tabs.tabs-primary>li.active>a{border-top-color:#4a89dc}.tab-block .tabs-border.tabs-left.tabs-primary>li.active>a{border-left-color:#4a89dc}.tab-block .tabs-border.tabs-right.tabs-primary>li.active>a{border-right-color:#4a89dc}.tab-block .tabs-border.tabs-below.tabs-primary>li.active>a{border-bottom-color:#4a89dc}.panel-tabs.panel-tabs-border.tabs-primary>li.active>a{border-top-color:#4a89dc}.tab-block .tabs-border.nav-tabs.tabs-success>li.active>a{border-top-color:#70ca63}.tab-block .tabs-border.tabs-left.tabs-success>li.active>a{border-left-color:#70ca63}.tab-block .tabs-border.tabs-right.tabs-success>li.active>a{border-right-color:#70ca63}.tab-block .tabs-border.tabs-below.tabs-success>li.active>a{border-bottom-color:#70ca63}.panel-tabs.panel-tabs-border.tabs-success>li.active>a{border-top-color:#70ca63}.tab-block .tabs-border.nav-tabs.tabs-info>li.active>a{border-top-color:#3bafda}.tab-block .tabs-border.tabs-left.tabs-info>li.active>a{border-left-color:#3bafda}.tab-block .tabs-border.tabs-right.tabs-info>li.active>a{border-right-color:#3bafda}.tab-block .tabs-border.tabs-below.tabs-info>li.active>a{border-bottom-color:#3bafda}.panel-tabs.panel-tabs-border.tabs-info>li.active>a{border-top-color:#3bafda}.tab-block .tabs-border.nav-tabs.tabs-warning>li.active>a{border-top-color:#f6bb42}.tab-block .tabs-border.tabs-left.tabs-warning>li.active>a{border-left-color:#f6bb42}.tab-block .tabs-border.tabs-right.tabs-warning>li.active>a{border-right-color:#f6bb42}.tab-block .tabs-border.tabs-below.tabs-warning>li.active>a{border-bottom-color:#f6bb42}.panel-tabs.panel-tabs-border.tabs-warning>li.active>a{border-top-color:#f6bb42}.tab-block .tabs-border.nav-tabs.tabs-danger>li.active>a{border-top-color:#e9573f}.tab-block .tabs-border.tabs-left.tabs-danger>li.active>a{border-left-color:#e9573f}.tab-block .tabs-border.tabs-right.tabs-danger>li.active>a{border-right-color:#e9573f}.tab-block .tabs-border.tabs-below.tabs-danger>li.active>a{border-bottom-color:#e9573f}.panel-tabs.panel-tabs-border.tabs-danger>li.active>a{border-top-color:#e9573f}.tab-block .tabs-border.nav-tabs.tabs-alert>li.active>a{border-top-color:#967adc}.tab-block .tabs-border.tabs-left.tabs-alert>li.active>a{border-left-color:#967adc}.tab-block .tabs-border.tabs-right.tabs-alert>li.active>a{border-right-color:#967adc}.tab-block .tabs-border.tabs-below.tabs-alert>li.active>a{border-bottom-color:#967adc}.panel-tabs.panel-tabs-border.tabs-alert>li.active>a{border-top-color:#967adc}.tab-block .tabs-border.nav-tabs.tabs-system>li.active>a{border-top-color:#37bc9b}.tab-block .tabs-border.tabs-left.tabs-system>li.active>a{border-left-color:#37bc9b}.tab-block .tabs-border.tabs-right.tabs-system>li.active>a{border-right-color:#37bc9b}.tab-block .tabs-border.tabs-below.tabs-system>li.active>a{border-bottom-color:#37bc9b}.panel-tabs.panel-tabs-border.tabs-system>li.active>a{border-top-color:#37bc9b}.tab-block .tabs-border.nav-tabs.tabs-dark>li.active>a{border-top-color:#3b3f4f}.tab-block .tabs-border.tabs-left.tabs-dark>li.active>a{border-left-color:#3b3f4f}.tab-block .tabs-border.tabs-right.tabs-dark>li.active>a{border-right-color:#3b3f4f}.tab-block .tabs-border.tabs-below.tabs-dark>li.active>a{border-bottom-color:#3b3f4f}.panel-tabs.panel-tabs-border.tabs-dark>li.active>a{border-top-color:#3b3f4f}body{color:#444;font-size:14px;min-height:0;height:auto;background-color:#efefef;background-repeat:repeat}body>.container{margin-top:17px}@media (min-width: 1400px){.container{width:1320px}}.docs-container{box-shadow:0 1px 1px rgba(0,0,0,0.25);border:1px solid #D9D9D9;border-radius:2px;margin-bottom:150px;background-color:#FFF;position:relative}.cdisable,.cdisable>a{cursor:not-allowed}.mt{margin-top:25px}hr{border-color:#DDD}table.fs11,table.fs11 p,table.fs11 span,table.fs11 b,table.fs11 code,table.fs11 pre{font-size:11px}table.fs12,table.fs12 p,table.fs12 span,table.fs12 b,table.fs12 code,table.fs12 pre{font-size:12px}p{font-size:15px;color:#666;line-height:24px;margin-bottom:25px}p.lead{font-size:16px;font-weight:400}p.alt{font-size:15px;line-height:23px}.well{box-shadow:none;border:1px solid #DDD;border-radius:2px}ul li{font-size:14px;color:#666}.vid{float:right;opacity:0.9;color:#d9534f;font-size:15px;font-weight:600}.label-primary{background-color:#0099cc}.label-system{background-color:#48c9a9}.label-alert{background-color:#967adc}.changelog-row .top-wrapper{margin-left:-25px;margin-right:-25px}.alert b,.alert .alert-link{font-weight:700}.docs-navbar{border-bottom:1px solid #DDD !important}.docs-navbar .navbar-brand{color:#666 !important;font-size:12px;height:80px;line-height:80px;padding:0 35px 0 25px}.docs-navbar .navbar-brand b{font-size:18px;letter-spacing:1px}.docs-navbar .nav>li>a{position:relative}.docs-navbar .nav>li.open>a,.docs-navbar .nav>li.active>a,.docs-navbar .nav>li:hover>a,.docs-navbar .nav>li:focus>a,.docs-navbar .nav>li>a:hover,.docs-navbar .nav>li>a:focus{background:#FFF !important;color:#444 !important}.docs-navbar .nav>li.open>a,.docs-navbar .nav>li.active>a{font-weight:600}.docs-navbar .nav>li.active>a:before{content:"";display:block;position:absolute;top:0;left:0;width:100%;height:3px;background:#3bafda}.docs-navbar .navbar-btn.btn-sm{margin-left:20px;margin-top:15px;margin-bottom:15px}.left-col{vertical-align:top !important;padding:25px;background:#fbfbfb;border-right:1px solid #dadada}body.left-col-hidden .left-col{width:20px;overflow:hidden;background-color:#f7f7f7}body.left-col-hidden .left-col ul,body.left-col-hidden .left-col .sidebar-title{display:none}body.left-col-hidden .center-col{width:100%}@media (max-width: 1400px){.left-col{padding:20px}body.left-col-hidden #left-col-toggle{right:9px}}@media (max-width: 940px){.left-col{border-right:0}body.left-col-hidden #left-col-toggle{top:9px}}@media (max-width: 940px){.changelog-row .left-col{border-top:1px solid #DDD !important;border-bottom:0 !important;padding:10px 25px}body.left-col-hidden .changelog-row .left-col ul,body.left-col-hidden .changelog-row .left-col .sidebar-title{display:block}}#left-col-toggle{z-index:5;cursor:pointer;position:absolute;right:14px;top:15px;width:20px;height:20px;color:#AAA;font-size:21px;-webkit-transition:color 0.2s ease;transition:color 0.2s ease}#left-col-toggle:hover{color:#666}body.left-col-hidden #left-col-toggle{color:#666;right:14px}section#relations{margin:25px -15px;text-align:center}div#prev,div#next{padding:25px 0;border:1px solid #F1F1F1}div#next a,div#prev a{font-size:18px}#share i{font-size:16px}.center-col{padding:30px 35px 100px}.changelog-row .center-col{padding:30px 25px}@media (max-width: 1400px){.center-col{padding:30px 25px}}@media (max-width: 1400px){.container{width:100% !important}}@media (max-width: 940px){.container>.navbar-header{display:none}.navbar-right .btn{display:none}.docs-navbar .navbar-right{width:100%;float:none;margin:0 auto}.docs-navbar .navbar-right:last-child{margin:0}#docs .table-layout{display:block;table-layout:auto}#docs .left-col,#docs .center-col{display:block;width:100%;float:left}#docs .left-col{border-bottom:1px solid #DDD}}@media (max-width: 750px){.container>.navbar-header{display:none}}table{font-size:13px}.table-bordered>thead>tr>th,.table-bordered>tbody>tr>th,.table-bordered>tfoot>tr>th,.table-bordered>thead>tr>td,.table-bordered>tbody>tr>td,.table-bordered>tfoot>tr>td{border-color:#DDD}table.footable>tbody>tr>td.footable-first-column{border-left:4px solid transparent}table.footable>tbody>tr:hover>td.footable-first-column,table.footable>tbody>tr.footable-detail-show>td.footable-first-column{border-left-color:#AAA}table.footable>tbody>tr.entry-updated:hover>td.footable-first-column,table.footable>tbody>tr.footable-detail-show.entry-updated>td.footable-first-column{border-left-color:#3bafda}table.footable>tbody>tr.entry-added:hover>td.footable-first-column,table.footable>tbody>tr.footable-detail-show.entry-added>td.footable-first-column{border-left-color:#70ca63}table.footable>tbody>tr.entry-moved:hover>td.footable-first-column,table.footable>tbody>tr.footable-detail-show.entry-moved>td.footable-first-column{border-left-color:#967adc}table.footable>tbody>tr.entry-fixed:hover>td.footable-first-column,table.footable>tbody>tr.footable-detail-show.entry-fixed>td.footable-first-column{border-left-color:#f6bb42}table.footable>tbody>tr.entry-removed:hover>td.footable-first-column,table.footable>tbody>tr.footable-detail-show.entry-removed>td.footable-first-column{border-left-color:#e9573f}table.footable>tbody>tr.entry-combined:hover>td.footable-first-column,table.footable>tbody>tr.footable-detail-show.entry-combined>td.footable-first-column{border-left-color:#37BC9B}.footable-row-detail-name,.footable-row-detail-value{padding:7px 9px 9px}table.footable .footable-odd{background-color:#FFF}table.footable .footable-even{background-color:#fafafa}table.footable>tbody>tr.footable-row-detail{background-color:#FFF !important}table.footable.breakpoint>tbody>tr>td>span.footable-toggle{float:right;font-size:10px;padding-top:2px}.foo-header>tr>th{background-color:#f6f6f6;border:1px solid #DDD !important}.foo-footer>tr>td{background-color:#f6f6f6}.footable-page-arrow a[data-page="first"],.footable-page-arrow a[data-page="last"]{display:none}table.footable.changelog-table>tbody>tr>td:first-child{width:90px;vertical-align:middle;padding:4px 12px 4px 8px}table.footable.changelog-table>tbody>tr>td:first-child .label{width:100%;display:inline-block;padding:3px 4px 5px;font-size:11px;text-align:center;font-weight:600;line-height:1}.left-col .list-group .list-group-item,.left-col .list-group-accordion .list-group-item{border-color:#DDD}.left-col .list-group .list-group-header,.left-col .list-group-accordion .list-group-header{padding:10px 15px 10px 2px;padding-bottom:13px;color:#444;font-weight:600;background-color:transparent}.list-group-accordion .list-group-item{-ms-user-select:none;-moz-user-select:-moz-none;-khtml-user-select:none;-webkit-user-select:none;user-select:none;padding:0}.list-group-accordion .list-group-item.active{background-color:#fafafa}.list-group-accordion .list-group-item>a{color:#AAA;display:block;text-decoration:none;padding:10px 15px}.list-group-accordion .list-group-item.active,.list-group-accordion .list-group-item.active:hover,.list-group-accordion .list-group-item.active:focus{color:#666;position:relative;border-color:#ddd}.list-group-accordion .list-group-item.active:after{content:"";position:absolute;display:block;left:0;top:-1px;height:3px;width:100%;background-color:#4a89dc}.list-group-accordion .list-group-item:nth-child(2):after{display:none !important}.list-group-accordion .list-group-item.active ul.collapse{display:block !important}.list-group-accordion .list-group-item>ul{padding-left:20px;padding-bottom:12px;padding-right:20px}.list-group-accordion .list-group-item>ul>li{padding:0;list-style-type:none}.list-group-accordion .list-group-item>ul>li>a{list-style:none;color:#AAA;padding:4px 0;display:block;text-decoration:none}.list-group-accordion .list-group-item>ul>li>a:hover{color:#555}.list-group-accordion .list-group-item>ul>li.active>a,.list-group-accordion .list-group-item>ul>li.active>a:hover{color:#4a89dc;font-weight:600}.list-group-accordion .list-group-item .sign-toggle{cursor:pointer;display:block;color:#AAA}.list-group-accordion .list-group-item .sign-toggle:after{right:10px;top:12px;position:absolute;content:"\f068";font-family:"FontAwesome";color:#AAA;font-size:12px;font-style:normal;font-weight:normal;-webkit-font-smoothing:antialiased}.list-group-accordion .list-group-item.active .sign-toggle{color:#666;font-weight:600}.list-group-accordion .list-group-item.active .sign-toggle:after{color:#666;content:"\f067"}.list-group-accordion .list-group-item .sign-toggle:hover,.list-group-accordion .list-group-item .sign-toggle:focus,.list-group-accordion .list-group-item .sign-toggle:hover:after,.list-group-accordion .list-group-item .sign-toggle:focus:after{color:#555}.list-group-accordion .list-group-item a .badge{float:right;background-color:#AAA}.list-group-accordion .list-group-item>.list-disc>li{list-style:disc}.list-group-accordion .list-group-item>ul>li.list-label{position:relative;left:-20px;margin-top:15px;margin-bottom:5px;font-weight:600;font-size:13px;list-style:none}.list-group-accordion .list-group-item>ul>li.list-label:first-child{margin-top:17px !important}html.template-page{background-color:#f1f1f1}html.template-page body{min-height:1500px;overflow-x:hidden}#onScreen,#offScreen{position:absolute;display:block;width:100%;height:100%;transition:all ease 0.5s}#onScreen{left:0}body.offscreen-active #onScreen{left:100%}#offScreen{left:-100%}body.offscreen-active #offScreen{left:0}.template-btn{display:block;width:100%;height:42px;text-align:center;color:#999;font-weight:600;font-size:15px;line-height:40px;background:#FFF;border:1px solid #DDD;margin-bottom:40px}.template-btn:hover{color:#666;text-decoration:none;background:#fafafa}.template-page .highlight.hljs-label-js pre,.template-page .highlight.hljs-label-js code{background-color:#fffffa}.bs-docs-section h2{border-top:1px dashed #CCC;border-bottom:0;padding-top:35px;margin-top:30px}.bs-docs-section h2+.bs-example{margin-top:20px}.bs-docs-section h2:first-child,.bs-docs-section .page-header+h2{border:0;margin:15px 0 15px;padding:0}.bs-example{position:relative;margin:0;padding:50px 15px 15px;background-color:#fdfdfd;border:1px solid #DDD;border-radius:4px 4px 0 0;-webkit-box-shadow:none;box-shadow:none}.bs-example:after{position:absolute;top:15px;left:15px;font-size:12px;font-weight:700;color:#959595;text-transform:uppercase;letter-spacing:1.2px;content:"Example"}.bs-example-type .table td{padding:15px 0;border-color:#eee}.bs-example-type h1,.bs-example-type h2,.bs-example-type h3,.bs-example-type h4,.bs-example-type h5,.bs-example-type h6{margin:0}.highlight.highlight-hover pre{height:185px;overflow:hidden;-webkit-transition:all ease 0.3s;transition:all ease 0.3s}.zero-clipboard:hover+.highlight-hover pre{height:auto}.highlight{margin-bottom:25px}.highlight.mn,.highlight.mn+.zero-clipboard+.highlight,.bs-example+.zero-clipboard+.highlight,.highlight.mn+.table-responsive{margin-top:-1px !important}.highlight+.table-responsive{margin-top:-1px}.table-responsive+.bs-example,.table-responsive+.zero-clipboard+.highlight,.table-responsive+.zero-clipboard+.bs-example{margin-top:-1px;border-radius:0 0 4px 4px}thead.hidden+tbody>tr:first-child>th,thead.hidden+tbody>tr:first-child>td{border-top:1px solid #DDD}.highlight pre{padding:9px 14px;margin-bottom:0;background-color:#f7f7f7;border:1px solid #e1e1e8;border-radius:3px}.zero-clipboard{position:relative;display:block}.btn-clipboard{position:absolute;top:-1px;right:0;z-index:10;display:block;padding:5px 12px 5px 14px;font-size:12px;color:#767676;cursor:pointer;background-color:#fff;border:1px solid #e1e1e8;border-radius:0}.btn-clipboard:hover{background-color:#FFFEF0}.highlight,.highlight.hljs-label-js{position:relative}.highlight pre,.highlight.hljs-label-js pre{padding:20px 14px 9px}.hljs-tag,.hljs-tag .hljs-title,.hljs-rules .hljs-property,.django .hljs-tag .hljs-keyword{color:#2f6f9f}.hljs-attribute,.hljs-variable,.lisp .hljs-body{color:#4f9fcf}.bs-example.dependencies,.bs-example.required-css,.bs-example.required-js,.bs-example.required-url,.bs-example.required-files{padding:38px 15px 15px}.bs-example.dependencies:after,.bs-example.required-css:after,.bs-example.required-js:after,.bs-example.required-url:after,.bs-example.required-files:after{font-size:10px}.bs-example.dependencies:after{content:"DEPENDENCIES"}.bs-example.required-css:after{content:"STYLESHEETS REQUIRED"}.bs-example.required-js:after{content:"SCRIPTS REQUIRED"}.bs-example.required-url:after{content:"DIRECTORY URL"}.bs-example.required-files:after{content:"FILES IN DIRECTORY"}.bs-example+.bs-example{border-top:0;border-radius:0;margin-top:-11px}.well.author-well{margin-top:25px;padding:15px 18px 0;background-color:#f8f8f8;border-radius:0px;border:1px solid #E6E6E6;box-shadow:0}.demo-table p{margin-bottom:0px}.bs-docs-section .media{font-weight:400}.highlight[data-label]{position:relative}.highlight[data-label] pre{padding:20px 14px 9px}.highlight[data-label]:after{content:"HTML";position:absolute;top:14px;left:15px;font-size:10px;font-weight:600;color:#959595;padding:1px 5px;border:1px solid #EEE;background:#f1f1f1;text-transform:uppercase;letter-spacing:1.2px;content:"HTML"}.highlight[data-label="html"]:after{content:"html"}.highlight[data-label="url"]:after{content:"Folder URL"}.bs-docs-grid{margin-top:15px;margin-bottom:25px}.show-grid{margin:0}.show-grid div[class*="col-xs-"],.show-grid div[class*="col-sm-"],.show-grid div[class*="col-md-"],.show-grid div[class*="col-lg-"],.show-grid div[class*="col-xl-"]{padding:15px;background:#fafafa;border:1px solid #EEE}.bs-example .holder-style{background-color:#f9f9f9}div[data-label]+div[data-label]{border-top:1px solid #EEE;padding-bottom:25px}.bs-example[data-label="contact"]:after{content:"Contact Forms"}.bs-example[data-label="comment"]:after{content:"Comment Forms"}.bs-example[data-label="login"]:after{content:"Login Forms"}.bs-example[data-label="register"]:after{content:"Register Forms"}.bs-example[data-label="order"]:after{content:"Order Forms"}.bs-example[data-label="misc"]:after{content:"Misc Forms"}.bs-example+.table-responsive{margin-top:-1px}.bs-example+.table-responsive .table>colgroup+thead>tr:first-child>th{border-bottom-width:1px}.scrollup{opacity:0.4;z-index:2;display:none;position:fixed;bottom:25px;right:30px;width:42px;height:40px;border-radius:4px;background:#d3301a;color:#FFF;font-size:18px;line-height:36px;text-align:center}.scrollup:hover,.scrollup:focus{opacity:1;color:#FFF;-webkit-transition:opacity 0.4s ease;transition:opacity 0.4s ease}@media (max-width: 940px){.scrollup{right:25px;left:auto;bottom:8px;width:35px;height:34px;line-height:32px}}.top-wrapper{background:#FBFBFB;border-top:1px solid #E5E5E5;padding:8px;margin-left:-35px;bottom:0;position:absolute;width:100%}.top-wrapper a{border:0;margin-top:0px}@media (max-width: 1400px){.top-wrapper{margin-left:-25px;margin-right:-25px}}.return-top{display:block;width:100%;height:42px;text-align:center;color:#999;font-weight:600;font-size:15px;line-height:40px;border:1px solid #DDD;margin-top:50px}.return-top:hover{color:#666;text-decoration:none;background:#fafafa}@media (min-width: 768px){#main.services .navbar-default{background-color:#000 !important}}footer{font-family:'PT Sans', arial, sans-serif;-webkit-font-smoothing:auto;padding:0;background:#000;position:absolute;width:100%;height:110px;bottom:0}@media (max-width: 955px){footer{height:185px}}footer section{padding:15px 0}footer hr{opacity:.3}footer ul{margin:0 0 15px;list-style-type:none;list-style-image:none;padding:0}footer ul li{line-height:16px;margin-bottom:0}footer a{font-family:'PT Sans Caption', 'PT Sans', arial, sans-serif;font-size:11px;text-transform:uppercase;color:#a8b2be;font-weight:600}footer a:hover{color:#FF7171}footer p{margin-bottom:6px}footer p a{font-family:'PT Sans Narrow', 'Arial Narrow', arial, sans-serif;font-size:15px;color:#000;text-transform:uppercase}footer div.footsm{font-size:.9em}footer span.pureplay_btm{color:#d63327;font-size:12px}footer span.mira_btm{color:#fff}footer span.copy_btm{color:#929aa2}footer .footer_copy{margin-top:30px;background:rgba(0,0,0,0.5);padding:10px 0}footer a.fmenu_section{font-size:1.5em;padding-bottom:12px;display:inline-block;color:#fff;font-weight:600;letter-spacing:1px;margin-top:30px;margin-bottom:10px}footer a.fmenu_section:hover{color:#d23527}footer div.footer_icon_set span{display:inline-block;margin:10px 8px;color:#fff;text-shadow:none}footer div.footer_icon_set a{font-size:130%;color:#fff;text-shadow:none}footer a.fproduct:hover div{background-position:0 100%}footer a.fproduct img{max-height:90px;margin:0 auto 10px}footer a.fproduct div{width:80px;height:48px;margin:7px auto 20px;background-size:cover}footer a.fproduct div.footerglyph1{background:url(footer_mos_a.png) no-repeat;background-position:0 0;background-size:cover}footer a.fproduct div.footerglyph2{background:url(footer_murano_a.png) no-repeat;background-position:0 0;background-size:cover}footer a.fproduct div.footerglyph3{background:url(footer_drivers_a.png) no-repeat;background-position:0 0;background-size:cover}footer a.fproduct div.footerglyph4{background:url(footer_unlocked_a.png) no-repeat;background-position:0 0;background-size:cover}footer a.fproduct span{display:block;text-align:center;text-transform:none;font-size:1.1em;line-height:1.1em;color:#fff}footer a.fproduct span:hover span{color:#fff}html{position:relative;min-height:100%;height:auto}body{margin-bottom:110px;position:static}.cc{color:#AAA;font-family:'PT Sans Caption', 'PT Sans', arial, sans-serif;font-size:11px;text-transform:uppercase;text-align:center;padding-top:10px}a.navbar-brand img{max-height:60px}.sphinx-content{display:none}input#searchInput:focus{outline:none}input#searchInput{border:none}.loader{margin:100px auto 0;width:70px;text-align:center}.loader>div{width:18px;height:18px;background-color:#333;border-radius:100%;display:inline-block;-webkit-animation:search-bouncedelay 1.4s infinite ease-in-out both;animation:search-bouncedelay 1.4s infinite ease-in-out both}.loader .bounce1{-webkit-animation-delay:-0.32s;animation-delay:-0.32s}.loader .bounce2{-webkit-animation-delay:-0.16s;animation-delay:-0.16s}@-webkit-keyframes search-bouncedelay{0%,80%,100%{-webkit-transform:scale(0)}40%{-webkit-transform:scale(1)}}@keyframes search-bouncedelay{0%,80%,100%{-webkit-transform:scale(0);transform:scale(0)}40%{-webkit-transform:scale(1);transform:scale(1)}}#search-results{margin-top:35px;margin-bottom:50px}div.mm_miralogo img{max-height:45px;margin-top:8px;margin-bottom:8px}#mira-menu-int{margin-top:0;float:left}a.glink{color:white;display:inline-block;font-family:'PT Sans Narrow', 'Arial Narrow', arial,sans-serif;-webkit-font-smoothing:auto;font-size:19px;letter-spacing:1px;padding:17px 16px;margin:0;white-space:nowrap;text-decoration:none;transition:all 0.2s ease}a.glink:active,a.glink:hover,a.glink.active{color:#fff;background:rgba(63,63,63,0.9)}.top-menu-social{margin-top:10px;float:right}.top-menu-social a{color:rgba(171,171,171,0.9);-webkit-font-smoothing:auto}form#searchForm button{position:absolute;top:0;bottom:0;right:0;border-color:transparent}a#top-linkedin:hover,a#top-linkedin:active,a#top-linkedin:focus{color:#007bb6;text-decoration:none}a#top-facebook:hover,a#top-facebook:active,a#top-facebook:focus{color:#3b5998;text-decoration:none}a#top-twitter:hover,a#top-twitter:active,a#top-twitter:focus{color:#4099FF;text-decoration:none}a#top-google-plus:hover,a#top-google-plus:active,a#top-google-plus:focus{color:#d34836;text-decoration:none}#share .btn-primary{background-color:#C9C9C9}#share .btn-primary:hover,#share .btn-primary.zeroclipboard-is-hover{background-color:#D3301A;border-left-color:transparent;border-right-color:transparent}.text-left-not-xs,.text-left-not-sm,.text-left-not-md,.text-left-not-lg{text-align:left}.text-center-not-xs,.text-center-not-sm,.text-center-not-md,.text-center-not-lg{text-align:center}.text-right-not-xs,.text-right-not-sm,.text-right-not-md,.text-right-not-lg{text-align:right}.text-justify-not-xs,.text-justify-not-sm,.text-justify-not-md,.text-justify-not-lg{text-align:justify}@media (max-width: 767px){.text-left-not-xs,.text-center-not-xs,.text-right-not-xs,.text-justify-not-xs{text-align:inherit}.text-left-xs{text-align:left}.text-center-xs{text-align:center}.text-right-xs{text-align:right}.text-justify-xs{text-align:justify}}@media (min-width: 768px) and (max-width: 991px){.text-left-not-sm,.text-center-not-sm,.text-right-not-sm,.text-justify-not-sm{text-align:inherit}.text-left-sm{text-align:left}.text-center-sm{text-align:center}.text-right-sm{text-align:right}.text-justify-sm{text-align:justify}}@media (min-width: 992px) and (max-width: 1199px){.text-left-not-md,.text-center-not-md,.text-right-not-md,.text-justify-not-md{text-align:inherit}.text-left-md{text-align:left}.text-center-md{text-align:center}.text-right-md{text-align:right}.text-justify-md{text-align:justify}}@media (min-width: 1200px){.text-left-not-lg,.text-center-not-lg,.text-right-not-lg,.text-justify-not-lg{text-align:inherit}.text-left-lg{text-align:left}.text-center-lg{text-align:center}.text-right-lg{text-align:right}.text-justify-lg{text-align:justify}} diff --git a/_templates/mirantis/theme.conf b/_templates/mirantis/theme.conf deleted file mode 100644 index f3d3c60b1..000000000 --- a/_templates/mirantis/theme.conf +++ /dev/null @@ -1,69 +0,0 @@ -# Bootstrap Theme -[theme] -inherit = basic -stylesheet = basic.css -pygments_style = tango - -# Configurable options. -[options] -# Navigation bar title. (Default: ``project`` value) -navbar_title = - -# Tab name for entire site. (Default: "Site") -navbar_site_name = Site - -# A list of tuples containting pages to link to. The value should be -# in the form [(name, page), ..] -navbar_links = - -# Render the next and previous page links in navbar. (Default: true) -navbar_sidebarrel = true - -# Render the current pages TOC in the navbar. (Default: true) -navbar_pagenav = true - -# Tab name for the current pages TOC. (Default: "Page") -navbar_pagenav_name = Page - -# Global TOC depth for "site" navbar tab. (Default: 1) -# Switching to -1 shows all levels. -globaltoc_depth = 1 - -# Include hidden TOCs in Site navbar? -# -# Note: If this is "false", you cannot have mixed ``:hidden:`` and -# non-hidden ``toctree`` directives in the same page, or else the build -# will break. -# -# Values: "true" (default) or "false" -globaltoc_includehidden = true - -# HTML navbar class (Default: "navbar") to attach to
      element. -# For black navbar, do "navbar navbar-inverse" -navbar_class = navbar - -# Fix navigation bar to top of page? -# Values: "true" (default) or "false" -navbar_fixed_top = false - -# Location of link to source. -# Options are "nav" (default), "footer" or anything else to exclude. -source_link_position = nav - -# Bootswatch (http://bootswatch.com/) theme. -# -# Options are nothing (default) or the name of a valid theme such as -# "amelia" or "cosmo". -bootswatch_theme = - -# Switch Bootstrap version? -# Values: "3" (default) or "2" -bootstrap_version = 3 - -# link targets -# NOTE: roottarget can be name of document (eg: 'index', or "") -# logotarget is same, or can be "" to reflect root value -roottarget = index -logotarget = - -googletag = GTM-K2J65K diff --git a/_templates/mirantiscover.tmpl b/_templates/mirantiscover.tmpl deleted file mode 100644 index f1393d6b4..000000000 --- a/_templates/mirantiscover.tmpl +++ /dev/null @@ -1,33 +0,0 @@ -.. role:: normal - -.. raw:: pdf - - Spacer 0 10cm - - - -.. cssclass:: subtitle - -**#{subtitle}** - - - -.. raw:: pdf - - Spacer 0 1cm - - - -.. cssclass:: title - -#{title} - - - -.. raw:: pdf - - Spacer 0 3cm - -.. raw:: pdf - - PageBreak oneColumn \ No newline at end of file diff --git a/_templates/searchbox.html b/_templates/searchbox.html new file mode 100644 index 000000000..2b99f75d8 --- /dev/null +++ b/_templates/searchbox.html @@ -0,0 +1,12 @@ +{%- if pagename != "search" %} +

      Quick search

      +
      + + + + +

      + Enter search terms or a module, class or function name. +

      + +{%- endif %} diff --git a/_templates/sidebarpdf.html b/_templates/sidebarpdf.html new file mode 100644 index 000000000..87f1a9b12 --- /dev/null +++ b/_templates/sidebarpdf.html @@ -0,0 +1,3 @@ +

      Downloadable PDF

      +Fuel Development Documentation diff --git a/buildsystem.rst b/buildsystem.rst new file mode 100644 index 000000000..8033af82c --- /dev/null +++ b/buildsystem.rst @@ -0,0 +1,328 @@ +.. _buildsystem: + + +Fuel ISO build system +===================== + +Use the `fuel-main repository `_ +to build Fuel components such as an ISO or an upgrade tarball. +This repository contains a set of GNU Make build scripts. + +Quick start +----------- + +1. You must use one of the following distributions to build Fuel components or the build process may fail. Note that build only works for x64 platforms. + +* Ubuntu 12.04 +* Ubuntu 14.04 + +2. Check whether you have git installed in + your system. To do that, use the following command: + +:: + + which git + +If git is not found, install it with the following command: + +:: + + + apt-get install git + + +3. Clone the **fuel-main** git repository to the location where + you will work. The root of your repo will be named `fuel-main`. + In this example, it will be located under the *~/fuel* directory: + +:: + + mkdir ~/fuel + cd ~/fuel + git clone https://github.com/openstack/fuel-main.git + cd fuel-main + + +.. note::Fuel build system consists of the following components: + + * a shell script (**./prepare-build-env.sh**) - prepares the build environment by checking + that all necessary packages are installed and installing any that are not. + + * **fuel-main** directory - the only one required repository for building the Fuel ISO. + + The make script then downloads the additional components + (Fuel Library, Nailgun, Astute and OSTF). + Unless otherwise specified in the makefile, + the master branch of each respective repo is used to build the ISO. + +4. Run the shell script: + +:: + + ./prepare-build-env.sh + + and wait until **prepare-build-env.sh** + installs the Fuel build evironment on your computer. + +5. After the script runs successfully, issue the following command to build a + Fuel ISO: + +:: + + make iso + +6. Use the following command to list the available make targets: + +:: + + make help + +For the full list of available targets with description, see :ref:`Build targets ` section below. + +Build system structure +---------------------- + +Fuel consists of several components such as web interface, +puppet modules, orchestration components, testing components. +Source code of all those components is split into multiple git +repositories like: + +- https://github.com/openstack/fuel-web +- https://github.com/openstack/fuel-astute +- https://github.com/openstack/fuel-ostf +- https://github.com/openstack/fuel-library +- https://github.com/openstack/fuel-docs + +The main component of the Fuel build system is +*fuel-main* directory. + +Fuel build processes are quite complicated, +so to make the **fuel-main** code easily +maintainable, it is +split into a bunch of files and directories. + +Those files +and directories contain independent +(or at least almost independent) +pieces of Fuel build system: + +* **Makefile** - the main Makefile which includes all other make modules. + +* **config.mk** - contains parameters used to customize the build process, + specifying items such as build paths, + upstream mirrors, source code repositories + and branches, built-in default Fuel settings and ISO name. + +* **rules.mk** - defines frequently used macros. + +* **repos.mk** - contains make scripts to download the + other repositories to develop Fuel + components put into separate repos. + +* **sandbox.mk** - shell script definitions that create + and destroy the special chroot environment required to + build some components. + For example, for building RPM packages, + CentOS images we use CentOS chroot environment. + +* **mirror** - contains the code which is used to download + all necessary packages from upstream mirrors and build new + ones which are to be copied on Fuel ISO even if Internet + connection is down. + +* **puppet** - contains the code used + to pack Fuel puppet modules into a tarball that is afterwards + put on Fuel ISO. + +* **packages** - contains DEB and RPM + specs as well as make code for building those packages, + included in Fuel DEB and RPM mirrors. + +* **bootstrap** - contains a make script intended + to build CentOS-based miniroot image (a.k.a initrd or initramfs). + +* **image** - contains **make** scripts for building CentOS + and Ubuntu images using the Fuel mirrors, built + from the scripts in the *mirror* directory. The images + are alternative to using the standard anaconda and debian installers. + +* **docker** - contains the make scripts to + build docker containers, deployed on the Fuel Master node. + +* **upgrade** - contains make scripts for building Fuel upgrade tarball. + +* **iso** - contains **make** scripts for building Fuel ISO file. + +**Fuel-main** also contains a set of directories which are not directly +related to Fuel build processes: + +* **virtualbox** - contains a set of shell scripts + which allow one to deploy Fuel demo lab easily using VirtualBox. + +* **utils** - contains a set of utilities used for + maintaining Fuel components. + +* **fuelweb_test** and **fuelweb_ui_test** - contain + the code of Fuel system tests. + + +.. _build-targets: + +Build targets +------------- + +* **all** - used for building all Fuel artifacts. + Currently, it is an alias for **iso** target. + +* **bootstrap** - used for building in-memory bootstrap + image which is used for auto-discovering. + +* **mirror** - used for building local mirrors (the copies of CentOS and + Ubuntu mirrors which are then placed into Fuel ISO). + They contain all necessary packages including those listed in + *requirements-*.txt* files with their dependencies as well as those which + are Fuel packages. Packages listed in *requirements-*.txt* files are downloaded + from upstream mirrors while Fuel packages are built from source code. + +* **iso** - used for building Fuel ISO. If build succeeds, + ISO is put into build/artifacts folder. + +* **img** - used for building Fuel flash stick image, + binary copied to a flash stick. That + stick is then used as a bootable device and + contains Fuel ISO as well as some auxiliary boot files. + +* **clean** - removes build directory. + +* **deep_clean** - removes build directory and local mirror. + Note that if you remove a local mirror, then next time + the ISO build job will download all necessary packages again. + So, the process goes faster if you keep local mirrors. + You should also mind the following: + it is better to run *make deep_clean* every time when building an ISO to make sure the local mirror is consistent. + + +Customizing build process +------------------------- + +There are plenty of variables in make files. +Some of them represent a kind of build parameters. +They are defined in **config.mk** file: + +* **TOP_DIR** - a default current directory. + All other build directories are relative to this path. + +* **BUILD_DIR** - contains all files, used during build process. + By default, it is **$(TOP_DIR)/build**. + +* **ARTS_DIR** - contains build artifacts such as ISO and IMG files + By default, it is **$(BUILD_DIR)/artifacts**. + +* **LOCAL_MIRROR** - contains local CentOS and Ubuntu mirrors + By default, it is **$(TOP_DIR)/local_mirror**. + +* **DEPS_DIR** - contains build targets that depend on artifacts + of the previous build jobs, placed there + before build starts. By default, it is **$(TOP_DIR)/deps**. + +* **ISO_NAME** - a name of Fuel ISO without file extension: + if **ISO_NAME** = **MY_CUSTOM_NAME**, then Fuel ISO file will + be placed into **$(MY_CUSTOM_NAME).iso**. + +* **ISO_PATH** - used to specify Fuel ISO full path instead of defining + just ISO name. + By default, it is **$(ARTS_DIR)/$(ISO_NAME).iso**. + +* **UPGRADE_TARBALL_NAME** - defines the name of upgrade tarball. + By default, it is **$(UPGRADE_TARBALL_NAME).tar**. + +* **UPGRADE_TARBALL_PATH** - used to define full upgrade tarball path. + By default, it is **$(ARTS_DIR)/$(UPGRADE_TARBALL_NAME).tar**. + +* **VBOX_SCRIPTS_NAME** - defines the name of the archive with + VirtualBox scripts. + By default, it is placed into **$(VBOX_SCRIPTS_NAME).zip**. + +* **VBOX_SCRIPTS_PATH** - defines full path for + VirtualBox scripts archive. + By default, it is **$(ARTS_DIR)/$(VBOX_SCRIPTS_NAME).zip** + +* Fuel ISO contains some default settings for the + Fuel Master node. These settings can be customized + during Fuel Master node installation. + One can customize those + settings using the following variables: + +- **MASTER_IP** - the Fuel Master node IP address. + By default, it is 10.20.0.2. + +- **MASTER_NETMASK** - Fuel Master node IP netmask. + By default, it is 255.255.255.0. + +- **MASTER_GW** - Fuel Master node default gateway. + By default, it is is 10.20.0.1. + +- **MASTER_DNS** - the upstream DNS location for the Fuel master node. + FUel Master node DNS will redirect there all DNS requests that it is not able to resolve itself. + By default, it is 10.20.0.1. + + +Other options +------------- + +* **BUILD_OPENSTACK_PACKAGES** - list of Openstack packages to be rebuilt from source. + +* **[repo]_REPO** - remote source code repo. + URL or git repository can be specified for each of the Fuel components. + (FUELLIB, NAILGUN, ASTUTE, OSTF). + +* **[repo]_COMMIT** - source branch for each of the Fuel components to build. + +* **[repo]_GERRIT_URL** - gerrit repo. + +* **[repo]_GERRIT_COMMIT** - list of extra commits from gerrit. + +* **[repo]_SPEC_REPO** - repo for RPM/DEB specs of OpenStack packages. + +* **[repo]_SPEC_COMMIT** - branch for checkout. + +* **[repo]_SPEC_GERRIT_URL** - gerrit repo for OpenStack specs. + +* **[repo]_SPEC_GERRIT_COMMIT** - list of extra commits from gerrit for specs. + +* **USE_MIRROR** - pre-built mirrors from Fuel infrastructure. + The following mirrors can be used: + * ext (external mirror, available from outside of Mirantis network) + * none (reserved for building local mirrors: in this case + CentOS and Ubuntu packages will be fetched from upstream mirrors, so + that it will make the build process much slower). + +* **MIRROR_CENTOS** - download CentOS packages from a specific remote repo. + +* **MIRROR_UBUNTU** - download Ubuntu packages from a specific remote repo. + +* **MIRROR_DOCKER** - download docker images from a specific remote url. + +* **EXTRA_RPM_REPOS** - extra repos with RPM packages. + Each repo must be comma separated + tuple with repo-name and repo-path: + , , + For example, + *qemu2,http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1-stable-15943/centos/ libvirt,http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1-stable-17019/centos/*. + +* **EXTRA_DEP_REPOS** - extra repos with DEB packages. + Each repo must consist of an url, + distro and section parts. + Repos must be separated by bar: + | + For example, + *http://fuel-repository.mirantis.com/repos/ubuntu-fuel-5.1-stable-15955/ubuntu/|http://fuel-repository.mirantis.com/repos/ubuntu-fuel-5.1-stable-15953/ubuntu/*. + +** **FEATURE_GROUPS** - options for the ISO. + Combination of the following: + + * mirantis (use mirantis logos and logic) + + * experimental (allow experimental features on Fuel web UI) + +Note that if you want to add more packages to the Fuel Master node, you should update the **requirements-rpm.txt** and the **requirements-deb.txt** files. diff --git a/common_conf.py b/common_conf.py index b18cc44ad..c3cc9d1ad 100644 --- a/common_conf.py +++ b/common_conf.py @@ -1,416 +1,101 @@ -# -*- coding: utf-8 -*- -# -# "Fuel" documentation build configuration file, created by -# sphinx-quickstart on Tue Sep 25 14:02:29 2012. -# -# This file is execfile()d with the current directory set to its containing dir. -# -# Note that not all possible configuration values are present in this -# autogenerated file. -# -# All configuration values have a default; values that are commented out -# serve to show the default. - -import sys, os - -on_rtd = os.environ.get('READTHEDOCS', None) == 'True' - -# If extensions (or modules to document with autodoc) are in another directory, -# add these directories to sys.path here. If the directory is relative to the -# documentation root, use os.path.abspath to make it absolute, like shown here. -#sys.path.insert(0, os.path.abspath('.')) - -# -- General configuration ----------------------------------------------------- - -# If your documentation needs a minimal Sphinx version, state it here. -#needs_sphinx = '1.0' - -# Add any Sphinx extension module names here, as strings. They can be extensions -# coming with Sphinx (named 'sphinx.ext.*') or your custom ones. -#if on_rtd: -# extensions = ['sphinx.ext.autodoc','sphinxcontrib.plantuml'] -# display_github = False -#else: -extensions = ['sphinx.ext.autodoc','rst2pdf.pdfbuilder','sphinxcontrib.plantuml'] -#,'sphinxcontrib.fancybox'] - -plantuml = ['java','-jar','/sbin/plantuml.jar'] - -# Add any paths that contain templates here, relative to this directory. -templates_path = ['_templates'] - -# The suffix of source filenames. -source_suffix = '.rst' - -# The encoding of source files. -#source_encoding = 'utf-8-sig' - -# The master toctree document. -master_doc = 'contents' - -# General information about the project. -project = u'Mirantis OpenStack' -copyright = u'2015, Mirantis Inc.' - -# The version info for the project you're documenting, acts as replacement for -# |version| and |release|, also used in various other places throughout the -# built documents. -# -# The short X.Y version. -version = '7.0' - -# The full version, including alpha/beta/rc tags. -release = '7.0' - -# The language for content autogenerated by Sphinx. Refer to documentation -# for a list of supported languages. -#language = None - -# There are two options for replacing |today|: either, you set today to some -# non-false value, then it is used: -#today = '' -# Else, today_fmt is used as the format for a strftime call. -#today_fmt = '%B %d, %Y' - -# List of patterns, relative to source directory, that match files and -# directories to ignore when looking for source files. -# exclude_patterns = ['_*', 'rn_index.rst'] - -# The reST default role (used for this markup: `text`) to use for all documents. -#default_role = None - -# If true, '()' will be appended to :func: etc. cross-reference text. -#add_function_parentheses = True - -# If true, the current module name will be prepended to all description -# unit titles (such as .. function::). -#add_module_names = True - -# If true, sectionauthor and moduleauthor directives will be shown in the -# output. They are ignored by default. -#show_authors = False - -# The name of the Pygments (syntax highlighting) style to use. -pygments_style = 'sphinx' - -# A list of ignored prefixes for module index sorting. -#modindex_common_prefix = [] - - -# -- Options for HTML output --------------------------------------------------- - -# The theme to use for HTML and HTML Help pages. See the documentation for -# a list of builtin themes. -html_theme = "mirantis" - -# Theme options are theme-specific and customize the look and feel of a theme -# further. For a list of options available for each theme, see the -# documentation. -html_theme_options = { - # Navigation bar title. (Default: ``project`` value) - 'navbar_title': "Documentation", - - # Tab name for entire site. (Default: "Site") - 'navbar_site_name': "Guide", - - # A list of tuples containing pages or urls to link to. - # Valid tuples should be in the following forms: - # (name, page) # a link to a page - # (name, "/aa/bb", 1) # a link to an arbitrary relative url - # (name, "http://example.com", True) # arbitrary absolute url - # Note the "1" or "True" value above as the third argument to indicate - # an arbitrary url. - # 'navbar_links': [ - # ("Examples", "examples"), - # ("Link", "http://example.com", True), - # ], - - # Render the next and previous page links in navbar. (Default: true) - 'navbar_sidebarrel': True, - - # Render the current pages TOC in the navbar. (Default: true) - 'navbar_pagenav': True, - - # Tab name for the current pages TOC. (Default: "Page") - 'navbar_pagenav_name': "Section", - - # Global TOC depth for "site" navbar tab. (Default: 1) - # Switching to -1 shows all levels. - 'globaltoc_depth': 2, - - # Include hidden TOCs in Site navbar? - # - # Note: If this is "false", you cannot have mixed ``:hidden:`` and - # non-hidden ``toctree`` directives in the same page, or else the build - # will break. - # - # Values: "true" (default) or "false" - 'globaltoc_includehidden': "true", - - # HTML navbar class (Default: "navbar") to attach to
      element. - # For black navbar, do "navbar navbar-inverse" - 'navbar_class': "navbar", - - # Fix navigation bar to top of page? - # Values: "true" (default) or "false" - 'navbar_fixed_top': "true", - - # Location of link to source. - # Options are "nav" (default), "footer" or anything else to exclude. - 'source_link_position': "nav", - - # Bootswatch (http://bootswatch.com/) theme. - # - # Options are nothing (default) or the name of a valid theme - # such as "amelia" or "cosmo". - 'bootswatch_theme': "yeti", - - # Choose Bootstrap version. - # Values: "3" (default) or "2" (in quotes) - 'bootstrap_version': "3", -} - -# Add any paths that contain custom themes here, relative to this directory. -html_theme_path = ['_templates'] - -# html_add_permalinks = None - -# The name for this set of Sphinx documents. If None, it defaults to -# " v documentation". -# html_title = project + ' v' + release + ' | Documentation' -html_title = project + ' v' + release + ' | Documentation' - -# A shorter title for the navigation bar. Default is the same as html_title. -#html_short_title = None - -# The name of an image file (relative to this directory) to place at the top -# of the sidebar. -html_logo = '_static/mirantis_logo.png' - -# The name of an image file (within the static path) to use as favicon of the -# docs. This file should be a Windows icon file (.ico) being 16x16 or 32x32 -# pixels large. -html_favicon = '_static/mirantis_icon.ico' - -# Add any paths that contain custom static files (such as style sheets) here, -# relative to this directory. They are copied after the builtin static files, -# so a file named "default.css" will overwrite the builtin "default.css". -html_static_path = ['_static'] - -# html_extra_path = ['_templates/mirantis/static/index.html'] - -# If not '', a 'Last updated on:' timestamp is inserted at every page bottom, -# using the given strftime format. -# html_last_updated_fmt = '%c, %Z' - -# If true, SmartyPants will be used to convert quotes and dashes to -# typographically correct entities. -html_use_smartypants = False - -# Custom sidebar templates, maps document names to template names. -#html_sidebars = { -# '**': ['searchbox.html', 'globaltoc.html'], -#} - -html_sidebars = { - '**': ['globaltoc.html'], -} - -# Additional templates that should be rendered to pages, maps page names to -# template names. -#html_additional_pages = {} - -# If false, no module index is generated. -#html_domain_indices = True - -# If false, no index is generated. -html_use_index = True - -# If true, the index is split into individual pages for each letter. -html_split_index = False - -# If true, links to the reST sources are added to the pages. -html_show_sourcelink = False - -# If true, "Created using Sphinx" is shown in the HTML footer. Default is True. -html_show_sphinx = False - -# If true, "(C) Copyright ..." is shown in the HTML footer. Default is True. -html_show_copyright = True - -# If true, an OpenSearch description file will be output, and all pages will -# contain a tag referring to it. The value of this option must be the -# base URL from which the finished HTML is served. -#html_use_opensearch = '' - -# This is the file name suffix for HTML files (e.g. ".xhtml"). -#html_file_suffix = None - -# Output file base name for HTML help builder. -htmlhelp_basename = 'fueldoc' - - -# -- Options for LaTeX output -------------------------------------------------- - -latex_elements = { -# The paper size ('letterpaper' or 'a4paper'). -#'papersize': 'letterpaper', - -# The font size ('10pt', '11pt' or '12pt'). -#'pointsize': '10pt', - -# Additional stuff for the LaTeX preamble. -#'preamble': '', -} - -# Grouping the document tree into LaTeX files. List of tuples -# (source start file, target name, title, author, documentclass [howto/manual]). -fuel = [ - ('install', 'install.tex', u'Fuel Installation Guide | Documentation', - u'Mirantis Inc.', 'manual'), -] - -# The name of an image file (relative to this directory) to place at the top of -# the title page. -#latex_logo = None - -# For "manual" documents, if this is true, then toplevel headings are parts, -# not chapters. -#latex_use_parts = False - -# If true, show page references after internal links. -#latex_show_pagerefs = False - -# If true, show URL addresses after external links. -#latex_show_urls = False - -# Documents to append as an appendix to all manuals. -#latex_appendices = [] - -# If false, no module index is generated. -#latex_domain_indices = True - - -# -- Options for manual page output -------------------------------------------- - -# One entry per manual page. List of tuples -# (source start file, name, description, authors, manual section). -man_pages = [ - ('index', 'fuel', u'Mirantis OpenStack | Documentation', - [u'Mirantis'], 1) -] - -# If true, show URL addresses after external links. -#man_show_urls = False - - -# -- Options for Texinfo output ------------------------------------------------ - -# Grouping the document tree into Texinfo files. List of tuples -# (source start file, target name, title, author, -# dir menu entry, description, category) -texinfo_documents = [ - ('index', 'fuel', u'Fuel for OpenStack | Documentation', - u'Mirantis Inc.', 'fuel', 'One line description of project.', - 'Miscellaneous'), -] - -# Documents to append as an appendix to all manuals. -#texinfo_appendices = [] - -# If false, no module index is generated. -#texinfo_domain_indices = True - -# How to display URL addresses: 'footnote', 'no', or 'inline'. -#texinfo_show_urls = 'footnote' -# -- Additional Settings ------------------------------------------------------- - - -# Add any Sphinx extension module names here, as strings. They can be extensions -# coming with Sphinx (named 'sphinx.ext.*') or your custom ones. -# extensions += ['sphinx.ext.inheritance_diagram', 'sphinxcontrib.blockdiag', 'sphinxcontrib.actdiag', 'sphinxcontrib.seqdiag', 'sphinxcontrib.nwdiag'] - -# The encoding of source files. -source_encoding = 'utf-8' -#source_encoding = 'shift_jis' - -# The language for content autogenerated by Sphinx. -#language = 'en' -#language = 'ja' - -# Enable Antialiasing -blockdiag_antialias = True -acttdiag_antialias = True -seqdiag_antialias = True -nwdiag_antialias = True - -extensions += ['rst2pdf.pdfbuilder'] -# pdf_documents = [ -# (master_doc, project, project, copyright), -# ] -pdf_stylesheets = ['letter', 'mirantis'] -pdf_style_path = ['_templates'] -#pdf_language = "en" -# Mode for literal blocks wider than the frame. Can be -# overflow, shrink or truncate -pdf_fit_mode = "shrink" - -# Section level that forces a break page. -# For example: 1 means top-level sections start in a new page -# 0 means disabled -pdf_break_level = 1 - -# When a section starts in a new page, force it to be 'even', 'odd', -# or just use 'any' -pdf_breakside = 'any' - -# Insert footnotes where they are defined instead of -# at the end. -#pdf_inline_footnotes = True - -# verbosity level. 0 1 or 2 -pdf_verbosity = 0 - -# If false, no index is generated. -#pdf_use_index = True - -# If false, no modindex is generated. -#pdf_use_modindex = False - -# If false, no coverpage is generated. -# pdf_use_coverpage = False - -# Name of the cover page template to use -pdf_cover_template = 'mirantiscover.tmpl' - -# Documents to append as an appendix to all manuals. -#pdf_appendices = [] - -# Enable experimental feature to split table cells. Use it -# if you get "DelayedTable too big" errors -#pdf_splittables = False - -# Set the default DPI for images -#pdf_default_dpi = 72 - -# Enable rst2pdf extension modules (default is only vectorpdf) -# you need vectorpdf if you want to use sphinx's graphviz support -#pdf_extensions = ['vectorpdf'] - -# Page template name for "regular" pages -# pdf_page_template = 'cutePage' -pdf_page_template = 'oneColumn' - -# Show Table Of Contents at the beginning? -pdf_use_toc = True - -# How many levels deep should the table of contents be? -pdf_toc_depth = 3 - -# Add section number to section references -#pdf_use_numbered_links = False - -# Background images fitting mode -pdf_fit_background_mode = 'scale' - -pdf_font_path = ['C:\\Windows\\Fonts\\', '/usr/share/fonts', '_fonts'] +# Add any Sphinx extension module names here, as strings. +# They can be extensions +# coming with Sphinx (named 'sphinx.ext.*') or your custom ones. +extensions += ['sphinx.ext.inheritance_diagram', 'sphinxcontrib.blockdiag', + 'sphinxcontrib.actdiag', 'sphinxcontrib.seqdiag', + 'sphinxcontrib.nwdiag'] + +# The encoding of source files. +source_encoding = 'utf-8-sig' +#source_encoding = 'shift_jis' + +# The language for content autogenerated by Sphinx. +language = 'en' +#language = 'ja' + +# The theme to use for HTML and HTML Help pages. +#html_theme = 'default' +#html_theme = 'sphinxdoc' +#html_theme = 'scrolls' +#html_theme = 'agogo' +#html_theme = 'traditional' +#html_theme = 'nature' +#html_theme = 'haiku' + +# If this is not the empty string, a 'Last updated on:' timestamp +# is inserted at every page bottom, using the given strftime() format. +# Default is '%b %d, %Y' (or a locale-dependent equivalent). +html_last_updated_fmt = '%Y/%m/%d' + +# Enable Antialiasing +blockdiag_antialias = True +acttdiag_antialias = True +seqdiag_antialias = True +nwdiag_antialias = True + +extensions += ['rst2pdf.pdfbuilder'] +pdf_documents = [ + (master_doc, project, project, copyright), +] +pdf_stylesheets = ['sphinx', 'kerning', 'a4'] +pdf_language = "en_US" +# Mode for literal blocks wider than the frame. Can be +# overflow, shrink or truncate +pdf_fit_mode = "shrink" + +# Section level that forces a break page. +# For example: 1 means top-level sections start in a new page +# 0 means disabled +#pdf_break_level = 0 + +# When a section starts in a new page, force it to be 'even', 'odd', +# or just use 'any' +pdf_breakside = 'any' + +# Insert footnotes where they are defined instead of +# at the end. +pdf_inline_footnotes = False + +# verbosity level. 0 1 or 2 +pdf_verbosity = 0 + +# If false, no index is generated. +pdf_use_index = True + +# If false, no modindex is generated. +pdf_use_modindex = True + +# If false, no coverpage is generated. +pdf_use_coverpage = True + +# Name of the cover page template to use +#pdf_cover_template = 'sphinxcover.tmpl' + +# Documents to append as an appendix to all manuals. +#pdf_appendices = [] + +# Enable experimental feature to split table cells. Use it +# if you get "DelayedTable too big" errors +#pdf_splittables = False + +# Set the default DPI for images +#pdf_default_dpi = 72 + +# Enable rst2pdf extension modules (default is only vectorpdf) +# you need vectorpdf if you want to use sphinx's graphviz support +#pdf_extensions = ['vectorpdf'] + +# Page template name for "regular" pages +#pdf_page_template = 'cutePage' + +# Show Table Of Contents at the beginning? +pdf_use_toc = True + +# How many levels deep should the table of contents be? +pdf_toc_depth = 3 + +# Add section number to section references +pdf_use_numbered_links = False + +# Background images fitting mode +pdf_fit_background_mode = 'scale' diff --git a/conf.py b/conf.py index bf113953e..0d461f0bb 100644 --- a/conf.py +++ b/conf.py @@ -1,9 +1,9 @@ # -*- coding: utf-8 -*- # -# "Fuel" documentation build configuration file, created by -# sphinx-quickstart on Tue Sep 25 14:02:29 2012. +# fuel documentation build configuration file # -# This file is execfile()d with the current directory set to its containing dir. +# This file is execfile()d with the current directory set to its containing +# dir. # # Note that not all possible configuration values are present in this # autogenerated file. @@ -11,7 +11,250 @@ # All configuration values have a default; values that are commented out # serve to show the default. -# -- Default Settings ----------------------------------------------------- -execfile('./common_conf.py') +import os +import sys -exclude_patterns = ['_*', 'pages', 'contents', 'pdf', '.tox', '*egg'] +sys.path.insert(0, os.path.join(os.path.abspath('.'))) + +autodoc_default_flags = ['members', 'show-inheritance'] +autodoc_member_order = 'bysource' + +# If extensions (or modules to document with autodoc) are in another directory, +# add these directories to sys.path here. If the directory is relative to the +# documentation root, use os.path.abspath to make it absolute, like shown here. +#sys.path.insert(0, os.path.abspath('.')) + +# -- General configuration ---------------------------------------------------- + +# If your documentation needs a minimal Sphinx version, state it here. +#needs_sphinx = '1.0' + +# Add any Sphinx extension module names here, as strings. They can be +# extensions coming with Sphinx (named 'sphinx.ext.*') or your custom ones. +extensions = [ + 'sphinx.ext.autodoc', + 'rst2pdf.pdfbuilder' +# 'sphinxcontrib.plantuml' +] +#plantuml = ['java', '-jar', 'plantuml.jar'] + +# Add any paths that contain templates here, relative to this directory. +templates_path = ['_templates'] + +# The suffix of source filenames. +source_suffix = '.rst' + +# The encoding of source files. +#source_encoding = 'utf-8-sig' + +# The master toctree document. +master_doc = 'index' + +# General information about the project. +project = u'Fuel' +copyright = u'2012-2014, Mirantis' + +# The version info for the project you're documenting, acts as replacement for +# |version| and |release|, also used in various other places throughout the +# built documents. +# +# The short X.Y version. +version = '0' +# The full version, including alpha/beta/rc tags. +release = '' + +# The language for content autogenerated by Sphinx. Refer to documentation +# for a list of supported languages. +language = 'en' + +# There are two options for replacing |today|: either, you set today to some +# non-false value, then it is used: +#today = '' +# Else, today_fmt is used as the format for a strftime call. +#today_fmt = '%B %d, %Y' + +# List of patterns, relative to source directory, that match files and +# directories to ignore when looking for source files. +exclude_patterns = ['_build', '.*'] + +# The reST default role (used for this markup: `text`) to use for all +# documents. +#default_role = None + +# If true, '()' will be appended to :func: etc. cross-reference text. +#add_function_parentheses = True + +# If true, the current module name will be prepended to all description +# unit titles (such as .. function::). +#add_module_names = True + +# If true, sectionauthor and moduleauthor directives will be shown in the +# output. They are ignored by default. +#show_authors = False + +# The name of the Pygments (syntax highlighting) style to use. +pygments_style = 'sphinx' + +# A list of ignored prefixes for module index sorting. +#modindex_common_prefix = [] + + +# -- Options for HTML output -------------------------------------------------- + +# The theme to use for HTML and HTML Help pages. See the documentation for +# a list of builtin themes. +html_theme = 'sphinxdoc' + +# Theme options are theme-specific and customize the look and feel of a theme +# further. For a list of options available for each theme, see the +# documentation. +#html_theme_options = {} + +# Add any paths that contain custom themes here, relative to this directory. +html_theme_path = ["_templates"] + +# The name for this set of Sphinx documents. If None, it defaults to +# " v documentation". +#html_title = None + +# A shorter title for the navigation bar. Default is the same as html_title. +#html_short_title = None + +# The name of an image file (relative to this directory) to place at the top +# of the sidebar. +#html_logo = None + +# The name of an image file (within the static path) to use as favicon of the +# docs. This file should be a Windows icon file (.ico) being 16x16 or 32x32 +# pixels large. +#html_favicon = None + +# Add any paths that contain custom static files (such as style sheets) here, +# relative to this directory. They are copied after the builtin static files, +# so a file named "default.css" will overwrite the builtin "default.css". +# html_static_path = ['_static'] + +# If not '', a 'Last updated on:' timestamp is inserted at every page bottom, +# using the given strftime format. +#html_last_updated_fmt = '%b %d, %Y' + +# If true, SmartyPants will be used to convert quotes and dashes to +# typographically correct entities. +#html_use_smartypants = True + +# Custom sidebar templates, maps document names to template names. +html_sidebars = { + '**': ['localtoc.html', 'relations.html', 'sourcelink.html', 'sidebarpdf.html', 'searchbox.html'], +} + +# Additional templates that should be rendered to pages, maps page names to +# template names. +#html_additional_pages = {} + +# If false, no module index is generated. +#html_domain_indices = True + +# If false, no index is generated. +#html_use_index = True + +# If true, the index is split into individual pages for each letter. +#html_split_index = False + +# If true, links to the reST sources are added to the pages. +#html_show_sourcelink = True + +# If true, "Created using Sphinx" is shown in the HTML footer. Default is True. +#html_show_sphinx = True + +# If true, "(C) Copyright ..." is shown in the HTML footer. Default is True. +#html_show_copyright = True + +# If true, an OpenSearch description file will be output, and all pages will +# contain a tag referring to it. The value of this option must be the +# base URL from which the finished HTML is served. +#html_use_opensearch = '' + +# This is the file name suffix for HTML files (e.g. ".xhtml"). +#html_file_suffix = None + +# Output file base name for HTML help builder. +htmlhelp_basename = 'fuel-doc' + + +# -- Options for LaTeX output ------------------------------------------------- + +latex_elements = { + # The paper size ('letterpaper' or 'a4paper'). + 'papersize': 'a4paper', + + # The font size ('10pt', '11pt' or '12pt'). + 'pointsize': '12pt', + + # Additional stuff for the LaTeX preamble. + 'preamble': ''' + \setcounter{tocdepth}{3} + \usepackage{tocbibind} + \pagenumbering{arabic} + ''' +} + +# Grouping the document tree into LaTeX files. List of tuples +# (source start file, target name, title, author, documentclass +# [howto/manual]). +latex_documents = [ + ('index', 'fuel.tex', u'Fuel Documentation', u'Mike Scherbakov', 'manual'), +] + +# The name of an image file (relative to this directory) to place at the top of +# the title page. +#latex_logo = None + +# For "manual" documents, if this is true, then toplevel headings are parts, +# not chapters. +#latex_use_parts = False + +# If true, show page references after internal links. +#latex_show_pagerefs = False + +# If true, show URL addresses after external links. +#latex_show_urls = False + +# Documents to append as an appendix to all manuals. +#latex_appendices = [] + +# If false, no module index is generated. +#latex_domain_indices = True + + +# -- Options for manual page output ------------------------------------------- + +# One entry per manual page. List of tuples +# (source start file, name, description, authors, manual section). +man_pages = [ + ('index', 'fuel', u'Fuel Documentation', [u'Mike Scherbakov'], 1) +] + +# If true, show URL addresses after external links. +#man_show_urls = False + + +# -- Options for Texinfo output ----------------------------------------------- + +# Grouping the document tree into Texinfo files. List of tuples +# (source start file, target name, title, author, +# dir menu entry, description, category) +texinfo_documents = [( + 'index', 'fuel', u'Fuel Documentation', u'Mike Scherbakov', + 'fuel', 'OpenStack Installer', 'Miscellaneous'), +] + +# Documents to append as an appendix to all manuals. +#texinfo_appendices = [] + +# If false, no module index is generated. +#texinfo_domain_indices = True + +# How to display URL addresses: 'footnote', 'no', or 'inline'. +#texinfo_show_urls = 'footnote' +# -- Additional Settings ------------------------------------------------------ +execfile('./common_conf.py') diff --git a/contents.rst b/contents.rst deleted file mode 100644 index 835cdafaf..000000000 --- a/contents.rst +++ /dev/null @@ -1,21 +0,0 @@ -.. index:: Documentation - -.. _Documentation: - -============================= -Documentation -============================= - -.. toctree:: - - quickstart-guide - planning-guide - user-guide - operations - monitoring-guide - reference-architecture - terminology - plugin-dev - file-ref - release-notes - fuel-install-guide diff --git a/contents/contents-file-ref.rst b/contents/contents-file-ref.rst deleted file mode 100644 index d08dc2c02..000000000 --- a/contents/contents-file-ref.rst +++ /dev/null @@ -1 +0,0 @@ -.. include:: /pages/file-ref/0000-intro.rst diff --git a/contents/contents-fuel-install.rst b/contents/contents-fuel-install.rst deleted file mode 100644 index 342000808..000000000 --- a/contents/contents-fuel-install.rst +++ /dev/null @@ -1,49 +0,0 @@ -.. include:: /pages/draft/fuel-install-guide/intro_fuel_install_intro.rst -.. include:: /pages/draft/fuel-install-guide/intro_fuel_intro.rst -.. include:: /pages/draft/fuel-install-guide/intro_install_overview.rst -.. include:: /pages/draft/fuel-install-guide/intro_planning_your_environment.rst -.. include:: /pages/draft/fuel-install-guide/sysreq_intro.rst -.. include:: /pages/draft/fuel-install-guide/sysreq_hw_intro.rst -.. include:: /pages/draft/fuel-install-guide/sysreq_fuel_master_node_hw_requirements.rst -.. include:: /pages/draft/fuel-install-guide/sysreq_fuel_slave_node_hw_recs.rst -.. include:: /pages/draft/fuel-install-guide/sysreq_network_requirements.rst -.. include:: /pages/draft/fuel-install-guide/sysreq_fuel_master_node_network_reqs.rst -.. include:: /pages/draft/fuel-install-guide/sysreq_storage_reqs.rst -.. include:: /pages/draft/fuel-install-guide/sysreq_sample_configuration.rst -.. include:: /pages/draft/fuel-install-guide/sysreq_sample_configuration_controllers.rst -.. include:: /pages/draft/fuel-install-guide/sysreq_sample_configuration_compute.rst -.. include:: /pages/draft/fuel-install-guide/sysreq_sample_configuration_storage.rst -.. include:: /pages/draft/fuel-install-guide/install_intro.rst -.. include:: /pages/draft/fuel-install-guide/install_before_you_install_fuel.rst -.. include:: /pages/draft/fuel-install-guide/install_download_iso.rst -.. include:: /pages/draft/fuel-install-guide/install_prepare_install_media.rst -.. include:: /pages/draft/fuel-install-guide/install_install_fuel_master_node.rst -.. include:: /pages/draft/fuel-install-guide/install_set_up_fuel.rst -.. include:: /pages/draft/fuel-install-guide/install_change_network_interface.rst -.. include:: /pages/draft/fuel-install-guide/install_login_fuel_master_node.rst -.. include:: /pages/draft/fuel-install-guide/install_login_fuel_master_node_multiple_nics.rst -.. include:: /pages/draft/fuel-install-guide/install_boot_slave_nodes.rst -.. include:: /pages/draft/fuel-install-guide/plugins_intro.rst -.. include:: /pages/draft/fuel-install-guide/plugins_overview.rst -.. include:: /pages/draft/fuel-install-guide/plugins_prerequisites.rst -.. include:: /pages/draft/fuel-install-guide/plugins_install_plugins.rst -.. include:: /pages/draft/fuel-install-guide/plugins_view_plugins.rst -.. include:: /pages/draft/fuel-install-guide/plugins_uninstall_upgrade.rst -.. include:: /pages/draft/fuel-install-guide/vsphere-intro.rst -.. include:: /pages/draft/fuel-install-guide/vsphere-upload-iso.rst -.. include:: /pages/draft/fuel-install-guide/vsphere-configure-network.rst -.. include:: /pages/draft/fuel-install-guide/vsphere-create-vm.rst -.. include:: /pages/draft/fuel-install-guide/vsphere-mount-iso.rst -.. include:: /pages/draft/fuel-install-guide/vsphere-install-master.rst -.. include:: /pages/draft/fuel-install-guide/vsphere-boot-master.rst -.. include:: /pages/draft/fuel-install-guide/vsphere-verify-master.rst -.. include:: /pages/draft/fuel-install-guide/upgrade-intro.rst -.. include:: /pages/draft/fuel-install-guide/upgrade-internals.rst -.. include:: /pages/draft/fuel-install-guide/upgrade-table.rst -.. include:: /pages/draft/fuel-install-guide/upgrade-fuel-master.rst -.. include:: /pages/draft/fuel-install-guide/upgrade-local-repo.rst -.. include:: /pages/draft/fuel-install-guide/upgrade-major-versions.rst -.. include:: /pages/draft/fuel-install-guide/upgrade-apply-patches.rst -.. include:: /pages/draft/fuel-install-guide/preinstall_intro.rst -.. include:: /pages/draft/fuel-install-guide/preinstall_hardware_checklist.rst - diff --git a/contents/contents-monitoring-guide.rst b/contents/contents-monitoring-guide.rst deleted file mode 100644 index 28e18692f..000000000 --- a/contents/contents-monitoring-guide.rst +++ /dev/null @@ -1,10 +0,0 @@ -.. include:: /pages/monitoring-guide/introduction.rst -.. include:: /pages/monitoring-guide/assumptions.rst -.. include:: /pages/monitoring-guide/intended-audience.rst -.. include:: /pages/monitoring-guide/document-scope.rst -.. include:: /pages/monitoring-guide/common-monitoring-practices/common-monitoring-practices.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/monitoring-activities-details.rst -.. include:: /pages/monitoring-guide/ha-cluster.rst -.. include:: /pages/monitoring-guide/storage-clusters/storage-clusters.rst -.. include:: /pages/monitoring-guide/hardware-and-system-monitoring/hardware-and-system-monitoring.rst -.. include:: /pages/monitoring-guide/appendix/appendix.rst diff --git a/contents/contents-operations.rst b/contents/contents-operations.rst deleted file mode 100644 index 7d4232e32..000000000 --- a/contents/contents-operations.rst +++ /dev/null @@ -1,48 +0,0 @@ -.. include:: /pages/operations/0000-intro.rst -.. include:: /pages/operations/0400-shell.rst -.. include:: /pages/operations/2290-exclude-from-raid.rst -.. include:: /pages/operations/0500-kernel-parameters.rst -.. include:: /pages/operations/2310-create-xfs.rst -.. include:: /pages/operations/2410-galera-autorebuild.rst -.. include:: /pages/operations/2450-galera-backport-ocf.rst -.. include:: /pages/operations/2452-backport-memcached-fixes-op.rst -.. include:: /pages/operations/2451-rabbitmq-backport-ocf.rst -.. include:: /pages/operations/2455-manage-openstack-services.rst -.. include:: /pages/operations/2320-redeploy-node.rst -.. include:: /pages/operations/2360-config-operating-system-node.rst -.. include:: /pages/operations/2500-delete-ceph-osd.rst -.. include:: /pages/operations/2510-ceph-osd-placement-groups.rst -.. include:: /pages/operations/how-to-shutdown-cluster-ops.rst -.. include:: /pages/operations/3000-ml2-create.rst -.. include:: /pages/operations/3500-mcn.rst -.. include:: /pages/operations/5400-puppet-custom-attributes.rst -.. include:: /pages/operations/docker-on-master.rst -.. include:: /pages/operations/2800-experimental.rst -.. include:: /pages/operations/6500-fuel-auth.rst -.. include:: /pages/operations/6700-ceph.rst -.. include:: /pages/operations/7000-sahara.rst -.. include:: /pages/operations/7400-murano.rst -.. include:: /pages/operations/7450-mm-ops.rst -.. include:: /pages/operations/7800-vcenter.rst -.. include:: /pages/operations/8000-performance.rst -.. include:: /pages/operations/8100-backup.rst -.. include:: /pages/operations/8200-slave-nodes-pxe.rst -.. include:: /pages/operations/8500-ceilometer.rst -.. include:: /pages/operations/8600-heat.rst -.. include:: /pages/operations/8800-horizon.rst -.. include:: /pages/operations/8900-testing-details.rst -.. include:: /pages/operations/corosync2.rst -.. include:: /pages/operations/9000-troubleshoot.rst -.. include:: /pages/operations/9600-upgrade.rst -.. include:: /pages/operations/enable_ubuntu_bootstrap.rst -.. include:: /pages/operations/ha-testing-scenarios-ops.rst -.. include:: /pages/operations/db-backup-ops.rst -.. include:: /pages/operations/isoUSB-ops.rst -.. include:: /pages/operations/empty-role.rst -.. include:: /pages/operations/configuring-repos-ops.rst -.. include:: /pages/operations/external-ubuntu-ops.rst -.. include:: /pages/operations/patching-ops.rst -.. include:: /pages/operations/reduced-footprint-ops.rst -.. include:: /pages/operations/tls-ssl-ops.rst -.. include:: /pages/operations/templates-networking-ops.rst -.. include:: /pages/operations/templates-networking-examples.rst diff --git a/contents/contents-planning-guide.rst b/contents/contents-planning-guide.rst deleted file mode 100644 index 1f25d7979..000000000 --- a/contents/contents-planning-guide.rst +++ /dev/null @@ -1,16 +0,0 @@ -.. include:: /pages/planning-guide/0010-intro.rst -.. include:: /pages/planning-guide/0020-system-requirements.rst -.. include:: /pages/planning-guide/4000-planning-summary.rst -.. include:: /pages/planning-guide/4200-net-topology.rst -.. include:: /pages/planning-guide/4360-storage-plan.rst -.. include:: /pages/planning-guide/4400-nodes-roles.rst -.. include:: /pages/planning-guide/4450-monitoring.rst -.. include:: /pages/planning-guide/7000-sahara-plan.rst -.. include:: /pages/planning-guide/7000-vcenter-plan.rst -.. include:: /pages/planning-guide/7300-fuel-on-vsphere-prepare.rst -.. include:: /pages/planning-guide/4500-hardware.rst -.. include:: /pages/planning-guide/0010-prerequisites.rst -.. include:: /pages/planning-guide/0080-reference-configuration.rst -.. include:: /pages/planning-guide/ha-testing.rst -.. include:: /pages/planning-guide/hcl.rst -.. include:: /pages/planning-guide/0090-appendix.rst diff --git a/contents/contents-plugin-dev.rst b/contents/contents-plugin-dev.rst deleted file mode 100644 index 5f788202c..000000000 --- a/contents/contents-plugin-dev.rst +++ /dev/null @@ -1 +0,0 @@ -.. include:: /pages/plugin-dev/links.rst \ No newline at end of file diff --git a/contents/contents-quickstart-guide.rst b/contents/contents-quickstart-guide.rst deleted file mode 100644 index 02d60fd4a..000000000 --- a/contents/contents-quickstart-guide.rst +++ /dev/null @@ -1,16 +0,0 @@ -.. include:: /pages/quickstart-guide/0300-qs-intro.rst -.. include:: /pages/quickstart-guide/0310-qs-prereq.rst -.. include:: /pages/quickstart-guide/0311-qs-supported-os.rst -.. include:: /pages/quickstart-guide/0320-qs-download.rst -.. include:: /pages/quickstart-guide/0330-qs-install-scripts.rst -.. include:: /pages/quickstart-guide/0331-qs-modify-params.rst -.. include:: /pages/quickstart-guide/0332-qs-run-scripts-win.rst -.. include:: /pages/quickstart-guide/0333-qs-install-scripts-procedure.rst -.. include:: /pages/quickstart-guide/0340-qs-install-manual.rst -.. include:: /pages/quickstart-guide/0341-qs-config-vm.rst -.. include:: /pages/quickstart-guide/0342-qs-vm-prereq-vm.rst -.. include:: /pages/quickstart-guide/0343-qs-config-network.rst -.. include:: /pages/quickstart-guide/0344-qs-create-vm.rst -.. include:: /pages/quickstart-guide/0345-qs-mount-iso.rst -.. include:: /pages/quickstart-guide/0346-qs-install-fuel.rst -.. include:: /pages/quickstart-guide/0350-qs-issues.rst diff --git a/contents/contents-refarch.rst b/contents/contents-refarch.rst deleted file mode 100644 index 58601bc22..000000000 --- a/contents/contents-refarch.rst +++ /dev/null @@ -1,20 +0,0 @@ -.. include:: /pages/reference-architecture/0010-overview.rst -.. include:: /pages/reference-architecture/0014-compact.rst -.. include:: /pages/reference-architecture/0015-closer-look.rst -.. include:: /pages/reference-architecture/1000-logical-setup.rst -.. include:: /pages/reference-architecture/1100-ha-notes.rst -.. include:: /pages/reference-architecture/1200-mysql-galera.rst -.. include:: /pages/reference-architecture/7000-vcenter.rst -.. include:: /pages/reference-architecture/1700-ceph.rst -.. include:: /pages/reference-architecture/6000-network-architecture.rst -.. include:: /pages/reference-architecture/6050-neutron-topologies.rst -.. include:: /pages/reference-architecture/6070-nova-topologies.rst -.. include:: /pages/reference-architecture/0100-openvswitch.rst -.. include:: /pages/reference-architecture/0110-bonding.rst -.. include:: /pages/reference-architecture/8000-fuel-upgrade.rst -.. include:: /pages/reference-architecture/8800-base-os.rst -.. include:: /pages/reference-architecture/9000-fuel-provision.rst -.. include:: /pages/reference-architecture/9900-task-deployment.rst -.. include:: /pages/reference-architecture/containers-master-node.rst -.. include:: /pages/reference-architecture/fuel-rep-mirror.rst -.. include:: /pages/reference-architecture/61-network-perf.rst diff --git a/contents/contents-release-notes.rst b/contents/contents-release-notes.rst deleted file mode 100644 index 6d94af2a8..000000000 --- a/contents/contents-release-notes.rst +++ /dev/null @@ -1,13 +0,0 @@ -.. include:: /pages/release-notes/v7-0-kilo-full.rst -.. include /pages/release-notes/v6-1-juno-full.rst -.. include /pages/release-notes/v6-0-juno-full.rst -.. include /pages/release-notes/v5-1-icehouse-full.rst -.. include /pages/release-notes/v5-0-icehouse-full.rst -.. include /pages/release-notes/v4-1-havana-full.rst -.. include /pages/release-notes/v4-0-havana-full.rst -.. include /pages/release-notes/v3-2-1-grizzly-full.rst -.. include /pages/release-notes/v3-1-grizzly.rst -.. include /pages/release-notes/v3-0-grizzly.rst -.. include /pages/release-notes/v2-1-folsom.rst -.. include /pages/release-notes/v2-0-folsom.rst -.. include /pages/release-notes/v1-0-essex.rst diff --git a/contents/contents-style-guide.rst b/contents/contents-style-guide.rst deleted file mode 100644 index 18f80b0c1..000000000 --- a/contents/contents-style-guide.rst +++ /dev/null @@ -1,8 +0,0 @@ -.. include:: /pages/style-guide/0010-intro.rst -.. include:: /pages/style-guide/0100-words.rst -.. include:: /pages/style-guide/0200-syntax.rst -.. include:: /pages/style-guide/0300-coding.rst -.. include:: /pages/style-guide/0901-style-notes-fuel-plugins.rst -.. include:: /pages/style-guide/0800-git-gerrit.rst -.. include:: /pages/style-guide/0900-reviewer-checklist.rst - diff --git a/contents/contents-terminology.rst b/contents/contents-terminology.rst deleted file mode 100644 index 46d63216b..000000000 --- a/contents/contents-terminology.rst +++ /dev/null @@ -1 +0,0 @@ -.. include:: /pages/terminology/allterms.rst diff --git a/contents/contents-user.rst b/contents/contents-user.rst deleted file mode 100644 index 0766a37da..000000000 --- a/contents/contents-user.rst +++ /dev/null @@ -1,17 +0,0 @@ -.. include:: /pages/user-guide/0070-introduction.rst -.. include:: /pages/user-guide/1500-confirm-hardware.rst -.. include:: /pages/user-guide/2000-install-boot.rst -.. include:: /pages/user-guide/fuel-plugins/010-install-plugin.rst -.. include:: /pages/user-guide/3000-create-environment.rst -.. include:: /pages/user-guide/4000-configure-environment.rst -.. include:: /pages/user-guide/5000-deploy-environment.rst -.. include:: /pages/user-guide/6000-next-steps.rst -.. include:: /pages/user-guide/post-install-healthchecks.rst -.. include:: /pages/user-guide/7000-sahara-install.rst -.. include:: /pages/user-guide/8000-upgrade.rst -.. include:: /pages/user-guide/9000-role-operations.rst -.. include:: /pages/user-guide/cli.rst -.. include:: /pages/user-guide/patching-ug.rst -.. include:: /pages/user-guide/rollback-ug.rst -.. include:: /pages/user-guide/9100-use-shotgun.rst -.. include:: /pages/user-guide/vmware-integration-notes.rst diff --git a/develop.rst b/develop.rst new file mode 100644 index 000000000..f5dda8d25 --- /dev/null +++ b/develop.rst @@ -0,0 +1,25 @@ +.. _develop: + +Development Documentation +========================= + +.. toctree:: + :maxdepth: 3 + :numbered: + + develop/architecture + develop/sequence + develop/quick_start + develop/addition_examples + develop/env + develop/system_tests/tree + develop/live_masternode + develop/nailgun + develop/module_structure + develop/fuel_settings + develop/puppet_tips + develop/pxe_deployment + develop/ostf_contributors_guide + develop/custom-bootstrap-node + develop/modular-architecture + develop/separateMOS diff --git a/develop/_images/dependGraph.png b/develop/_images/dependGraph.png new file mode 100644 index 000000000..46e3d94c9 Binary files /dev/null and b/develop/_images/dependGraph.png differ diff --git a/develop/_images/dependGraph02.png b/develop/_images/dependGraph02.png new file mode 100644 index 000000000..de0d2a3fe Binary files /dev/null and b/develop/_images/dependGraph02.png differ diff --git a/develop/_images/granularDeployment.png b/develop/_images/granularDeployment.png new file mode 100644 index 000000000..8424a46dc Binary files /dev/null and b/develop/_images/granularDeployment.png differ diff --git a/develop/_images/graph.png b/develop/_images/graph.png new file mode 100644 index 000000000..f4dce3c46 Binary files /dev/null and b/develop/_images/graph.png differ diff --git a/develop/_images/nmanager.png b/develop/_images/nmanager.png new file mode 100644 index 000000000..7a296a20f Binary files /dev/null and b/develop/_images/nmanager.png differ diff --git a/develop/_images/plugin_structure.png b/develop/_images/plugin_structure.png new file mode 100644 index 000000000..f0ac031fe Binary files /dev/null and b/develop/_images/plugin_structure.png differ diff --git a/develop/_images/test_docstring_structure.png b/develop/_images/test_docstring_structure.png new file mode 100644 index 000000000..13a87ec3a Binary files /dev/null and b/develop/_images/test_docstring_structure.png differ diff --git a/develop/addition_examples.rst b/develop/addition_examples.rst new file mode 100644 index 000000000..e1560d132 --- /dev/null +++ b/develop/addition_examples.rst @@ -0,0 +1,198 @@ +Fuel Development Examples +========================= + +This section provides examples of the Fuel development +process. It builds on the information in the `How to +contribute +`_ +document, and the :doc:`Fuel Development Quick-Start Guide +` which illustrate the development +process for a single Fuel component. These examples show how +to manage development and integration of a more complicated +example. + +Any new feature effort should start with the creation of a +blueprint where implementation decisions and related commits +are tracked. More information on launchpad blueprints can +be found here: `https://wiki.openstack.org/wiki/Blueprints +`_. + +Understanding the Fuel architecture helps you understand +which components any particular addition will impact. The +following documents provide valuable information about the +Fuel architecture, and the provisioning and deployment +process: + +* `Fuel architecture on the OpenStack wiki `_ +* :doc:`Architecture section of Fuel documentation ` +* :doc:`Visual of provisioning tasks ` + +Adding Zabbix Role +------------------ + +This section outlines the steps followed to add a new role +to Fuel. In this case, monitoring service functionality was +added by enabling the deployment of a Zabbix server +configured to monitor an OpenStack environment deployed by +Fuel. + +The monitoring server role was initially planned in `this +blueprint +`_. +Core Fuel developers provided feedback to small +commits via Gerrit and IRC while the work was coming +together. Ultimately the work was rolled up into two +commits including over 23k lines of code, and these two +commits were merged into `fuel-web `_ +and `fuel-library +`_. + +Additions to Fuel-Web for Zabbix role +------------------------------------- + +In fuel-web, the `Support for Zabbix +`_ commit added the +additional role to :doc:`Nailgun `. The +reader is urged to review this commit closely as a good +example of where specific additions fit. In order to +include this as an option in the Fuel deployment process, +the following files were included in the commit for +fuel-web: + +UI components:: + + nailgun/static/translations/core.json + nailgun/static/js/views/cluster_page_tabs/nodes_tab_screens/node_list_screen.jsx + +Testing additions:: + + nailgun/nailgun/test/integration/test_cluster_changes_handler.py + nailgun/nailgun/test/integration/test_orchestrator_serializer.py + +General Nailgun additions:: + + nailgun/nailgun/errors/__init__.py + nailgun/nailgun/fixtures/openstack.yaml + nailgun/nailgun/network/manager.py + nailgun/nailgun/orchestrator/deployment_serializers.py + nailgun/nailgun/rpc/receiver.py + nailgun/nailgun/settings.yaml + nailgun/nailgun/task/task.py + nailgun/nailgun/utils/zabbix.py + +Additions to Fuel-Library for Zabbix role +----------------------------------------- + +In addition to the Nailgun additions, the related Puppet +modules were added to the `fuel-library repository +`_. This +`Zabbix fuel-library integration +`_ commit included +all the puppet files, many of which are brand new modules +specifically for Zabbix, in addition to adjustments to the +following files:: + + deployment/puppet/openstack/manifests/logging.pp + deployment/puppet/osnailyfacter/manifests/cluster_ha.pp + deployment/puppet/osnailyfacter/manifests/cluster_simple.pp + +Once all these commits passed CI and had been reviewed by +both community members and the Fuel PTLs, they were merged +into master. + +Adding Hardware Support +----------------------- + +This section outlines the steps followed to add support for +a Mellanox network card, which requires a kernel driver that +is available in most Linux distributions but was not loaded +by default. Adding support for other hardware would touch +similar Fuel components, so this outline should provide a +reasonable guide for contributors wishing to add support for +new hardware to Fuel. + +It is important to keep in mind that the Fuel node discovery +process works by providing a bootstrap image via PXE. Once +the node boots with this image, a basic inventory of +hardware information is gathered and sent back to the Fuel +controller. If a node contains hardware requiring a unique +kernel module, the bootstrap image must contain that module +in order to detect the hardware during discovery. + +In this example, loading the module in the bootstrap image +was enabled by adjusting the ISO makefile and specifying the +appropriate requirements. + +Adding a hardware driver to bootstrap +------------------------------------- + +The `Added bootstrap support to Mellanox +`_ commit shows how +this is achieved by adding the modprobe call to load the +driver specified in the requirements-rpm.txt file, requiring +modification of only two files in the fuel-main repository:: + + bootstrap/module.mk + requirements-rpm.txt + +.. note:: Any package specified in the bootstrap building procedure + must be listed in the requirements-rpm.txt file explicitly. + The Fuel mirrors must be rebuilt by the OSCI team prior to + merging requests like this one. + +.. note:: Changes made to bootstrap do not affect package sets for + target systems, so in case if you're adding support for NIC, + for example, you have to add installation of all related + packages to kickstart/preceed as well. + +The `Adding OFED drivers installation +`_ commit shows the +changes made to the preseed (for Ubuntu) and kickstart (for +CentOS) files in the fuel-library repository:: + + deployment/puppet/cobbler/manifests/snippets.pp + deployment/puppet/cobbler/templates/kickstart/centos.ks.erb + deployment/puppet/cobbler/templates/preseed/ubuntu-1404.preseed.erb + deployment/puppet/cobbler/templates/snippets/centos_ofed_prereq_pkgs_if_enabled.erb + deployment/puppet/cobbler/templates/snippets/ofed_install_with_sriov.erb + deployment/puppet/cobbler/templates/snippets/ubuntu_packages.erb + +Though this example did not require it, if the hardware +driver is required during the operating system installation, +the installer images (debian-installer and anaconda) would +also need to be repacked. For most installations though, +ensuring the driver package is available during installation +should be sufficient. + +Adding to Fuel package repositories +----------------------------------- + +If the addition will be committed back to the public Fuel +codebase to benefit others, you will need to submit a bug in +the Fuel project to request the package be added to the +repositories. + +Let's look at this process step by step by the example +of `Add neutron-lbaas-agent package +`_ bug: + +* you create a bug in the Fuel project providing full description on + the packages to be added, and assign it to the Fuel OSCI team +* you create a request to add these packages to Fuel requirements-\*.txt + files `Add all neutron packages to requirements + `_ + You receive +1 vote from Fuel CI if these packages already exist on + either Fuel internal mirrors or upstream mirrors for respective OS + type (rpm/deb), or -1 vote in any other case. +* if requested packages do not exist in the upstream OS distributive, + OSCI team builds them and then places on internal Fuel mirrors +* OSCI team rebuilds public Fuel mirrors with `Add all neutron packages to + requirements `_ request +* `Add all neutron packages to requirements + `_ request is merged + +.. note:: The package must include a license that complies + with the Fedora project license requirements for binary + firmware. See the `Fedora Project licensing page + `_ + for more information. diff --git a/develop/architecture.rst b/develop/architecture.rst new file mode 100644 index 000000000..9a8367a7e --- /dev/null +++ b/develop/architecture.rst @@ -0,0 +1,182 @@ +Fuel Architecture +================= + +Good overview of Fuel architecture is represented on +`OpenStack wiki `_. +You can find a detailed breakdown of how this works in the +:doc:`Sequence Diagrams `. + +Master node is the main part of the Fuel project. It contains all the +services needed for network provisioning of other managed nodes, +installing an operating system, and then deploying OpenStack services to +create a cloud environment. *Nailgun* is the most important service. +It is a RESTful application written in Python that contains all the +business logic of the system. A user can interact with it either using +the *Fuel Web* interface or by the means of *CLI utility*. He can create +a new environment, edit its settings, assign roles to the discovered +nodes, and start the deployment process of the new OpenStack cluster. + +Nailgun stores all of its data in a *PostgreSQL* database. It contains +the hardware configuration of all discovered managed nodes, the roles, +environment settings, current deployment status and progress of +running deployments. + +#.. uml:: + +# package "Discovered Node" { +# component "Nailgun Agent" +# } + +# package "Master Node" { +# component "Nailgun" +# component "Database" +# interface "REST API" +# component "Fuel Web" +# } + +# actor "User" +# component "CLI tool" + +# [User] -> [CLI tool] +# [User] -> [Fuel Web] +# [Nailgun Agent] -> [REST API] : Upload hardware profile + +# [CLI tool] -> [REST API] +# [Fuel Web] -> [REST API] +# [REST API] -> [Nailgun] +# [Nailgun] -> [Database] + +Managed nodes are discovered over PXE using a special bootstrap image +and the PXE boot server located on the master node. The bootstrap image +runs a special script called Nailgun agent. The agent **nailgun-agent.rb** +collects the server's hardware information and submits it to Nailgun +through the REST API. + +The deployment process is started by the user after he has configured +a new environment. The Nailgun service creates a JSON data structure +with the environment settings, its nodes and their roles and puts this +file into the *RabbitMQ* queue. This message should be received by one +of the worker processes who will actually deploy the environment. These +processes are called *Astute*. + +#.. uml:: +# package "Master Node" { +# component "Nailgun" +# interface "RabbitMQ" + +# package "Astute Worker" { +# component Astute +# } + +# component "Cobbler" +# component "DHCP and TFTP" +# } + +# [Nailgun] -> [RabbitMQ] : Put task into Nailgun queue +# [Astute] <- [RabbitMQ] : Take task from Nailgun queue +# [Astute] -> [Cobbler] : Set node's settings through XML-RPC +# [Cobbler] -> [DHCP and TFTP] + +The Astute workers are listening to the RabbitMQ queue and receives +messages. They use the *Astute* library which implements all deployment +actions. First, it starts the provisioning of the environment's nodes. +Astute uses XML-RPC to set these nodes' configuration in Cobbler and +then reboots the nodes using *MCollective agent* to let Cobbler install +the base operating system. *Cobbler* is a deployment system that can +control DHCP and TFTP services and use them to network boot the managed +node and start the OS installer with the user-configured settings. + +Astute puts a special message into the RabbitMQ queue that contains +the action that should be executed on the managed node. MCollective +servers are started on all bootstrapped nodes and they constantly listen +for these messages, when they receive a message, they run the required +agent action with the given parameters. MCollective agents are just Ruby +scripts with a set of procedures. These procedures are actions that the +MCollective server can run when asked to. + +When the managed node's OS is installed, Astute can start the deployment +of OpenStack services. First, it uploads the node's configuration +to the **/etc/astute.yaml** file on node using the **uploadfile** agent. +This file contains all the variables and settings that will be needed +for the deployment. + +Next, Astute uses the **puppetsync** agent to synchronize Puppet +modules and manifests. This agent runs an rsync process that connects +to the rsyncd server on the Master node and downloads the latest version +of Puppet modules and manifests. + +#.. uml:: +# package "Master Node" { +# interface "RabbitMQ" +# component "Rsyncd" +# component "Astute" +# } + +# package "Managed Node" { +# interface "MCollective" +# package "MCollective Agents" { +# component "uploadfile" +# component "puppetsync" +# component "puppetd" +# component "shell" +# } +# component "Puppet" +# component "Rsync" +# interface "astute.yaml" +# component "Puppet Modules" +# } + +# [Astute] <-> [RabbitMQ] +# [RabbitMQ] <-> [MCollective] +# +# [MCollective] -> [uploadfile] +# [MCollective] -> [puppetsync] +# [MCollective] -> [puppetd] +# [MCollective] -> [shell] + +# [uploadfile] ..> [astute.yaml] +# [puppetsync] -> [Rsync] +# [puppetd] -> [Puppet] +# [Rsync] <..> [Rsyncd] + +# [Rsync] ..> [Puppet Modules] +# [astute.yaml] ..> [Puppet] +# [Puppet Modules] ..> [Puppet] + +When the modules are synchronized, Astute can run the actual deployment +by applying the main Puppet manifest **site.pp**. MCollective agent runs +the Puppet process in the background using the **daemonize** tool. +The command looks like this: +:: + + daemonize puppet apply /etc/puppet/manifests/site.pp" + +Astute periodically polls the agent to check if the deployment has +finished and reports the progress to Nailgun through its RabbitMQ queue. + +When started, Puppet reads the **astute.yaml** file content as a fact +and then parses it into the **$fuel_settings** structure used to get all +deployment settings. + +When the Puppet process exits either successfully or with an error, +Astute gets the summary file from the node and reports the results to +Nailgun. The user can always monitor both the progress and the +results using Fuel Web interface or the CLI tool. + +Fuel installs the **puppet-pull** script. Developers can use it if +they need to manually synchronize manifests from the Master node and +run the Puppet process on node again. + +Astute also does some additional actions, depending on environment +configuration, either before the deployment of after successful one: + +* Generates and uploads SSH keys that will be needed during deployment. +* During network verification phase **net_verify.py** script. +* Uploads CirrOS guest image into Glance after the deployment. +* Updates **/etc/hosts** file on all nodes when new nodes are deployed. +* Updates RadosGW map when Ceph nodes are deployed. + +Astute also uses MCollective agents when a node or the entire +environment is being removed. It erases all boot sectors on the node +and reboots it. The node will be network booted with the bootstrap +image again, and will be ready to be used in a new environment. diff --git a/develop/custom-bootstrap-node.rst b/develop/custom-bootstrap-node.rst new file mode 100644 index 000000000..5cee8708f --- /dev/null +++ b/develop/custom-bootstrap-node.rst @@ -0,0 +1,273 @@ +.. _custom-bootstrap-node: + + +Bootstrap node +============== + +When you would like to bring changes +into bootstrap, you should take up either of the +options: + +* create an additional + "piece" of bootstrap (initrd_update) + that will be injected into the + original initramfs image on the bootstrap. + That means, avoid modifying the original initramfs + image for bootstrap + +* modify the original initramfs image manually + +* create a custom initramfs image for + bootstrap to replace the default one. + +Let's take a look at every approach in more details. + +Creating and injecting the initrd_update into bootstrap +------------------------------------------------------- + +A typical use case for creating initrd_update looks as follows: +a great number of proprietary drivers for equipment cannot be +shipped with GA Fuel ISO due to legal issues +and should be installed by users themselves. + +That means, you can add (or inject) the required issues (drivers, +scripts etc.) during Fuel ISO +installation procedure. + +Injection workflow consists of several stages: + +#. Prepare the injected initramfs image with the required kernel modules (for CentOS). +#. Modify bootstrap (CentOS) + +Prepare injected initramfs image for CentOS ++++++++++++++++++++++++++++++++++++++++++++ + +The injected initramfs image should contain +the files what are going to be put on (or let's say injected into) +the original initramfs on the bootstrap in addition to +the deployed (original) RAM file system. + +The injected initramfs image should have the following structure: + +:: + + / + /lib/modules//kernel// + /etc/modprobe.d/.conf + +Let's put all required files into the folder called *dd-src* and create the image. +For example, we need the 2.6.32-504 (CentOs 6.6) kernel: + +#. Create the working folder dd-src: + + :: + + mkdir dd-src + +#. Put the kernel modules into: + + :: + + mkdir -p ./dd-src/lib/modules/2.6.32-504.1.3.el6.x86_64/kernel/drivers/scsi + cp hpvsa.ko ./dd-src/lib/modules/2.6.32-504.1.3.el6.x86_64/kernel/drivers/scsi + + +#. Put the *.conf* file with the modprobe command into + the *etc/modprobe.d/* folder: + + :: + + mkdir -p ./dd-src/etc/modprobe.d/ + echo modprobe hpvsa > ./dd-src/etc/modprobe.d/hpvsa.conf + chmod +x ./dd-src/etc/modprobe.d/hpvsa.conf + + + There is the second (deprecated) way: + create the */etc/rc.modules* executable file and list the command to probe with the module name. + Do not use */etc/rc.local* file for this purpose, + because it is too late for init hardware: + + :: + + mkdir ./dd-src/etc + echo modprobe hpvsa > ./dd-src/etc/rc.modules + chmod +x ./dd-src/etc/rc.modules + + + + +#. Create the dd-src.tar.gz file for coping to the Fuel Master node: + + :: + + tar -czvf dd-src.tar.gz ./dd-src + + The *dd-src.tar.gz* file can now be copied to the Fuel Master node. + + +Adding initrd_update image to the bootstrap ++++++++++++++++++++++++++++++++++++++++++++ + +.. note:: Currently, the bootstrap is based on CentOS (kernel and modules). + + +Let's assume that the Fuel Master node has been deployed: + +#. Connect to the Fuel Master node: + + :: + + ssh root@ + +#. Prepare initramfs update image: + + :: + + tar -xzvf dd-src.tar.gz + find dd-src/ | cpio --quiet -o -H newc | gzip -9 > /tmp/initrd_update.img + +#. Copy into the TFTP (PXE) bootstrap folder: + + :: + + cp /tmp/initrd_update.img /var/www/nailgun/bootstrap/ + chmod 755 /var/www/nailgun/bootstrap/initrd_update.img + +#. Copy inside the cobbler container to the folder: + + :: + + dockerctl copy initrd_update.img cobbler:/var/lib/tftpboot/initrd_update.img + +#. Modify the bootstrap menu initrd parameter. + + * Log into the cobbler container: + + :: + + dockerctl shell cobbler + + * Get the variable kopts variable value: + + :: + + cobbler profile dumpvars --name=bootstrap | grep kernel_options + kernel_options : ksdevice=bootif locale=en_US text mco_user=mcollective initrd=initrd_update.img biosdevname=0 lang url=http://10.20.0.2:8000/api priority=critical mco_pass=HfQqE2Td kssendmac + + * Add *initrd=initrd_update.img* at the beginning of the string + and re-sync the container. It turns into the kernel + parameter passing to the kernel on boot + 'initrd=initramfs.img,initrd_update.img': + + :: + + cobbler profile edit --name bootstrap --kopts='initrd=initrd_update.img ksdevice=bootif lang= locale=en_US text mco_user=mcollective priority=critical url=http://10.20.0.2:8000/api biosdevname=0 mco_pass=HfQqE2Td kssendmac' + cobbler sync + + +Modifying initramfs image manually for bootstrap node +----------------------------------------------------- + +To edit the initramfs (initrd) image, +you should unpack it, modify and pack back. +Initramfs image is a gzip-ed cpio archive. + +To change initramfs image, follow these steps: + +#. Create a folder for modifying initramfs image and copy the initramfs image into it: + + :: + + mkdir /tmp/initrd-orig + dockerctl copy cobbler:/var/lib/tftpboot/images/bootstrap/initramfs.img /tmp/initrd-orig/ + +#. Unpack initramfs image. First of all, unzip it: + + :: + + cd /tmp/initrd-orig/ + mv initramfs.img initramfs.img.gz + gunzip initramfs.img.gz + +#. Unpack the cpio archive to the initramfs folder: + + :: + + mkdir initramfs + cd initramfs + cpio -i < ../initramfs.img + +#. Now you have the file system what you have in the RAM on the bootstrap: + + :: + + ls -l /tmp/initrd-orig/initramfs + +#. Modify it as you need. For example, copy files or modify the scripts: + + :: + + cp hpvsa.ko lib/modules/2.6.32-504.1.3.el6.x86_64/kernel/drivers/scsi/ + echo "modprobe hpvsa" > etc/modprobe.d/hpvsa.conf + + + To get more information on how to pass options to + the module, start dependent modules or black-list modules please, + consult see the *modprobe.d* man page. + + :: + + vi etc/modprobe.d/blacklist.conf + +#. Pack the intiramfs back to **initfamfs.img.new** image: + + :: + + find /tmp/initrd-orig/initramfs | cpio --quiet -o -H newc | gzip -9 > /tmp/initramfs.img.new + +#. Clean up. Remove */tmp/initrd-orig* temporary folder: + + :: + + rm -Rf /tmp/initrd-orig/ + + +Creating a custom bootstrap node +-------------------------------- + +This option requires further investigation +and will be introduced in the near future. + + +Replacing default bootstrap node with the custom one +++++++++++++++++++++++++++++++++++++++++++++++++++++ + +Let's suppose that you have created or modified +the initramfs image. It is placed in the */tmp* folder under **initramfs.img.new** name. + +To replace the default boostrap with the custom, +follow these steps: + +#. Save the previous initramfs image: + + :: + + mv /var/www/nailgun/bootstrap/initramfs.img /var/www/nailgun/bootstrap/initramfs.img.old + + +#. Copy the new initramfs image into the bootstrap folder: + + :: + + cd /tmp + cp initramfs.img.new /var/www/nailgun/bootstrap/initramfs.img + dockerctl copy /var/www/nailgun/bootstrap/initramfs.img cobbler:/var/lib/tftpboot/images/bootstrap/initramfs.img + +#. Make the Cobbler update the files: + + :: + + cobbler sync + + + diff --git a/develop/env.rst b/develop/env.rst new file mode 100644 index 000000000..0d455dee6 --- /dev/null +++ b/develop/env.rst @@ -0,0 +1,368 @@ +Fuel Development Environment +============================ + +.. warning:: Fuel ISO build works only on 64-bit operating system. + +If you are modifying or augmenting the Fuel source code or if you +need to build a Fuel ISO from the latest branch, you will need +an environment with the necessary packages installed. This page +lays out the steps you will need to follow in order to prepare +the development environment, test the individual components of +Fuel, and build the ISO which will be used to deploy your +Fuel master node. + +The basic operating system for Fuel development is Ubuntu Linux. +The setup instructions below assume Ubuntu 14.04 (64 bit) though most of +them should be applicable to other Ubuntu and Debian versions, too. + +Each subsequent section below assumes that you have followed the steps +described in all preceding sections. By the end of this document, you +should be able to run and test all key components of Fuel, build the +Fuel master node installation ISO, and generate documentation. + +.. _getting-source: + +Getting the Source Code +----------------------- + +Source code of OpenStack Fuel can be found at git.openstack.org or +GitHub. + +Follow these steps to clone the repositories for each of +the Fuel components: +:: + + apt-get install git + git clone https://github.com/openstack/fuel-main + git clone https://github.com/openstack/fuel-web + git clone https://github.com/openstack/fuel-agent + git clone https://github.com/openstack/fuel-astute + git clone https://github.com/openstack/fuel-ostf + git clone https://github.com/openstack/fuel-library + git clone https://github.com/openstack/fuel-docs + + +.. _building-fuel-iso: + +Building the Fuel ISO +--------------------- + +The "fuel-main" repository is the only one required in order +to build the Fuel ISO. The make script then downloads the +additional components (Fuel Library, Nailgun, Astute and OSTF). +Unless otherwise specified in the makefile, the master branch of +each respective repo is used to build the ISO. + +The basic steps to build the Fuel ISO from trunk in an +Ubuntu 14.04 environment are: +:: + + apt-get install git + git clone https://github.com/openstack/fuel-main + cd fuel-main + ./prepare-build-env.sh + make iso + +If you want to build an ISO using a specific commit or repository, +you will need to modify the "Repos and versions" section in the +config.mk file found in the fuel-main repo before executing "make +iso". For example, this would build a Fuel ISO against the v5.0 +tag of Fuel: +:: + + # Repos and versions + FUELLIB_COMMIT?=tags/5.0 + NAILGUN_COMMIT?=tags/5.0 + ASTUTE_COMMIT?=tags/5.0 + OSTF_COMMIT?=tags/5.0 + + FUELLIB_REPO?=https://github.com/openstack/fuel-library.git + NAILGUN_REPO?=https://github.com/openstack/fuel-web.git + ASTUTE_REPO?=https://github.com/openstack/fuel-astute.git + OSTF_REPO?=https://github.com/openstack/fuel-ostf.git + +To build an ISO image from custom gerrit patches on review, edit the +"Gerrit URLs and commits" section of config.mk, e.g. for +https://review.openstack.org/#/c/63732/8 (id:63732, patch:8) set: +:: + + FUELLIB_GERRIT_COMMIT?=refs/changes/32/63732/8 + +If you are building Fuel from an older branch that does not contain the +"prepare-build-env.sh" script, you can follow these steps to prepare +your Fuel ISO build environment on Ubuntu 14.04: + +#. ISO build process requires sudo permissions, allow yourself to run + commands as root user without request for a password:: + + echo "`whoami` ALL=(ALL) NOPASSWD: ALL" | sudo tee -a /etc/sudoers + +#. Install software:: + + sudo apt-get update + sudo apt-get install apt-transport-https + echo deb http://mirror.yandex.ru/mirrors/docker/ docker main | sudo tee /etc/apt/sources.list.d/docker.list + sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv-keys 36A1D7869245C8950F966E92D8576A8BA88D21E9 + sudo apt-get update + sudo apt-get install lxc-docker + sudo apt-get update + sudo apt-get remove nodejs nodejs-legacy npm + sudo apt-get install software-properties-common python-software-properties + sudo add-apt-repository -y ppa:chris-lea/node.js + sudo apt-get update + sudo apt-get install build-essential make git ruby ruby-dev rubygems debootstrap createrepo \ + python-setuptools yum yum-utils libmysqlclient-dev isomd5sum \ + python-nose libvirt-bin python-ipaddr python-paramiko python-yaml \ + python-pip kpartx extlinux unzip genisoimage nodejs multistrap \ + lrzip python-daemon + sudo gem install bundler -v 1.2.1 + sudo gem install builder + sudo pip install xmlbuilder jinja2 + sudo npm install -g gulp + +#. If you haven't already done so, get the source code:: + + git clone https://github.com/openstack/fuel-main + +#. Now you can build the Fuel ISO image:: + + cd fuel-main + make iso + +#. If you encounter issues and need to rebase or start over:: + + make clean #remove build/ directory + make deep_clean #remove build/ and local_mirror/ + +.. note:: + + In case you use a virtual machine for building the image, verify the + following: + + - Both ``BUILD_DIR`` and ``LOCAL_MIRROR`` build directories are + out of the shared folder path in the `config.mk + `_ + file. For more information, see: + + - `Shared folders of VitrualBox + `_ + documentation + + - `Synced folders of Vargant + `_ + documentation + + - To prevent a random docker unexpected termination, a virtual + machine has a kernel that supports the ``aufs`` file system. + + To install the kernel, run: + + .. code-block:: console + + sudo apt-get install --yes linux-image-extra-virtual + + Reboot the kernel when the installation is complete. Check that + docker is using ``aufs`` by running: + + .. code-block:: console + + sudo docker info 2>&1 | grep -q 'Storage Driver: aufs' \ + && echo OK || echo KO + + For more information, see `Select a storage driver for docker + `_. + +You can also use the following tools to make your work and development process +with Fuel easier: + +* CGenie fuel-utils - a set of tools to interact with code on a Fuel Master node created + from the ISO. It provides the *fuel* command + that gives a simple way to upload Python or UI code (with staticfiles compression) + to Docker containers, SSH into machine and into the container, + display the logs etc. + +* Vagrant SaltStack-based -Vagrant box definition with quick and basic Fuel + environment with fake tasks. + This is useful for UI or Nailgun development. + +You can download both tools from the +`fuel-dev-tools `_. + +Nailgun (Fuel-Web) +------------------ + +Nailgun is the heart of Fuel project. It implements a REST API as well +as deployment data management. It manages disk volume configuration data, +network configuration data and any other environment specific data +necessary for a successful deployment of OpenStack. It provides the +required orchestration logic for provisioning and +deployment of the OpenStack components and nodes in the right order. +Nailgun uses a SQL database to store its data and an AMQP service to +interact with workers. + +Requirements for preparing the nailgun development environment, along +with information on how to modify and test nailgun can be found in +the Nailgun Development Instructions document: :ref:`nailgun-development` + + +Astute +------ + +Astute is the Fuel component that represents Nailgun's workers, and +its function is to run actions according to the instructions provided +from Nailgun. Astute provides a layer which encapsulates all the details +about interaction with a variety of services such as Cobbler, Puppet, +shell scripts, etc. and provides a universal asynchronous interface to +those services. + +#. Astute can be found in fuel-astute repository + +#. Install Ruby dependencies:: + + sudo apt-get install git curl + curl -sSL https://get.rvm.io | bash -s stable + source ~/.rvm/scripts/rvm + rvm install 2.1 + rvm use 2.1 + git clone https://github.com/nulayer/raemon.git + cd raemon + git checkout b78eaae57c8e836b8018386dd96527b8d9971acc + gem build raemon.gemspec + gem install raemon-0.3.0.gem + cd .. + rm -Rf raemon + +#. Install or update dependencies and run unit tests:: + + cd fuel-astute + ./run_tests.sh + +#. (optional) Run Astute MCollective integration test (you'll need to + have MCollective server running for this to work):: + + cd fuel-astute + bundle exec rspec spec/integration/mcollective_spec.rb + +Running Fuel Puppet Modules Unit Tests +-------------------------------------- + +If you are modifying any puppet modules used by Fuel, or including +additional modules, you can use the PuppetLabs RSpec Helper +to run the unit tests for any individual puppet module. Follow +these steps to install the RSpec Helper: + +#. Install PuppetLabs RSpec Helper:: + + cd ~ + gem2deb puppetlabs_spec_helper + sudo dpkg -i ruby-puppetlabs-spec-helper_0.4.1-1_all.deb + gem2deb rspec-puppet + sudo dpkg -i ruby-rspec-puppet_0.1.6-1_all.deb + +#. Run unit tests for a Puppet module:: + + cd fuel/deployment/puppet/module + rake spec + +Installing Cobbler +------------------ + +Install Cobbler from GitHub (it can't be installed from PyPi, and deb +package in Ubuntu is outdated):: + + cd ~ + git clone git://github.com/cobbler/cobbler.git + cd cobbler + git checkout release24 + sudo make install + +Building Documentation +---------------------- + +You should prepare your build environment before you can build +this documentation. First you must install Java, using the +appropriate procedure for your operating system. + +Java is needed to use PlantUML to automatically generate UML diagrams +from the source. You can also use `PlantUML Server +`_ for a quick preview of your +diagrams and language documentation. + +Then you need to install all the packages required for creating of +the Python virtual environment and dependencies installation. +:: + + sudo apt-get install make postgresql postgresql-server-dev-9.1 + sudo apt-get install python-dev python-pip python-virtualenv + +Now you can create the virtual environment and activate it. +:: + + virtualenv fuel-web-venv + . virtualenv/bin/activate + +And then install the dependencies. +:: + + pip install -r nailgun/test-requirements.txt + +Now you can look at the list of available formats and generate +the one you need: +:: + + cd docs + make help + make html + +There is a helper script **build-docs.sh**. It can perform +all the required steps automatically. The script can build documentation +in required format. +:: + + Documentation build helper + -o - Open generated documentation after build + -c - Clear the build directory + -n - Don't install any packages + -f - Documentation format [html,signlehtml,latexpdf,pdf,epub] + +For example, if you want to build HTML documentation you can just +use the following script, like this: +:: + + ./build-docs.sh -f html -o + +It will create virtualenv, install the required dependencies and +build the documentation in HTML format. It will also open the +documentation with your default browser. + +If you don't want to install all the dependencies and you are not +interested in building automatic API documentation there is an easy +way to do it. + +First remove autodoc modules from extensions section of **conf.py** +file in the **docs** directory. This section should be like this: +:: + + extensions = [ + 'rst2pdf.pdfbuilder', + 'sphinxcontrib.plantuml', + ] + +Then remove **develop/api_doc.rst** file and reference to it from +**develop.rst** index. + +Now you can build documentation as usual using make command. +This method can be useful if you want to make some corrections to +text and see the results without building the entire environment. +The only Python packages you need are Sphinx packages: +:: + + Sphinx + sphinxcontrib-actdiag + sphinxcontrib-blockdiag + sphinxcontrib-nwdiag + sphinxcontrib-plantuml + sphinxcontrib-seqdiag + +Just don't forget to rollback all these changes before you commit your +corrections. diff --git a/develop/fuel_settings.rst b/develop/fuel_settings.rst new file mode 100644 index 000000000..0b17bce3e --- /dev/null +++ b/develop/fuel_settings.rst @@ -0,0 +1,130 @@ +Using Fuel settings +~~~~~~~~~~~~~~~~~~~ + +Fuel uses a special method to pass settings from Nailgun to Puppet manifests: + +- Before the deployment process begins, + Astute uploads all settings + to the the */etc/astute.yaml* files that are located on each node. +- When Puppet is run, + Facter reads the contents of all these */etc/astute.yaml* files + and creates a single file called *$astute_settings_yaml*. +- The **parseyaml** function (at the beginning of the *site.pp* file) + then parses these settings + and creates a rich data structure called *$fuel_settings*. + All of the settings used during node deployment are stored there + and can be used anywhere in Puppet code. + +For example, single top level variables are available as +*$::fuel_settings['debug']*. +More complex structures are also available as +values of *$::fuel_settings* hash keys +and can be accessed like normal hashes and arrays. +Many aliases and generated values are provided +to help you retrieve values easily. +You can create a variable from any hash key in *$fuel_settings* +and work with this variable within your local scope +or from other classes, using fully qualified paths:: + + $debug = $::fuel_settings['debug'] + +Some variables and structures are generated from the settings hash +by filtering and transformation functions. +For example the $node structure only contains +settings of the current node, +filtered from the has of all nodes. +It can be accessed as:: + + $node = filter_nodes($nodes_hash, 'name', $::hostname) + +If you are going to use your module inside the Fuel Library +and need some settings, +you can get them from this *$::fuel_settings* structure. +Most variables related to network and OpenStack services configuration +are already available there and you can use them as they are. +If your modules require some additional or custom settings, +you must either use **Custom Attributes** +by editing the JSON files before deployment, or, +if you are integrating your project with the Fuel Library, +you can contact the Fuel UI developers +and ask them to add your configuration options to the Fuel setting panel. + +After you have defined all classes you need inside your module, +you can add this module's declaration +into the Fuel manifests such as +*cluster_simple.pp* and *cluster_ha.pp* located inside +the *osnailyfacter/manifests* folder +or, if your additions are related to another class, +can add them into that class. + +Example module +~~~~~~~~~~~~~~ + +To demonstrate how to add a new module to the Fuel Library, +let us add a simple class +that changes the terminal color of Red Hat based systems. +Our module is named *profile* and has only one class.:: + + profile + profile/manifests + profile/manifests/init.pp + profile/files + profile/files/colorcmd.sh + +init.pp could have a class definition such as::: + + class profile { + if $::osfamily == 'RedHat' { + file { 'colorcmd.sh' : + ensure => present, + owner => 'root', + group => 'root', + mode => '0644', + path => "/etc/profile.d/colorcmd.sh", + source => 'puppet:///modules/profile/colorcmd.sh', + } + } + } + +This class downloads the *colorcmd.sh* file +and places it in the defined location +when the class is run on a Red Hat or CentOS system. +The profile module can be added to Fuel modules +by uploading its folder to */etc/puppet/modules* +on the Fuel Master node. + +Now we need to declare this module somewhere inside the Fuel manifests. +Since this module should be run on every server, +we can use our main *site.pp* manifest +found inside the *osnailyfacter/examples* folder. +On the deployed master node, +this file will be copied to */etc/puppet/manifests* +and used to deploy Fuel on all other nodes. +The only thing we need to do here is to add the *include profile* +to the end of the */etc/puppet/manifests/site.pp* file +on the already deployed master node +and to the *osnailyfacter/examples/site.pp* file inside the Fuel repository. + +Declaring a class outside of a node block +forces this class to be included everywhere. +If you want to include your module only on some nodes, +you can add its declaration +to the blocks associated with the role that is running on those nodes +inside the *cluster_simple* and *cluster_ha* classes. + +You can add some additional logic to allow this module to be disabled, +either from the Fuel UI or by passing Customer Attributes +to the Fuel configuration.:: + + if $::fuel_settings['enable_profile'] { + include 'profile' + } + +This block uses the *enable_profile* variable +to enable or disable inclusion of the profile module. +The variable should be passed from Nailgun and saved +to the */etc/astute.yaml* files on managed nodes. +You can do this either by downloading the settings files +and manually editing them before deployment +or by asking the Fuel UI developers to include additional options +in the settings panel. diff --git a/develop/live_masternode.rst b/develop/live_masternode.rst new file mode 100644 index 000000000..11395778a --- /dev/null +++ b/develop/live_masternode.rst @@ -0,0 +1,9 @@ +Fuel Development Environment on Live Master Node +================================================ + +If you need to deploy your own developer version of FUEL on live +Master Node, you can use the helper scripts, that are available +in the `fuel-dev-tools ` repository. + +Help information about fuel-dev-tools can be found by running it +with the '-h' parameter. diff --git a/develop/modular-architecture.rst b/develop/modular-architecture.rst new file mode 100644 index 000000000..5624b8f00 --- /dev/null +++ b/develop/modular-architecture.rst @@ -0,0 +1,396 @@ +Modular Architecture +==================== + +The idea behind the modular architecture introduced in Fuel 6.1 is the separation of the legacy site.pp manifests to a group of small manifests. Each manifest can be designed to do only a limited part of the deployment process. These manifests can be applied by Puppet the same way as it was done in Fuel 6.0 or older. The deployment process in Fuel 6.1 consists of a sequential application of small manifests in a predefined order. + +Using smaller manifests instead of the monolithic ones has the following advantages: + +* **Independent development** + As a developer, you can work only with those Fuel components that you are interested in. A separate manifest + can be dedicated wholly to a single task without any interference from other components and developers. This + task may require the system to be in some state before the deployment can be started and the task may require + some input data be available. But other than that each task is on its own. + +* **Granular testing** + With granular deployment introduced in Fuel 6.1, any finished task can be tested independently. Testing can be + automated with autotests; you can snapshot and revert the environment to a previous state; or you can manually + run tests in your environment. With Fuel 6.0 or older, testing consumes a considerable amount of time as there + is no way to test only a part of the deployment -- each new change requires the whole deployment to be started + from scratch. See also the `granular deployment blueprint `_. + +* **Encapsulation** + Puppet deems all resources to be unique within the catalog and the way it works with dependencies and + ordering. Normally one cannot take a third party module and expect that it will work as designed within the + Puppet infrastructure. Modular manifests, introduced in Fuel 6.1, solve this by making every single task use + its own catalog without directly interfering with other tasks. + +* **Self-Testing** + Granular architecture allows making tests for every task. These tests can be run either after the task to + check if it is successful or before the task to check if the system is in the required state to start the + task. These tests can be used by the developer as acceptance tests, by the Continuous Integration (CI) to + determine if the changes can be merged, or during the real deployment to control the whole process and to + raise alarm if something goes wrong. + +* **Using multiple tools** + Sometimes you may use a tool other than Puppet (from shell scripts to Python or Ruby, and even binary + executables). Granular deployment allows using any tools you see fit for the task. Tasks, tests and pre/post + hooks can be implemented using anything the developer knows best. In Fuel 6.1 only pre/post hooks can use + non-Puppet tasks. + +Granular deployment process +--------------------------- + +Granular deployment is implemented using the Nailgun plugin system. Nailgun uses the deployment graph data to determine what tasks on which nodes should be run. This data graph is traversed and sent to Astute as an ordered list of tasks to be executed with the information on which nodes they should be run. + +Astute receives this data structure and starts running the tasks one by one in the following order: + + #. Pre-deploy actions + #. Main deployment tasks + #. Post-deploy actions + +Each tasks reports back if it is successful. Astute stops the deployment on any failed task. + +.. image:: _images/granularDeployment.png + +See also `Fuel Reference Architecture: Task Deployment _`. + +Task Graph +---------- + +A task graph is built by Nailgun from *tasks.yaml* files during Fuel Master node bootstrap: + + :: + + fuel rel --sync-deployment-tasks --dir /etc/puppet/ + +*tasks.yaml* files describe a group of tasks (or a single task). + + :: + + - id: netconfig + type: puppet + groups: [primary-controller, controller, cinder, compute, ceph-osd, zabbix-server, primary-mongo, mongo] + required_for: [deploy] + requires: [hiera] + parameters: + puppet_manifest: /etc/puppet/modules/osnailyfacter/modular/netconfig.pp + puppet_modules: /etc/puppet/modules + timeout: 3600 + +where: + + * ``id`` - Each task must have the unique ID. + * ``type`` - Determines how the tasks should be executed. Currently there are Puppet and exec types. + * ``groups`` - Groups are used to determine on which nodes these tasks should be started and are mostly related to the node roles. + * ``required_for`` - The list of tasks that require this task to start. Can be empty. + * ``requires`` - The list of tasks that are required by this task to start. Can be empty. + * Both the ``requires`` and ``required_for`` fields are used to build the dependency graph and to determine the order of task execution. + * ``parameters`` - The actual payload of the task. For the Puppet task these can be paths to modules (puppet_modules) and the manifest (puppet_manifest) to apply; the exec type requires the actual command to run. + * ``timeout`` determines how long the orchestrator should wait (in seconds) for the task to complete before marking it as failed. + +Graph example +------------- + + :: + + - id: netconfig + type: puppet + groups: [primary-controller, controller, cinder, compute, ceph-osd, zabbix-server, primary-mongo, mongo] + required_for: [deploy_start] + requires: [hiera] + parameters: + puppet_manifest: /etc/puppet/modules/osnailyfacter/modular/netconfig.pp + puppet_modules: /etc/puppet/modules + timeout: 3600 + + :: + + - id: tools + type: puppet + groups: [primary-controller, controller, cinder, compute, ceph-osd, zabbix-server, primary-mongo, mongo] + required_for: [deploy_start] + requires: [hiera] + parameters: + puppet_manifest: /etc/puppet/modules/osnailyfacter/modular/tools.pp + puppet_modules: /etc/puppet/modules + timeout: 3600 + + - id: hosts + type: puppet + groups: [primary-controller, controller, cinder, compute, ceph-osd, zabbix-server, primary-mongo, mongo] + required_for: [deploy_start] + requires: [netconfig] + parameters: + puppet_manifest: /etc/puppet/modules/osnailyfacter/modular/hosts.pp + puppet_modules: /etc/puppet/modules + timeout: 3600 + + - id: firewall + type: puppet + groups: [primary-controller, controller, cinder, compute, ceph-osd, zabbix-server, primary-mongo, mongo] + required_for: [deploy_start] + requires: [netconfig] + parameters: + puppet_manifest: /etc/puppet/modules/osnailyfacter/modular/firewall.pp + puppet_modules: /etc/puppet/modules + timeout: 3600 + + - id: hiera + type: puppet + groups: [primary-controller, controller, cinder, compute, ceph-osd, zabbix-server, primary-mongo, mongo] + required_for: [deploy_start] + parameters: + puppet_manifest: /etc/puppet/modules/osnailyfacter/modular/hiera.pp + puppet_modules: /etc/puppet/modules + timeout: 3600 + +This graph data will be processed to the following graph when imported to the Nailgun. Deploy task is an anchor used to start the graph traversal and is hidden from the image. + +.. image:: _images/graph.png + +Nailgun will run the hiera task first, then netconfig or tools, and then firewall or hosts. Astute will start each task on those nodes whose roles are present in the groups field of each task. + +Modular manifests +----------------- + + Starting with Fuel 6.1, granular deployment allows using a number of small manifests instead of the single monolithic one. These small manifests are placed in the ``deployment/puppet/osnailyfacter/modular`` folder and its subfolders. In Fuel 6.0 or older there was a single entry point manifest used -- located at ``deployment/puppet/osnailyfacter/examples/site.pp`` in the `fuel-library `_ repository. + +To write a modular manifest, you will need to take all the resources, classes and definitions you are using to deploy your component and place them into a single file. This manifest should be able to do everything that is required for your component. + +The system should be in some state before you will be able to start your task. For example, database, Pacemaker, or Keystone should be present. + +You should also satisfy the missing dependencies. Some of the manifests may have internal dependencies on other manifests and their parts. You will have to either remove these dependencies or make dummy classes to satisfy them. + +Modular example +--------------- + +Here is an example of a modular manifest that installs Apache and creates a basic site. + + :: + + >>> site.pp + + $fuel_settings = parseyaml($astute_settings_yaml) + + File { + owner => ‘root’, + group => ‘root’, + mode => ‘0644’, + } + + package { ‘apache’ : + ensure => ‘installed’, + } + + service { ‘apache’ : + ensure => ‘running’, + enable => ‘true’, + } + + file { ‘/etc/apache.conf’ : + ensure => present, + content => template(‘apache/config.erb’), + } + + $www_root = $fuel_settings[‘www_root’] + + file { “${www_root}/index.html” : + ensure => present, + content => ‘hello world’, + } + +As the first line of any granular Puppet manifest, add the following: + + :: + + notice("MODULAR: $$$TASK_ID_OR_NAME$$$") + +It will help you debug by finding a place in ``puppet.log`` where your task started. + +Now let's split the manifest into several tasks: + + :: + + >>> apache_install.pp + package { ‘apache’ : + ensure => ‘installed’, + } + + >>> apache_config.pp + File { + owner => ‘root’, + group => ‘root’, + mode => ‘0644’, + } + + $www_root = hiera(‘www_root’) + + file { ‘/etc/apache.conf’ : + ensure => present, + content => template(‘apache/config.erb’), + } + + >>> create_site.pp + File { + owner => ‘root’, + group => ‘root’, + mode => ‘0644’, + } + + $www_root = hiera(‘www_root’) + + file { “${www_root}/index.html” : + ensure => present, + content => ‘hello world’, + } + + >>> apache_start.pp + service { ‘apache’ : + ensure => ‘running’, + enable => ‘true’, + } + +We have just created several manifests. Each will do just its simple action. First we install an Apache package, then we create a configuration file, then create a sample site, and, finally, start the service. Each of these tasks now can be started separately together with any other task. We have also replaced ``$fuel_settings`` with hiera calls. + +Since there are some dependencies, we cannot start the Apache service without installing the package first, but we can start the service just after the package installation without the configuration and sample site creation. + +So there are the following tasks: + + * install + * config + * site + * start + * hiera (to enable the hiera function) + +A visual representation of the dependency graph will be the following: + +.. image:: _images/dependGraph.png + +**start**, **config**, and **site** require the package to be installed. **site** and **config** require the **hiera** function to work. Apache should be configured and **site** should be created to start. + +Now, let’s write a data yaml to describe this structure: + + :: + + - id: hiera + type: puppet + role: [test] + required_for: [deploy] + parameters: + puppet_manifest: /etc/puppet/modules/osnailyfacter/modular/hiera.pp + puppet_modules: /etc/puppet/modules + timeout: 3600 + + - id: install + type: puppet + role: [test] + required_for: [deploy] + parameters: + puppet_manifest: /etc/puppet/modules/osnailyfacter/modular/apache_install.pp + puppet_modules: /etc/puppet/modules + timeout: 3600 + + - id: config + type: puppet + role: [test] + required_for: [deploy] + requires: [hiera, install] + parameters: + puppet_manifest: /etc/puppet/modules/osnailyfacter/modular/apache_config.pp + puppet_modules: /etc/puppet/modules + timeout: 3600 + + - id: site + type: puppet + role: [test] + required_for: [deploy] + requires: [install, hiera] + parameters: + puppet_manifest: /etc/puppet/modules/osnailyfacter/modular/create_site.pp + puppet_modules: /etc/puppet/modules + timeout: 3600 + + - id: start + type: puppet + role: [test] + required_for: [deploy] + requires: [install, config, site] + parameters: + puppet_manifest: /etc/puppet/modules/osnailyfacter/modular/apache_start.pp + puppet_modules: /etc/puppet/modules + timeout: 3600 + +Nailgun can process this data file and tell Astute to deploy all the tasks in the required order. Other nodes or other deployment modes may require more tasks or tasks run in different order. + +Now, let's say you have a new apache_proxy class, and want to add it to the setup: + + :: + + >>> apache_proxy/init.pp + + file { ‘/etc/apache.conf’ : + owner => ‘root’, + group => ‘root’, + mode => ‘0644’, + ensure => present, + source => puppet:///apache/proxy.conf, + } -> + + service { ‘apache’ : + ensure => running, + enable => true, + } + +This tasks updates the main Apache configuration as well, and it conflicts with the previous configuration tasks. It would not be possible to combine them in a single catalog. It also attempts to enable the Apache service, which produces a new duplicate error. + +Granular deployment solves this. You can still use them together without trying to do something with duplicates or dependency problems. + +.. image:: _images/dependGraph02.png + +We have just inserted a new proxy task between the **config** and **start** tasks. The proxy task will rewrite the configuration file created in the **config** task making the **config** task pointless. This setup will still work as expected and we will have a working Apache-based proxy. Apache will be started on the proxy task but the **start** task will not produce any errors due to Puppet's idempotency. + +There are also `granular noop tests `_ based on rspec-puppet. These CI tests will put -1 for any new Puppet task not covered with tests. + +Testing +------- + +Testing these manifests is easier than having a single monolithic manifest. + +After writing each file you can manually apply it to check if the task works as expected. + +If the task is complex enough, it can benefit from automated acceptance testing. These tests can be implemented using any tool you as a developer see fit. + +For example, let’s try using `http://serverspec.org `_. This is an rspec extension that is very convenient for server testing. + +The only thing the install task does is the package installation and it has no preconditions. The spec file for it may look like this: + + :: + + require 'spec_helper' + describe package(‘apache’) do + it { should be_installed } + end + +Running the spec should produce an output similar to the following: + + :: + + Package "nginx" + should be installed + + Finished in 0.17428 seconds + 1 example, 0 failures + +There are many different resource types *serverspec* can work with, and this can easily be extended. Other tasks can be tested with specs like the following: + + :: + + describe service('apache') do + it { should be_enabled } + it { should be_running } + end + + describe file(‘/etc/apache.conf’) do + it { should be_file } + its(:content) { should match %r{DocumentRoot /var/www/html} } + end diff --git a/develop/module_structure.rst b/develop/module_structure.rst new file mode 100644 index 000000000..23a6b98ba --- /dev/null +++ b/develop/module_structure.rst @@ -0,0 +1,423 @@ +Contributing to Fuel Library +============================ + +This chapter explains how to add a new module or project into the Fuel Library, +how to integrate with other components, +and how to avoid different problems and potential mistakes. +The Fuel Library is a very big project +and even experienced Puppet users may have problems +understanding its structure and internal workings. + +Adding new modules to fuel-library +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +*Case A. Pulling in an existing module* + +If you are adding a module that is the work of another project +and is already tracked in a separate repo: + +1. Create a review request with an unmodified copy + of the upstream module from which you are working + and *no* other related modifications. + + * This review should also contain the commit hash from the upstream repo + in the commit message. + * The review should be evaluated to determine its suitability + and either rejected + (for licensing, code quality, outdated version requested) + or accepted without requiring modifications. + * The review should not include code that calls this new module. + +2. Any changes necessary to make it work with Fuel + should then be proposed as a dependent change(s). + +*Case B. Adding a new module* + +If you are adding a new module that is a work purely for Fuel +and is not tracked in a separate repo, +submit incremental reviews that consist of +working implementations of features for your module. + +If you have features that are necessary but do not yet work fully, +then prevent them from running during the deployment. +Once your feature is complete, +submit a review to activate the module during deployment. + +Contributing to existing fuel-library modules +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +As developers of Puppet modules, we tend to collaborate with the Puppet +OpenStack community. As a result, we contribute to upstream modules all of the +improvements, fixes and customizations we make to improve Fuel as well. +That implies that every contributor must follow Puppet DSL basics, +`puppet-openstack dev docs +`_ +and `Puppet rspec tests +`_ +requirements. + +The most common and general rule is that upstream modules should be modified +only when bugfixes and improvements could benefit everyone in the community. +And appropriate patch should be proposed to the upstream project prior +to Fuel project. + +In other cases (like applying some very specific custom logic or settings) +contributor should submit patches to ``openstack::*`` `classes +`_ + +Fuel library includes custom modules as well as ones forked from upstream +sources. Note that ``Modulefile``, if any exists, should be used in order +to recognize either given module is forked upstream one or not. +In case there is no ``Modulefile`` in module's directory, the contributor may +submit a patch directly to this module in Fuel library. +Otherwise, he or she should submit patch to upstream module first, and once +merged or +2 recieved from a core reviewer, the patch should be backported to +Fuel library as well. Note that the patch submitted for Fuel library should +contain in commit message the upstream commit SHA or link to github pull-request +(if the module is not on git.openstack.org) or Change-Id of gerrit patch. + +The Puppet modules structure +~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +Code that is contributed into the Fuel Library +should be organized into a Puppet module. +A module is a self-contained set of Puppet code +that is usually made to perform a specific function. +For example, you could have a module for each service +you are going to configure or for every part of your project. +Usually it is a good idea to make a module independent +but sometimes it may require or be required by other modules. +You can think of a module as a sort of library. + +The most important part of every Puppet module is its **manifests** folder. +This folder contains Puppet classes and definitions +which also contain resources managed by this module. +Modules and classes also form namespaces. +Each class or definition should be placed into a single file +inside the manifests folder +and this file should have the same name as the class or definition. +The module should have a top level class +that serves as the module's entry point +and is named same as the module. +This class should be placed into the *init.pp* file. +This example module shows the standard structure +that every Puppet module should follow:: + + example + example/manifests/init.pp + example/manifests/params.pp + example/manifests/client.pp + example/manifests/server + example/manifests/server/vhost.pp + example/manifests/server/service.pp + example/templates + example/templates/server.conf.erb + example/files + example/files/client.data + +The first file in the *manifests* folder is named *init.pp* +and should contain the entry point class of this module. +This class should have the same name as the module:: + + class example { + + } + +The second file is *params.pp*. +This file is not mandatory but is often used +to store different configuration values and parameters +that are used by other classes of the module. +For example, it could contain the service name and package name +of our hypothetical example module. +Conditional statements might be included +if you need to change default values in different environments. +The *params* class should be named as a child +to the module's namespace as are all other classes of the module:: + + class example::params { + $service = 'example' + $server_package = 'example-server' + $client_package = 'example-client' + $server_port = '80' + } + +All other files inside the manifests folder +contain classes as well and can perform any action +you might want to identify as a separate piece of code. +This generally falls into sub-classes that do not require its users +to configure the parameters explicitly, +or may be optional classes that are not required in all cases. +In the following example, +we create a client class that defines a client package +that will be installed and placed into a file called *client.pp*:: + + class example::client { + include example::params + + package { $example::params::client_package : + ensure => installed, + } + + } + +As you can see, we have used the package name from params class. +Consolidating all values that might require editing into a single class, +as opposed to hardcoding them, +allows you to reduce the effort required +to maintain and develop the module further in the future. +If you are going to use any values from the params class, +you should include it first to force its code +to execute and create all required variables. + +You can add more levels into the namespace structure if you want. +Let's create server folder inside our manifests folder +and add the *service.pp* file there. +It would be responsible for installing and running +the server part of our imaginary software. +Placing the class inside the subfolder adds one level +into the name of the contained class.:: + + class example::server::service ( + $port = $example::params::server_port, + ) inherits example::params { + + $package = $example::params::server_package + $service = $example::params::service + + package { $package : + ensure => installed, + } + + service { $service : + ensure => running, + enabled => true, + hasstatus => true, + hasrestart => true, + } + + file { 'example_config' : + ensure => present, + path => '/etc/example.conf', + owner => 'root', + group => 'root', + mode => '0644', + content => template('example/server.conf.erb'), + } + + file { 'example_config_dir' : + ensure => directory, + path => '/etc/example.d', + owner => 'example', + group => 'example', + mode => '0755', + } + + Package[$package] -> File['example_config', 'example_config_dir'] ~> + Service['example_config'] + + } + +This example is a bit more complex. Let's see what it does. + +Class *example::server::service* is **parametrized** +and can accept one parameter: +the port to which the server process should bind. +It also uses a popular "smart defaults" hack. +This class inherits the params class and uses its default values +only if no port parameter is provided. +In this case, you cannot use *include params* +to load the default values +because it is called by the *inherits example::params* clause +of the class definition. + +Inside our class, we take several variables from the params class +and declare them as variables of the local scope. +This is a convenient practice to make their names shorter. + +Next we declare our resources. +These resources are package, service, config file and config dir. +The package resource installs the package +whose name is taken from the variable +if it is not already installed. +File resources create the config file and config dir; +the service resource starts the daemon process and enables its autostart. + +The final part of this class is the *dependency* declaration. +We have used a "chain" syntax to specify the order of evaluation +of these resources. +It is important to install the package first, +then install the configuration files +and only then start the service. +Trying to start the service before installing the package will definitely fail. +So we need to tell Puppet that there are dependencies between our resources. + +The arrow operator that has a tilde instead of a minus sign (~>) +means not only dependency relationship +but also *notifies* the object to the right of the arrow to refresh itself. +In our case, any changes in the configuration file +would make the service restart and load a new configuration file. +Service resources react to the notification event +by restating the managed service. +Other resources may instead perform other supported actions. + +The configuration file content is generated by the template function. +Templates are text files that use Ruby's erb language tags +and are used to generate a text file using pre-defined text +and some variables from the manifest. + +These template files are located inside the **templates** folder +of the module and usually have the *erb* extension. +When a template function is called +with the template name and module name prefix, +Fuel tries to load this template and compile it +using variables from the local scope of the class function +from which the template was called. +For example, the following template saved in +the templates folder as *server.conf.erb file* +is a setting to bind the port of our service:: + + bind_port = <%= @port %> + +The template function will replace the 'port' tag +with the value of the port variable from our class +during Puppet's catalog compilation. + +If the service needs several virtual hosts, +you need to define **definitions**, +which are similar to classes but, unlike classes, +they have titles like resources do +and can be used many times with different titles +to produce many instances of the managed resources. +Classes cannot be declared several times with different parameters. + +Definitions are placed in single files inside the manifests directories +just as classes are +and are named in a similar way, using the namespace hierarchy. +Let's create our vhost definition.:: + + define example::server::vhost ( + $path = '/var/data', + ) { + include example::params + + $config = “/etc/example.d/${title}.conf” + $service = $example::params::service + + file { $config : + ensure => present, + owner => 'example', + group => 'example', + mode => '0644', + content => template('example/vhost.conf.erb'), + } + + File[$config] ~> Service[$service] + } + +This defined type only creates a file resource +with its name populated by the title +that is used when it gets defined. +It sets the notification relationship with the service +to make it restart when the vhost file is changed. + +This defined type can be used by other classes +like a simple resource type to create as many vhost files as we need.:: + + example::server::vhost { 'mydata' : + path => '/path/to/my/data', + } + +Defined types can form relationships in the same way as resources do +but you need to capitalize all elements of the path to make the reference:: + + File['/path/to/my/data'] -> Example::Server::Vhost['mydata'] + +This is works for text files but binary files must be handled differently. +Binary files or text files that will always be same +can be placed into the **files** directory of the module +and then be taken by the file resource. + +To illustrate this, let's add a file resource for a file +that contains some binary data that must be distributed +in our client package. +The file resource is the *example::client* class:: + + file { 'example_data' : + path => '/var/lib/example.data', + owner => 'example', + group => 'example', + mode => '0644', + source => 'puppet:///modules/example/client.data', + } + +We have specified source as a special puppet URL scheme +with the module's and the file's name. +This file will be placed in the specified location when Puppet runs. +On each run, Puppet will check this file's checksum, +overwriting it if the checksum changes; +note that this method should not be used with mutable data. +Puppet's fileserving works in both client-server and masterless modes. + +We now have all classes and resources that are required +to manage our hypothetical example service. +Our example class defined inside *init.pp* is still empty +so we can use it to declare all other classes +to put everything together:: + + class example { + include example::params + include example::client + + class { 'example::server::service' : + port => '100', + } + + example::server::vhost { 'site1' : + path => '/data/site1', + } + + example::server::vhost { 'site2' : + path => '/data/site2', + } + + example::server::vhost { 'test' : + path => '/data/test', + } + + } + +Now we have entire module packed inside *example* class and we can just +include this class to any node where we want to see our service running. +Declaration of parametrized class also did override default port number from +params file and we have three separate virtual hosts for out service. Client +package is also included into this class. + +Adding Python code to fuel-library +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +All Python code that is added to fuel-library must pass style checks and have +tests written. + +Whole test suite is run by `python_run_tests.sh `_. +It uses a virtualenv in which all Python modules from +`python-tests-requirements.txt `_ +are installed. If tests need any third-party library, it should be added as a requirement into this file. + +Before starting any test for Python code, test suite runs style checks for any Python code +found in fuel-library. Those checks are performed by `flake8` (for more information, see the +`flake8 documentation `_) +with additional `hacking` checks installed. Those checks are a set of guidelines for Python code. +More information about those guidelines could be found in `hacking documentation `_ + +If, for some reason, you need to disable style checks in the given file you can add the following +line at the beginning of the file::: + + # flake8: noqa + +After style checks, test suite will execute Python tests by using `py.test `_ test runner. +`py.test` will look for Python files whose names begin with 'test\_' and will search for the tests in them. +Documentation on how to write tests could be found in +`the official Python documentation `_ and +`py.test documentation `_. + diff --git a/develop/nailgun.rst b/develop/nailgun.rst new file mode 100644 index 000000000..6f1ec4f8d --- /dev/null +++ b/develop/nailgun.rst @@ -0,0 +1,7 @@ +.. _nailgun: + +Nailgun +======= + +.. toctree:: + nailgun/tree \ No newline at end of file diff --git a/develop/nailgun/customization/bonding_in_ui.rst b/develop/nailgun/customization/bonding_in_ui.rst new file mode 100644 index 000000000..cd18a45df --- /dev/null +++ b/develop/nailgun/customization/bonding_in_ui.rst @@ -0,0 +1,142 @@ +Bonding in UI/Nailgun +===================== + +Abstract +-------- + +The NIC bonding allows you to aggregate multiple physical links to one link +to increase speed and provide fault tolerance. + +Design docs +----------- + +https://etherpad.openstack.org/p/fuel-bonding-design + +Fuel Support +------------ + +The Puppet module L23network has support for OVS and native Linux bonding, +so we can use it for both NovaNetwork and Neutron deployments. Only Native +OVS bonding (Neutron only) is implemented in Nailgun now. Vlan splinters cannot +be used on bonds now. Three modes are supported now: 'active-backup', +'balance-slb', 'lacp-balance-tcp' (see nailgun.consts.OVS_BOND_MODES). + +Deployment serialization +------------------------ + +Most detailed docs on deployment serialization for neutron are here: + +1. http://docs.mirantis.com/fuel/fuel-4.0/reference-architecture.html#advanced-network-configuration-using-open-vswitch +2. https://etherpad.openstack.org/p/neutron-orchestrator-serialization + +Changes related to bonding are in the “transformations” section: + +1. "add-bond" section +:: + + { + "action": "add-bond", + "name": "bond-xxx", # name is generated in UI + "interfaces": [], # list of NICs; ex: ["eth1", "eth2"] + "bridge": "br-xxx", + "properties": [] # info on bond's policy, mode; ex: ["bond_mode=active-backup"] + } + +2. Instead of creating separate OVS bridges for every bonded NIC we need to create one bridge for the bond itself +:: + + { + "action": "add-br", + "name": "br-xxx" + } + +REST API +-------- + +NodeNICsHandler and NodeCollectionNICsHandler are used for bonds creation, +update and removal. Operations with bonds and networks assignment are done in +single request fashion. It means that creation of bond and appropriate networks +reassignment is done using one request. Request parameters must contain +sufficient and consistent data for construction of new interfaces topology and +proper assignment of all node's networks. + +Request/response data example:: + + [ + { + "name": "ovs-bond0", # only name is set for bond, not id + "type": "bond", + "mode": "balance-slb", # see nailgun.consts.OVS_BOND_MODES for modes list + "slaves": [ + {"name": "eth1"}, # only “name” must be in slaves list + {"name": "eth2"}], + "assigned_networks": [ + { + "id": 9, + "name": "public" + } + ] + }, + { + "name": "eth0", + "state": "up", + "mac": "52:54:00:78:55:68", + "max_speed": null, + "current_speed": null, + "assigned_networks": [ + { + "id": 1, + "name": "fuelweb_admin" + }, + { + "id": 10, + "name": "management" + }, + { + "id": 11, + "name": "storage" + } + ], + "type": "ether", + "id": 5 + }, + { + "name": "eth1", + "state": "up", + "mac": "52:54:00:88:c8:78", + "max_speed": null, + "current_speed": null, + "assigned_networks": [], # empty for bond slave interfaces + "type": "ether", + "id": 2 + }, + { + "name": "eth2", + "state": "up", + "mac": "52:54:00:03:d1:d2", + "max_speed": null, + "current_speed": null, + "assigned_networks": [], # empty for bond slave interfaces + "type": "ether", + "id": 1 + } + ] + +Following fields are required in request body for bond interface: +name, type, mode, slaves. +Following fields are required in request body for NIC: +id, type. + +Nailgun DB +---------- + +Now we have separate models for bond interfaces and NICs: NodeBondInterface and +NodeNICInterface. Node's interfaces can be accessed through Node.nic_interfaces +and Node.bond_interfaces separately or through Node.interfaces (property, +read-only) all together. +Relationship between them (bond:NIC ~ 1:M) is expressed in “slaves” field in +NodeBondInterface model. +Two more new fields in NodeBondInterface are: “flags” and “mode”. +Bond's “mode” can accept values from nailgun.consts.OVS_BOND_MODES. +Bond's “flags” are not in use now. “type” property (read-only) indicates whether +it is a bond or NIC (see nailgun.consts.NETWORK_INTERFACE_TYPES). diff --git a/develop/nailgun/customization/partitions.rst b/develop/nailgun/customization/partitions.rst new file mode 100644 index 000000000..dd079a381 --- /dev/null +++ b/develop/nailgun/customization/partitions.rst @@ -0,0 +1,177 @@ +Creating Partitions on Nodes +============================ + +Fuel generates Anaconda Kickstart scripts for Red Hat based systems and +preseed files for Ubuntu to partition block devices on new nodes. Most +of the work is done in the pmanager.py_ Cobbler script using the data +from the "ks_spaces" variable generated by the Nailgun VolumeManager_ +class based on the volumes metadata defined in the openstack.yaml_ +release fixture. + +.. _pmanager.py: https://github.com/openstack/fuel-library/blob/master/deployment/puppet/cobbler/templates/scripts/pmanager.py +.. _VolumeManager: https://github.com/openstack/fuel-web/blob/master/nailgun/nailgun/extensions/volume_manager/manager.py +.. _openstack.yaml: https://github.com/openstack/fuel-web/blob/master/nailgun/nailgun/fixtures/openstack.yaml + +Volumes are created following best practices for OpenStack and other +components. Following volume types are supported: + +vg + an LVM volume group that can contain one or more volumes with type set + to "lv" + +partition + plain non-LVM partition + +raid + a Linux software RAID-1 array of LVM volumes + +Typical slave node will always have an "os" volume group and one or more +volumes of other types, depending on the roles assigned to that node and +the role-to-volumes mapping defined in the "volumes_roles_mapping" +section of openstack.yaml. + +There are a few different ways to add another volume to a slave node: + +#. Add a new logical volume definition to one of the existing LVM volume + groups. +#. Create a new volume group containing your new logical volumes. +#. Create a new plain partition. + +Adding an LV to an Existing Volume Group +---------------------------------------- + +If you need to add a new volume to an existing volume group, for example +"os", your volume definition in openstack.yaml might look like this:: + + - id: "os" + type: "vg" + min_size: {generator: "calc_min_os_size"} + label: "Base System" + volumes: + - mount: "/" + type: "lv" + name: "root" + size: {generator: "calc_total_root_vg"} + file_system: "ext4" + - mount: "swap" + type: "lv" + name: "swap" + size: {generator: "calc_swap_size"} + file_system: "swap" + - mount: "/mnt/some/path" + type: "lv" + name: "LOGICAL_VOLUME_NAME" + size: + generator: "calc_LOGICAL_VOLUME_size" + generator_args: ["arg1", "arg2"] + file_system: "ext4" + +Make sure that your logical volume name ("LOGICAL_VOLUME_NAME" in the +example above) is not the same as the volume group name ("os"), and +refer to current version of openstack.yaml_ for up-to-date format. + +Adding Generators to Nailgun VolumeManager +------------------------------------------ + +The "size" field in a volume definition can be defined either directly +as an integer number in megabytes, or indirectly via a so called +generator. Generator is a Python lambda that can be called to calculate +logical volume size dynamically. In the json example above size is +defined as a dictionary with two keys: "generator" is the name of the +generator lambda and "generator_args" is the list of arguments that will +be passed to the generator lambda. + +There is the method in the VolumeManager class where generators are +defined. New volume generator 'NEW_GENERATOR_TO_CALCULATE_SIZ' needs to +be added in the generators dictionary inside this method. + +.. code-block:: python + + class VolumeManager(object): + ... + def call_generator(self, generator, *args): + generators = { + ... + 'NEW_GENERATOR_TO_CALCULATE_SIZE': lambda: 1000, + ... + } + + +Creating a New Volume Group +--------------------------- + +Another way to add new volume to slave nodes is to create new volume +group and to define one or more logical volume inside the volume group +definition:: + + + - id: "NEW_VOLUME_GROUP_NAME" + type: "vg" + min_size: {generator: "calc_NEW_VOLUME_NAME_size"} + label: "Label for NEW VOLUME GROUP as it will be shown on UI" + volumes: + - mount: "/path/to/mount/point" + type: "lv" + name: "LOGICAL_VOLUME_NAME" + size: + generator: "another_generator_to_calc_LOGICAL_VOLUME_size" + generator_args: ["arg"] + file_system: "xfs" + +Creating a New Plain Partition +------------------------------ + +Some node roles may be incompatible with LVM and would require plain +partitions. If that's the case, you may have to define a standalone +volume with type "partition" instead of "vg":: + + - id: "NEW_PARTITION_NAME" + type: "partition" + min_size: {generator: "calc_NEW_PARTITION_NAME_size"} + label: "Label for NEW PARTITION as it will be shown on UI" + mount: "none" + disk_label: "LABEL" + file_system: "xfs" + +Note how you can set mount point to "none" and define a disk label to +identify the partition instead. Its only possible to set a disk label on +a formatted portition, so you have to set "file_system" parameter to use +disk labels. + +Updating the Node Role to Volumes Mapping +----------------------------------------- + +Unlike a new logical volume added to a pre-existing logical volume +group, a new logical volume group or partition will not be allocated on +the node unless it is included in the role-to-volumes mapping +corresponding to one of the node's roles, like this:: + + volumes_roles_mapping: + controller: + - {allocate_size: "min", id: "os"} + - {allocate_size: "all", id: "image"} + compute: + ... + +* *controller* - is a role for which partitioning information is given +* *id* - is id of volume group or plain partition +* *allocate_size* - can be "min" or "all" + * *min* - allocate volume with minimal size + * *all* - allocate all free space for + volume, if several volumes have this key + then free space will be allocated equally + +Setting Volume Parameters from Nailgun Settings +----------------------------------------------- + +In addition to VolumeManager generators, it is also possible to define +sizes or whatever you want in the nailgun configuration file +(/etc/nailgun/settings.yaml). All fixture files are templated using +Jinja2 templating engine just before being loaded into nailgun database. +For example, we can define mount point for a new volume as follows:: + + "mount": "{{settings.NEW_LOGICAL_VOLUME_MOUNT_POINT}}" + +Of course, *NEW_LOGICAL_VOLUME_MOUNT_POINT* must be defined in the +settings file. + diff --git a/develop/nailgun/customization/reliability.rst b/develop/nailgun/customization/reliability.rst new file mode 100644 index 000000000..f84561acc --- /dev/null +++ b/develop/nailgun/customization/reliability.rst @@ -0,0 +1,66 @@ +Nailgun is the core of FuelWeb. +To allow an enterprise features be easily connected, +and open source commity to extend it as well, Nailgun must +have simple, very well defined and documented core, +with the great pluggable capabilities. + +Reliability +___________ + +All software contains bugs and may fail, and Nailgun is not an exception of this rule. +In reality, it is not possible to cover all failure scenarios, +even to come close to 100%. +The question is how we can design the system to avoid bugs in one module causing the damage +of the whole system. + +Example from the Nailgun's past: +Agent collected hardware information, include current_speed param on the interfaces. +One of the interfaces had current_speed=0. At the registration attempt, Nailgun's validator +checked that current_speed > 0, and validator raised an exception InvalidData, +which declined node discovery. +current_speed is one of the attibutes which we can easily skip, it is not even +used for deployment in any way at the moment and used only for the information provided to the user. +But it prevented node discovery, and it made the server unusable. + +Another example. Due to the coincedence of bug and wrong metadata of one of the nodes, +GET request on that node would return 500 Internal Server Error. +Looks like it should affect the only one node, and logically we could remove such +failing node from the environment to get it discovered again. +However, UI + API handlers were written in the following way: + +* UI calls /api/nodes to fetch info about all nodes to just show how many nodes are allocated, and how many are not + +* NodesCollectionHandler would return 500 if any of nodes raise an exception + +It is simple to guess, that the whole UI was completely destroyed by just one +failed node. It was impossible to do any action on UI. + +These two examples give us the starting point to rethink on how to avoid +Nailgun crash just if one of the meta attr is wrong. + +First, we must divide the meta attributes discovered by agent on two categories: + +* absolutely required for node discovering (i.e. MAC address) + +* non-required for discovering + + * required for deployment (i.e. disks) + + * non-required for deployment (i.e. current_speed) + +Second, we must have UI refactored to fetch only the information required, +not the whole DB to just show two numbers. To be more specific, +we have to make sure that issues in one environment must not +affect the other environment. Such a refactoring will require additional +handlers in Nailgun, as well as some additions, such as pagination and etc. +From Nailgun side, it is bad idea to fail the whole CollectionHandler if one +of the objects fail to calculate some attribute. My(mihgen) idea is to simply set +attrubute to Null if failed to calculate, and program UI to handle it properly. +Unit tests must help in testing of this. + +Another idea is to limit the /api/nodes, +/api/networks and other calls +to work only if cluster_id param provided, whether set to None or some of cluster Ids. +In such a way we can be sure that one env will not be able to break the whole UI. + + diff --git a/develop/nailgun/customization/roles.rst b/develop/nailgun/customization/roles.rst new file mode 100644 index 000000000..a22043f49 --- /dev/null +++ b/develop/nailgun/customization/roles.rst @@ -0,0 +1,121 @@ +Creating roles +============== + +Each release has its own role list which can be customized. A plain list of +roles is stored in the "roles" section of each release in the openstack.yaml_:: + + roles: + - controller + - compute + - cinder + +The order in which the roles are listed here determines the order in which +they are displayed on the UI. + +For each role in this list there should also be entry in "roles_metadata" +section. It defines role name, description and conflicts with other roles:: + + roles_metadata: + controller: + name: "Controller" + description: "..." + conflicts: + - compute + compute: + name: "Compute" + description: "..." + conflicts: + - controller + cinder: + name: "Storage - Cinder LVM" + description: "..." + +"conflicts" section should contain a list of other roles that cannot be placed +on the same node. In this example, "controller" and "compute" roles cannot be +combined. + +Roles restrictions +------------------ + +You should take the following restrictions for the role into consideration: + +#. Controller + + * There should be at least one controller. The `Not enough deployed + controllers` error occurs when you have 1 Controller installed + and want to redeploy that controller. During redeployment, it will + be taken off, so for some time the cluster will not have any + operating controller, which is wrong. + + * If we are using simple multinode mode, then we cannot add more + than one controller. + + * In HA mode, we can add as much as possible controllers, though + it is recommended to add at least 3. + + * Controller role cannot be combined with compute. + + +#. Compute + + * It is recommended to have at least one compute in non-vCenter env + (https://bugs.launchpad.net/fuel/+bug/1381613: note that this is a + bug in UI and not yaml-specific). Beginning + with Fuel 6.1, no vCenter-related limitations are longer present. + + * Computes cannot be combined with controllers. + + * Computes cannot be added if vCenter is chosen as a hypervisor. + +#. Cinder + + * It is impossible to add Cinder nodes to an environment with Ceph RBD. + + * At least one Cinder node is recommended + + * Cinder LVM needs to be enabled on the *Settings* tab of the Fuel web UI. + + +#. MongoDB + + * Cannot be added to already deployed environment. + + * Can be added only if Ceilometer is enabled. + + * Cannot be combined with Ceph OSD and Compute. + + * For a simple mode there has to be 1 Mongo node, for HA at least 3. + + * It is not allowed to choose MongoDB role for a node if external + MongoDB setup is used. + + +#. Zabbix + + * Only available in experimental ISO. + + * Cannot be combined with any other roles. + + * Only one Zabbix node can be assigned in an environment. + + +#. Ceph + + * Cannot be used with Mongo and Zabbix. + + * Minimal number of Ceph nodes is equal to + the `Ceph object replication factor` value from the *Settings* tab + of the Fuel web UI. + + * Ceph cannot be added if vCenter is chosen as a hypervisor + and `volumes_ceph`, `images_ceph` and `ephemeral_ceph` settings + are all False. + + +#. Ceilometer + + * Either a node with MongoDB role or external MongoDB turned on is + required. + + +.. _openstack.yaml: https://github.com/openstack/fuel-web/blob/master/nailgun/nailgun/fixtures/openstack.yaml diff --git a/develop/nailgun/customization/settings.rst b/develop/nailgun/customization/settings.rst new file mode 100644 index 000000000..c12ce185c --- /dev/null +++ b/develop/nailgun/customization/settings.rst @@ -0,0 +1,156 @@ +Extending OpenStack Settings +============================ + +Each release has a list of OpenStack settings that can be customized. +The settings configuration is stored in the "attributes_metadata.editable" +release section in the openstack.yaml_ file. + +Settings are divided into groups. Each group should have a "metadata" section +with the following attributes:: + + metadata: + toggleable: true + enabled: false + weight: 40 + +* *toggleable* defines an ability to enable/disable the whole setting group + on UI (checkbox control is presented near a setting group label) +* *enabled* indicates whether the group is checked on the UI +* *weight* defines the order in which this group is displayed on the tab. +* *restrictions*: see restrictions_. + +Other sections of a setting group represent separate settings. A setting +structure includes the following attributes:: + + syslog_transport: + value: "tcp" + label: "Syslog transport protocol" + description: "" + weight: 30 + type: "radio" + values: + - data: "udp" + label: "UDP" + description: "" + restrictions: + - "cluster:net_provider != 'neutron'" + - data: "tcp" + label: "TCP" + description: "" + regex: + source: "^[A-z0-9]+$" + error: "Invalid data" + +* *label* is a setting title that is displayed on UI +* *weight* defines the order in which this setting is displayed in its group. + This attribute is desirable +* *type* defines the type of UI control to use for the setting. + The following types are supported: + + * *text* - single line input + * *password* - password input + * *textarea* - multiline input + * *checkbox* - multiple-options selector + * *radio* - single-option selector + * *select* - drop-down list + * *hidden* - invisible input + * *file* - file contents input + +* *regex* section is applicable for settings of "text" type. "regex.source" + is used when validating with a regular expression. "regex.error" contains + a warning displayed near invalid field +* *restrictions*: see restrictions_. +* *description* section should also contain information about setting + restrictions (dependencies, conflicts) +* *values* list is needed for settings of "radio" or "select" type to declare + its possible values. Options from "values" list also support dependencies + and conflcits declaration. + +.. _restrictions: + +Restrictions +------------ + +Restrictions define when settings and setting groups should be available. +Each restriction is defined as a *condition* with optional *action*, *message* +and *strict*:: + + restrictions: + - condition: "settings:common.libvirt_type.value != 'kvm'" + message: "KVM only is supported" + - condition: "not ('experimental' in version:feature_groups)" + action: hide + +* *condition* is an expression written in `Expression DSL`_. If returned value + is true, then *action* is performed and *message* is shown (if specified). + +* *action* defines what to do if *condition* is satisfied. Supported values + are "disable", "hide" and "none". "none" can be used just to display + *message*. This field is optional (default value is "disable"). + +* *message* is a message that is shown if *condition* is satisfied. This field + is optional. + +* *strict* is a boolean flag which specifies how to handle non-existent keys + in expressions. If it is set to true (default value), exception is thrown in + case of non-existent key. Otherwise values of such keys have null value. + Setting this flag to false is useful for conditions which rely on settings + provided by plugins:: + + restrictions: + - condition: "settings:other_plugin == null or settings:other_plugin.metadata.enabled != true" + strict: false + message: "Other plugin must be installed and enabled" + +There are also short forms of restrictions:: + + restrictions: + - "settings:common.libvirt_type.value != 'kvm'": "KVM only is supported" + - "settings:storage.volumes_ceph.value == true" + +.. _Expression DSL: + +Expression Syntax +----------------- + +Expression DSL can describe arbitrarily complex conditions that compare fields +of models and scalar values. + +Supported types are: + +* Number (123, 5.67) + +* String ("qwe", 'zxc') + +* Boolean (true, false) + +* Null value (null) + +* ModelPath (settings:common.libvirt_type.value, cluster:net_provider) + +ModelPaths consist of a model name and a field name separated by ":". Nested +fields (like in settings) are supported, separated by ".". Models available for +usage are "cluster", "settings", "networking_parameters" and "version". + +Supported operators are: + +* "==". Returns true if operands are equal:: + + settings:common.libvirt_type.value == 'qemu' + +* "!=". Returns true if operands are not equal:: + + cluster:net_provider != 'neutron' + +* "in". Returns true if the right operand (Array or String) contains the left + operand:: + + 'ceph-osd' in release:roles + +* Boolean operators: "and", "or", "not":: + + cluster:mode == "ha_compact" and not (settings:common.libvirt_type.value == 'kvm' or 'experimental' in version:feature_groups) + +Parentheses can be used to override the order of precedence. + +.. _openstack.yaml: https://github.com/openstack/fuel-web/blob/master/nailgun/nailgun/fixtures/openstack.yaml diff --git a/develop/nailgun/development/code_testing.rst b/develop/nailgun/development/code_testing.rst new file mode 100644 index 000000000..43ee555b9 --- /dev/null +++ b/develop/nailgun/development/code_testing.rst @@ -0,0 +1,56 @@ +Code testing policy +=================== + +When writing tests, please note the following rules: + +#. Each code change MUST be covered with tests. The test for specific code + change must fail if that change to code is reverted, i.e. the test must + really cover the code change and not the general case. Bug fixes should + have tests for failing case. + +#. The tests MUST be in the same patchset with the code changes. + +#. It's permitted not to write tests in extreme cases. The extreme cases are: + + * hot-fix / bug-fix with *Critical* status. + * patching during Feature Freeze (FF_) or Hard Code Freeze (HCF_). + + In this case, request for writing tests should be reported as a bug with + *technical-debt* tag. It has to be related to the bug which was fixed with + a patchset that didn't have the tests included. + + .. _FF: https://wiki.openstack.org/wiki/FeatureFreeze + .. _HCF: https://wiki.openstack.org/wiki/Fuel/Hard_Code_Freeze + +#. Before writing tests please consider which type(s) of testing is suitable + for the unit/module you're covering. + +#. Test coverage should not be decreased. + +#. Nailgun application can be sliced up to tree layers (Presentation, Object, + Model). Consider usage of the unit testing if it is performed within one of + the layers or implementing mock objects is not complicated. + +#. The tests have to be isolated. The order and count of executions must not + influence test results. + +#. Tests must be repetitive and must always pass regardless of how many times + they are run. + +#. Parametrize tests to avoid testing many times the same behaviour but with + different data. This gives an additional flexibility in the methods' usage. + +#. Follow DRY principle in tests code. If common code parts are present, please + extract them to a separate method/class. + +#. Unit tests are grouped by namespaces as corresponding unit. For instance, + the unit is located at: ``nailgun/db/dl_detector.py``, corresponding test + would be placed in ``nailgun/test/unit/nailgun.db/test_dl_detector.py`` + +#. Integration tests are grouped at the discretion of the developer. + +#. Consider implementing performance tests for the cases: + + * new handler is added which depends on number of resources in the database. + * new logic is added which parses/operates on elements like nodes. + diff --git a/develop/nailgun/development/db_migrations.rst b/develop/nailgun/development/db_migrations.rst new file mode 100644 index 000000000..cc435017a --- /dev/null +++ b/develop/nailgun/development/db_migrations.rst @@ -0,0 +1,43 @@ +Nailgun database migrations +=========================== + +Nailgun uses Alembic (http://alembic.readthedocs.org/en/latest/) for database +migrations, allowing access to all common Alembic commands through "python +manage.py migrate" + +This command creates DB tables for Nailgun service:: + + python manage.py syncdb + +This is done by applying one by one a number of database migration files, +which are located in nailgun/nailgun/db/migration/alembic_migrations/versions. +This command does not create corresponding DB tables unless you created another +migration file or updated an existing one, even if you're making some changes +in SQLAlchemy models or creating the new ones. +A new migration file can be generated by running:: + + python manage.py migrate revision -m "Revision message" --autogenerate + +There are two important points here: + + 1) This command always creates a "diff" between the current database state + and the one described by your SQLAlchemy models, so you should always + run "python manage.py syncdb" before this command. This prevents running + the migrate command with an empty database, which would cause it to + create all tables from scratch. + 2) Some modifications may not be detected by "--autogenerate", which + require manual addition to the migration file. For example, adding a new + value to ENUM field is not detected. + +After creating a migration file, you can upgrade the database to a new state +by using this command:: + + python manage.py migrate upgrade +1 + +To merge your migration with an existing migration file, you can just move +lines of code from the "upgrade()" and "downgrade()" methods to the bottom of corresponding methods in previous migration file. As of this writing, +the migration file is called "current.py". + +For all additional features and needs, you may refer to Alembic documentation: +http://alembic.readthedocs.org/en/latest/tutorial.html + diff --git a/develop/nailgun/development/env.rst b/develop/nailgun/development/env.rst new file mode 100644 index 000000000..5e372a2b8 --- /dev/null +++ b/develop/nailgun/development/env.rst @@ -0,0 +1,349 @@ +Setting up Environment +====================== + +For information on how to get source code see :ref:`getting-source`. + +.. _nailgun_dependencies: + +Preparing Development Environment +--------------------------------- + +.. warning:: Nailgun requires Python 2.6 with development files. Please check + installed Python version using ``python --version``. If the version check + does not match, please install Python 2.6 as described in step 1. + If Python version matches, skip step 1. + + Please note that these instructions were tested on Ubuntu 12.04.4/14.04.1 (64 bit) + that contains Python 2.7 and requires downgrade to Python 2.6. + PPA instructions listed below install Python 2.6 but do not remove Python 2.7. + The default Python version remains 2.7. + You will have to specify Python version when you create virtual environment (see 8.1.1.1. step 5). + + +#. Install Python 2.6 using + `PPA `:: + + sudo add-apt-repository --yes ppa:fkrull/deadsnakes + sudo apt-get update + sudo apt-get install --yes python2.6 python2.6-dev + +#. Nailgun can be found in fuel-web/nailgun + +#. Install and configure PostgreSQL database. Please note that + Ubuntu 12.04 requires postgresql-server-dev-9.1 while + Ubuntu 14.04 requires postgresql-server-dev-9.3:: + + sudo apt-get install --yes postgresql postgresql-server-dev-all + + sudo sed -ir 's/peer/trust/' /etc/postgresql/9.*/main/pg_hba.conf + sudo service postgresql restart + + sudo -u postgres psql -c "CREATE ROLE nailgun WITH LOGIN PASSWORD 'nailgun'" + sudo -u postgres createdb nailgun + + If required, you can specify Unix-domain + socket in 'host' settings to connect to PostgreSQL database: + + .. code-block:: yaml + + DATABASE: + engine: "postgresql" + name: "nailgun" + host: "/var/run/postgresql" + port: "" + user: "nailgun" + passwd: "nailgun" + +#. Install pip and development tools:: + + sudo apt-get install --yes python-dev python-pip + +#. Install virtualenv. This step increases flexibility + when dealing with environment settings and package installation. + This step is obligatory if you need to downgrade to Python version 2.6 + (that Nailgun depends on):: + + sudo pip install virtualenv virtualenvwrapper + . /usr/local/bin/virtualenvwrapper.sh # you can save this to .bashrc + whereis python2.6 # Prints the intall path of python 2.6, let's say /usr/bin/python2.6. + # Copy the output and paste it in the command below for option -p + mkvirtualenv fuel -p /usr/bin/python2.6 # you can use any name instead of 'fuel' + workon fuel # command selects the particular environment + python --version # verify that default Python version inside virtual environment is 2.6 + +#. Install Python dependencies. This section assumes that you use virtual environment. + Otherwise, you must install all packages globally. + You can install pip and use it to require all the other packages at once:: + + sudo apt-get install --yes git + git clone https://github.com/openstack/fuel-web.git + cd fuel-web + pip install --allow-all-external -r nailgun/test-requirements.txt + +#. Create required folder for log files:: + + sudo mkdir /var/log/nailgun + sudo chown -R `whoami`.`whoami` /var/log/nailgun + sudo chmod -R a+w /var/log/nailgun + +#. Install NodeJS and JS dependencies:: + + sudo apt-get remove --yes nodejs nodejs-legacy + sudo apt-get install --yes software-properties-common + sudo add-apt-repository --yes ppa:chris-lea/node.js + sudo apt-get update + sudo apt-get install --yes nodejs + sudo npm install -g gulp + sudo chown -R `whoami`.`whoami` ~/.npm + cd nailgun + npm install + +Setup for Nailgun Unit Tests +---------------------------- + +#. Nailgun unit tests use `Tox `_ for generating test + environments. This means that you don't need to install all Python packages required + for the project to run them, because Tox does this by itself. + +#. First, create a virtualenv the way it's described in previous section. Then, install + the Tox package:: + + workon fuel #activate virtual environment created in the previous section + pip install tox + +#. Run the Nailgun backend unit tests:: + + sudo apt-get install puppet-common #install missing package required by tasklib tests + ./run_tests.sh --no-webui + +#. Run the Nailgun flake8 test:: + + ./run_tests.sh --flake8 + +#. You can also run the same tests by hand, using tox itself:: + + cd nailgun + tox -epy26 -- -vv nailgun/test + tox -epep8 + +#. Tox reuses the previously created environment. After making some changes with package + dependencies, tox should be run with **-r** option to recreate existing virtualenvs:: + + tox -r -epy26 -- -vv nailgun/test + tox -r -epep8 + +Running Nailgun Performance Tests ++++++++++++++++++++++++++++++++++ + +Now you can run performance tests using -x option: + +:: + + ./run_tests.sh -x + + +If -x is not specified, run_tests.sh will not run performance tests. + +The -n or -N option works exactly as before: it states whether +tests should be launched or not. + +For example: + +* run_tests.sh -n -x - run both regular and performance Nailgun tests. + +* run_tests.sh -x - run nailgun performance tests only, do not run + regular Nailgun tests. + +* run_tests.sh -n - run regular Naigun tests only. + +* run_tests.sh -N - run all tests except for Nailgun regular and + performance tests. + + + +Setup for Web UI Tests +---------------------- + +#. UI tests use Selenium server, so you need to install Java Runtime + Environment (JRE) 1.6 or newer version. + +#. You also need to install Firefox - it is used as the default browser for + tests. + +#. Run full Web UI test suite (this will wipe your Nailgun database in + PostgreSQL):: + + cd fuel-web + ./run_tests.sh --webui + + By default Firefox browser is used. You can specify the browser using + BROWSER environment variable:: + + BROWSER=chrome ./run_tests.sh --webui + + +.. _running-parallel-tests-py: + +Running parallel tests with py.test +----------------------------------- + +Now tests can be run over several processes +in a distributed manner; each test is executed +within an isolated database. + +Prerequisites ++++++++++++++ + +- Nailgun user requires createdb permission. + +- Postgres database is used for initial connection. + +- If createdb cannot be granted for the environment, + then several databases should be created. The number of + databases should be equal to *TEST_WORKERS* variable. + The *createdb* permission + should have the following format: *nailgun0*, *nailgun1*. + +- If no *TEST_WORKERS* variable is provided, then a default + database name will be used. Often it is nailgun, + but you can overwrite it with *TEST_NAILGUN_DB* + environment variable. + +- To execute parallel tests on your local environment, + run the following command from *fuel-web/nailgun*: + + :: + + py.test -n 4 nailgun/test + + + + You can also run the it from *fuel-web*: + + :: + + + py.test -n 4 nailgun/nailgun/test + + + +.. _running-nailgun-in-fake-mode: + +Running Nailgun in Fake Mode +---------------------------- + +#. Switch to virtual environment:: + + workon fuel + +#. Populate the database from fixtures:: + + cd nailgun + ./manage.py syncdb + ./manage.py loaddefault # It loads all basic fixtures listed in settings.yaml + ./manage.py loaddata nailgun/fixtures/sample_environment.json # Loads fake nodes + +#. Start application in "fake" mode, when no real calls to orchestrator + are performed:: + + python manage.py run -p 8000 --fake-tasks | egrep --line-buffered -v '^$|HTTP' >> /var/log/nailgun.log 2>&1 & + +#. (optional) You can also use --fake-tasks-amqp option if you want to + make fake environment use real RabbitMQ instead of fake one:: + + python manage.py run -p 8000 --fake-tasks-amqp | egrep --line-buffered -v '^$|HTTP' >> /var/log/nailgun.log 2>&1 & + +#. If you plan to use Fuel UI: + + * Update JS dependencies:: + + npm install + + * If you don't plan to modify Fuel UI, you may want just to build static + version which is served by nailgun:: + + gulp build + + Please note that after pulling updates from fuel-web repo you may need to + run this command again. + + To specify custom output directory location use + `static-dir` option:: + + gulp build --static-dir=static_compressed + + To speed up build process you may also want to disable uglification and + source maps generation:: + + gulp build --no-uglify --no-sourcemaps + + * If you plan to modify Fuel UI, there is more convenient option -- + a development server. It watches for file changes and automatically + rebuilds changed modules (significantly faster than full rebuild) + and triggers page refresh in browsers:: + + gulp dev-server + + By default it runs on port 8080 and assumes that nailgun runs on + port 8000. You can override this by using the following options:: + + gulp dev-server --dev-server-host=127.0.0.1 --dev-server-port=8080 --nailgun-host=127.0.0.1 --nailgun-port=8000 + + If you don't want to use a development server but would like to recompile + the bundle on any change, use:: + + gulp build --watch + + If automatic rebuild on change doesn't work, most likely you need to + increase the limit of inotify watches:: + + echo 100000 | sudo tee /proc/sys/fs/inotify/max_user_watches + + +Note: Diagnostic Snapshot is not available in a Fake mode. + +Running the Fuel System Tests +----------------------------- + +For fuel-devops configuration info please refer to +:doc:`Devops Guide ` article. + +#. Run the integration test:: + + cd fuel-main + make test-integration + +#. To save time, you can execute individual test cases from the + integration test suite like this (nice thing about TestAdminNode + is that it takes you from nothing to a Fuel master with 9 blank nodes + connected to 3 virtual networks):: + + cd fuel-main + export PYTHONPATH=$(pwd) + export ENV_NAME=fuelweb + export PUBLIC_FORWARD=nat + export ISO_PATH=`pwd`/build/iso/fuelweb-centos-6.5-x86_64.iso + ./fuelweb_tests/run_tests.py --group=test_cobbler_alive + +#. The test harness creates a snapshot of all nodes called 'empty' + before starting the tests, and creates a new snapshot if a test + fails. You can revert to a specific snapshot with this command:: + + dos.py revert --snapshot-name + +#. To fully reset your test environment, tell the Devops toolkit to erase it:: + + dos.py list + dos.py erase + + +Flushing database before/after running tests +-------------------------------------------- + +The database should be cleaned after running tests; +before parallel tests were enabled, +you could only run dropdb with *./run_tests.sh* script. + +Now you need to run dropdb for each slave node: +the *py.test --cleandb * command is introduced for this +purpose. diff --git a/develop/nailgun/development/i18n.rst b/develop/nailgun/development/i18n.rst new file mode 100644 index 000000000..bd95c7033 --- /dev/null +++ b/develop/nailgun/development/i18n.rst @@ -0,0 +1,35 @@ +Fuel UI Internationalization Guidelines +======================================= +Fuel UI internationalization is done using `i18next `_ +library. Please read `i18next documentation +`_ first. + +All translations are stored in nailgun/static/translations/core.json + +If you want to add new strings to the translations file, follow these rules: + +#. Use words describing placement of strings like "button", "title", "summary", + "description", "label" and place them at the end of the key + (like "apply_button", "cluster_description", etc.). One-word strings may + look better without any of these suffixes. +#. Do NOT use shortcuts ("bt" instead of "button", "descr" instead of + "description", etc.) +#. Nest keys if it makes sense, for example, if there are a few values + for statuses, etc. +#. If some keys are used in a few places (for example, in utils), move them to + "common.*" namespace. +#. Use defaultValue ONLY with dynamically generated keys. + +Validating translations +========================================= +To search for absent and unnecessary translation keys you can perform the following steps: + +#. Open terminal and cd to fuel-web/nailgun directory. +#. Run "gulp i18n:validate" to start the validation. + If there are any mismatches, you'll see the list of mismatching keys. + +Gulp task "i18n:validate" has one optional argument - a comma-separated list of +languages to compare with base English en-US translations. Run +"gulp i18n:validate --locales=zh-CN" to perform comparison only between English +and Chinese keys. You can also run "grunt i18n:validate --locales=zh-CN,ru-RU" +to perform comparison between English-Chinese and English-Russian keys. diff --git a/develop/nailgun/development/shell_doc.rst b/develop/nailgun/development/shell_doc.rst new file mode 100644 index 000000000..b18babe86 --- /dev/null +++ b/develop/nailgun/development/shell_doc.rst @@ -0,0 +1,120 @@ +Interacting with Nailgun using Shell +==================================== + +.. contents:: :local: + + +Launching shell +--------------- + +Development shell for Nailgun can only be accessed inside its virtualenv, +which can be activated by launching the following command:: + + source /opt/nailgun/bin/activate + +After that, the shell is accessible through this command:: + + python /opt/nailgun/bin/manage.py shell + +Its appearance depends on availability of ipython on current system. This +package is not available by default on the master node but you can use the +command above to run a default Python shell inside the Nailgun environment:: + + Python 2.7.3 (default, Feb 27 2014, 19:58:35) + [GCC 4.6.3] on linux2 + Type "help", "copyright", "credits" or "license" for more information. + (InteractiveConsole) + >>> + + +.. note:: If you want to quickly access the database, + use *manage.py dbshell* command. + + +Interaction +----------- + +There are two ways user may interact with Nailgun object instances +through shell: + + * Using Nailgun objects abstraction + * Using raw SQLAlchemy queries + +**IMPORTANT NOTE:** Second way (which is equal to straightforward modifying +objects in DB) should only be used if nothing else works. + +.. _shell-objects: + +Objects approach +**************** + +Importing objects may look like this:: + + >>> from nailgun import objects + >>> objects.Release + + >>> objects.Cluster + + >>> objects.Node + + +These are common abstractions around basic items Nailgun is dealing with. + +These objects allow user to interact with items in DB on higher level, which +includes all necessary business logic which is not executed then values in DB +are changed by hands. For working examples continue to :ref:`shell-faq`. + +SQLAlchemy approach +******************* + +Using raw SQLAlchemy models and queries allows user to modify objects through +ORM, almost the same way it can be done through SQL CLI. + +First, you need to get a DB session and import models:: + + >>> from nailgun.db import db + >>> from nailgun.db.sqlalchemy import models + >>> models.Release + + >>> models.Cluster + + >>> models.Node + + +and then get necessary instances from DB, modify them and commit current +transaction:: + + >>> node = db().query(models.Node).get(1) # getting object by ID + >>> node + + >>> node.status = 'error' + >>> db().commit() + +You may refer to `SQLAlchemy documentation `_ +to find some more info on how to do queries. + +.. _shell-faq: + +Frequently Asked Questions +-------------------------- + +As a first step in any case objects should be imported as is +described here: :ref:`shell-objects`. + +**Q:** How can I change status for particular node? + +**A:** Just retrieve node by its ID and update it:: + + >>> node = objects.Node.get_by_uid(1) + >>> objects.Node.update(node, {"status": "ready"}) + >>> objects.Node.save(node) + + +**Q:** How can I remove node from cluster by hands? + +**A:** Get node by ID and call its method:: + + >>> node = objects.Node.get_by_uid(1) + >>> objects.Node.remove_from_cluster(node) + >>> objects.Node.save(node) + diff --git a/develop/nailgun/development/ui_dependencies.rst b/develop/nailgun/development/ui_dependencies.rst new file mode 100644 index 000000000..07627ae2b --- /dev/null +++ b/develop/nailgun/development/ui_dependencies.rst @@ -0,0 +1,41 @@ +Managing UI Dependencies +======================== + +The dependencies of Fuel UI are managed by NPM_. + +Used NPM packages are listed in *dependencies* and *devDependencies* sections +of a package.json file. To install all required packages, run:: + + npm install + +To use gulp_ you also need to install the gulp package globally:: + + sudo npm install -g gulp + +To add a new package, it is not enough just to add a new entry to a +package.json file because npm-shrinkwrap_ is used to lock down package +versions. First you need to install the clingwrap package globally: + + sudo npm install -g clingwrap + +Then install required package:: + + npm install --save some-package + +Then run:: + + clingwrap some-package + +to update npm-shrinkwrap.json. + +Alternatively, you can completely regenerate npm-shrinkwrap.json by running:: + + rm npm-shrinkwrap.json + rm -rf node_modules + npm install + npm shrinkwrap --dev + clingwrap npmbegone + +.. _npm: https://www.npmjs.org/ +.. _gulp: http://gulpjs.com/ +.. _npm-shrinkwrap: https://www.npmjs.org/doc/cli/npm-shrinkwrap.html diff --git a/develop/nailgun/tree.rst b/develop/nailgun/tree.rst new file mode 100644 index 000000000..e2557992f --- /dev/null +++ b/develop/nailgun/tree.rst @@ -0,0 +1,25 @@ +.. _nailgun-development: + +Nailgun Development Instructions +================================ + +.. toctree:: + development/env + development/i18n + development/db_migrations + development/shell_doc + development/ui_dependencies + development/code_testing + + +Nailgun Customization Instructions +================================== + +.. _nailgun-customization: + +.. toctree:: + customization/partitions + customization/reliability + customization/roles + customization/settings + customization/bonding_in_ui diff --git a/develop/ostf_contributors_guide.rst b/develop/ostf_contributors_guide.rst new file mode 100644 index 000000000..828f3ed09 --- /dev/null +++ b/develop/ostf_contributors_guide.rst @@ -0,0 +1,533 @@ +Health Check (OSTF) Contributor's Guide +======================================= + +Health Check or OSTF? +Main goal of OSTF +Main rules of code contributions +How to setup my environment? +How should my modules look like? +How to execute my tests? +Now I'm done, what's next? +General OSTF architecture +OSTF packages architecture +OSTF Adapter architecture +Appendix 1 + +Health Check or OSTF? +^^^^^^^^^^^^^^^^^^^^^ +Fuel UI has tab which is called Health Check. In development team though, +there is an established acronym OSTF, which stands for OpenStack Testing Framework. +This is all about the same. For simplicity, this document will use widely +accepted term OSTF. + +Main goal of OSTF +^^^^^^^^^^^^^^^^^ +After OpenStack installation via Fuel, it`s very important to understand whether it was successful and if it`s ready for work. +OSTF provides a set of health checks - sanity, smoke, HA and additional components tests that check the proper operation of all system components in typical conditions. +There are tests for OpenStack scenarios validation and other specific tests useful in validating an OpenStack deployment. + +Main rules of code contributions +^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ +There are a few rules you need to follow to successfully pass the code review and contribute high-quality code. + +How to setup my environment? +---------------------------- + +OSTF repository is located at git.openstack.org or GitHub mirror: https://github.com/openstack/fuel-ostf. You also have to install and hook-up gerrit, because otherwise you will not be able to contribute code. To do that you need to follow registration and installation instructions in the document https://wiki.openstack.org/wiki/CLA#Contributors_License_Agreement +After you've completed the instructions, you're all set to begin editing/creating code. + +How should my modules look like? +-------------------------------- + +The rules are quite simple: + - follow Python coding rules + - follow OpenStack contributor's rules + - watch out for mistakes in docstrings + - follow correct test structure + - always execute your tests after you wrote them before sending them to review + +Speaking of following Python coding standards, you can find the style guide here: http://www.python.org/dev/peps/pep-0008/. You should read it carefully once and after implementing scripts you need to run some checks that will ensure that your code corresponds the standards. Without correcting issues with coding stadards your scripts will not be merged to master. + +You should always follow the following implementation rules: + - name the test module, test class and test method beginning with the word "test" + - if you have some tests that should be ran in a specific order, add a number to test method name, for example: test_001_create_keypair + - use verify(), verify_response_body_content() and other methods from mixins (see OSTF package architecture fuel_health/common/test_mixins.py section) with giving them failed step parameter + - always list all steps you are checking using test_mixins methods in the docstring in Scenario section in correct order + - always use verify() method when you want to check an operation that can go to an infinite loop + +The test docstrings are another important piece and you should always stick to the following docstring structure: + - test title - test description that will be always shown on UI (the remaining part of docstring will only be shown in cases when test failed) + - target component (optional) - component name that is tested (e.g. Nova, Keystone) + - blank line + - test scenario, example:: + + Scenario: + 1. Create a new small-size volume. + 2. Wait for volume status to become "available". + 3. Check volume has correct name. + 4. Create new instance. + 5. Wait for "Active" status. + 6. Attach volume to an instance. + 7. Check volume status is "in use". + 8. Get information on the created volume by its id. + 9. Detach volume from the instance. + 10. Check volume has "available" status. + 11. Delete volume. + + - test duration - an estimate of how much a test will take + +deployment tags (optional) - gives information about what kind of environment the test will be run, possible values are CENTOS, Ubuntu, RHEL nova_network, Heat, Murano, Sahara) + +Here's a test example which confirms the above explanations: + +.. image:: _images/test_docstring_structure.png + +Test run ordering and profiles +------------------------------ + +Each test set (sanity, smoke, HA and platform_tests) contains a special +variable in __init__.py module which is called __profile__. +The profile variable makes it possible to set different rules, such as test run +order, set up deployment tags, information gathering on cleanup and expected +time estimate for running a test set. + +If you are to develop a new set of tests, you need to create __init__.py module +and place __profile__ dict in it. It is important that your profile matches +the following structure:: + + __profile__ = { + "test_runs_ordering_priority": 4, + "id": "platform_tests", + "driver": "nose", + "test_path": "fuel_health/tests/platform_tests", + "description": ("Platform services functional tests." + " Duration 3 min - 60 min"), + "cleanup_path": "fuel_health.cleanup", + "deployment_tags": ['additional_components'], + "exclusive_testsets": [], + "available_since_release": "2015.2-6.1", + } + +Take note of each field in the profile, along with acceptable values. + + - test_runs_ordering_priority is a field responsible for setting the priority + in which the test set will be displayed. For example, if you set "6" for + sanity tests and "3" for smoke tests, smoke test set will be displayed + first on the HealthCheck tab; + - id is just the unique id of a test set; + - driver field is used for setting the test runner; + - test_path is the field representing path where test set is located starting + from fuel_health directory; + - description is the field which contains the value to be shown on the UI + as the tests duration; + - cleanup_path is the field that specifies path to module responsible for + cleanup mechanism (if you do not specify this value, cleanup will not be + started after your test set); + - deployment_tags field is used for defining when these tests should be + available depending on cluster settings; + - exclusive_testsets field gives you an opportunity to specify test sets that + will be run successively. For example, you can specify "smoke_sanity" for + smoke and sanity test set profiles, then these tests will be run not + simultaneously, but successively. + - available_since_release field is responsible for the release version + starting from which a particular test set can be run. This means that + the test will run only on the specified or newer version of Fuel. + +It is necessary to specify a value for each of the attributes. The optional +attribute is "deployment_tags", meaning optionally you may not specify it +in your profile at all. You can leave the "exclusive_testsets" empty ([]) to +run your testset simultaneously with other ones. + + +How to execute my tests? +------------------------ + +Simplest way is to install Fuel, and OSTF will be installed as part of it. + - install virtualbox + - build Fuel ISO: :ref:`building-fuel-iso` + - use `virtualbox scripts to run an ISO `_ + - once the installation is finished, go to Fuel UI (usually it's 10.20.0.2:8000) and create a new cluster with necessary configuration + - execute:: + + rsync -avz / root@10.20.0.2:/opt/fuel_plugins/ostf/lib/python2.6/site-packages/fuel_health/ + - execute:: + + ssh root@10.20.0.2 + ps uax | grep supervisor + kill + service supervisord start + - go to Fuel UI and run your new tests + +Now I'm done, what's next? +-------------------------- + + - don't forget to run pep8 on modified part of code + - commit your changes + - execute git review + - ask to review in IRC + +From this part you'll only need to fix and commit review comments (if there are any) by doing the same steps. If there are no review comments left, the reviewers will accept your code and it will be automatically merged to master. + +General OSTF architecture +^^^^^^^^^^^^^^^^^^^^^^^^^ + +Tests are included to Fuel, so they will be accessible as soon as you install Fuel on your lab. OSTF architecture is quite simple, it consists of two main packages: + - fuel_health which contains the test set itself and related modules + - fuel_plugin which contains OSTF-adapter that forms necessary test list in context of cluster deployment options and transfers them to UI using REST_API + +On the other hand, there is some information necessary for test execution itself. There are several modules that gather information and parse them into objects which will be used in the tests themselves. All information is gathered from Nailgun component. + +OSTF REST api interface +----------------------- + +Fuel OSTF module provides not only testing, but also RESTful +interface, a means for interaction with the components. + +In terms of REST, all types of OSTF entities are managed by three HTTP verbs: +GET, POST and PUT. + +The following basic URL is used to make requests to OSTF:: + + {ostf_host}:{ostf_port}/v1/{requested_entity}/{cluster_id} + +Currently, you can get information about testsets, tests and testruns +via GET request on corresponding URLs for ostf_plugin. + +To get information about testsets, make the following GET request on:: + + {ostf_host}:{ostf_port}/v1/testsets/{cluster_id} + +To get information about tests, make GET request on:: + + {ostf_host}:{ostf_port}/v1/tests/{cluster_id} + +To get information about executed tests, make the following GET +requests: + +- for the whole set of testruns:: + + {ostf_host}:{ostf_port}/v1/testruns/ + +- for the particular testrun:: + + {ostf_host}:{ostf_port}/v1/testruns/{testrun_id} + +- for the list of testruns executed on the particular cluster:: + + {ostf_host}:{ostf_port}/v1/testruns/last/{cluster_id} + +To start test execution, make the following POST request on this URL:: + + {ostf_host}:{ostf_port}/v1/testruns/ + +The body must consist of JSON data structure with testsets and the list +of tests belonging to it that must be executed. It should also have +metadata with the information about the cluster +(the key with the "cluster_id" name is used to store the parameter's value):: + + [ + { + "testset": "test_set_name", + "tests": ["module.path.to.test.1", ..., "module.path.to.test.n"], + "metadata": {"cluster_id": id} + }, + + ..., + + {...}, # info for another testrun + {...}, + + ..., + + {...} + ] + +If succeeded, OSTF adapter returns attributes of created testrun entities +in JSON format. If you want to launch only one test, put its id +into the list. To launch all tests, leave the list empty (by default). +Example of the response:: + + [ + { + "status": "running", + "testset": "sanity", + "meta": null, + "ended_at": "2014-12-12 15:31:54.528773", + "started_at": "2014-12-12 15:31:41.481071", + "cluster_id": 1, + "id": 1, + "tests": [.....info on tests.....] + }, + + .... + ] + +You can also stop and restart testruns. To do that, make a PUT request on +testruns. The request body must contain the list of the testruns and +tests to be stopped or restarted. Example:: + + [ + { + "id": test_run_id, + "status": ("stopped" | "restarted"), + "tests": ["module.path.to.test.1", ..., "module.path.to.test.n"] + }, + + ..., + + {...}, # info for another testrun + {...}, + + ..., + + {...} + ] + +If succeeded, OSTF adapter returns attributes of the processed testruns +in JSON format. Its structure is the same as for POST request, described +above. + +OSTF package architecture +^^^^^^^^^^^^^^^^^^^^^^^^^ + +The main modules used in fuel_health package are: + + **config** module is responsible of getting data which is necessary for tests. All data is gathered from Nailgun component or a text config. + Nailgun provides us with the following data: + - OpenStack admin user name + - OpenStack admin user password + - OpenStack admin user tenant + - ip of controllers node + - ip of compute node - easily get data from nailgun by parsing role key in response json + - deployment mode (HA /non-HA) + - deployment os (RHEL/CENTOS) + - keystone / horizon urls + - tiny proxy address + +All other information we need is stored in config.py itself and remains default in this case. In case you are using data from Nailgun (OpenStack installation using Fuel) you should to the following: +initialize NailgunConfig() class. + +Nailgun is running on Fuel master node, so you can easily get data for each cluster by invoking curl http:/localhost:8000/api/. Cluster id can be get from OS environment (provided by Fuel) + +If you want run OSTF for non Fuel installation, change the initialization of NailgunConfig() to FileConfig() and set parameters marked with green color in config - see Appendix 1 (default config file path fuel_health/etc/test.conf) + + **cleanup.py** - invoked by OSTF adapter in case if user stops test execution in Web UI. This module is responsible for deleting all test resources created during test suite run. It simply finds all resources whose name starts with ‘ost1_test-’ and destroys each of them using _delete_it method. + + *Important: if you decide to add additional cleanup for this resource, you have to keep in mind: + All resources depend on each other, that's why deleting a resource that is still in use will give you an exception; + Don't forget that deleting several resources requires an ID for each resource, but not its name. You'll need to specify delete_type optional argument in _delete_it method to ‘id’* + + **nmanager.py** contains base classes for tests. Each base class contains setup, teardown and methods that act as an interlayer between tests and OpenStack python clients (see nmanager architecture diagram). + + .. image:: _images/nmanager.png + + **fuel_health/common/test_mixins.py** - provides mixins to pack response verification into a human-readable message. For assertion failure cases, the method requires a step on which we failed and a descriptive + message to be provided. The verify() method also requires a timeout value to be set. This method should be used when checking OpenStack operations (such as instance creation). Sometimes a cluster + operation taking too long may be a sign of a problem, so this will secure the tests from such a situation or even from going into infinite loop. + + **fuel_health/common/ssh.py** - provides an easy way to ssh to nodes or instances. This module uses the paramiko library and contains some useful wrappers that make some routine tasks for you + (such as ssh key authentication, starting transport threads, etc). Also, it contains a rather useful method exec_command_on_vm(), which makes an ssh to an instance through a controller and then executes + the necessary command on it. + +OSTF Adapter architecture +^^^^^^^^^^^^^^^^^^^^^^^^^ + +.. image:: _images/plugin_structure.png + +The important thing to remember about OSTF Adapter is that just like when writing tests, all code should follow pep8 standard. + +Appendix 1 +---------- + +:: + + IdentityGroup = [ + cfg.StrOpt('catalog_type', + default='identity', may be changes on keystone + help="Catalog type of the Identity service."), + cfg.BoolOpt('disable_ssl_certificate_validation', + default=False, + help="Set to True if using self-signed SSL certificates."), + cfg.StrOpt('uri', + default='http://localhost/' (If you are using FileConfig set here appropriate address) + help="Full URI of the OpenStack Identity API (Keystone), v2"), + cfg.StrOpt('url', + default='http://localhost:5000/v2.0/', (If you are using FileConfig set here appropriate address to horizon) + help="Dashboard Openstack url, v2"), + cfg.StrOpt('uri_v3', + help='Full URI of the OpenStack Identity API (Keystone), v3'), + cfg.StrOpt('strategy', + default='keystone', + help="Which auth method does the environment use? " + "(basic|keystone)"), + cfg.StrOpt('region', + default='RegionOne', + help="The identity region name to use."), + cfg.StrOpt('admin_username', + default='nova' , (If you are using FileConfig set appropriate value here) + help="Administrative Username to use for" + "Keystone API requests."), + cfg.StrOpt('admin_tenant_name', (If you are using FileConfig set appropriate value here) + default='service', + help="Administrative Tenant name to use for Keystone API " + "requests."), + cfg.StrOpt('admin_password', (If you are using FileConfig set appropriate value here) + default='nova', + help="API key to use when authenticating as admin.", + secret=True), + ] + + ComputeGroup = [ + cfg.BoolOpt('allow_tenant_isolation', + default=False, + help="Allows test cases to create/destroy tenants and " + "users. This option enables isolated test cases and " + "better parallel execution, but also requires that " + "OpenStack Identity API admin credentials are known."), + cfg.BoolOpt('allow_tenant_reuse', + default=True, + help="If allow_tenant_isolation is True and a tenant that " + "would be created for a given test already exists (such " + "as from a previously-failed run), re-use that tenant " + "instead of failing because of the conflict. Note that " + "this would result in the tenant being deleted at the " + "end of a subsequent successful run."), + cfg.StrOpt('image_ssh_user', + default="root", (If you are using FileConfig set appropriate value here) + help="User name used to authenticate to an instance."), + cfg.StrOpt('image_alt_ssh_user', + default="root", (If you are using FileConfig set appropriate value here) + help="User name used to authenticate to an instance using " + "the alternate image."), + cfg.BoolOpt('create_image_enabled', + default=True, + help="Does the test environment support snapshots?"), + cfg.IntOpt('build_interval', + default=10, + help="Time in seconds between build status checks."), + cfg.IntOpt('build_timeout', + default=160, + help="Timeout in seconds to wait for an instance to build."), + cfg.BoolOpt('run_ssh', + default=False, + help="Does the test environment support snapshots?"), + cfg.StrOpt('ssh_user', + default='root', (If you are using FileConfig set appropriate value here) + help="User name used to authenticate to an instance."), + cfg.IntOpt('ssh_timeout', + default=50, + help="Timeout in seconds to wait for authentication to " + "succeed."), + cfg.IntOpt('ssh_channel_timeout', + default=20, + help="Timeout in seconds to wait for output from ssh " + "channel."), + cfg.IntOpt('ip_version_for_ssh', + default=4, + help="IP version used for SSH connections."), + cfg.StrOpt('catalog_type', + default='compute', + help="Catalog type of the Compute service."), + cfg.StrOpt('path_to_private_key', + default='/root/.ssh/id_rsa', (If you are using FileConfig set appropriate value here) + help="Path to a private key file for SSH access to remote " + "hosts"), + cfg.ListOpt('controller_nodes', + default=[], (If you are using FileConfig set appropriate value here) + help="IP addresses of controller nodes"), + cfg.ListOpt('compute_nodes', + default=[], (If you are using FileConfig set appropriate value here) + help="IP addresses of compute nodes"), + cfg.StrOpt('controller_node_ssh_user', + default='root', (If you are using FileConfig set appropriate value here) + help="ssh user of one of the controller nodes"), + cfg.StrOpt('controller_node_ssh_password', + default='r00tme', (If you are using FileConfig set appropriate value here) + help="ssh user pass of one of the controller nodes"), + cfg.StrOpt('image_name', + default="TestVM", (If you are using FileConfig set appropriate value here) + help="Valid secondary image reference to be used in tests."), + cfg.StrOpt('deployment_mode', + default="ha", (If you are using FileConfig set appropriate value here) + help="Deployments mode"), + cfg.StrOpt('deployment_os', + default="RHEL", (If you are using FileConfig set appropriate value here) + help="Deployments os"), + cfg.IntOpt('flavor_ref', + default=42, + help="Valid primary flavor to use in tests."), + ] + + + ImageGroup = [ + cfg.StrOpt('api_version', + default='1', + help="Version of the API"), + cfg.StrOpt('catalog_type', + default='image', + help='Catalog type of the Image service.'), + cfg.StrOpt('http_image', + default='http://download.cirros-cloud.net/0.3.1/' + 'cirros-0.3.1-x86_64-uec.tar.gz', + help='http accessable image') + ] + + NetworkGroup = [ + cfg.StrOpt('catalog_type', + default='network', + help='Catalog type of the Network service.'), + cfg.StrOpt('tenant_network_cidr', + default="10.100.0.0/16", + help="The cidr block to allocate tenant networks from"), + cfg.IntOpt('tenant_network_mask_bits', + default=29, + help="The mask bits for tenant networks"), + cfg.BoolOpt('tenant_networks_reachable', + default=True, + help="Whether tenant network connectivity should be " + "evaluated directly"), + cfg.BoolOpt('neutron_available', + default=False, + help="Whether or not neutron is expected to be available"), + ] + + VolumeGroup = [ + cfg.IntOpt('build_interval', + default=10, + help='Time in seconds between volume availability checks.'), + cfg.IntOpt('build_timeout', + default=180, + help='Timeout in seconds to wait for a volume to become' + 'available.'), + cfg.StrOpt('catalog_type', + default='volume', + help="Catalog type of the Volume Service"), + cfg.BoolOpt('cinder_node_exist', + default=True, + help="Allow to run tests if cinder exist"), + cfg.BoolOpt('multi_backend_enabled', + default=False, + help="Runs Cinder multi-backend test (requires 2 backends)"), + cfg.StrOpt('backend1_name', + default='BACKEND_1', + help="Name of the backend1 (must be declared in cinder.conf)"), + cfg.StrOpt('backend2_name', + default='BACKEND_2', + help="Name of the backend2 (must be declared in cinder.conf)"), + ] + + ObjectStoreConfig = [ + cfg.StrOpt('catalog_type', + default='object-store', + help="Catalog type of the Object-Storage service."), + cfg.StrOpt('container_sync_timeout', + default=120, + help="Number of seconds to time on waiting for a container" + "to container synchronization complete."), + cfg.StrOpt('container_sync_interval', + default=5, + help="Number of seconds to wait while looping to check the" + "status of a container to container synchronization"), + ] + + diff --git a/develop/puppet_tips.rst b/develop/puppet_tips.rst new file mode 100644 index 000000000..8f1b6f8ce --- /dev/null +++ b/develop/puppet_tips.rst @@ -0,0 +1,315 @@ +Resource duplication and file conflicts +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +If you have been developing your module that somehow uses services which are +already in use by other components of OpenStack, most likely you will try to +declare some of the same resources that have already been declared. +Puppet architecture doesn't allow declaration of resources that have same +type and title even if they do have same attributes. + +For example, your module could be using Apache and has Service['apache'] +declared. When you are running your module outside Fuel nothing else tries to +control this service to and everything work fine. But when you will try to add +this module to Fuel you will get resource duplication error because Apache is +already managed by Horizon module. + +There is pretty much nothing you can do about this problem because uniqueness +of Puppet resources is one on its core principles. But you can try to solve +the problem by one of following ways. + +The best thing you can do is to try to use an already declared resource by +settings dependencies to the other class that does use it. This will not work +in many cases and you may have to modify both modules or move conflicting +resource elsewhere to avoid conflicts. + +Puppet does provide a good solution to this problem - **virtual resources**. +The idea behind it is that you move resource declaration to separate class and +make them virtual. Virtual resources will not be evaluated until you realize +them and you can do it in all modules that do require this resources. +The trouble starts when these resources have different attributes and complex +dependencies. Most current Puppet modules doesn't use virtual resources and +will require major refactoring to add them. + +Puppet style guidelines advise to move all classes related with the same +service inside a single module instead of using many modules to work with +same service to minimize conflicts, but in many cases this approach +doesn't work. + +There are also some hacks such are defining resource inside *if ! +defined(Service['apache']) { ... }* block or using **ensure_resource** +function from Puppet's stdlib. + +Similar problems often arise then working with configuration files. +Even using templates doesn't allow several modules to directly edit same +file. There are a number of solutions to this starting from using +configurations directories and snippets if service supports them to +representing lines or configuration options as resources and managing +them instead of entire files. + +Many services does support configuration directories where you can place +configuration files snippets. Daemon will read them all, concatenate and +use like it was a single file. Such services are the most convenient to +manage with Puppet. You can just separate you configuration and manage +its pieces as templates. If your service doesn't know how to work with +snippets you still can use them. You only need to create parts of your +configuration file in some directory and then just combine them all +using simple exec with *cat* command. There is also a special *concat* +resource type to make this approach easier. + +Some configuration files could have standard structure and can be managed +by custom resource types. For example, there is the *ini_file* resource +type to manage values in compatible configuration as single resources. +There is also *augeas* resource type that can manage many popular +configuration file formats. + +Each approach has its own limitations and editing single file from +many modules is still non-trivial task in most cases. + +Both resource duplication and file editing problems doesn't have a good +solution for every possible case and significantly limit possibility +of code reuse. + +The last approach to solving this problem you can try is to modify files +by scripts and sed patches ran by exec resources. This can have unexpected +results because you can't be sure of what other operations are performed +on this configuration file, what text patterns exist there, and if your +script breaks another exec. + +Puppet module containment +~~~~~~~~~~~~~~~~~~~~~~~~~ + +Fuel Library consists of many modules with a complex structure and +several dependencies defined between the provided modules. +There is a known Puppet problem related to dependencies between +resources contained inside classes declared from other classes. +If you declare resources inside a class or definition they will be +contained inside it and entire container will not be finished until all +of its contents have been evaluated. + +For example, we have two classes with one notify resource each.:: + + class a { + notify { 'a' :} + } + + class b { + notify { 'b' :} + } + + Class['a'] -> Class['b'] + + include a + include b + +Dependencies between classes will force contained resources to be executed in +declared order. +But if we add another layer of containers dependencies between them will not +affect resources declared in first two classes.:: + + class a { + notify { 'a' :} + } + + class b { + notify { 'b' :} + } + + class l1 { + include a + } + + class l2 { + include b + } + + Class['l1'] -> Class['l2'] + + include 'l1' + include 'l2' + +This problem can lead to unexpected and in most cases unwanted behaviour +when some resources 'fall out' from their classes and can break the logic +of the deployment process. + +The most common solution to this issue is **Anchor Pattern**. Anchors are +special 'do-nothing' resources found in Puppetlab's stdlib module. +Anchors can be declared inside top level class and be contained +inside as any normal resource. If two anchors was declared they can be +named as *start* and *end* anchor. All classes, that should be contained +inside the top-level class can have dependencies with both anchors. +If a class should go after the start anchor and before the end anchor +it will be locked between them and will be correctly contained inside +the parent class.:: + + class a { + notify { 'a' :} + } + + class b { + notify { 'b' :} + } + + class l1 { + anchor { 'l1-start' :} + include a + anchor { 'l1-end' :} + + Anchor['l1-start'] -> Class['a'] -> Anchor['l1-end'] + } + + class l2 { + anchor { 'l2-start' :} + include b + anchor { 'l2-end' :} + + Anchor['l2-start'] -> Class['b'] -> Anchor['l2-end'] + } + + Class['l1'] -> Class['l2'] + + include 'l1' + include 'l2' + +This hack does help to prevent resources from randomly floating out of their +places, but look very ugly and is hard to understand. We have to use this +technique in many of Fuel modules which are rather complex and require such +containment. +If your module is going to work with dependency scheme like this, you could +find anchors useful too. + +There is also another solution found in the most recent versions of Puppet. +*Contain* function can force declared class to be locked within its +container.:: + + class l1 { + contain 'a' + } + + class l2 { + contain 'b' + } + +Puppet scope and variables +~~~~~~~~~~~~~~~~~~~~~~~~~~ + +The way Puppet looks for values of variables from inside classes can be +confusing too. There are several levels of scope in Puppet. +**Top scope** contains all facts and built-in variables and goes from the +start of *site.pp* file before any class or node declaration. There is also a +**node scope**. It can be different for every node block. Each class and +definition start their own **local scopes** and their variables and resource +defaults are available their. **They can also have parent scopes**. + +Reference to a variable can consist of two parts +**$(class_name)::(variable_name)** for example *$apache::docroot*. Class name +can also be empty and such record will explicitly reference top level scope +for example *$::ipaddress*. + +If you are going to use value of a fact or top-scope variable it's usually a +good idea to add two colons to the start of its name to ensure that you +will get the value you are looking for. + +If you want to reference variable found in another class and use fully +qualified name like this *$apache::docroot*. But you should remember that +referenced class should be already declared. Just having it inside your +modules folder is not enough for it. Using *include apache* before referencing +*$apache::docroot* will help. This technique is commonly used to make +**params** classes inside every module and are included to every other class +that use their values. + +And finally if you reference a local variable you can write just *$myvar*. +Puppet will first look inside local scope of current class of defined type, +then inside parent scope, then node scope and finally top scope. If variable +is found on any of this scopes you get the first match value. + +Definition of what the parent scope is varies between Puppet 2.* and Puppet +3.*. Puppet 2.* thinks about parent scope as a class from where current class +was declared and all of its parents too. If current class was inherited +from another class base class also is parent scope allowing to do popular +*Smart Defaults* trick.:: + + class a { + $var = ‘a’ + } + + class b( + $a = $a::var, + ) inherits a { + + } + +Puppet 3.* thinks about parent scope only as a class from which current class +was inherited if any and doesn't take declaration into account. + +For example:: + + $msg = 'top' + + class a { + $msg = "a" + } + + class a_child inherits a { + notify { $msg :} + } + +Will say 'a' in puppet 2.* and 3.* both. But.:: + + $msg = 'top' + + class n1 { + $msg = 'n1' + include 'n2' + } + + class n2 { + notify { $msg :} + } + + include 'n1' + +Will say 'n1' in puppet 2.6, will say 'n1' and issue *deprecation warning* in +2.7, and will say 'top' in puppet 3.* + +Finding such variable references replacing them with fully qualified names is +very important part Fuel of migration to Puppet 3.* + +Where to find more information +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +The best place to start learning Puppet is Puppetlabs' official learning +course (http://docs.puppetlabs.com/learning/). There is also a special virtual +machine image you can use to safely play with Puppet manifests. + +Then you can continue to read Puppet reference and other pages of Puppetlabs +documentation. + +You can also find a number of printed book about Puppet and how to use it to +manage your IT infrastructure. + +Pro Puppet +http://www.apress.com/9781430230571 + +Pro Puppet. 2nd Edition +http://www.apress.com/9781430260400 + +Puppet 2.7 Cookbook +https://www.packtpub.com/networking-and-servers/puppet-27-cookbook + +Puppet 3 Cookbook +https://www.packtpub.com/networking-and-servers/puppet-3-cookbook + +Puppet 3: Beginners Guide +https://www.packtpub.com/networking-and-servers/puppet-3-beginner%E2%80%99s-guide + +Instant Puppet 3 Starter +https://www.packtpub.com/networking-and-servers/instant-puppet-3-starter-instant + +Pulling Strings with Puppet Configuration Management Made Easy +http://www.apress.com/9781590599785 + +Puppet Types and Providers Extending Puppet with Ruby +http://shop.oreilly.com/product/0636920026860.do + +Managing Infrastructure with Puppet. Configuration Management at Scale +http://shop.oreilly.com/product/0636920020875.do diff --git a/develop/pxe_deployment.rst b/develop/pxe_deployment.rst new file mode 100644 index 000000000..37e0ce1f3 --- /dev/null +++ b/develop/pxe_deployment.rst @@ -0,0 +1,304 @@ +Fuel Master Node Deployment over PXE +==================================== + +Tech Explanation of the process +------------------------------- +In some cases (such as no installed CD-ROM or no physical access to the +servers) we need to install Fuel Master node somehow other way from CD or USB +Flash drive. Starting from Fuel 4.0 it's possible to deploy Master node with PXE + +The process of deployment of Fuel master node over network consists of booting +linux kernel by DHCP and PXE. Then anaconda installer will download +configuration file and all packages needed to complete the installation. + + * PXE firmware of the network card makes DHCP query and gets IP address and + boot image name. + * Firmware downloads boot image file using TFTP protocol and starts it. + * This bootloader downloads configuration file with kernel boot option, + kernel and initramfs and starts the installer. + * Installer downloads kickstart configuration file by mounting contents of + Fuel ISO file over NFS. + * Installer partitions hard drive, installs the system by downloading packages + over NFS, copies all additional files, installs the bootloader and reboots + into new system. + +So we need: + * Working system to serve as network installer. + * DHCP server + * TFTP server + * NFS server + * PXE bootloader and its configuration file + * Extracted or mounted Fuel ISO file + +In our test we will use 10.20.0.0/24 network. +10.20.0.1/24 will be IP address of our host system. + +Installing packages +------------------- +We will be using Ubuntu or Debian system as an installation server. Other linux +or even BSD-based systems could be used too, but paths to configuration files +and init scripts may differ. + +First we need to install the software:: + + # TFTP server and client + apt-get install tftp-hpa tftpd-hpa + # DHCP server + apt-get install isc-dhcp-server + # network bootloader + apt-get install syslinux syslinux-common + # nfs server + apt-get install nfs-server + +Setting up DHCP server +-------------------------- +Standalone ISC DHCPD +~~~~~~~~~~~~~~~~~~~~ +First we are going to create configuration file located at /etc/dhcp/dhcpd.conf:: + + ddns-update-style none; + default-lease-time 600; + max-lease-time 7200; + authoritative; + log-facility local7; + + subnet 10.20.0.0 netmask 255.255.255.0 { + range 10.20.0.2 10.20.0.2; + option routers 10.20.0.1; + option domain-name-servers 10.20.0.1; + } + + host fuel { + hardware ethernet 52:54:00:31:38:5a; + fixed-address 10.20.0.2; + filename "pxelinux.0"; + } + +We have declared a subnet with only one IP address available that we are going +to give to our master node. We are not going to serve entire range of IP +addresses because it will disrupt Fuel’s own DHCP service. There is also a host +definition with a custom configuration that matches a specific MAC address. This +address should be set to the MAC address of the system that you are going to +make Fuel master node. Other systems on this subnet will not receive any IP +addresses and will load bootstrap from master node when it starts serving DHCP +requests. +We also give a filename that will be used to boot the Fuel master node. + + +Using 10.20.0.0/24 subnet requires you to set 10.20.0.1 on the network +interface connected to this network. You may also need to set the interface +manually using the INTERFACES variable in /etc/default/isc-dhcp-server file. + +Start DHCP server:: + + /etc/init.d/isc-dhcp-server restart + +Simple with dnsmasq:: + + sudo dnsmasq -d --enable-tftp --tftp-root=/var/lib/tftpboot \ + --dhcp-range=10.20.0.2,10.20.0.2 \ + --port=0 -z -i eth2 \ + --dhcp-boot='pxelinux.0' + +Libvirt with dnsmasq +~~~~~~~~~~~~~~~~~~~~ +If you are using libvirt virtual network to install your master node, then you +can use its own DHCP service. Use virsh net-edit default to modify network +configuration:: + + + default + + + + + + + + + + + + +This configuration includes TFTP server and DHCP server with only one IP +address set to your master node’s MAC address. You don't need to install +neither external DHCP server nor TFTP server. +Don’t forget to restart the network after making edits:: + + virsh net-destroy default + virsh net-start default + +Dnsmasq without libvirt +~~~~~~~~~~~~~~~~~~~~~~~ +You can also use dnsmasq as a DHCP and TFTP server without libvirt:: + + strict-order + domain-needed + user=libvirt-dnsmasq + local=// + pid-file=/var/run/dnsmasq.pid + except-interface=lo + bind-dynamic + interface=virbr0 + dhcp-range=10.20.0.2,10.20.0.2 + dhcp-no-override + enable-tftp + tftp-root=/var/lib/tftpboot + dhcp-boot=pxelinux.0 + dhcp-leasefile=/var/lib/dnsmasq/leases + dhcp-lease-max=1 + dhcp-hostsfile=/etc/dnsmasq/hostsfile + +In /etc/dnsmasq/hostsfile you can specify hosts and their mac addresses:: + + 52:54:00:31:38:5a,10.20.0.2 + +Dnsmasq provides both DHCP, TFTP, as well as acts as a DNS caching server, so +you don't need to install additional external services. + +Setting our TFTP server +----------------------- +If you are not using a libvirt virtual network, then you need to install tftp +server. On Debian or Ubuntu system its configuration file will be located here +/etc/default/tftpd-hpa. +Checking if all we want are there:: + + TFTP_USERNAME="tftp" + TFTP_DIRECTORY="/var/lib/tftpboot" + TFTP_ADDRESS="10.20.0.1:69" + TFTP_OPTIONS="--secure --blocksize 512" + +Don’t forget to set blocksize here. Some hardware switches have problems with +larger block sizes. +And star it:: + + /etc/init.d/tftpd-hpa restart + +Setting up NFS server +--------------------- +You will also need to setup NFS server on your install system. Edit the NFS +exports file:: + + vim /etc/exports + +Add the following line:: + + /var/lib/tftpboot 10.20.0.2(ro,async,no_subtree_check,no_root_squash,crossmnt) + +And start it:: + + /etc/init.d/nfs-kernel-server restart + + +Set up tftp root +---------------- +Our tftp root will be located here: /var/lib/tftpboot +Let’s create a folder called "fuel" to store ISO image contents and syslinux +folder for bootloader files. If you have installed syslinux package you can find +them in /usr/lib/syslinux folder. +Copy this files from /usr/lib/syslinux to /var/lib/tftpboot:: + + memdisk menu.c32 poweroff.com pxelinux.0 reboot.c32 + +Now we need to write the pxelinux configuration file. It will be located here +/var/lib/tftpboot/pxelinux.cfg/default:: + + DEFAULT menu.c32 + prompt 0 + MENU TITLE My Distro Installer + + TIMEOUT 600 + + LABEL localboot + MENU LABEL ^Local Boot + MENU DEFAULT + LOCALBOOT 0 + + LABEL fuel + MENU LABEL Install ^FUEL + KERNEL /fuel/isolinux/vmlinuz + INITRD /fuel/isolinux/initrd.img + APPEND biosdevname=0 ks=nfs:10.20.0.1:/var/lib/tftpboot/fuel/ks.cfg repo=nfs:10.20.0.1:/var/lib/tftpboot/fuel ip=10.20.0.2 netmask=255.255.255.0 gw=10.20.0.1 dns1=10.20.0.1 hostname=fuel.mirantis.com showmenu=no + + LABEL reboot + MENU LABEL ^Reboot + KERNEL reboot.c32 + + LABEL poweroff + MENU LABEL ^Poweroff + KERNEL poweroff.com + +You can ensure silent installation without any Anaconda prompts by adding the following APPEND directives: + +* ksdevice=INTERFACE +* installdrive=DEVICENAME +* forceformat=yes + +For example: + + installdrive=sda ksdevice=eth0 forceformat=yes + +Now we need to unpack the Fuel ISO file we have downloaded:: + + mkdir -p /var/lib/tftpboot/fuel /mnt/fueliso + mount -o loop /path/to/your/fuel.iso /mnt/fueliso + rsync -a /mnt/fueliso/ /var/lib/tftpboot/fuel/ + umount /mnt/fueliso && rmdir /mnt/fueliso + +So that's it! We can boot over the network from this PXE server. + +Troubleshooting +--------------- + +After implementing one of the described configuration you should see something +like that in your /var/log/syslog file:: + + dnsmasq-dhcp[16886]: DHCP, IP range 10.20.0.2 -- 10.20.0.2, lease time 1h + dnsmasq-tftp[16886]: TFTP root is /var/lib/tftpboot + +To make sure all of daemon listening sockets as they should:: + + # netstat -upln | egrep ':(67|69|2049) ' + udp 0 0 0.0.0.0:67 0.0.0.0:* 30791/dnsmasq + udp 0 0 10.20.0.1:69 0.0.0.0:* 30791/dnsmasq + udp 0 0 0.0.0.0:2049 0.0.0.0:* - + +* NFS - udp/2049 +* DHCP - udp/67 +* TFTP - udp/69 + +So all of daemons listening as they should. + +To test DHCP server does provide an IP address you can do something like that +on the node in the defined PXE network. Please note, it should have Linux +system installed or any other OS to test configuration properly:: + + # dhclient -v eth0 + Internet Systems Consortium DHCP Client 4.1.1-P1 + Copyright 2004-2010 Internet Systems Consortium. + All rights reserved. + For info, please visit https://www.isc.org/software/dhcp/ + + Listening on LPF/eth0/00:25:90:c4:7a:64 + Sending on LPF/eth0/00:25:90:c4:7a:64 + Sending on Socket/fallback + DHCPREQUEST on eth0 to 255.255.255.255 port 67 (xid=0x7b6e25dc) + DHCPACK from 10.20.0.1 (xid=0x7b6e25dc) + bound to 10.20.0.2 -- renewal in 1659 seconds. + +After running dhclient you should see how it asks one or few times DHCP server +with DHCPDISCOVER and then get 10.20.0.2. If you have more then one NIC you +should run dhclient on every one to determine where our network in connected +to. + +TFTP server can be tested with tftp console client:: + + # tftp + (to) 10.20.0.1 + tftp> get /pxelinux.0 + +NFS could be tested with mounting it:: + + mkdir /mnt/nfsroot + mount -t nfs 10.20.0.1:/var/lib/tftpboot /mnt/nfsroot + diff --git a/develop/quick_start.rst b/develop/quick_start.rst new file mode 100644 index 000000000..fb2459fba --- /dev/null +++ b/develop/quick_start.rst @@ -0,0 +1,110 @@ +Fuel Development Quick-Start +============================ + +If you are interested in contributing to Fuel or modifying Fuel +for your own purposes, this short guide should get you pointed +to all the information you need to get started. + +If you are new to contributing to OpenStack, read +through the “How To Contribute” page on the OpenStack wiki. +See: `How to contribute +`_. + +For this walk-through, let’s use the example of modifying an +option to the “new environment wizard” in Fuel (example here: +`https://review.openstack.org/#/c/90687/1 +`_). This +enhancement required modification to three files in the fuel-web +repository:: + + fuel-web/nailgun/static/translations/core.json + fuel-web/nailgun/static/js/views/dialogs.jsx + fuel-web/nailgun/static/templates/dialogs/create_cluster_wizard/storage.html + +In order to add, test and commit the code necessary to +implement this feature, these steps were followed: + +#. Create a Fuel development environment by following the + instructions found here: + :doc:`Fuel Development Environment `. + +#. In your development environment, prepare your environment + for Nailgun unit tests and Web UI tests by following + the instructions found here: + :doc:`Nailgun Dev Environment `. + Be sure to run the tests noted in each section to ensure + your environment confirms to a known good baseline. + +#. Branch your fuel-web checkout (see `Gerrit Workflow + `_ for + more information on the gerrit workflow):: + + cd fuel-web + git fetch --all;git checkout -b vcenter-wizard-fix origin/master + +#. Modify the necessary files (refer to :doc:`Fuel Architecture + ` to understand how the components + of Fuel work together). + +#. Test your Nailgun changes:: + + cd fuel-web + ./run_tests.sh --no-webui + ./run_tests.sh --flake8 + ./run_tests.sh --webui + +#. You should also test Nailgun in fake UI mode by following + the steps found here: :ref:`running-nailgun-in-fake-mode` + +#. When all tests pass you should commit your code, which + will subject it to further testing via Jenkins and Fuel CI. + Be sure to include a good commit message, guidelines can be + found here: `Git Commit Messages `_.:: + + git commit -a + git review + +#. Frequently, the review process will suggest changes be + made before your code can be merged. In that case, make + your changes locally, test the changes, and then re-submit + for review by following these steps:: + + git commit -a --amend + git review + +#. Now that your code has been committed, you should change + your Fuel ISO makefile to point to your specific commit. + As noted in the :doc:`Fuel Development documentation `, + when you build a Fuel ISO it pulls down the additional + repositories rather than using your local repos. Even + though you have a local clone of fuel-web holding the branch + you just worked on, the build script will be pulling code + from git for the sub-components (Nailgun, Astute, OSTF) + based on the repository and commit specified in environment + variables when calling “make iso”, or as found in config.mk. + You will need to know the gerrit commit ID and patch number. + For this example we are looking at + https://review.openstack.org/#/c/90687/1 + with the gerrit ID 90687, patch 1. In this instance, you + would build the ISO with:: + + cd fuel-main + NAILGUN_GERRIT_COMMIT=refs/changes/32/90687/1 make iso + +#. Once your ISO build is complete, you can test it. If + you have access to hardware that can run the KVM + hypervisor, you can follow the instructions found in the + :doc:`Devops Guide ` to create a robust testing + environment. Otherwise you can test the ISO with + Virtualbox (the download link can be found at + `https://software.mirantis.com/ `_) + +#. Once your code has been merged, you can return your local + repo to the master branch so you can start fresh on your + next commit by following these steps:: + + cd fuel-web + git remote update + git checkout master + git pull + diff --git a/develop/separateMOS.rst b/develop/separateMOS.rst new file mode 100644 index 000000000..26c85ec3d --- /dev/null +++ b/develop/separateMOS.rst @@ -0,0 +1,544 @@ +Separate Mirantis OpenStack and Linux Repositories +================================================== + +Starting with Fuel 6.1, the repositories for +Mirantis OpenStack and Linux packages are separate. + +Having separate repositories gives you the following +advantages: + +* You can run base distributive updates and + Mirantis OpenStack updates during the product life cycle. + +* You can see what packages are provided by + Mirantis OpenStack and what packages provided by the base distributive. + +* You can download security updates + independently for the base distributive and for Mirantis OpenStack. + +* You can see sources of the base distributive and + Mirantis OpenStack packages. + +* You can see the debug symbols of the base distributive and + Mirantis OpenStack packages. + +* As a Fuel Developer, you can have the same approach for making + changes to Fuel components and their dependencies. + +Types of software packages +-------------------------- + +All software packages deployed starting with Fuel 6.1 +are divided into the following categories: + +#. *Upstream package*: A package from the supported release of the base distributive + is reused from the distributive repositories directly, without modifications specific + to Mirantis OpenStack. + +#. *Mirantis OpenStack specific package*: A package specific to Mirantis OpenStack that does not + exist in any release of the base distributive, or any of the base distributive's + upstream distributions. + +#. *Divergent package*: A package that is based on a version of the same + package from any release of the base distributive or its upstream distributions, + and includes a different software version than the corresponding *upstream + package*, or additional modifications that are not present in the *upstream + package*, or both. + + #. *Upgraded package*: A variant of *divergent package* that includes a + newer software version than the corresponding *upstream package*. + + #. *Holdback package*: a variant of *divergent package* constituting a + temporary replacement for an *upstream package* to fix a regression + introduced in the supported release of the base distributive. It is published + in a Mirantis OpenStack repository after a regression is detected, and is + removed from that repository as soon as the regression is either resolved + in the upstream package, or addressed elsewhere in Mirantis OpenStack. + +.. note:: Downgraded packages with the upstream version lower than the version + available in the base distributive are not allowed. + +Different releases of Mirantis OpenStack can put the same software package in different +categories. + +All kinds of divergence from the base distributive should be kept to a minimum. As +many of Mirantis OpenStack dependencies as possible should be satisfied by upstream packages +from the supported release of the base distro. When possible, Mirantis OpenStack patches and +Mirantis OpenStack specific packages should be contributed back to the base distributives. + +Distributing Mirantis OpenStack packages +---------------------------------------- + +Released Mirantis OpenStack packages are be distributed as part of the Fuel ISO image. Upstream +packages and any other IP protected by respective operating system vendors are not +included in Fuel ISO images. Regular updates to the Mirantis OpenStack +distribution are delivered through online Mirantis OpenStack mirrors. + +Mirantis OpenStack mirrors structure +------------------------------------ + +Mirantis OpenStack mirrors are organized in the same way as base distro mirrors. + +Every supported operating system has its own set of repositories containing Mirantis OpenStack packages +per release (mos6.1, mos7.0 etc). These repositories contain only packages +with Mirantis OpenStack specific modifications, and no upstream packages from the +corresponding base distro. + +As a user you can create and maintain local copies of the base distro and Mirantis OpenStack mirrors. +This allows you to use the repositories in completely isolated environments or +create your own mirrors to pass the extended validation before a package update +roll-out across your production environment. + +Top level Mirantis OpenStack mirror structure +--------------------------------------------- + +:: + + / + +--+centos + | | + | +--+6 + | | | + | | +--+mos6.0 + | | | + | | +--+mos6.1 + | | + | +--+7 + | | + | +--+mos7.0 + | | + | +--+mos7.1 + | + +--+ubuntu + | + +--+dists + | + +--+pool + | + +--+... + +Debian based mirror structure +----------------------------- + +Mirantis OpenStack mirrors include several repositories (updates, security, proposed) +built in the same way as the base operating system mirror (Debian or Ubuntu). Repository sections +are organized in the same way (main, restricted) in accordance with the package licenses +(non-free). + +:: + + $(OS_MIRROR) $(MOS_MIRROR) + + + + | | + +--+ubuntu +--+ubuntu + | | + +--+dists +--+dists + | | | | + | +--+precise-backport | +--+mos6.1-proposed + | | | | + | +--+precise-proposed | +--+mos6.1-security + | | | | + | +--+precise-security | +--+mos6.1-updates + | | | | + | +--+precise-updates | +--+mos6.1 + | | | | + | +--+precise | +--+mos7.0-proposed + | | | | + | +--+trusty-backport | +--+mos7.0-security + | | | | + | +--+trusty-proposed | +--+mos7.0-updates + | | | | + | +--+trusty-security | +--+mos7.0 + | | | + | +--+trusty-updates +--+indices + | | | | + | +--+trusty | +--+... + | | + +--+indices +--+pool + | | | | + | +--+... | +--+main + | | | | + +--+pool | | +--+a + | | | | | + | +--+main | | +--+... + | | | | | + | +--+multiverse | | +--+z + | | | | + | |--+restricted | |--+restricted + | | | | + + |--+universe | +--+a + | | | + |--+... | +--+... + | | + | +--+z + | + +--+project + | + +--+mos-archive-keyring.gpg + | + +--+mos-archive-keyring.sig + +Red Hat based mirror structure +------------------------------ + +Mirantis OpenStack mirrors include several repositories (operating system, updates, Fasttrack) built +in the same way as base distro mirror (Red Hat or CentOS). + +:: + + $(OS_MIRROR) $(MOS_MIRROR) + + + + | | + +--+centos-6 +--+centos-6 + | | | | + | +--+... | +--+mos6.1 + | | | + +--+centos-7 | +--+mos7.0 + | | | + +--+7 | +--+os + | | | | + +--+os | | +--+x86_64 + | | | | | + | +--+x86_64 | | +--+Packages + | | | | | | + | +--+Packages | | | +--+*.rpm + | | | | | | + | | +--+*.rpm | | +--+RPM-GPG-KEY-MOS7.0 + | | | | | + | +--+RPM-GPG-KEY-CentOS-7 | | +--+repodata + | | | | | + | +--+repodata | | +--+*.xml,*.gz + | | | | + | +--+*.xml,*.gz | +--+updates + | | | + +--+updates | +--+x86_64 + | | | + +--+x86_64 | +--+Packages + | | | | + +--+Packages | | +--+*.rpm + | | | | + | +--+*.rpm | +--+repodata + | | | + +--+repodata | +--+*.xml,*.gz + | | + +--+*.xml,*.gz +--+centos-7 + | + +--+mos7.1 + | + +--+mos8.0 + +Repositories priorities +----------------------- + +Handling multiple package repositories in Nailgun is expanded to +allow the user to set priorities during deployment. + +Default repository priorities are arranged so that packages from Mirantis OpenStack +repositories are preferred over packages from the base distro. On Debian based +systems, the force-downgrade APT pinning priorities are used for Mirantis OpenStack +repositories to make sure that, when a package is available in a Mirantis OpenStack +repository, it is always preferred over the package from the base distro, even if +the version in the Mirantis OpenStack repository is lower. + +Fuel developer repositories +--------------------------- + +The build system allows developers to build custom packages. These packages +are placed into a special repository which can be specified in Nailgun +to deliver these packages to an environment. APT pinning priority for these +repositories is higher than the base distro and Mirantis OpenStack repositories. +Accordingly, Yum repository priority value is lower than the base distro and +Mirantis OpenStack repositories. + +Holdback repository +------------------- + +The purpose of the holdback repository is to ensure the highest quality of the Mirantis OpenStack +product. If there is an *upstream* package that breaks the product, and this +cannot be fixed in a timely manner, the Mirantis OpenStack team publishes the package +proven stable to the "mosXX-holdback" repository. This repository is +automatically configured on all installations with the priority higher than the base +distro repositories. + +The case when the base distro vendor releases a fixed version of a problem package +is covered by Mirantis OpenStack system tests. + +Package versioning requirements +------------------------------- + +A package version string for a *Mirantis OpenStack specific* or a *divergent* package must not +include registered trademarks of base distro vendors, and should include the "mos" +keyword. + +Every new revision of a *Mirantis OpenStack specific* or a *divergent* package targeted to a Mirantis OpenStack +release (including the corresponding update repository) must have a package version +greater than or equal to the versions of the same package in all previous +releases of Mirantis OpenStack (base, update, security repositories), as well as versions of +the same package previously published in any repos for this Mirantis OpenStack release. + +For example, there must be no package version downgrades in the following Mirantis OpenStack +release progression (where 6.1.1 matches the state of update repository at the +time of 6.1.1 maintenance release): + + 6.0 <= 6.0.1 <= 6.1 <= 6.1.1 <= 6.1.2 <= 7.0 + +Package version of a *divergent* package (including *upgraded* and *holdback* +packages) must be constructed in a way that allows the *upstream* package +with the same software version to be automatically considered for an upgrade by +the package management system as soon as the divergent package is removed from the +Mirantis OpenStack repositories. This simplifies the phasing out of divergent packages in favor of the +upstream packages between major Mirantis OpenStack releases, but due to the repository priorities +defined above, does not lead to new upstream packages superceding the *upgraded* +packages available from Mirantis OpenStack repositories when applying updates. + +Every new revision of a *divergent* package must have a package version greater +than previous revisions of the same package that is published to the same +repository for that Mirantis OpenStack release. Its version should be lower than the version of +the corresponding *upstream* package. + +When the same package version is ported from one Mirantis OpenStack release to another without +modifications (i.e. same upstream version and same set of patches), a new package +version should include the full package version from the original Mirantis OpenStack release. + +Debian package versioning +------------------------- + +Versioning requirements defined in this section apply to all software packages +in all Mirantis OpenStack repositories for Debian based distros. The standard terms defined in +Debian Policy are used to describe package version components: epoch, +upstream version, Debian revision. + +Upstream version of a package should exactly match the software version, +without suffixes. Introducing epoch or increasing epoch relative to a base distro +should be avoided. + +Debian revision of a Mirantis OpenStack package should use the following format:: + + ~+mos + +In Mirantis OpenStack specific packages, revision must always be "0":: + + fuel-nailgun_6.1-0~u14.04+mos1 + +In *divergent* packages, revision should include as much of the Debian revision +of the corresponding *upstream* package as possible while excluding the base +distro vendor's trademarks, and including the target distribution version:: + + qemu_2.1.0-1 -> qemu_2.1.0-1~u14.04+mos1 + ohai_6.14.0-2.3ubuntu4 -> ohai_6.14.0-2.3~u14.04+mos1 + +Subrevision numbering starts from 1. Subsequent revisions of a package using +the same upstream version and based on the upstream package with the same +Debian revision should increment the subrevision:: + + ohai_6.14.0-2.3~u14.04+mos2 + ohai_6.14.0-2.3~u14.04+mos3 + +Subsequent revision of a package that introduces a new upstream version or new +base distro package revision should reset the subrevision back to 1:: + + ohai_6.14.0-3ubuntu1 -> ohai_6.14.0-3~u14.04+mos1 + +Versioning of packages in post-release updates +++++++++++++++++++++++++++++++++++++++++++++++ + +Once a Mirantis OpenStack release reaches GA, the primary package repository for the release +is frozen, and subsequent updates are published to the updates repositories. + +Most of the time, only a small subset of modifications (including patches, +metadata changes, etc.) is backported to updates for old Mirantis OpenStack releases. +When an updated package includes only a subset of modifications, its version +should include the whole package version from the primary repository, followed +by a reference to the targeted Mirantis OpenStacj release, and an update subrevision, both +separated by "+":: + + mos6.1: qemu_2.1.0-1~u14.04+mos1 + mos7.0: qemu_2.1.0-1~u14.04+mos1 + mos7.1: qemu_2.1.0-1~u14.04+mos2 + mos6.1-updates: qemu_2.1.0-1~u14.04+mos1+mos6.1+1 + mos7.0-updates: qemu_2.1.0-1~u14.04+mos1+mos7.0+1 + +If the whole package along with all the included modifications is backported from +the current release to updates for an old Mirantis OpenStack release, its version should include +the whole package version from the current release, followed by a reference to +the targeted Mirantis OpenStack release separated by "~", and an update subrevision, separated +by "+":: + + mos6.1: qemu_2.1.0-1~u14.04+mos1 + mos7.0: qemu_2.1.0-1~u14.04+mos1 + mos7.1: qemu_2.1.0-1~u14.04+mos2 + mos6.1-updates: qemu_2.1.0-1~u14.04+mos2~mos6.1+1 + mos7.0-updates: qemu_2.1.0-1~u14.04+mos2~mos7.0+1 + +The same rule applies if modifications include an upgrade to a newer software +version:: + + mos6.1: qemu_2.1.0-1~u14.04+mos1 + mos7.0: qemu_2.1.0-1~u14.04+mos1 + mos7.1: qemu_2.2+dfsg-5exp~u14.04+mos3 + mos6.1-updates: qemu_2.2+dfsg-5exp~u14.04+mos3~mos6.1+1 + mos7.0-updates: qemu_2.2+dfsg-5exp~u14.04+mos3~mos7.0+1 + +Debian package metadata +----------------------- + +All *Mirantis OpenStack specific* and *divergent* packages must have the following metadata: + +#. The latest entry in the debian/changelog must contain: + + - reference to the targeted Mirantis OpenStack release series (e.g. mos6.1) + + - reference to the organization that produced the package (Mirantis) + + - commits (full git commit sha1) in all source code repositories that the + package was built from: build repository commit if both source code and + build scripts are tracked in the same repository (git-buildpackage style), + or both source and build repository commits if the source code is tracked in a + separate repository from build scripts + +#. Maintainer in debian/control must be Mirantis OpenStack Team + +Example of a valid debian/changelog entry:: + + keystone (2014.2.3-1~u14.04+mos1) mos6.1; urgency=low + + * Source commit: 17f8fb6d8d3b9d48f5a4206079c18e84b73bf36b + * Build commit: 8bf699819c9d30e2d34e14e76917f94daea4c67f + + -- Mirantis OpenStack Team Sat, 21 Mar 2015 15:08:01 -0700 + +If the package is a backport from a different release of a base distro (e.g. a +backport of a newer software version from Ubuntu 14.10 to Ubuntu 14.04), the +exact package version which the backport was based on must also be specified in +the debian/changelog entry, along with the URL where the source package for +that package version can be obtained from. + +The following types of URLs may be used, in the order of preference: + +#. git-buildpackage or similar source code repository, + +#. deb package pool directory, + +#. direct dpkg source (orig and debian) download links. + +Package life cycle management +----------------------------- + +To deliver the high quality of the product, Mirantis OpenStack teams produce package updates +during the product life cycle when required. + +Packaging life cycle follows the Mirantis OpenStack product lifecycle (Feature Freeze, +Soft Code Freeze, Hard Code Freeze, Release, Updates). + +The Mirantis OpenStack mirror is modified on the Hard Code Freeze announcement. A new Mirantis OpenStack +version is created to allow the developers continue on a new release. + +After a GA release, all packages are placed in the updates or security +repository + +:: + + V^ +---------------------+ + | |7.1-updates + | | + | | + | +-----------------------------------+ + | |8.0-dev | + | | | + | | | + | +-------------------------------------------------+ + | |6.1-updates | | + | | | | + | | | | + | +-------------------------+-------------+---------------------+ + | |7.1-dev | 7.1-HCF 7.1 GA + | | | + | | | + +------------+-----------+-------------------------------------------------> + 6.1 dev 6.1 HCF 6.1 GA t + + +Patches for the security vulnerabilities are placed in the *security* repository. +They are designed to change the behavior of the package as little as possible. + +Continous integration testing against base distro updates +--------------------------------------------------------- + +As part of the product lifecycle, there are system tests that +verify functionality of Mirantis OpenStack against: + +- the current state of the base distro mirror (base system plus released updates), + to check stability of the current release +- the current state of the Stable Release Updates or Fasttrack repository, + to check if package candidates introduce any regressions + +Handling of system test results +------------------------------- + +If the system test against proposed or Fasttrack repositories reveals +one or several packages that break the Mirantis OpenStack functionality, the Mirantis OpenStack teams provide +one of the following solutions: + +- solve the issue on the product side by releasing fixed Mirantis OpenStack packages through + the "updates" repository +- raise a debate with base distro SRU reviewing team regarding problem packages +- (if none of the above helps) put working version of a problem package to + the holdback repository + +Also, any package that failed the system test, is reflected on the +release status page. + +Release status page +------------------- + +To ensure that the Mirantis OpenStack customers have full information on the release stability, all +packages that produce system test failures must are also reported in several +different ways: + +- Web: Via the `status page `_. +- on deployed nodes: Via a hook that updates MOTD using the `Fuel Infra website `_. +- on deployed nodes: Via an APT pre-hook that checks the status via the above + website, and gives a warning if an ``apt-get update`` command is issued + +Packages building module +------------------------ + +Fuel DEB packages build routinely are disabled by default, and kept for the +Fuel CI purposes only (nightly and test product builds). The release product +ISO contains Fuel DEB packages from the Mirantis OpenStack repository. Updates to the Fuel +DEB packages are consumed from the Mirantis OpenStack mirror directly on the Fuel Master +node. + +The explicit list of Fuel DEB packages is the following: + +* fencing-agent +* nailgun-mcagents +* nailgun-net-check +* nailgun-agent +* python-tasklib + +Docker containers building module +--------------------------------- + +All Dockerfile configs are adjusted to include both upstream and Mirantis OpenStack +repositories. + +ISO assembly module +------------------- + +ISO assembly module excludes all the parts mentioned above. + +Offline installations +--------------------- + +To support offline installation cases there is a Linux console +script that mirrors the public base distro and Mirantis OpenStack mirrors to a given location, +allowing to put these local sources as input for the appropriate menu entry of the +Fuel "Settings" tab on UI, or specify directly via Fuel CLI. In case of +deb-based base distro, Mirantis OpenStack requires packages from multiple sections of a given +distribution (main, universe, multiverse, restricted), so the helper script +will mirror all packages from the components specified above. Requirements: + +* input base distro mirror URL +* input MOS mirror URL +* ability to run as cronjob to update base distro and Mirantis OpenStack mirrors diff --git a/develop/sequence.rst b/develop/sequence.rst new file mode 100644 index 000000000..295862fe3 --- /dev/null +++ b/develop/sequence.rst @@ -0,0 +1,114 @@ +Sequence Diagrams +================= + +OS Provisioning +--------------- +# .. uml:: +# title Nodes Provisioning +# actor WebUser + +# box "Physical Server" +# participant NodePXE +# participant NodeAgent +# end box + +# NodePXE -> Cobbler: PXE discovery +# Cobbler --> NodePXE: bootstrap OS image +# NodePXE -> Cobbler: network settings request +# Cobbler --> NodePXE: IP, DNS response +# NodePXE -> NodePXE: OS installation +# NodePXE -> NodeAgent: starts agent +# NodePXE -> MC: starts MCollective +# NodeAgent -> Ohai: get info +# Ohai --> NodeAgent: info +# NodeAgent -> NodePXE: get admin node IP +# NodePXE --> NodeAgent: admin node IP +# NodeAgent -> Nailgun: Registration +# ||| +# WebUser -> Nailgun: create cluster +# WebUser -> Nailgun: add nodes to cluster +# WebUser -> Nailgun: deploy cluster +# ||| +# Nailgun -> Astute: Provision CentOS +# Astute -> Cobbler: Provision CentOS +# Cobbler -> NodePXE: ssh to reboot +# Cobbler --> NodePXE: CentOS image +# NodePXE -> NodeAgent: starts agent +# NodePXE -> MC: starts MC agent +# NodeAgent -> Nailgun: Node metadata + +Networks Verification +--------------------- +# .. uml:: +# title Network Verification +# actor WebUser + +# WebUser -> Nailgun: verify networks (cluster #1) +# Nailgun -> Astute: verify nets (100-120 vlans) +# Astute -> MC: start listeners +# MC -> net_probe.py: forks to listen +# MC --> Astute: listening +# Astute -> MC: send frames +# MC -> net_probe.py: send frames +# net_probe.py --> MC: sent +# MC --> Astute: sent + +# Astute -> MC: get result +# MC -> net_probe.py: stop listeners +# net_probe.py --> MC: result +# MC --> Astute: result graph +# Astute --> Nailgun: response vlans Ok +# Nailgun --> WebUser: response + + +Details on Cluster Provisioning & Deployment (via Facter extension) +------------------------------------------------------------------- +# .. uml:: +# title Cluster Deployment +# actor WebUser + +# Nailgun -> Astute: Provision,Deploy +# Astute -> MC: Type of nodes? +# MC -> Astute: bootstrap +# Astute -> Cobbler: create system,reboot +# Astute -> MC: Type of nodes? + +# MC --> Astute: booted in target OS +# Astute --> Nailgun: provisioned +# Nailgun --> WebUser: status on UI +# Astute -> MC: Create /etc/astute.yaml + +# Astute -> MC: run puppet +# MC -> Puppet: runonce +# Puppet -> Facter: get facts +# Facter --> Puppet: set facts and parse astute.yaml + +# Puppet -> Puppet: applies $role +# Puppet --> MC: done +# MC --> Astute: deploy is done +# Astute --> Nailgun: deploy is done +# Nailgun --> WebUser: deploy is done + +Once deploy and provisioning messages are accepted by Astute, provisioning +method is called. Provisioning part creates system in Cobbler and +calls reboot over Cobbler. Then Astute uses `MCollective direct addressing +mode +`_ +to check if all required nodes are available, include puppet agent on them. If +some nodes are not yet ready, Astute waits for a few seconds and tries to +request again. When nodes are booted in target OS, Astute uses upload_file +MCollective plugin to push data to a special file */etc/astute.yaml* on the +target system. +Data include role and all other variables needed for deployment. Then, Astute +calls puppetd MCollective plugin to start deployment. Puppet is started on +nodes. + +Accordingly, puppet agent starts its run. Modules contain facter extension, +which runs before deployment. Extension reads data from */etc/astute.yaml* +placed by mcollective, and extends Facter data with it as a single fact, which +is then parsed by *parseyaml* function to create *$::fuel_settings* data +structure. This structure contains all variables as a single hash and +supports embedding of other rich structures such as nodes hash or arrays. +Case structure in running class chooses appropriate class to import, +based on *role* and *deployment_mode* variables found in */etc/astute.yaml*. diff --git a/develop/system_tests/tree.rst b/develop/system_tests/tree.rst new file mode 100644 index 000000000..293f57e0e --- /dev/null +++ b/develop/system_tests/tree.rst @@ -0,0 +1,9 @@ +.. _system-tests: + +System Tests +============ + +To include documentation on system tests, **SYSTEM_TESTS_PATH** +environment variable should be set before running *sphinx-build* or +*make*. + diff --git a/devops.rst b/devops.rst new file mode 100644 index 000000000..12fe71045 --- /dev/null +++ b/devops.rst @@ -0,0 +1,381 @@ +Devops Guide +============ + +Introduction +------------ + +Fuel-Devops is a sublayer between application and target environment (currently +only supported under libvirt). + + +This application is used for testing purposes like grouping virtual machines to +environments, booting KVM VMs locally from the ISO image and over the network +via PXE, creating, snapshotting and resuming back the whole environment in +single action, create virtual machines with multiple NICs, multiple hard drives +and many other customizations with a few lines of code in system tests. + +After 6.0 release, fuel-devops was divided into 2.5.x and 2.9.x versions. Two +separate versions of fuel-devops provide backward compatibility for system +tests which have been refactored since the last major release. `How to migrate`_ + +For sources please refer to +`fuel-devops repository on github `_. + +.. _install system dependencies: + +Installation +------------- + +The installation procedure can be implemented via PyPI in Python virtual environment +(suppose you are using *Ubuntu 12.04* or *Ubuntu 14.04*): + +Before using it, please install the following required dependencies: + +.. code-block:: bash + + sudo apt-get install git \ + postgresql \ + postgresql-server-dev-all \ + libyaml-dev \ + libffi-dev \ + python-dev \ + python-libvirt \ + python-pip \ + qemu-kvm \ + qemu-utils \ + libvirt-bin \ + libvirt-dev \ + ubuntu-vm-builder \ + bridge-utils + + sudo apt-get update && sudo apt-get upgrade -y + +.. _DevOpsPyPIvenv: + +Devops installation in `virtualenv `_ +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +1. Install packages needed for building python eggs + +.. code-block:: bash + + sudo apt-get install python-virtualenv libpq-dev libgmp-dev + +2. In case you are using *Ubuntu 12.04* let's update pip and virtualenv, otherwise you can skip this step + +.. code-block:: bash + + sudo pip install pip virtualenv --upgrade + hash -r + +4. Create virtualenv for the *devops* project + +.. code-block:: bash + + virtualenv --system-site-packages /fuel-devops-venv + +.. note:: If you want to use different devops versions in the same time, you can create several different folders for each version, and then activate required virtual environment for each case. + For example: :: + virtualenv --system-site-packages /fuel-devops-venv # For fuel-devops 2.5.x + virtualenv --system-site-packages /fuel-devops-venv-2.9 # For fuel-devops 2.9.x + + represents the path where your Python virtualenv will be located. (e.g. ~/venv). If it is not specified, it will use the current working directory. + +5. Activate virtualenv and install *devops* package using PyPI. + +.. code-block:: bash + + source /fuel-devops-venv/bin/activate + pip install git+https://github.com/openstack/fuel-devops.git@ --upgrade + +where is the specific version of fuel-devops you would like to +install. For Fuel 6.0 and earlier, take the latest fuel-devops 2.5.x. For Fuel +6.1 and later, use 2.9.x or newer. See more information on the latest available +versions in `fuel-devops `_ +repo. + +setup.py in fuel-devops repository does everything required. + +.. hint:: You can also use + `virtualenvwrapper `_ + which can help you manage virtual environments + +6. Next, follow :ref:`DevOpsConf` section + +.. _DevOpsConf: + +Configuration +-------------- + +Basically *devops* requires that the following system-wide settings are +configured: + + * Default libvirt storage pool is active (called 'default') + * Current user must have permission to run KVM VMs with libvirt + * PostgreSQL server running with appropriate grants and schema for *devops* + * [Optional] Nested Paging is enabled + +Configuring libvirt pool +~~~~~~~~~~~~~~~~~~~~~~~~~ + +Create libvirt's pool + +.. code-block:: bash + + sudo virsh pool-define-as --type=dir --name=default --target=/var/lib/libvirt/images + sudo virsh pool-autostart default + sudo virsh pool-start default + +Permissions to run KVM VMs with libvirt with current user +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +Give current user permissions to use libvirt (Do not forget to log out and log back in!) + +.. code-block:: bash + + sudo usermod $(whoami) -a -G libvirtd,sudo + +Configuring Postgresql database +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +Set local peers to be trusted by default, create user and db and load fixtures. + +.. code-block:: bash + + sudo sed -ir 's/peer/trust/' /etc/postgresql/9.*/main/pg_hba.conf + sudo service postgresql restart + sudo -u postgres createuser -P # see default and below + sudo -u postgres createdb -O + django-admin.py syncdb --settings=devops.settings + django-admin.py migrate devops --settings=devops.settings + +* in 2.5.x version, default and are **devops** +* in 2.9.x version, default and are **fuel_devops** + +.. note:: Depending on your Linux distribution, + `django-admin `_ may refer + to system-wide django installed from package. If this happens you could get + an exception that says that devops.settings module is not resolvable. + To fix this, run django-admin.py (or django-admin) with a relative path :: + + ./bin/django-admin syncdb --settings=devops.settings + ./bin/django-admin migrate devops --settings=devops.settings + + +[Optional] Enabling `Nested Paging `_ +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +This option is enabled by default in the KVM kernel module + +.. code-block:: bash + + $ cat /etc/modprobe.d/qemu-system-x86.conf + options kvm_intel nested=1 + +In order to be sure that this feature is enabled on your system, +please run: + +.. code-block:: bash + + sudo kvm-ok && cat /sys/module/kvm_intel/parameters/nested + +The result should be: + +.. code-block:: bash + + INFO: /dev/kvm exists + KVM acceleration can be used + Y + + +Environment creation via Devops + Fuel_QA or Fuel_main +------------------------------------------------------- + +Depending on the Fuel release, you may need a different repository. In case of +6.0 or earlier, please use *fuel-main* repository. For 6.1 and later, the +*fuel-qa* is required. + +1. Clone GIT repository + +.. code-block:: bash + + git clone https://github.com/openstack/fuel-qa # fuel-main for 6.0 and earlier + cd fuel-qa/ + +2. Install requirements + +.. code-block:: bash + + source /fuel-devops-venv/bin/activate + pip install -r ./fuelweb_test/requirements.txt --upgrade + +3. Check :ref:`DevOpsConf` section + +4. Prepare environment + +Download Fuel ISO from +`Nightly builds `_ +or build it yourself (please, refer to :ref:`building-fuel-iso`) + +Next, you need to define several variables for the future environment + +.. code-block:: bash + + export ISO_PATH= + export NODES_COUNT= + +Optionally you can specify the name of your test environment (it will +be used as a prefix for the domains and networks names created by +libvirt, defaults is =fuel_system_test=) + +.. code-block:: bash + + export ENV_NAME= + +.. code-block:: bash + + export VENV_PATH=/fuel-devops-venv + +If you want to use separated files for snapshots you need to use libvirtd in version >= 1.2.12 +and set env variable. This change will switch snapshots created by libvirt from internal +to external mode. + +.. code-block:: bash + + export SNAPSHOTS_EXTERNAL=true + +.. note:: External snapshots by default uses ~/.devops/snap directory to store memory dumps. + If you want to use other directory you can set SNAPSHOTS_EXTERNAL_DIR variable. + + .. code-block:: bash + + export SNAPSHOTS_EXTERNAL_DIR=~/.devops/snap + +Alternatively, you can edit this file to set them as a default values + +.. code-block:: bash + + fuelweb_test/settings.py + +Start tests by running this command + +.. code-block:: bash + + ./utils/jenkins/system_tests.sh -t test -w $(pwd) -j fuelweb_test -i $ISO_PATH -o --group=setup + +For more information about how tests work, read the usage information + +.. code-block:: bash + + ./utils/jenkins/system_tests.sh -h + +Important notes for Sahara and Murano tests +-------------------------------------------- + * It is not recommended to start tests without KVM. + * For the best performance Put Sahara image + `savanna-0.3-vanilla-1.2.1-ubuntu-13.04.qcow2 `_ + (md5: 9ab37ec9a13bb005639331c4275a308d) in /tmp/ before start, otherwise + (If Internet access is available) the image will download automatically. + * Put Murano image `ubuntu-murano-agent.qcow2 `_ + (md5: b0a0fdc0b4a8833f79701eb25e6807a3) in /tmp before start. + * Running Murano tests on instances without an Internet connection will fail. + * For Murano tests execute 'export SLAVE_NODE_MEMORY=5120' before starting. + * If you need an image For Heat autoscale tests check + `prebuilt-jeos-images `_. + +Run single OSTF tests several times +----------------------------------- + * Export environment variable OSTF_TEST_NAME. Example: export OSTF_TEST_NAME='Request list of networks' + * Export environment variable OSTF_TEST_RETRIES_COUNT. Example: export OSTF_TEST_RETRIES_COUNT=120 + * Execute test_ostf_repetable_tests from tests_strength package + +Run tests :: + + sh "utils/jenkins/system_tests.sh" -t test \ + -w $(pwd) \ + -j "fuelweb_test" \ + -i "$ISO_PATH" \ + -V $(pwd)/venv/fuelweb_test \ + -o \ + --group=create_delete_ip_n_times_nova_flat + +.. _How to migrate: + +Upgrade from system-wide devops to devops in Python virtual environment +------------------------------------------------------------------------ + +To migrate from older devops, follow these steps: + +1. Remove system-wide fuel-devops (e.g. python-devops) + +You must remove system-wide fuel-devops and switch to separate venvs with +different versions of fuel-devops, for Fuel 6.0.x (and older) and 6.1 release. + +Repositories 'fuel-main' and 'fuel-qa', that contain system tests, must use different Python virtual environments, for example: + +* ~/venv-nailgun-tests - used for 6.0.x and older releases. Contains version 2.5.x of fuel-devops +* ~/venv-nailgun-tests-2.9 - used for 6.1 and above. Contains version 2.9.x of fuel-devops + +If you have scripts which use system fuel-devops, fix them, and activate Python +venv before you start working in your devops environment. + +By default, the network pool is configured as follows: + +* 10.108.0.0/16 for devops 2.5.x +* 10.109.0.0/16 for 2.9.x + +Please check other settings in *devops.settings*, especially the connection settings to the database. + +Before using devops in Python venv, you need to `install system dependencies`_ + +2. Update fuel-devops and Python venv on CI servers + +To update fuel-devops, you can use the following examples: + +.. code-block:: bash + + # DevOps 2.5.x for system tests from 'fuel-main' repository + if [ -f ~/venv-nailgun-tests/bin/activate ]; then + echo "Python virtual env exist" + else + rm -rf ~/venv-nailgun-tests + virtualenv --system-site-packages ~/venv-nailgun-tests + fi + source ~/venv-nailgun-tests/bin/activate + pip install -r https://raw.githubusercontent.com/openstack/fuel-main/master/fuelweb_test/requirements.txt --upgrade + django-admin.py syncdb --settings=devops.settings --noinput + django-admin.py migrate devops --settings=devops.settings --noinput + deactivate + + # DevOps 2.9.x for system tests from 'fuel-qa' repository + if [ -f ~/venv-nailgun-tests-2.9/bin/activate ]; then + echo "Python virtual env exist" + else + rm -rf ~/venv-nailgun-tests-2.9 + virtualenv --system-site-packages ~/venv-nailgun-tests-2.9 + fi + source ~/venv-nailgun-tests-2.9/bin/activate + pip install -r https://raw.githubusercontent.com/openstack/fuel-qa/master/fuelweb_test/requirements.txt --upgrade + django-admin.py syncdb --settings=devops.settings --noinput + django-admin.py migrate devops --settings=devops.settings --noinput + deactivate + +3. Setup new repository of system tests for 6.1 release + +All system tests for 6.1 and higher were moved to +`fuel-qa `_ repo. + +To upgrade 6.1 jobs, follow these steps: + +* make a separate Python venv, for example in ~/venv-nailgun-tests-2.9 +* install `requirements `_ of system tests +* if you are using system tests on CI, please configure your CI to use new Python venv, or export path to the new Python venv in the variable VENV_PATH: + export VENV_PATH=/fuel-devops-venv-2.9 + +Known issues +------------ +* Some versions of libvirt contain a bug that breaks QEMU virtual machine + XML. You can see this when tests crush with a *libvirt: QEMU Driver error: + unsupported configuration: host doesn't support invariant TSC*. See: `Bug 1133155 `_. + + Workaround: upgrade libvirt to the latest version. diff --git a/eula.rst b/eula.rst deleted file mode 100644 index 802d25286..000000000 --- a/eula.rst +++ /dev/null @@ -1,10 +0,0 @@ -:orphan: - -.. index:: Fuel License - -============ -Fuel License -============ - -.. literalinclude:: LICENSE - :language: none diff --git a/examples/bonding_lnx_network_scheme.yaml b/examples/bonding_lnx_network_scheme.yaml deleted file mode 100644 index fd527e16d..000000000 --- a/examples/bonding_lnx_network_scheme.yaml +++ /dev/null @@ -1,59 +0,0 @@ - network_scheme: - provider: ovs - version: 1.0 - interfaces: - eth0: {} - eth1: {} - eth2: {} - eth3: {} - endpoints: - br-ex: - IP: [172.16.0.2/24] - gateway: 172.16.0.1 - br-mgmt: - IP: [192.168.0.2/24] - br-prv: {IP: none} - br-storage: - IP: [192.168.1.2/24] - eth0: - IP: [10.20.0.4/24] - roles: - ex: br-ex - fw-admin: eth0 - management: br-mgmt - private: br-prv - storage: br-storage - transformations: - - action: add-br - name: br-ex - - action: add-br - name: br-mgmt - - action: add-br - name: br-storage - - action: add-br - name: br-prv - - action: add-br - name: br-bondnew - - action: add-br - name: br-eth1 - - action: add-bond - bridge: br-bondnew - interfaces: [eth2, eth3] - provider: lnx - properties: - mode: 1 - name: bondnew - - action: add-port - bridge: br-eth1 - name: eth1 - - action: add-patch - bridges: [br-bondnew, br-storage] - tags: [103, 0] - - action: add-patch - bridges: [br-eth1, br-ex] - tags: [101, 0] - - action: add-patch - bridges: [br-eth1, br-mgmt] - tags: [102, 0] - - action: add-patch - bridges: [br-bondnew, br-prv] diff --git a/examples/bonding_ovs_network_scheme.yaml b/examples/bonding_ovs_network_scheme.yaml deleted file mode 100644 index 6f2f660d8..000000000 --- a/examples/bonding_ovs_network_scheme.yaml +++ /dev/null @@ -1,66 +0,0 @@ - network_scheme: - provider: ovs - version: 1.1 - interfaces: - eth0: {} - eth1: {} - eth2: {} - eth3: {} - endpoints: - br-ex: - IP: [172.16.0.2/24] - gateway: 172.16.0.1 - br-mgmt: - IP: [192.168.0.2/24] - br-prv: {IP: none} - br-storage: - IP: [192.168.1.2/24] - eth0: - IP: [10.20.0.4/24] - roles: - ex: br-ex - fw-admin: eth0 - management: br-mgmt - private: br-prv - storage: br-storage - transformations: - - action: add-br - name: br-ex - provider: ovs - - action: add-br - name: br-mgmt - provider: ovs - - action: add-br - name: br-storage - provider: ovs - - action: add-br - name: br-prv - provider: ovs - - action: add-br - name: br-bondnew - provider: ovs - - action: add-br - name: br-eth1 - provider: ovs - - action: add-bond - bridge: br-bondnew - interfaces: [eth2, eth3] - properties: {lacp:active} - name: bondnew - provider: ovs - - action: add-port - bridge: br-eth1 - name: eth1 - provider: ovs - - action: add-patch - bridges: [br-bondnew, br-storage] - tags: [103, 0] - - action: add-patch - bridges: [br-eth1, br-ex] - tags: [101, 0] - - action: add-patch - bridges: [br-eth1, br-mgmt] - tags: [102, 0] - - action: add-patch - bridges: [br-bondnew, br-prv] - diff --git a/examples/mtu_network_scheme.yaml b/examples/mtu_network_scheme.yaml deleted file mode 100644 index f6f76601e..000000000 --- a/examples/mtu_network_scheme.yaml +++ /dev/null @@ -1,68 +0,0 @@ - network_scheme: - endpoints: - br-ex: - IP: - - 172.16.0.7/24 - gateway: 172.16.0.1 - br-fw-admin: - IP: - - 10.20.0.7/24 - br-mgmt: - IP: - - 192.168.0.7/24 - br-prv: - IP: none - br-storage: - IP: - - 192.168.1.6/24 - interfaces: - eth0: - mtu: 1234 - eth1: - mtu: 4321 - provider: ovs - roles: - ex: br-ex - fw-admin: eth0 - management: br-mgmt - private: br-prv - storage: br-storage - transformations: - - action: add-br - name: br-ex - provider: ovs - - action: add-br - name: br-mgmt - provider: ovs - - action: add-br - name: br-storage - provider: ovs - - action: add-br - name: br-prv - provider: ovs - - action: add-br - name: br-bondnew - provider: ovs - - action: add-br - name: br-eth1 - provider: ovs - - action: add-bond - bridge: br-bondnew - interfaces: [eth2, eth3] - properties: [lacp=active] - name: bondnew - - action: add-port - bridge: br-eth1 - name: eth1 - provider: ovs - - action: add-patch - bridges: [br-bondnew, br-storage] - vlan_ids: [103, 0] - - action: add-patch - bridges: [br-eth1, br-ex] - vlan_ids: [101, 0] - - action: add-patch - bridges: [br-eth1, br-mgmt] - vlan_ids: [102, 0] - - action: add-patch - bridges: [br-bondnew, br-prv] diff --git a/examples/network-template-tunneling-with-tagging.yaml b/examples/network-template-tunneling-with-tagging.yaml deleted file mode 100644 index 3a069dae6..000000000 --- a/examples/network-template-tunneling-with-tagging.yaml +++ /dev/null @@ -1,224 +0,0 @@ -adv_net_template: - default: - network_assignments: - fuelweb_admin: - ep: br-fw-admin - management: - ep: br-mgmt - private: - ep: br-mesh - public: - ep: br-ex - storage: - ep: br-storage - network_scheme: - admin: - endpoints: - - br-fw-admin - roles: - admin/pxe: br-fw-admin - fw-admin: br-fw-admin - transformations: - - action: add-br - name: br-fw-admin - - action: add-port - bridge: br-fw-admin - name: <% if1 %> - mgmt-cpu: - endpoints: - - br-mgmt - roles: - neutron/private: br-mgmt - ceilometer/api: br-mgmt - ceph/public: br-mgmt - glance/api: br-mgmt - heat/api: br-mgmt - horizon: br-mgmt - keystone/api: br-mgmt - management: br-mgmt - mgmt/api: br-mgmt - mgmt/corosync: br-mgmt - mgmt/database: br-mgmt - mgmt/memcache: br-mgmt - mgmt/messaging: br-mgmt - mgmt/vip: br-mgmt - mongo/db: br-mgmt - murano/api: br-mgmt - neutron/api: br-mgmt - nova/api: br-mgmt - nova/migration: br-mgmt - sahara/api: br-mgmt - swift/api: br-mgmt - transformations: - - action: add-br - name: br-mgmt - - action: add-port - bridge: br-mgmt - name: <% if2 %>.100 - mgmt-ctrl: - endpoints: - - br-mgmt - roles: - neutron/private: br-mgmt - ceilometer/api: br-mgmt - ceph/public: br-mgmt - glance/api: br-mgmt - heat/api: br-mgmt - horizon: br-mgmt - keystone/api: br-mgmt - management: br-mgmt - mgmt/api: br-mgmt - mgmt/corosync: br-mgmt - mgmt/database: br-mgmt - mgmt/memcache: br-mgmt - mgmt/messaging: br-mgmt - mgmt/vip: br-mgmt - mongo/db: br-mgmt - murano/api: br-mgmt - neutron/api: br-mgmt - nova/api: br-mgmt - nova/migration: br-mgmt - sahara/api: br-mgmt - swift/api: br-mgmt - transformations: - - action: add-br - name: br-mgmt - - action: add-port - bridge: br-mgmt - name: <% if4 %> - public-private-cpu: - endpoints: - - br-mesh - - br-ex - roles: - ceph/radosgw: br-ex - cinder/api: br-ex - public/vip: br-ex - ex: br-ex - neutron/mesh: br-mesh - neutron/floating: br-floating - transformations: - - action: add-br - name: br-ex - - action: add-br - name: br-mesh - - action: add-br - name: br-floating - provider: ovs - - action: add-patch - bridges: - - br-floating - - br-ex - provider: ovs - mtu: 65000 - - action: add-bond - interfaces: - - <% if3 %> - - <% if4 %> - bond_properties: - lacp_rate: fast - mode: 802.3ad - xmit_hash_policy: layer3+4 - name: bond0 - interface_properties: - vendor_specific: - disable_offloading: true - - action: add-port - bridge: br-ex - name: bond0.200 - - action: add-port - bridge: br-mesh - name: bond0.400 - public-private-ctrl: - endpoints: - - br-mesh - - br-ex - roles: - ceph/radosgw: br-ex - cinder/api: br-ex - public/vip: br-ex - ex: br-ex - neutron/mesh: br-mesh - neutron/floating: br-floating - transformations: - - action: add-br - name: br-mesh - - action: add-br - name: br-ex - - action: add-br - name: br-floating - provider: ovs - - action: add-patch - bridges: - - br-floating - - br-ex - provider: ovs - mtu: 65000 - - action: add-port - bridge: br-mesh - name: <% if5 %> - - action: add-port - bridge: br-ex - name: <% if2 %> - storage-cpu: - endpoints: - - br-storage - roles: - ceph/replication: br-storage - cinder/iscsi: br-storage - storage: br-storage - swift/replication: br-storage - transformations: - - action: add-br - name: br-storage - - action: add-bond - interfaces: - - <% if5 %> - - <% if6 %> - bond_properties: - mode: balance-rr - name: bond1 - interface_properties: - vendor_specific: - disable_offloading: true - - action: add-port - bridge: br-storage - name: bond1.300 - storage-ctrl: - endpoints: - - br-storage - roles: - ceph/replication: br-storage - cinder/iscsi: br-storage - storage: br-storage - swift/replication: br-storage - transformations: - - action: add-br - name: br-storage - - action: add-port - bridge: br-storage - name: <% if3 %> - nic_mapping: - default: - if1: eth0 - if2: eth1 - if3: eth2 - if4: eth3 - if5: eth4 - if6: eth5 - templates_for_node_role: - compute: - - admin - - mgmt-cpu - - public-private-cpu - - storage-cpu - controller: - - admin - - mgmt-ctrl - - public-private-ctrl - - storage-ctrl - virt: - - admin - - mgmt-cpu - - public-private-cpu - - storage-cpu diff --git a/examples/network-template-vlan.yaml b/examples/network-template-vlan.yaml deleted file mode 100644 index 2c4ca3861..000000000 --- a/examples/network-template-vlan.yaml +++ /dev/null @@ -1,231 +0,0 @@ -adv_net_template: - default: - network_assignments: - fuelweb_admin: - ep: br-fw-admin - management: - ep: br-mgmt - private: - ep: br-prv - public: - ep: br-ex - storage: - ep: br-storage - network_scheme: - admin: - endpoints: - - br-fw-admin - roles: - admin/pxe: br-fw-admin - fw-admin: br-fw-admin - transformations: - - action: add-br - name: br-fw-admin - - action: add-port - bridge: br-fw-admin - name: <% if1 %> - mgmt-cpu: - endpoints: - - br-mgmt - roles: - ceilometer/api: br-mgmt - ceph/public: br-mgmt - glance/api: br-mgmt - heat/api: br-mgmt - horizon: br-mgmt - keystone/api: br-mgmt - management: br-mgmt - mgmt/api: br-mgmt - mgmt/corosync: br-mgmt - mgmt/database: br-mgmt - mgmt/memcache: br-mgmt - mgmt/messaging: br-mgmt - mgmt/vip: br-mgmt - mongo/db: br-mgmt - murano/api: br-mgmt - neutron/api: br-mgmt - nova/api: br-mgmt - nova/migration: br-mgmt - sahara/api: br-mgmt - swift/api: br-mgmt - transformations: - - action: add-br - name: br-mgmt - - action: add-port - bridge: br-mgmt - name: <% if2 %>.100 - mgmt-ctrl: - endpoints: - - br-mgmt - roles: - ceilometer/api: br-mgmt - ceph/public: br-mgmt - glance/api: br-mgmt - heat/api: br-mgmt - horizon: br-mgmt - keystone/api: br-mgmt - management: br-mgmt - mgmt/api: br-mgmt - mgmt/corosync: br-mgmt - mgmt/database: br-mgmt - mgmt/memcache: br-mgmt - mgmt/messaging: br-mgmt - mgmt/vip: br-mgmt - mongo/db: br-mgmt - murano/api: br-mgmt - neutron/api: br-mgmt - nova/api: br-mgmt - nova/migration: br-mgmt - sahara/api: br-mgmt - swift/api: br-mgmt - transformations: - - action: add-br - name: br-mgmt - - action: add-port - bridge: br-mgmt - name: <% if4 %> - public-private-cpu: - endpoints: - - br-ex - - br-prv - roles: - ceph/radosgw: br-ex - cinder/api: br-ex - ex: br-ex - neutron/floating: br-floating - neutron/private: br-prv - neutron/mesh: br-prv - transformations: - - action: add-br - name: br-ex - - action: add-br - name: br-aux - - action: add-br - name: br-prv - provider: ovs - - action: add-br - name: br-floating - provider: ovs - - action: add-patch - bridges: - - br-floating - - br-ex - mtu: 65000 - provider: ovs - - action: add-patch - bridges: - - br-prv - - br-aux - mtu: 65000 - provider: ovs - - action: add-bond - bond_properties: - lacp_rate: fast - mode: 802.3ad - xmit_hash_policy: layer3+4 - bridge: br-aux - interface_properties: - vendor_specific: - disable_offloading: true - interfaces: - - <% if3 %> - - <% if4 %> - name: bond0 - - action: add-port - bridge: br-ex - name: bond0.200 - public-private-ctrl: - endpoints: - - br-prv - - br-ex - roles: - ceph/radosgw: br-ex - cinder/api: br-ex - ex: br-ex - neutron/floating: br-floating - neutron/private: br-prv - public/vip: br-ex - neutron/mesh: br-prv - transformations: - - action: add-br - name: br-prv - provider: ovs - - action: add-br - name: br-ex - - action: add-br - name: br-floating - provider: ovs - - action: add-patch - bridges: - - br-floating - - br-ex - mtu: 65000 - provider: ovs - - action: add-port - bridge: br-prv - name: <% if5 %> - - action: add-port - bridge: br-ex - name: <% if2 %> - storage-cpu: - endpoints: - - br-storage - roles: - ceph/replication: br-storage - cinder/iscsi: br-storage - storage: br-storage - swift/replication: br-storage - transformations: - - action: add-br - name: br-storage - - action: add-bond - bond_properties: - mode: balance-rr - interface_properties: - vendor_specific: - disable_offloading: true - interfaces: - - <% if5 %> - - <% if6 %> - name: bond1 - - action: add-port - bridge: br-storage - name: bond1.300 - storage-ctrl: - endpoints: - - br-storage - roles: - ceph/replication: br-storage - cinder/iscsi: br-storage - storage: br-storage - swift/replication: br-storage - transformations: - - action: add-br - name: br-storage - - action: add-port - bridge: br-storage - name: <% if3 %> - nic_mapping: - default: - if1: eth0 - if2: eth1 - if3: eth2 - if4: eth3 - if5: eth4 - if6: eth5 - templates_for_node_role: - compute: - - admin - - mgmt-cpu - - public-private-cpu - - storage-cpu - controller: - - admin - - mgmt-ctrl - - public-private-ctrl - - storage-ctrl - virt: - - admin - - mgmt-cpu - - public-private-cpu - - storage-cpu diff --git a/examples/network_templates/ceph.yaml b/examples/network_templates/ceph.yaml deleted file mode 100644 index 894e0527b..000000000 --- a/examples/network_templates/ceph.yaml +++ /dev/null @@ -1,332 +0,0 @@ -adv_net_template: - default: - nic_mapping: - default: - if1: eth0 # admin - if2: eth1 # public - if3: eth3 # management (vlan 101) storage (vlan 102) & private (vlan 103) - if4: eth4 # other networks (vlan 201-299) - if5: eth2 # fake bond - templates_for_node_role: - controller: - - public - - private - - storage - - common - - custom - compute: - - common - - private - - storage - - custom - ceph-osd: - - common - - storage - - custom - network_assignments: - storage: - ep: br-storage - private: - ep: br-prv - public: - ep: br-ex - management: - ep: br-mgmt - fuelweb_admin: - ep: br-fw-admin - fake: - ep: br-fake - mongo: - ep: br-mongo - keystone: - ep: br-keystone - neutron-api: - ep: br-neutronapi - neutron-mesh: - ep: br-neutronmesh - swift: - ep: br-swift - sahara: - ep: br-sahara - ceilometer: - ep: br-ceilometer - cinder: - ep: br-cinder - glance: - ep: br-glance - heat: - ep: br-heat - nova: - ep: br-nova - nova-migration: - ep: br-novamigr - murano: - ep: br-murano - horizon: - ep: br-horizon - messaging: - ep: br-messaging - corosync: - ep: br-corosync - memcache: - ep: br-memcache - database: - ep: br-database - cinder-iscsi: - ep: br-cinderiscsi - swift-replication: - ep: br-swiftrepl - ceph-replication: - ep: br-cephrepl - ceph-radosgw: - ep: br-cephrados - network_scheme: - storage: - transformations: - - action: add-br - name: br-storage - - action: add-port - bridge: br-storage - name: <% if3 %>.102 - endpoints: - - br-storage - roles: - storage: br-storage - ceph/public: br-storage - private: - transformations: - - action: add-br - name: br-prv - provider: ovs - - action: add-br - name: br-aux - - action: add-patch - bridges: - - br-prv - - br-aux - provider: ovs - mtu: 65000 - - action: add-port - bridge: br-aux - name: <% if3 %>.103 - endpoints: - - br-prv - roles: - neutron/private: br-prv - public: - transformations: - - action: add-br - name: br-ex - - action: add-br - name: br-floating - provider: ovs - - action: add-patch - bridges: - - br-floating - - br-ex - provider: ovs - mtu: 65000 - - action: add-port - bridge: br-ex - name: <% if2 %> - endpoints: - - br-ex - roles: - public/vip: br-ex - neutron/floating: br-floating - ex: br-ex - common: - transformations: - - action: add-br - name: br-fw-admin - - action: add-port - bridge: br-fw-admin - name: <% if1 %> - - action: add-br - name: br-mgmt - - action: add-port - bridge: br-mgmt - name: <% if3 %>.101 - - action: add-br - name: br-fake - - action: add-port - name: <% if5 %>.555 - - action: add-port - name: <% if5 %>.666 - - action: add-bond - bridge: br-fake - name: lnxbond0 - interfaces: - - <% if5 %>.555 - - <% if5 %>.666 - bond_properties: - mode: active-backup - interface_properties: {} - endpoints: - - br-fw-admin - - br-mgmt - - br-fake - roles: - admin/pxe: br-fw-admin - fw-admin: br-fw-admin - management: br-mgmt - mgmt/vip: br-mgmt - mgmt/api: br-mgmt - custom: - transformations: - - action: add-br - name: br-mongo - - action: add-port - bridge: br-mongo - name: <% if4 %>.201 - - action: add-br - name: br-keystone - - action: add-port - bridge: br-keystone - name: <% if4 %>.202 - - action: add-br - name: br-neutronapi - - action: add-port - bridge: br-neutronapi - name: <% if4 %>.203 - - action: add-br - name: br-neutronmesh - - action: add-port - bridge: br-neutronmesh - name: <% if4 %>.204 - - action: add-br - name: br-swift - - action: add-port - bridge: br-swift - name: <% if4 %>.205 - - action: add-br - name: br-sahara - - action: add-port - bridge: br-sahara - name: <% if4 %>.206 - - action: add-br - name: br-ceilometer - - action: add-port - bridge: br-ceilometer - name: <% if4 %>.207 - - action: add-br - name: br-cinder - - action: add-port - bridge: br-cinder - name: <% if4 %>.208 - - action: add-br - name: br-glance - - action: add-port - bridge: br-glance - name: <% if4 %>.209 - - action: add-br - name: br-heat - - action: add-port - bridge: br-heat - name: <% if4 %>.210 - - action: add-br - name: br-nova - - action: add-port - bridge: br-nova - name: <% if4 %>.211 - - action: add-br - name: br-novamigr - - action: add-port - bridge: br-novamigr - name: <% if4 %>.212 - - action: add-br - name: br-murano - - action: add-port - bridge: br-murano - name: <% if4 %>.213 - - action: add-br - name: br-horizon - - action: add-port - bridge: br-horizon - name: <% if4 %>.214 - - action: add-br - name: br-messaging - - action: add-port - bridge: br-messaging - name: <% if4 %>.215 - - action: add-br - name: br-corosync - - action: add-port - bridge: br-corosync - name: <% if4 %>.216 - - action: add-br - name: br-memcache - - action: add-port - bridge: br-memcache - name: <% if4 %>.217 - - action: add-br - name: br-database - - action: add-port - bridge: br-database - name: <% if4 %>.218 - - action: add-br - name: br-cinderiscsi - - action: add-port - bridge: br-cinderiscsi - name: <% if4 %>.219 - - action: add-br - name: br-swiftrepl - - action: add-port - bridge: br-swiftrepl - name: <% if4 %>.220 - - action: add-br - name: br-cephrepl - - action: add-port - bridge: br-cephrepl - name: <% if4 %>.221 - - action: add-br - name: br-cephrados - - action: add-port - bridge: br-cephrados - name: <% if4 %>.222 - endpoints: - - br-mongo - - br-keystone - - br-neutronapi - - br-neutronmesh - - br-swift - - br-sahara - - br-ceilometer - - br-cinder - - br-glance - - br-heat - - br-nova - - br-novamigr - - br-murano - - br-horizon - - br-messaging - - br-corosync - - br-memcache - - br-database - - br-cinderiscsi - - br-swiftrepl - - br-cephrepl - - br-cephrados - roles: - mongo/db: br-mongo - keystone/api: br-keystone - neutron/api: br-neutronapi - neutron/mesh: br-neutronmesh - swift/api: br-swift - sahara/api: br-sahara - ceilometer/api: br-ceilometer - cinder/api: br-cinder - glance/api: br-glance - heat/api: br-heat - nova/api: br-nova - nova/migration: br-novamigr - murano/api: br-murano - horizon: br-horizon - mgmt/messaging: br-messaging - mgmt/corosync: br-corosync - mgmt/memcache: br-memcache - mgmt/database: br-database - cinder/iscsi: br-cinderiscsi - swift/replication: br-swiftrepl - ceph/replication: br-cephrepl - ceph/radosgw: br-cephrados diff --git a/examples/network_templates/cinder.yaml b/examples/network_templates/cinder.yaml deleted file mode 100644 index 44dd0e2bd..000000000 --- a/examples/network_templates/cinder.yaml +++ /dev/null @@ -1,327 +0,0 @@ -adv_net_template: - default: - nic_mapping: - default: - if1: eth0 # admin - if2: eth1 # public - if3: eth3 # management (vlan 101) storage (vlan 102) & private (vlan 103) - if4: eth4 # other networks (vlan 201-299) - if5: eth2 # fake bond - templates_for_node_role: - controller: - - public - - private - - storage - - common - - custom - compute: - - common - - private - - storage - - custom - cinder: - - common - - storage - - custom - network_assignments: - storage: - ep: br-storage - private: - ep: br-prv - public: - ep: br-ex - management: - ep: br-mgmt - fuelweb_admin: - ep: br-fw-admin - fake: - ep: br-fake - mongo: - ep: br-mongo - keystone: - ep: br-keystone - neutron-api: - ep: br-neutronapi - neutron-mesh: - ep: br-neutronmesh - swift: - ep: br-swift - sahara: - ep: br-sahara - ceilometer: - ep: br-ceilometer - cinder: - ep: br-cinder - glance: - ep: br-glance - heat: - ep: br-heat - nova: - ep: br-nova - nova-migration: - ep: br-novamigr - murano: - ep: br-murano - horizon: - ep: br-horizon - messaging: - ep: br-messaging - corosync: - ep: br-corosync - memcache: - ep: br-memcache - database: - ep: br-database - cinder-iscsi: - ep: br-cinderiscsi - swift-replication: - ep: br-swiftrepl - network_scheme: - storage: - transformations: - - action: add-br - name: br-storage - - action: add-port - bridge: br-storage - name: <% if3 %>.102 - endpoints: - - br-storage - roles: - storage: br-storage - ceph/public: br-storage - private: - transformations: - - action: add-br - name: br-prv - provider: ovs - - action: add-br - name: br-aux - - action: add-patch - bridges: - - br-prv - - br-aux - provider: ovs - mtu: 65000 - - action: add-port - bridge: br-aux - name: <% if3 %>.103 - endpoints: - - br-prv - roles: - neutron/private: br-prv - public: - transformations: - - action: add-br - name: br-ex - - action: add-br - name: br-floating - provider: ovs - - action: add-patch - bridges: - - br-floating - - br-ex - provider: ovs - mtu: 65000 - - action: add-port - bridge: br-ex - name: <% if2 %> - endpoints: - - br-ex - roles: - public/vip: br-ex - neutron/floating: br-floating - ex: br-ex - common: - transformations: - - action: add-br - name: br-fw-admin - - action: add-port - bridge: br-fw-admin - name: <% if1 %> - - action: add-br - name: br-mgmt - - action: add-port - bridge: br-mgmt - name: <% if3 %>.101 - - action: add-br - name: br-fake - - action: add-bond - bridge: br-fake - name: lnx-bond0 - interfaces: - - <% if5 %> - bond_properties: - mode: active-backup - interface_properties: {} - endpoints: - - br-fw-admin - - br-mgmt - - br-fake - roles: - admin/pxe: br-fw-admin - fw-admin: br-fw-admin - management: br-mgmt - mgmt/vip: br-mgmt - mgmt/api: br-mgmt - custom: - transformations: - - action: add-br - name: br-mongo - - action: add-port - bridge: br-mongo - name: <% if4 %>.201 - - action: add-br - name: br-keystone - - action: add-port - bridge: br-keystone - name: <% if4 %>.202 - - action: add-br - name: br-neutronapi - - action: add-port - bridge: br-neutronapi - name: <% if4 %>.203 - - action: add-br - name: br-neutronmesh - - action: add-port - bridge: br-neutronmesh - name: <% if4 %>.204 - - action: add-br - name: br-swift - - action: add-port - bridge: br-swift - name: <% if4 %>.205 - - action: add-br - name: br-sahara - - action: add-port - bridge: br-sahara - name: <% if4 %>.206 - - action: add-br - name: br-ceilometer - - action: add-port - bridge: br-ceilometer - name: <% if4 %>.207 - - action: add-br - name: br-cinder - - action: add-port - bridge: br-cinder - name: <% if4 %>.208 - - action: add-br - name: br-glance - - action: add-port - bridge: br-glance - name: <% if4 %>.209 - - action: add-br - name: br-heat - - action: add-port - bridge: br-heat - name: <% if4 %>.210 - - action: add-br - name: br-nova - - action: add-port - bridge: br-nova - name: <% if4 %>.211 - - action: add-br - name: br-novamigr - - action: add-port - bridge: br-novamigr - name: <% if4 %>.212 - - action: add-br - name: br-murano - - action: add-port - bridge: br-murano - name: <% if4 %>.213 - - action: add-br - name: br-horizon - - action: add-port - bridge: br-horizon - name: <% if4 %>.214 - - action: add-br - name: br-messaging - - action: add-port - bridge: br-messaging - name: <% if4 %>.215 - - action: add-br - name: br-corosync - - action: add-port - bridge: br-corosync - name: <% if4 %>.216 - - action: add-br - name: br-memcache - - action: add-port - bridge: br-memcache - name: <% if4 %>.217 - - action: add-br - name: br-database - - action: add-port - bridge: br-database - name: <% if4 %>.218 - - action: add-br - name: br-cinderiscsi - - action: add-port - bridge: br-cinderiscsi - name: <% if4 %>.219 - - action: add-br - name: br-swiftrepl - - action: add-port - bridge: br-swiftrepl - name: <% if4 %>.220 - endpoints: - - br-mongo - - br-keystone - - br-neutronapi - - br-neutronmesh - - br-swift - - br-sahara - - br-ceilometer - - br-cinder - - br-glance - - br-heat - - br-nova - - br-novamigr - - br-murano - - br-horizon - - br-messaging - - br-corosync - - br-memcache - - br-database - - br-cinderiscsi - - br-swiftrepl - roles: - mongo/db: br-mongo - keystone/api: br-keystone - neutron/api: br-neutronapi - neutron/mesh: br-neutronmesh - swift/api: br-swift - sahara/api: br-sahara - ceilometer/api: br-ceilometer - cinder/api: br-cinder - glance/api: br-glance - heat/api: br-heat - nova/api: br-nova - nova/migration: br-novamigr - murano/api: br-murano - horizon: br-horizon - mgmt/messaging: br-messaging - mgmt/corosync: br-corosync - mgmt/memcache: br-memcache - mgmt/database: br-database - cinder/iscsi: br-cinderiscsi - swift/replication: br-swiftrepl - unused: - transformations: - - action: add-br - name: br-cephrepl - - action: add-port - bridge: br-cephrepl - name: <% if4 %>.221 - - action: add-br - name: br-cephrados - - action: add-port - bridge: br-cephrados - name: <% if4 %>.222 - endpoints: - - br-cephrepl - - br-cephrados - roles: - ceph/replication: br-cephrepl - ceph/radosgw: br-cephrados diff --git a/examples/network_templates/cinder_add_nodes.yaml b/examples/network_templates/cinder_add_nodes.yaml deleted file mode 100644 index 8fd3dd036..000000000 --- a/examples/network_templates/cinder_add_nodes.yaml +++ /dev/null @@ -1,333 +0,0 @@ -adv_net_template: - default: - nic_mapping: - default: - if1: eth0 # admin - if2: eth1 # public - if3: eth3 # management (vlan 101) storage (vlan 102) & private (vlan 103) - if4: eth4 # other networks (vlan 201-299) - if5: eth2 # fake bond - node-4: - if1: eth0 # admin - if2: eth2 # public - if3: eth4 # management (vlan 101) storage (vlan 102) & private (vlan 103) - if4: eth3 # other networks (vlan 201-299) - if5: eth1 # fake bond - templates_for_node_role: - controller: - - public - - private - - storage - - common - - custom - compute: - - common - - private - - storage - - custom - cinder: - - common - - storage - - custom - network_assignments: - storage: - ep: br-storage - private: - ep: br-prv - public: - ep: br-ex - management: - ep: br-mgmt - fuelweb_admin: - ep: br-fw-admin - fake: - ep: br-fake - mongo: - ep: br-mongo - keystone: - ep: br-keystone - neutron-api: - ep: br-neutronapi - neutron-mesh: - ep: br-neutronmesh - swift: - ep: br-swift - sahara: - ep: br-sahara - ceilometer: - ep: br-ceilometer - cinder: - ep: br-cinder - glance: - ep: br-glance - heat: - ep: br-heat - nova: - ep: br-nova - nova-migration: - ep: br-novamigr - murano: - ep: br-murano - horizon: - ep: br-horizon - messaging: - ep: br-messaging - corosync: - ep: br-corosync - memcache: - ep: br-memcache - database: - ep: br-database - cinder-iscsi: - ep: br-cinderiscsi - swift-replication: - ep: br-swiftrepl - network_scheme: - storage: - transformations: - - action: add-br - name: br-storage - - action: add-port - bridge: br-storage - name: <% if3 %>.102 - endpoints: - - br-storage - roles: - storage: br-storage - ceph/public: br-storage - private: - transformations: - - action: add-br - name: br-prv - provider: ovs - - action: add-br - name: br-aux - - action: add-patch - bridges: - - br-prv - - br-aux - provider: ovs - mtu: 65000 - - action: add-port - bridge: br-aux - name: <% if3 %>.103 - endpoints: - - br-prv - roles: - neutron/private: br-prv - public: - transformations: - - action: add-br - name: br-ex - - action: add-br - name: br-floating - provider: ovs - - action: add-patch - bridges: - - br-floating - - br-ex - provider: ovs - mtu: 65000 - - action: add-port - bridge: br-ex - name: <% if2 %> - endpoints: - - br-ex - roles: - public/vip: br-ex - neutron/floating: br-floating - ex: br-ex - common: - transformations: - - action: add-br - name: br-fw-admin - - action: add-port - bridge: br-fw-admin - name: <% if1 %> - - action: add-br - name: br-mgmt - - action: add-port - bridge: br-mgmt - name: <% if3 %>.101 - - action: add-br - name: br-fake - - action: add-bond - bridge: br-fake - name: lnx-bond0 - interfaces: - - <% if5 %> - bond_properties: - mode: active-backup - interface_properties: {} - endpoints: - - br-fw-admin - - br-mgmt - - br-fake - roles: - admin/pxe: br-fw-admin - fw-admin: br-fw-admin - management: br-mgmt - mgmt/vip: br-mgmt - mgmt/api: br-mgmt - custom: - transformations: - - action: add-br - name: br-mongo - - action: add-port - bridge: br-mongo - name: <% if4 %>.201 - - action: add-br - name: br-keystone - - action: add-port - bridge: br-keystone - name: <% if4 %>.202 - - action: add-br - name: br-neutronapi - - action: add-port - bridge: br-neutronapi - name: <% if4 %>.203 - - action: add-br - name: br-neutronmesh - - action: add-port - bridge: br-neutronmesh - name: <% if4 %>.204 - - action: add-br - name: br-swift - - action: add-port - bridge: br-swift - name: <% if4 %>.205 - - action: add-br - name: br-sahara - - action: add-port - bridge: br-sahara - name: <% if4 %>.206 - - action: add-br - name: br-ceilometer - - action: add-port - bridge: br-ceilometer - name: <% if4 %>.207 - - action: add-br - name: br-cinder - - action: add-port - bridge: br-cinder - name: <% if4 %>.208 - - action: add-br - name: br-glance - - action: add-port - bridge: br-glance - name: <% if4 %>.209 - - action: add-br - name: br-heat - - action: add-port - bridge: br-heat - name: <% if4 %>.210 - - action: add-br - name: br-nova - - action: add-port - bridge: br-nova - name: <% if4 %>.211 - - action: add-br - name: br-novamigr - - action: add-port - bridge: br-novamigr - name: <% if4 %>.212 - - action: add-br - name: br-murano - - action: add-port - bridge: br-murano - name: <% if4 %>.213 - - action: add-br - name: br-horizon - - action: add-port - bridge: br-horizon - name: <% if4 %>.214 - - action: add-br - name: br-messaging - - action: add-port - bridge: br-messaging - name: <% if4 %>.215 - - action: add-br - name: br-corosync - - action: add-port - bridge: br-corosync - name: <% if4 %>.216 - - action: add-br - name: br-memcache - - action: add-port - bridge: br-memcache - name: <% if4 %>.217 - - action: add-br - name: br-database - - action: add-port - bridge: br-database - name: <% if4 %>.218 - - action: add-br - name: br-cinderiscsi - - action: add-port - bridge: br-cinderiscsi - name: <% if4 %>.219 - - action: add-br - name: br-swiftrepl - - action: add-port - bridge: br-swiftrepl - name: <% if4 %>.220 - endpoints: - - br-mongo - - br-keystone - - br-neutronapi - - br-neutronmesh - - br-swift - - br-sahara - - br-ceilometer - - br-cinder - - br-glance - - br-heat - - br-nova - - br-novamigr - - br-murano - - br-horizon - - br-messaging - - br-corosync - - br-memcache - - br-database - - br-cinderiscsi - - br-swiftrepl - roles: - mongo/db: br-mongo - keystone/api: br-keystone - neutron/api: br-neutronapi - neutron/mesh: br-neutronmesh - swift/api: br-swift - sahara/api: br-sahara - ceilometer/api: br-ceilometer - cinder/api: br-cinder - glance/api: br-glance - heat/api: br-heat - nova/api: br-nova - nova/migration: br-novamigr - murano/api: br-murano - horizon: br-horizon - mgmt/messaging: br-messaging - mgmt/corosync: br-corosync - mgmt/memcache: br-memcache - mgmt/database: br-database - cinder/iscsi: br-cinderiscsi - swift/replication: br-swiftrepl - unused: - transformations: - - action: add-br - name: br-cephrepl - - action: add-port - bridge: br-cephrepl - name: <% if4 %>.221 - - action: add-br - name: br-cephrados - - action: add-port - bridge: br-cephrados - name: <% if4 %>.222 - endpoints: - - br-cephrepl - - br-cephrados - roles: - ceph/replication: br-cephrepl - ceph/radosgw: br-cephrados diff --git a/examples/network_templates/default.yaml b/examples/network_templates/default.yaml deleted file mode 100644 index f569396a2..000000000 --- a/examples/network_templates/default.yaml +++ /dev/null @@ -1,135 +0,0 @@ -adv_net_template: - default: - nic_mapping: - default: - if1: eth0 # admin - if2: eth1 # public - if3: eth4 # management - if4: eth2 # private - if5: eth3 # storage - templates_for_node_role: - controller: - - public - - private - - storage - - common - compute: - - common - - private - - storage - cinder: - - common - - storage - ceph-osd: - - common - - storage - network_assignments: - storage: - ep: br-storage - private: - ep: br-prv - public: - ep: br-ex - management: - ep: br-mgmt - fuelweb_admin: - ep: br-fw-admin - network_scheme: - storage: - transformations: - - action: add-br - name: br-storage - - action: add-port - bridge: br-storage - name: <% if5 %> - endpoints: - - br-storage - roles: - cinder/iscsi: br-storage - swift/replication: br-storage - ceph/replication: br-storage - storage: br-storage - private: - transformations: - - action: add-br - name: br-prv - provider: ovs - - action: add-br - name: br-aux - - action: add-patch - bridges: - - br-prv - - br-aux - provider: ovs - mtu: 65000 - - action: add-port - bridge: br-aux - name: <% if4 %> - endpoints: - - br-prv - roles: - neutron/private: br-prv - public: - transformations: - - action: add-br - name: br-ex - - action: add-br - name: br-floating - provider: ovs - - action: add-patch - bridges: - - br-floating - - br-ex - provider: ovs - mtu: 65000 - - action: add-port - bridge: br-ex - name: <% if2 %> - endpoints: - - br-ex - roles: - public/vip: br-ex - neutron/floating: br-floating - ceph/radosgw: br-ex - ex: br-ex - common: - transformations: - - action: add-br - name: br-fw-admin - - action: add-port - bridge: br-fw-admin - name: <% if1 %> - - action: add-br - name: br-mgmt - - action: add-port - bridge: br-mgmt - name: <% if3 %> - endpoints: - - br-fw-admin - - br-mgmt - roles: - admin/pxe: br-fw-admin - fw-admin: br-fw-admin - mongo/db: br-mgmt - management: br-mgmt - keystone/api: br-mgmt - neutron/api: br-mgmt - neutron/mesh: br-mgmt - swift/api: br-mgmt - sahara/api: br-mgmt - ceilometer/api: br-mgmt - cinder/api: br-mgmt - glance/api: br-mgmt - heat/api: br-mgmt - nova/api: br-mgmt - nova/migration: br-mgmt - murano/api: br-mgmt - horizon: br-mgmt - mgmt/api: br-mgmt - mgmt/memcache: br-mgmt - mgmt/database: br-mgmt - mgmt/messaging: br-mgmt - mgmt/corosync: br-mgmt - mgmt/vip: br-mgmt - mgmt/api: br-mgmt - ceph/public: br-mgmt diff --git a/examples/network_templates/hardware.yaml b/examples/network_templates/hardware.yaml deleted file mode 100644 index d7d560f25..000000000 --- a/examples/network_templates/hardware.yaml +++ /dev/null @@ -1,252 +0,0 @@ -adv_net_template: - default: - network_assignments: - ceph: - ep: br-ceph - database: - ep: br-database - fuelweb_admin: - ep: br-fw-admin - ha: - ep: br-ha - management: - ep: br-mgmt - messaging: - ep: br-messaging - mongo: - ep: br-mongo - openstack: - ep: br-openstack - private: - ep: br-prv - public: - ep: br-ex - services: - ep: br-services - storage: - ep: br-storage - network_scheme: - admin: - endpoints: - - br-fw-admin - roles: - admin/pxe: br-fw-admin - fw-admin: br-fw-admin - transformations: - - action: add-br - name: br-fw-admin - - action: add-port - bridge: br-fw-admin - name: <% if1 %> - ceph: - endpoints: - - br-ceph - roles: - ceph/replication: br-ceph - transformations: - - action: add-br - name: br-ceph - - action: add-port - bridge: br-ceph - name: <% if1 %>.364 - database: - endpoints: - - br-database - roles: - mgmt/database: br-database - mgmt/memcache: br-database - transformations: - - action: add-br - name: br-database - - action: add-port - bridge: br-database - name: <% if2 %>.367 - ha: - endpoints: - - br-ha - roles: - mgmt/corosync: br-ha - transformations: - - action: add-br - name: br-ha - - action: add-port - bridge: br-ha - name: <% if2 %>.366 - management: - endpoints: - - br-mgmt - roles: - management: br-mgmt - mgmt/api: br-mgmt - mgmt/vip: br-mgmt - transformations: - - action: add-br - name: br-mgmt - - action: add-port - name: <% if1 %>.360 - - action: add-port - name: <% if2 %>.360 - - action: add-bond - bond_properties: - mode: active-backup - bridge: br-mgmt - interface_properties: {} - interfaces: - - <% if1 %>.360 - - <% if2 %>.360 - name: lnxbond0 - messaging: - endpoints: - - br-messaging - roles: - mgmt/messaging: br-messaging - transformations: - - action: add-br - name: br-messaging - - action: add-port - bridge: br-messaging - name: <% if2 %>.368 - mongo: - endpoints: - - br-mongo - roles: - mongo/db: br-mongo - transformations: - - action: add-br - name: br-mongo - - action: add-port - bridge: br-mongo - name: <% if1 %>.369 - openstack: - endpoints: - - br-openstack - roles: - horizon: br-openstack - keystone/api: br-openstack - neutron/api: br-openstack - neutron/mesh: br-openstack - nova/api: br-openstack - nova/migration: br-openstack - transformations: - - action: add-br - name: br-openstack - - action: add-port - bridge: br-openstack - name: <% if2 %>.365 - private: - endpoints: - - br-prv - roles: - neutron/private: br-prv - transformations: - - action: add-br - name: br-prv - provider: ovs - - action: add-br - name: br-aux - - action: add-patch - bridges: - - br-prv - - br-aux - mtu: 65000 - provider: ovs - - action: add-port - bridge: br-aux - name: <% if1 %>.362 - public: - endpoints: - - br-ex - roles: - ex: br-ex - neutron/floating: br-floating - public/vip: br-ex - transformations: - - action: add-br - name: br-ex - - action: add-br - name: br-floating - provider: ovs - - action: add-patch - bridges: - - br-floating - - br-ex - mtu: 65000 - provider: ovs - - action: add-port - bridge: br-ex - name: <% if2 %> - services: - endpoints: - - br-services - roles: - ceilometer/api: br-services - heat/api: br-services - murano/api: br-services - sahara/api: br-services - transformations: - - action: add-br - name: br-services - - action: add-port - bridge: br-services - name: <% if1 %>.363 - storage: - endpoints: - - br-storage - roles: - ceph/public: br-storage - ceph/radosgw: br-storage - cinder/api: br-storage - cinder/iscsi: br-storage - glance/api: br-storage - storage: br-storage - swift/api: br-storage - swift/replication: br-storage - transformations: - - action: add-br - name: br-storage - - action: add-port - bridge: br-storage - name: <% if2 %>.361 - nic_mapping: - default: - if1: eth0 - if2: eth1 - templates_for_node_role: - ceph-osd: - - admin - - public - - management - - storage - - ceph - - messaging - cinder: - - admin - - public - - management - - storage - - messaging - compute: - - admin - - public - - management - - storage - - private - - openstack - - messaging - controller: - - admin - - public - - management - - storage - - private - - services - - ha - - openstack - - database - - messaging - - mongo - mongo: - - admin - - management - - messaging - - mongo diff --git a/examples/network_templates/one_network.yaml b/examples/network_templates/one_network.yaml deleted file mode 100644 index 289c83314..000000000 --- a/examples/network_templates/one_network.yaml +++ /dev/null @@ -1,85 +0,0 @@ -adv_net_template: - default: - network_assignments: - fuelweb_admin: - ep: br-fw-admin - network_scheme: - common: - endpoints: - - br-fw-admin - roles: - admin/pxe: br-fw-admin - ceilometer/api: br-fw-admin - ceph/public: br-fw-admin - cinder/api: br-fw-admin - fw-admin: br-fw-admin - glance/api: br-fw-admin - heat/api: br-fw-admin - horizon: br-fw-admin - keystone/api: br-fw-admin - management: br-fw-admin - mgmt/corosync: br-fw-admin - mgmt/database: br-fw-admin - mgmt/memcache: br-fw-admin - mgmt/messaging: br-fw-admin - mgmt/vip: br-fw-admin - mongo/db: br-fw-admin - murano/api: br-fw-admin - neutron/api: br-fw-admin - neutron/mesh: br-fw-admin - nova/api: br-fw-admin - nova/migration: br-fw-admin - sahara/api: br-fw-admin - swift/api: br-fw-admin - neutron/private: br-fw-admin - ceph/radosgw: br-fw-admin - ex: br-fw-admin - neutron/floating: br-floating - public/vip: br-fw-admin - ceph/replication: br-fw-admin - cinder/iscsi: br-fw-admin - storage: br-fw-admin - swift/replication: br-fw-admin - swift/public: br-fw-admin - transformations: - - action: add-br - name: br-fw-admin - - action: add-port - bridge: br-fw-admin - name: <% if1 %> - - action: add-br - name: br-aux - - action: add-br - name: br-prv - provider: ovs - - action: add-patch - bridges: - - br-prv - - br-fw-admin - mtu: 65000 - provider: ovs - - action: add-br - name: br-floating - provider: ovs - - action: add-patch - bridges: - - br-floating - - br-fw-admin - mtu: 65000 - provider: ovs - nic_mapping: - default: - if1: eth0 - templates_for_node_role: - cinder: - - common - compute: - - common - controller: - - common - ceph-osd: - - common - mongo: - - common - - diff --git a/examples/network_templates/two_networks.yaml b/examples/network_templates/two_networks.yaml deleted file mode 100644 index fd379836a..000000000 --- a/examples/network_templates/two_networks.yaml +++ /dev/null @@ -1,93 +0,0 @@ -adv_net_template: - default: - network_assignments: - fuelweb_admin: - ep: br-fw-admin - everything: - ep: br-all - network_scheme: - common: - endpoints: - - br-all - - br-fw-admin - roles: - admin/pxe: br-fw-admin - ceilometer/api: br-all - ceph/public: br-all - cinder/api: br-all - fw-admin: br-fw-admin - glance/api: br-all - heat/api: br-all - horizon: br-all - keystone/api: br-all - management: br-all - mgmt/corosync: br-all - mgmt/database: br-all - mgmt/memcache: br-all - mgmt/messaging: br-all - mgmt/vip: br-all - mongo/db: br-all - murano/api: br-all - neutron/api: br-all - neutron/mesh: br-all - nova/api: br-all - nova/migration: br-all - sahara/api: br-all - swift/api: br-all - neutron/private: br-all - ceph/radosgw: br-all - ex: br-all - neutron/floating: br-floating - public/vip: br-all - ceph/replication: br-all - cinder/iscsi: br-all - storage: br-all - swift/replication: br-all - swift/public: br-all - transformations: - - action: add-br - name: br-fw-admin - - action: add-port - bridge: br-fw-admin - name: <% if1 %> - - action: add-br - name: br-all - - action: add-port - bridge: br-all - name: <% if2 %> - - action: add-br - name: br-aux - - action: add-br - name: br-prv - provider: ovs - - action: add-patch - bridges: - - br-prv - - br-all - mtu: 65000 - provider: ovs - - action: add-br - name: br-floating - provider: ovs - - action: add-patch - bridges: - - br-floating - - br-all - mtu: 65000 - provider: ovs - nic_mapping: - default: - if1: eth0 - if2: eth1 - templates_for_node_role: - cinder: - - common - compute: - - common - controller: - - common - ceph-osd: - - common - mongo: - - common - diff --git a/examples/network_templates/two_nodegroups.yaml b/examples/network_templates/two_nodegroups.yaml deleted file mode 100644 index b2b112e53..000000000 --- a/examples/network_templates/two_nodegroups.yaml +++ /dev/null @@ -1,285 +0,0 @@ -adv_net_template: - default: - nic_mapping: - default: - if11: eth0 # admin - if12: eth1 # public - if13: eth2 # management - if14: eth3 # private - if15: eth4 # storage - templates_for_node_role: - controller: - - admin - - public - - management - - private - - storage - compute: - - admin - - public - - management - - private - - storage - cinder: - - admin - - public - - management - - private - - storage - network_assignments: - storage: - ep: br-storage - private: - ep: br-prv - public: - ep: br-ex - management: - ep: br-mgmt - fuelweb_admin: - ep: br-fw-admin - network_scheme: - admin: - transformations: - - action: add-br - name: br-fw-admin - - action: add-port - bridge: br-fw-admin - name: eth0 - endpoints: - - br-fw-admin - roles: - admin/pxe: br-fw-admin - fw-admin: br-fw-admin - public: - transformations: - - action: add-br - name: br-ex - - action: add-br - name: br-floating - provider: ovs - - action: add-patch - bridges: - - br-floating - - br-ex - provider: ovs - mtu: 65000 - - action: add-port - bridge: br-ex - name: eth1 - endpoints: - - br-ex - roles: - public/vip: br-ex - neutron/floating: br-ex - ex: br-ex - public: br-ex - management: - transformations: - - action: add-br - name: br-mgmt - - action: add-port - bridge: br-mgmt - name: eth2 - endpoints: - - br-mgmt - roles: - management: br-mgmt - mgmt/vip: br-mgmt - mgmt/api: br-mgmt - mongo/db: br-mgmt - keystone/api: br-mgmt - neutron/api: br-mgmt - neutron/mesh: br-mgmt - swift/api: br-mgmt - sahara/api: br-mgmt - ceilometer/api: br-mgmt - cinder/api: br-mgmt - glance/api: br-mgmt - heat/api: br-mgmt - nova/api: br-mgmt - nova/migration: br-mgmt - murano/api: br-mgmt - horizon: br-mgmt - mgmt/messaging: br-mgmt - mgmt/corosync: br-mgmt - mgmt/memcache: br-mgmt - mgmt/database: br-mgmt - cinder/iscsi: br-mgmt - swift/replication: br-mgmt - ceph/replication: br-mgmt - ceph/radosgw: br-mgmt - private: - transformations: - - action: add-br - name: br-prv - provider: ovs - - action: add-br - name: br-aux - - action: add-patch - bridges: - - br-prv - - br-aux - provider: ovs - mtu: 65000 - - action: add-port - bridge: br-aux - name: eth3 - endpoints: - - br-prv - roles: - private: br-prv - neutron/private: br-prv - storage: - transformations: - - action: add-br - name: br-storage - - action: add-port - bridge: br-storage - name: eth4 - endpoints: - - br-storage - roles: - storage: br-storage - ceph/public: br-storage - group-custom-1: - nic_mapping: - default: - if11: eth0 # admin - if12: eth1 # public - if13: eth2 # management - if14: eth3 # private - if15: eth4 # storage - templates_for_node_role: - controller: - - admin - - public - - management - - private - - storage - compute: - - admin - - public - - management - - private - - storage - cinder: - - admin - - public - - management - - private - - storage - network_assignments: - storage: - ep: br-storage - private: - ep: br-prv - public: - ep: br-ex - management: - ep: br-mgmt - fuelweb_admin: - ep: br-fw-admin - network_scheme: - admin: - transformations: - - action: add-br - name: br-fw-admin - - action: add-port - bridge: br-fw-admin - name: eth0 - endpoints: - - br-fw-admin - roles: - admin/pxe: br-fw-admin - fw-admin: br-fw-admin - public: - transformations: - - action: add-br - name: br-ex - - action: add-br - name: br-floating - provider: ovs - - action: add-patch - bridges: - - br-floating - - br-ex - provider: ovs - mtu: 65000 - - action: add-port - bridge: br-ex - name: eth1 - endpoints: - - br-ex - roles: - public/vip: br-ex - neutron/floating: br-ex - ex: br-ex - public: br-ex - management: - transformations: - - action: add-br - name: br-mgmt - - action: add-port - bridge: br-mgmt - name: eth2 - endpoints: - - br-mgmt - roles: - management: br-mgmt - mgmt/vip: br-mgmt - mgmt/api: br-mgmt - mongo/db: br-mgmt - keystone/api: br-mgmt - neutron/api: br-mgmt - neutron/mesh: br-mgmt - swift/api: br-mgmt - sahara/api: br-mgmt - ceilometer/api: br-mgmt - cinder/api: br-mgmt - glance/api: br-mgmt - heat/api: br-mgmt - nova/api: br-mgmt - nova/migration: br-mgmt - murano/api: br-mgmt - horizon: br-mgmt - mgmt/messaging: br-mgmt - mgmt/corosync: br-mgmt - mgmt/memcache: br-mgmt - mgmt/database: br-mgmt - cinder/iscsi: br-mgmt - swift/replication: br-mgmt - ceph/replication: br-mgmt - ceph/radosgw: br-mgmt - private: - transformations: - - action: add-br - name: br-prv - provider: ovs - - action: add-br - name: br-aux - - action: add-patch - bridges: - - br-prv - - br-aux - provider: ovs - mtu: 65000 - - action: add-port - bridge: br-aux - name: eth3 - endpoints: - - br-prv - roles: - private: br-prv - neutron/private: br-prv - storage: - transformations: - - action: add-br - name: br-storage - - action: add-port - bridge: br-storage - name: eth4 - endpoints: - - br-storage - roles: - storage: br-storage - ceph/public: br-storage diff --git a/file-ref.rst b/file-ref.rst deleted file mode 100644 index 2909913cd..000000000 --- a/file-ref.rst +++ /dev/null @@ -1,12 +0,0 @@ -.. index:: User Guide - -.. _file-ref: - -===================== -File Format Reference -===================== - -.. contents:: :local: - :depth: 2 - -.. include:: /contents/contents-file-ref.rst diff --git a/fuel-install-guide.rst b/fuel-install-guide.rst deleted file mode 100644 index d7f58a84a..000000000 --- a/fuel-install-guide.rst +++ /dev/null @@ -1,11 +0,0 @@ -.. index:: Fuel Installation Guide - -.. _fuel-install-guide: - -======================= -Fuel Installation Guide -======================= - -.. contents:: :local: - -.. include:: /contents/contents-fuel-install.rst diff --git a/index.rst b/index.rst index 157c4700f..4396839c9 100644 --- a/index.rst +++ b/index.rst @@ -1,28 +1,19 @@ -:orphan: +.. _contents: -.. index:: Fuel Documentation +Table of contents +================= -.. _Manpage: +.. toctree:: + :maxdepth: 4 + :numbered: -============================= -Fuel Documentation -============================= - -Mirantis OpenStack consists of the following components: - -* Hardened packages - Mirantis OpenStack includes the core OpenStack projects updated with - each stable release of OpenStack and supporting a broad range of - operating systems, hypervisors, and deployment topologies. - -* Fuel software - Fuel is an open source, software lifecycle management application - that deploys multiple OpenStack (https://www.openstack.org/) - environments from a single interface and then enables you to manage - those environments post deployment. - -* Support - After you complete your evaluation of Mirantis OpenStack, - get support for Mirantis OpenStack from the industry experts. - For more information go to - https://www.mirantis.com/services/enterprise-support-services/ + develop + user + devops + buildsystem + infra/jenkins_master_deployment + infra/jenkins_slave_deployment + infra/overview + infra/puppet_master_deployment + infra/third_party + packaging diff --git a/infra/jenkins_master_deployment.rst b/infra/jenkins_master_deployment.rst new file mode 100644 index 000000000..20ee03dee --- /dev/null +++ b/infra/jenkins_master_deployment.rst @@ -0,0 +1,83 @@ +Jenkins Master +============== + +Jenkins master as a head of CI systems handles all tasks related to the build +system being responsible for its slaves connectivity, users authentication, and +job launches. + +Deployment +---------- + +Before you deploy the Jenkins master, perform the following tasks: + +#. Verify that the Puppet Master is deployed and DNS solution is working. +#. Consider using the Hiera role. As an example, see the ``jenkins_master`` role + included in the ``fuel-infra/puppet-manifests`` repository. +#. Set the following parameters for the Hiera role on the Jenkins Master: + + .. code-block:: ini + + --- + classes: + - '::fuel_project::jenkins::master' + + jenkins::master::jenkins_ssh_private_key_contents: | + -----BEGIN RSA PRIVATE KEY----- + MIIEogIBAAKCAQEAzVoDH+iIrEmNBytJqR5IFYUcR7A6JvNTyelt4wIHEgVmNSs/ + 9ry/fEivdaaYGJpw2tri23IWNl5PXInnzKZu0KuRDuqEjyiSYQA8gmAF/+2KJmSM + OCj+QIRutLnHbUyg9MvExSveWrXqZYHKvSS0SJ4a3YP75yS2yp1e5T9YOXX2Na5u + ... + LJnYPGIQsEziRtqpClCz9O6qyzPagom13y+s/uYrk9IKzSzjNvHKqzAFIF57paGo + 3TWXEjB/RazdPB0PWfc3kjruz8IhDsLKQYPX+h8JuLO8ZL20Mxo7o3bs/GQnDrw1 + g/PCKBJscu0RQxsa16tt5aX/IM82cJR6At3tTUyUpiwqNsVClJs= + -----END RSA PRIVATE KEY----- + + jenkins::master::jenkins_ssh_public_key_contents: | + 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNWgMf6IisSY0HK0mpHkgVhRxHs + Dom81PJ6W3jAgcSBWY1Kz/2vL98SK91ppgYmnDa2uLbchY2Xk9ciefMpm7Qq5EO6oS \ + ... + KnV7lP1g5dfY1rm6bum7P+Jwf2tdTOa0b5ucK/+iWVbyPO4Z2afPpblh4Vynfe2wMz \ + zpGAp3n5MwtH2EZmSXm/B6/CkgOFROsmWH8MzQEvNBGHhw+ONR9' + +#. Set proper service FQDN of the Jenkins Master instance: + + .. code-block:: ini + + fuel_project::jenkins::master::service_fqdn: 'jenkins-master.test.local' + +#. Adjust the security model of the Jenkins after the deployment: + + .. code-block:: ini + + jenkins::master::security_model: 'unsecured' || 'password' || 'ldap' + + .. note:: + The ``password`` is the most basic one, when Jenkins has no access to + the LDAP and you still require some authorization to be enabled in the + Jenkins. + +To deploy the Jenkins Master, complete the following steps: + +#. Install base Ubuntu 14.04 with SSH service and set appropriate FQDN. + +#. Install puppet agent package: + + .. code-block:: console + + apt-get update; apt-get install -y puppet + +#. Enable puppet agent: + + .. code-block:: console + + puppet agent --enable + +#. Run the Jenkins Master deployment: + + .. code-block:: console + + FACTER_ROLE=jenkins_master FACTER_LOCATION=us1 puppet agent -tvd \ + --server puppet-master.test.local --waitforcert 60 + +The last action requests the client's certificate. To continue the puppet run, +the certificate should be signed from the Puppet Master. \ No newline at end of file diff --git a/infra/jenkins_slave_deployment.rst b/infra/jenkins_slave_deployment.rst new file mode 100644 index 000000000..30d792493 --- /dev/null +++ b/infra/jenkins_slave_deployment.rst @@ -0,0 +1,101 @@ +Jenkins Slave +============= + +The Jenkins Slave is a machine that is set up to run build projects scheduled +from the master. Slave runs a dedicated program called a ``slave agent`` +spawned from the master, thus there is no need to install Jenkins itself +on a slave. + +Deployment +---------- + +There are few ways to setup Jenkins master-slave connection, however in our +infra currently we use only one of them. +In general, the Jenkins master SSH-key is to be placed in authorized_keys file +for the jenkins user on a slave machine. Then via the Jenkins Master's WebUI +create a node manually by specifying slave's node FQDN. After, the Jenkins +master will connect to the slave via SSH to the jenkins user, upload +``slave.jar`` file and spawn it on slave using jenkins user. + +In order to deploy Jenkins Slave please look at already existing hiera +role for an example of jenkins slave instance. Check if ssh public key +authentication is properly configured. + +#. Ensure that in jenkins master hiera role the following two parameters are + set: + + .. code-block:: ini + + --- + classes: + - '::fuel_project::jenkins::master' + + jenkins::master::jenkins_ssh_private_key_contents: | + -----BEGIN RSA PRIVATE KEY----- + MIIEogIBAAKCAQEAzVoDH+iIrEmNBytJqR5IFYUcR7A6JvNTyelt4wIHEgVmNSs/ + 9ry/fEivdaaYGJpw2tri23IWNl5PXInnzKZu0KuRDuqEjyiSYQA8gmAF/+2KJmSM + ... + 3TWXEjB/RazdPB0PWfc3kjruz8IhDsLKQYPX+h8JuLO8ZL20Mxo7o3bs/GQnDrw1 + g/PCKBJscu0RQxsa16tt5aX/IM82cJR6At3tTUyUpiwqNsVClJs= + -----END RSA PRIVATE KEY----- + + jenkins::master::jenkins_ssh_public_key_contents: | + 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNWgMf6IisSY0HK0mpHkgVhRxHs \ + Dom81PJ6W3jAgcSBWY1Kz/2vL98SK91ppgYmnDa2uLbchY2Xk9ciefMpm7Qq5EO6oS \ + ... + KnV7lP1g5dfY1rm6bum7P+Jwf2tdTOa0b5ucK/+iWVbyPO4Z2afPpblh4Vynfe2wMz \ + zpGAp3n5MwtH2EZmSXm/B6/CkgOFROsmWH8MzQEvNBGHhw+ONR9' + + +#. In the jenkins slave role ensure to set proper 'authorized_keys' parameter + + .. code-block:: ini + + --- + classes: + - fuel_project::jenkins::slave + + jenkins::slave::authorized_keys: + 'jenkins@jenkins-master.test.local': + type: ssh-rsa + key: 'AAAAB3NzaC1yc2EAAAADAQABAAABAQDNWgMf6IisSY...BGHhw+ONR9' + + # optional - if you wish to use also password authentication, set to true: + ssh::sshd::password_authentication: true + +The above configuration is mandatory to be set in order to get proper +master-to-slave connection. + +Other case, if the slaves running the particular hiera role are suppose to be +able to buid the ISO, it is required to enable 'build_fuel_iso' parameter in +the 'slave' class. + + .. code-block:: ini + + fuel_project::jenkins::slave::build_fuel_iso: true + +To deploy Jenkins slave, complete the following steps: + +#. Install base Ubuntu 14.04 with SSH service and set appropriate FQDN. + +#. Install puppet agent package: + + .. code-block:: console + + apt-get update; apt-get install -y puppet + +#. Enable puppet agent: + + .. code-block:: console + + puppet agent --enable + +#. Run the Jenkins Master deployment. + + .. code-block:: console + + FACTER_ROLE=jenkins_slave FACTER_LOCATION=us1 puppet agent -tvd \ + --server puppet-master.test.local --waitforcert 60 + +The last action requests the client's certificate. To continue the puppet run, +the certificate should be signed from the Puppet Master. \ No newline at end of file diff --git a/infra/overview.rst b/infra/overview.rst new file mode 100644 index 000000000..f365a4bc3 --- /dev/null +++ b/infra/overview.rst @@ -0,0 +1,311 @@ +Fuel Infrastructure +=================== + +Overview +-------- + +Fuel Infrastructure is the set of systems (servers and services) which provide +the following functionality: + +* Automatic tests for every patchset committed to Fuel Gerrit repositories +* Fuel nightly builds +* Regular integration tests +* Custom builds and custom tests +* Release management and publishing +* Centralized log storage for gathering logs from infra's servers +* Internal and external mirrors, used by our infra and partners +* DNS service +* Server's monitoring service +* Docker's registry for managing custom docker images +* Small helper subsystems like status pages and so on + +Fuel Infrastructure servers are managed by Puppet from one Puppet Master node. + +To add new server to the infrastructure you can either take any server with base +Ubuntu 14.04 installed and connect it to the Puppet Master via puppet agent, or +you can first set up the PXE-server with PXETool and then run +server provisioning in automated way. + +Your infrastructure must have a DNS service running in order to resolve the +mandatory hosts like puppet-master.test.local or pxetool.test.local. There are +at least two possible scenarios of using DNS in infra. +Using DHCP service in your infra is optional, but can be more elastic and +comfortable than static IP configuration. + +#. Create own DNS service provided by dnsmasq in your infra. + + #. Install base Ubuntu 14.04 with SSH service and set an appropriate FQDN + such as ``dns01.test.local`` and configure the Dnsmasq service: + + .. code-block:: console + + apt-get update; apt-get install -y dnsmasq + echo "addn-hosts=/etc/dnsmasq.d/hosts" >> /etc/dnsmasq.conf + echo "192.168.50.2 puppet-master.test.local puppet-master" > /etc/dnsmasq.d/hosts + echo "192.168.50.3 pxetool.test.local puppet-master" > /etc/dnsmasq.d/hosts + service dnsmasq restart + + #. If you use a static IP, verify that the ``/etc/resolv.conf`` file points + to your DNS. + #. If you use a dynamic IP, verify that the DHCP service is updated + correspondingly. + +#. Add a new zone to your current DNS setup or use an external, online DNS service. + + #. Add a zone named ``test.local``. + #. Add an appropriate A and its coresponding PTR record for the + ``puppet-master`` name (mandatory for deployment) at least. + #. If you use a static IP, verify that the ``/etc/resolv.conf`` file points + to your DNS, + #. If you use a dynamic IP, verify that the DHCP service is updated + correspondingly. + +Jenkins Jobs +------------ + +Our CI requires many jobs and configuration, it is not convenient to configure +everything with jenkins GUI. We use dedicated +`repository `_ and +`JJB `_ +to store and manage our jobs. + +Install Jenkins Job Builder +~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +To begin work with jenkins job builder we need to install it and configure. + +#. Install packages required to work with JJB + + .. code-block:: console + + apt-get install -y git python-tox + # or + yum install git python-tox + +#. Download git repository and install JJB + + .. code-block:: console + + git clone https://github.com/fuel-infra/jenkins-jobs.git + cd jenkins-jobs + tox + +#. Enable python environment, please replace with server name, for + example fuel-ci + + .. code-block:: console + + source .tox//bin/activate + +#. Create file jenkins_jobs.ini with JJB configuration. It could be created + at any place, for this documentation we assume that it will be placed in + conf/ directory, inside local copy of jenkins-jobs repository. + + .. code-block:: console + + [jenkins] + user= + password= + url=https:/// + + [job_builder] + ignore_cache=True + keep_descriptions=False + recursive=True + include_path=.:scripts + + .. note:: is the user already defined in Jenkins with an + appropriate permissions set: + + * Read - under the Global group of permissions + * Create, Delete, Configure and Read - under the Job group of permissions + +Upload jobs to Jenkins +~~~~~~~~~~~~~~~~~~~~~~ + +When JJB is installed and configured you can upload jobs to jenkins master. + +.. note:: We assume that you are in main directory of jenkins-jobs repository + and you have enabled python environment. + +Upload all jobs configured for one specified server, for example upload of +fule-ci can be done in this way: + + .. code-block:: console + + jenkins-jobs --conf conf/jenkins_jobs.ini update servers/fuel-ci:common + + +Upload only one job + + .. code-block:: console + + jenkins-jobs --conf conf/jenkins_jobs.ini update servers/fuel-ci:common 8.0-community.all + +Building ISO with Jenkins +------------------------- + +Requirements +~~~~~~~~~~~~ + +For minimal environment we need 3 systems: + +* Jenkins master +* Jenkins slave with enabled slave function for ISO building and deployment + testing. This can be done in different ways. For instance, you can create + hiera role for such server with the values provided below. Please keep in + mind that you have to explicitely set run_test and build_fuel_iso variables + to true, as ones are not enabled by default. + + .. code-block:: ini + + --- + classes: + - '::fuel_project::jenkins::slave' + + fuel_project::jenkins::slave::run_test: true + fuel_project::jenkins::slave::build_fuel_iso: true + + .. note:: Every slave which will be used for ISO deployment testing, like + BVT, requires additional preparation. + + Once puppet is applied, and slave is configured in Jenkins master, you need + to run the prepare_env job on it. Job will setup the python virtual + environment with fuel-devops installed (:doc:`../devops`). + + If you build ISO newer than 6.1 there is no need to change default job + parameters. For older versions you need to run build with + update_devops_2_5_x option checked. + +* Seed server - it is the server where you plan to store built ISO + + +Create Jenkins jobs +~~~~~~~~~~~~~~~~~~~ + +To build your own ISO you need to create job configurations for it, it requires +a few steps: + +#. Create your own jobs repository, for start we will use fuel-ci jobs + + .. code-block:: console + + cd jenkins-jobs/servers + cp -pr fuel-ci test-ci + +#. To build and test ISO we will use files: + + * servers/test-ci/8.0/community.all.yaml + * servers/test-ci/8.0/fuel_community_publish_iso.yaml + * servers/test-ci/8.0/fuel_community.centos.bvt_2.yaml + * servers/test-ci/8.0/fuel_community.ubuntu.bvt_2.yaml + +#. In all files you need to make changes: + + * Change email devops+alert@mirantis.com to your own + + * If you don't need reporting jobs you should delete triggering of + fuel_community_build_reports in all jobs or disable reporting job + + .. code-block:: ini + + - job: + ... + publishers: + ... + - trigger-parameterized-builds: + ... + - project: fuel_community_build_reports + + * Update seed name server in file + servers/test-ci/8.0/fuel_community_publish_iso.yaml + + .. code-block:: ini + + - job: + ... + publishers: + ... + - trigger-parameterized-builds: + ... + - project: 8.0.fuel_community.centos.bvt_2, 8.0.fuel_community.ubuntu.bvt_2 + ... + predefined-parameters: | + ISO_TORRENT=http://seed.fuel-infra.org/fuelweb-iso/fuel-community-$ISO_ID.iso.torrent + + * Update seed name server in file + servers/test-ci/8.0/builders/publish_fuel_community_iso.sh + + .. code-block:: console + + sed -i 's/seed-us1.fuel-infra.org/seed.test.local/g' servers/test-ci/8.0/builders/publish_fuel_community_iso.sh + sed -i 's/seed-cz1.fuel-infra.org/seed.test.local/g' servers/test-ci/8.0/builders/publish_fuel_community_iso.sh + +#. Create jobs on jenkins master + + .. note:: Please remember to: + + * change current directory to the root directory of cloned jenkins-jobs repository + * enable python environment + * use correct jenkins_jobs.ini file (with correct jenkins master server) + + .. code-block:: console + + jenkins-jobs --conf conf/jenkins_jobs.ini update servers/test-ci:common 8.0-community.all + jenkins-jobs --conf conf/jenkins_jobs.ini update servers/test-ci:common 8.0.publish_fuel_community_iso + jenkins-jobs --conf conf/jenkins_jobs.ini update servers/test-ci:common 8.0.fuel_community.centos.bvt_2 + jenkins-jobs --conf conf/jenkins_jobs.ini update servers/test-ci:common 8.0.fuel_community.ubuntu.bvt_2 + + +Start ISO building +~~~~~~~~~~~~~~~~~~ + +When you finish setting jobs up on jenkins master you will see project with +name 8.0-community.all there, to start ISO build and test procedure you need +to run mentioned project. + +Build and test procedure have 3 steps: + +* ISO building (8.0-community.all) +* when ISO is successfully created it will be uploaded to the seed server + (by triggering 8.0.publish_fuel_community_iso) +* successful upload will start BVT test (8.0.fuel_community.centos.bvt_2 and + 8.0.fuel_community.ubuntu.bvt_2) + + +Gerrit +------ + +Although fuel-* repositories are hosted by the `OpenStack Gerrit `_, +we use additional Gerrit instance to host OpenStack packages, internal projects and all the code +related to Infrastructure itself. + +Our Gerrit instance is installed and configured by Puppet, including specifying +the exact Java WAR file that is used(link). To manage Gerrit instance we use +`Jeepyb `_ - the tool written by Openstack Infra +team, which allows to store projects configuration in YAML format. + +To use Jeepyb with gerrit you need to create "projects.yaml" configuration file, +where for each project you add the following information: + +* project name +* project description +* project ACL +* project upstream + +If "upstream" option is specified, Jeepyb will automaticaly import the upstream +repository to this new project. To apply the configuration, use "manage-projects" command. + +Every project has ACL file. One ACL file can be reused in several projects. In +ACL file, access rights are defined based on the Gerrit user groups. +For example, in this file you can allow certain group to use the Code-Review ++/-2 marks. + +In our gerrit, we have some global projects - /. The Core Reviewers +for these projects are . + +Contributing +~~~~~~~~~~~~ + +Feedback +~~~~~~~~ \ No newline at end of file diff --git a/infra/puppet_master_deployment.rst b/infra/puppet_master_deployment.rst new file mode 100644 index 000000000..f3edd751d --- /dev/null +++ b/infra/puppet_master_deployment.rst @@ -0,0 +1,128 @@ +Puppet Master +============= + +Puppet is a tool which provides ability to manage configuration of systems in an +automatic way using the declarative language. The so called 'manifests' are +used for describing particular system configuration. + +Deployment +---------- + +In order to install Puppet Master on the brand new server running Ubuntu please +proceed with the following steps: + +#. Install Ubuntu 14.04 with SSH service and set FQDN to puppet-master.test.local + +#. Install git and clone Puppet Manifests repository into /etc/puppet directory: + + .. code-block:: console + + apt-get install -y git + git clone https://github.com/fuel-infra/puppet-manifests.git /etc/puppet + +#. Execute the Puppet Master's install script: + + .. code-block:: console + + /etc/puppet/bin/install_puppet_master.sh + +The script does the following: + +* upgrades all packages on the system +* installs required puppet modules +* installs Puppet Master packages +* runs puppet apply to setup Puppet Master +* runs puppet agent to do a second pass and verify if installation is usable + +When script finishes successfully, the Puppet Master installation is completed. + +----------- +Using Hiera +----------- + +Puppet can use Hiera to look for data. Hiera allows to override manifest +parameter values during the deployment, thus it is possible to create +a specific data configuration for easier code re-use and easier management of +data that needs to differ across nodes. +All related Hiera structure is placed under the ``/var/lib/hiera`` directory. + +The Hiera hierarchy +------------------- + + #. common.yaml - the most general, + #. locations/%{::location}.yaml - can override common's data, + #. roles/%{::role}.yaml - can override location's and common's data + #. nodes/%{::clientcert}.yaml - can override data specified in common, + location and role. + +The ``common`` and ``nodes`` are used within every deployment when exist. But in +contrast, the ``location`` and ``role`` needs to be passed explicitly as a +variable within ``puppet agent`` run, in order to use them. An example: + + .. code-block:: console + + FACTER_ROLE=websrv FACTER_LOCATION=us1 puppet agent -tvd + +To include puppet's class in a role, it is required to use the ``classes`` +keyword on the role's beginning. An example: + + .. code-block:: ini + + --- + classes: + - '::class1::class2' + +.. note:: + avoid including classes in more than one place since this will lead to + duplicate class declaration error. + +Other example - create a role's stub for 'docker_registry' module and make +sure that each of the nodes running that role have its own, custom, service's +FQDN set in Nginx's Vhost. + +#. File 'roles/docker_registry.yaml' + + .. code-block:: ini + + --- + classes: + - '::docker_registry' + - '::fuel_project::nginx' + - '::fuel_project::apps::firewall' + - '::fuel_project::common' + + docker_registry::service_fqdn: '%{::fqdn}' + +#. File 'nodes/srv01-us.infra.test.local.yaml' + + .. code-block:: ini + + --- + + docker_registry::service_fqdn: 'registry-us1.infra.test.local' + +#. File 'nodes/srv01-cz.infra.test.local.yaml' + + .. code-block:: ini + + --- + + docker_registry::service_fqdn: 'registry-cz1.infra.test.local' + +On a ``srv01-us.infra.test.local`` node, during the deployment of a +``docker_registry`` role, a default value for ``service_fqdn`` class parameter +has been overridden. + +After the deployment using FACTER variable a facter file is created containing +the used FACTERs variables. For instance: + + .. code-block:: console + + cat /etc/facter/facts.d/facts.sh + #!/bin/bash + + echo "location=us1" + echo "role=docker_registry" + +Having these, now every next puppet agent run will not require ``FACTER`` variables +to be passed (if no role nor location is to be changed). diff --git a/infra/third_party.rst b/infra/third_party.rst new file mode 100644 index 000000000..0cb4c32f0 --- /dev/null +++ b/infra/third_party.rst @@ -0,0 +1,310 @@ +.. _third-party-testing: + +Third Party Testing +=================== + +Overview +-------- + +Gerrit has an event stream which can be subscribed to, using this it +is possible to test commits against testing systems beyond those +supplied by Fuel's Jenkins setup. It is also possible for these +systems to feed information back into Gerrit. What's more, they +can leave non-gating votes on Gerrit review requests. + +There are several examples of systems that read the Gerrit event stream +and run their own tests on the commits +`on this page `_. +For each patch set the third party system tests, the system adds a comment +in Gerrit with a summary of the test result and links to the test artifacts. + +Requirements +------------ + +* Until a third party testing system operates in a stable fashion, third + party tests can comment on patches but not vote on them. + + * A system can also be set up to only do '+1' reviews and leave all the + '-1's to be manually confirmed. + +* A third-party system may only leave one comment per patch set + (unless it is retriggered). + +* The maintainers are responsible for re-triggering tests when their third + party testing system breaks. + +* Support recheck to request re-running a test. + + * Support the following syntaxes: ``recheck``. + * Recheck means recheck everything. A single recheck comment should + re-trigger all testing systems. + +* Publish contact information for the maintainers. + + * All accounts must be previously set by posting launchpad bug to add your + system. + * Maintainers are encouraged to be in IRC regularly to make it + faster to contact them. + +* Include a public link to all test artifacts to make debugging failed tests + easier (using a dns name over a hardcoded ip is recommended). + This should include: + + * Environment details + + * This must include a utc timestamp of the test run + * Test configuration + + * Skipped tests + * logs should include a trace of the commands used + * OpenStack logs + * Tempest logs (including ``testr_results.html.gz``) + + * logs must be browsable; logs requiring download, installation or login + to access are not acceptable + + .. note:: All test artifacts must be retained for one month. + +Reading the Event Stream +------------------------ + +It is possible to use ssh to connect to ``review.fuel-infra.org`` on port 29418 +with your ssh key if you have a normal reviewer account in Gerrit. + +This will give you a real-time JSON stream of events happening inside Gerrit. +For example: + +.. code-block:: bash + + $ ssh -p 29418 USERNAME@review.fuel-infra.org gerrit stream-events + +Will give a stream with an output like this (line breaks and +indentation added in this document for readability, the real JSON will +be all one line per event): + +.. code-block:: javascript + + {"type":"comment-added","change": + {"project":"openstack/keystone","branch":"stable/essex","topic":"bug/969088","id":"I18ae38af62b4c2b2423e20e436611fc30f844ae1","number":"7385","subject":"Make import_nova_auth only create roles which don\u0027t already exist","owner": + {"name":"Chuck Short","email":"chuck.short@canonical.com","username":"zulcss"},"url":"https://review.fuel-infra.org/7385"}, + "patchSet": + {"number":"1","revision":"aff45d69a73033241531f5e3542a8d1782ddd859","ref":"refs/changes/85/7385/1","uploader": + {"name":"Chuck Short","email":"chuck.short@canonical.com","username":"zulcss"}, + "createdOn":1337002189}, + "author": + {"name":"Mark McLoughlin","email":"markmc@redhat.com","username":"markmc"}, + "approvals": + [{"type":"CRVW","description":"Code Review","value":"2"},{"type":"APRV","description":"Approved","value":"0"}], + "comment":"Hmm, I actually thought this was in Essex already.\n\nIt\u0027s a pretty annoying little issue for folks migrating for nova auth. Fix is small and pretty safe. Good choice for backporting"} + +For most purposes you will want to trigger on ``patchset-created`` for when a +new patchset has been uploaded. + +Further documentation on how to use the events stream can be found in `Gerrit's stream event documentation page `_. + +Posting Result To Gerrit +------------------------ + +External testing systems can give non-gating votes to Gerrit by means +of a -1/+1 verify vote. Comments should also be provided to explain what kind +of test failed. We do also ask that the comments contain public links to the +failure so that the developer can see what caused the failure. + +An example of how to post this is as follows: + +.. code-block:: bash + + $ ssh -p 29418 USERNAME@review.fuel-infra.org gerrit review -m '"Test failed on MegaTestSystem "' --verified=-1 c0ff33 + +In this example ``c0ff33`` is the commit ID for the review. You can +set the verified to either `-1` or `+1` depending on whether or not it +passed the tests. + +Further documentation on the `review` command in Gerrit can be found in the `Gerrit review documentation page `_. + +We do suggest cautious testing of these systems and have a development Gerrit +setup to test on if required. In SmokeStack's case all failures are manually +reviewed before getting pushed to OpenStack, while this may not scale it is +advisable during the initial testing of the setup. + +There are several triggers that gerrit will match to alter the +formatting of comments. The raw regular expressions can be seen in +`gerrit.pp `_. +For example, to have your test results formatted in the same manner as +the upstream Jenkins results, use a template for each result matching:: + + * test-name-no-spaces http://link.to/result : [SUCCESS|FAILURE] some comment about the test + +.. _request-account-label: + +Creating a Service Account +-------------------------- + +In order to post comments as a Third Party CI System and eventually verify +your build status on Gerrit patches, you will need a dedicated Gerrit +CI account. You will need to create this account in our OpenID provider +`Launchpad `_. You may already have an existing +personal account in Launchpad, but you should create a new and entirely +separate account for this purpose. + +Once you have created this account with the OpenID provider you can log +into Gerrit with that new account as you would with your normal user +account. Once logged in you will need to do several things: + + 1. Set an SSH username at https://review.fuel-infra.org/#/settings/ if + it isn't already set. This is the username your CI system will use to + SSH to Gerrit in order to read the event stream. + + 2. Set the account's fullname at https://review.fuel-infra.org/#/settings/contact + This name should follow a few rules in order to make it clear in Gerrit + comments what this CI system exists to test. The name should have three + pieces ``Organization`` ``Product/technology`` ``CI designator``. The + organization value should be your company name or other organization + affiliation. Product/technology should describe the product or technology + you are testing in conjunction with OpenStack. This should be the name of + a component which cannot be tested in the official OpenStack + infrastructure (requires particular physical hardware, proprietary + software, some hypervisor feature not available in public clouds, + et cetera). Note this should not be the name of an OpenStack project but + rather the thing you are testing with OpenStack projects. And finally + the CI designator is used to denote this is a CI system so that automatic + Gerrit comment parsers can filter these comments out. This value should + be ``CI`` for most CI systems but can be ``Bot`` if you are not + performing continuous integration. An example of a proper name would be + something like ``IBM DB2 CI``. + + 3. Add the SSH public key you will be using to the Gerrit account at + https://review.fuel-infra.org/#/settings/ssh-keys You can generate an + ssh key using ``ssh-keygen``. You want to give Gerrit the contents of + the generated id_rsa.pub file. + +Once you have done this you will have everything you need to comment on +Gerrit changes from our CI system but you will not be able to vote +/-1 +Verified on changes. To get voting rights you will need to get the release +group of the project you are testing to add you to their project specific +-ci group. Please contact the project in question when you are +ready to start voting and they can add you to this group. + + + +The Jenkins Gerrit Trigger Plugin Way +------------------------------------- + +There is a Gerrit Trigger plugin for Jenkins which automates all of the +processes described in this document. So if your testing system is Jenkins +based you can use it to simplify things. You will still need an account to do +this as described in the :ref:`request-account-label` section above. + +The Gerrit Trigger plugin for Jenkins can be found on `the Jenkins +repository`_. You can install it using the Advanced tab in the +Jenkins Plugin Manager. + +.. _the Jenkins repository: http://repo.jenkins-ci.org/repo/com/sonyericsson/hudson/plugins/gerrit/gerrit-trigger/ + +Once installed Jenkins will have a new `Gerrit Trigger` option in the `Manage +Jenkins` menu. This should be given the following options:: + + Hostname: review.fuel-infra.org + Frontend URL: https://review.fuel-infra.org/ + SSH Port: 29418 + Username: (the Gerrit user) + SSH Key File: (path to the user SSH key) + + Verify + ------ + Started: 0 + Successful: 1 + Failed: -1 + Unstable: 0 + + Code Review + ----------- + Started: 0 + Successful: 0 + Failed: 0 + Unstable: 0 + + (under Advanced Button): + + Stated: (blank) + Successful: gerrit approve , --message 'Build Successful ' --verified --code-review + Failed: gerrit approve , --message 'Build Failed ' --verified --code-review + Unstable: gerrit approve , --message 'Build Unstable ' --verified --code-review + +Note that it is useful to include something in the messages about what testing +system is supplying these messages. + +When creating jobs in Jenkins you will have the option to add triggers. You +should configure as follows:: + + Trigger on Patchset Uploaded: ticked + (the rest unticked) + + Type: Plain + Pattern: openstack/project-name (where project-name is the name of the project) + Branches: + Type: Path + Pattern: ** + +This job will now automatically trigger when a new patchset is +uploaded and will report the results to Gerrit automatically. + +Testing your CI setup +--------------------- + +You can use the ``fuel-external/test`` project to test your external CI +infrastructure with OpenStack's Gerrit. By using the sandbox project you +can test your CI system without affecting regular OpenStack reviews. + +Once you confirm your CI system works as you expect, change your +configuration of the gerrit trigger plugin or zuul to subscribe to gerrit +events from your target project. + +Permissions on your Third Party System +-------------------------------------- + +When you create your CI account it will have no special permissions. +This means it can comment on changes but generally not vote +/-1 +Verified on any changes. The exception to this is on the +``fuel-external/test`` project. Any account is able to vote +/-1 +Verified on that account and it provides a way to test your CI's voting +abilities before you vote on other projects. + +.. _openstack-dev/ci-sandbox: https://review.fuel-infra.org/[ADDME] + +The Fuel Infrastructure team disables mis-behaving third-party ci +accounts at its discretion. This documentation endeavours to outline specific +circumstances that may lead to an account being disabled. There have been +times when third-party ci systems behave in ways we didn't envision +and therefore were unable to document prior to the event. If your +third-party ci system has been disabled, please don't hesitate to contact +devops team. + +In order to get your Third Pary CI account to have voting permissions on +repos in gerrit in addition to ``fuel-external/test`` you have a greater +chance of success if you follow these steps: + +* Set up your system and test it according to "Testing your CI setup" outlined + above (this will create a history of activity associated with your account + which will be evaluated when you apply for voting permissions). + +* Post comments, that adhere to the "Requirements" listed above, that + demonstrate the format for your system communication to the repos + you want your system to test. + +* Once your Third Party Account has a history on gerrit so that others + can evaluate your format for comments, and the stability of your + voting pattern (in the sandbox repo): + + * send an email to the fuel-devops mailing list nominating your + system for voting permissions + + * fuel-devops@mirantis.com + + * present your account history + * address any questions and concerns with your system + +* If the members of the program you want voting permissions from agree + your system should be able to vote, the release group for that program + or project can add you to the -ci group specific to that + program/project. diff --git a/lunr.py b/lunr.py deleted file mode 100755 index 197ddd131..000000000 --- a/lunr.py +++ /dev/null @@ -1,62 +0,0 @@ -#!/usr/bin/env python - -import glob, ntpath, random, json -from bs4 import BeautifulSoup - -exclude = ['_build/html/search.html', '_build/html/index.html', '_build/html/index_content.html', '_build/html/contents.html', '_build/html/genindex.html', '_build/html/terminology.html'] -files = glob.glob('_build/html/*.html') - -for remove in exclude: - if remove in files: files.remove(remove) - -doc = [] - -def formatheading(filename, link, headings, guide, type): - title = headings.text[:-1] - parent = headings.parent - url = filename + '#' + headings.parent.attrs['id'] - - if type == 'h2': - for tag in parent.find_all('h2'): - tag.replaceWith('') - for tag in parent.find_all('h3'): - tag.parent.replaceWith('') - else: - url = filename + '#' + link - for tag in parent.find_all('h3'): - tag.replaceWith('') - for tag in parent.find_all('h4'): - tag.replaceWith('') - - body = parent.get_text(" ", strip=True) - - return { - "title": title, - "guide": guide, - "url": url, - "body": body.replace('\n', ' ') - } - -for file in files: - filename = ntpath.basename(file) - h2 = BeautifulSoup(open(file), 'html.parser') - h3 = BeautifulSoup(open(file), 'html.parser') - - for title in h2.findAll('h1'): - guide = title.text[:-1] - - for headings in h3.findAll('h3'): - parent = headings.parent - parenth3 = parent.parent.findAll('h2') - link = parenth3[0].parent.attrs['id'] - result = formatheading(filename, link, headings, guide, 'h3') - if result['body']: - doc.append(result) - - for headings in h2.findAll('h2'): - result = formatheading(filename, '', headings, guide, 'h2') - if result['body']: - doc.append(result) - -with open('_build/html/_static/data.json', 'w') as outfile: - json.dump(doc, outfile) \ No newline at end of file diff --git a/make.bat b/make.bat new file mode 100644 index 000000000..34e9cb2e8 --- /dev/null +++ b/make.bat @@ -0,0 +1,199 @@ +@ECHO OFF + +REM Command file for Sphinx documentation + +if "%SPHINXBUILD%" == "" ( + set SPHINXBUILD=sphinx-build +) +set BUILDDIR=_build +set ALLSPHINXOPTS=-d %BUILDDIR%/doctrees %SPHINXOPTS% . +set I18NSPHINXOPTS=%SPHINXOPTS% . +if NOT "%PAPER%" == "" ( + set ALLSPHINXOPTS=-D latex_paper_size=%PAPER% %ALLSPHINXOPTS% + set I18NSPHINXOPTS=-D latex_paper_size=%PAPER% %I18NSPHINXOPTS% +) + +if "%1" == "" goto help + +if "%1" == "help" ( + :help + echo.Please use `make ^` where ^ is one of + echo. html to make standalone HTML files + echo. dirhtml to make HTML files named index.html in directories + echo. singlehtml to make a single large HTML file + echo. pickle to make pickle files + echo. json to make JSON files + echo. htmlhelp to make HTML files and a HTML help project + echo. qthelp to make HTML files and a qthelp project + echo. devhelp to make HTML files and a Devhelp project + echo. epub to make an epub + echo. latex to make LaTeX files, you can set PAPER=a4 or PAPER=letter + echo. pdf to make PDF files + echo. text to make text files + echo. man to make manual pages + echo. texinfo to make Texinfo files + echo. gettext to make PO message catalogs + echo. changes to make an overview over all changed/added/deprecated items + echo. linkcheck to check all external links for integrity + echo. doctest to run all doctests embedded in the documentation if enabled + goto end +) + +if "%1" == "clean" ( + for /d %%i in (%BUILDDIR%\*) do rmdir /q /s %%i + del /q /s %BUILDDIR%\* + goto end +) + +if "%1" == "html" ( + %SPHINXBUILD% -b html %ALLSPHINXOPTS% %BUILDDIR%/html + if errorlevel 1 exit /b 1 + echo. + echo.Build finished. The HTML pages are in %BUILDDIR%/html. + goto end +) + +if "%1" == "dirhtml" ( + %SPHINXBUILD% -b dirhtml %ALLSPHINXOPTS% %BUILDDIR%/dirhtml + if errorlevel 1 exit /b 1 + echo. + echo.Build finished. The HTML pages are in %BUILDDIR%/dirhtml. + goto end +) + +if "%1" == "singlehtml" ( + %SPHINXBUILD% -b singlehtml %ALLSPHINXOPTS% %BUILDDIR%/singlehtml + if errorlevel 1 exit /b 1 + echo. + echo.Build finished. The HTML pages are in %BUILDDIR%/singlehtml. + goto end +) + +if "%1" == "pickle" ( + %SPHINXBUILD% -b pickle %ALLSPHINXOPTS% %BUILDDIR%/pickle + if errorlevel 1 exit /b 1 + echo. + echo.Build finished; now you can process the pickle files. + goto end +) + +if "%1" == "json" ( + %SPHINXBUILD% -b json %ALLSPHINXOPTS% %BUILDDIR%/json + if errorlevel 1 exit /b 1 + echo. + echo.Build finished; now you can process the JSON files. + goto end +) + +if "%1" == "htmlhelp" ( + %SPHINXBUILD% -b htmlhelp %ALLSPHINXOPTS% %BUILDDIR%/htmlhelp + if errorlevel 1 exit /b 1 + echo. + echo.Build finished; now you can run HTML Help Workshop with the ^ +.hhp project file in %BUILDDIR%/htmlhelp. + goto end +) + +if "%1" == "qthelp" ( + %SPHINXBUILD% -b qthelp %ALLSPHINXOPTS% %BUILDDIR%/qthelp + if errorlevel 1 exit /b 1 + echo. + echo.Build finished; now you can run "qcollectiongenerator" with the ^ +.qhcp project file in %BUILDDIR%/qthelp, like this: + echo.^> qcollectiongenerator %BUILDDIR%\qthelp\fuel.qhcp + echo.To view the help file: + echo.^> assistant -collectionFile %BUILDDIR%\qthelp\fuel.ghc + goto end +) + +if "%1" == "devhelp" ( + %SPHINXBUILD% -b devhelp %ALLSPHINXOPTS% %BUILDDIR%/devhelp + if errorlevel 1 exit /b 1 + echo. + echo.Build finished. + goto end +) + +if "%1" == "epub" ( + %SPHINXBUILD% -b epub %ALLSPHINXOPTS% %BUILDDIR%/epub + if errorlevel 1 exit /b 1 + echo. + echo.Build finished. The epub file is in %BUILDDIR%/epub. + goto end +) + +if "%1" == "latex" ( + %SPHINXBUILD% -b latex %ALLSPHINXOPTS% %BUILDDIR%/latex + if errorlevel 1 exit /b 1 + echo. + echo.Build finished; the LaTeX files are in %BUILDDIR%/latex. + goto end +) + +if "%1" == "pdf" ( + %SPHINXBUILD% -bpdf %ALLSPHINXOPTS% %BUILDDIR%/pdf + if errorlevel 1 exit /b 1 + echo. + echo.Build finished; the PDF files are in %BUILDDIR%/pdf. + goto end +) + +if "%1" == "text" ( + %SPHINXBUILD% -b text %ALLSPHINXOPTS% %BUILDDIR%/text + if errorlevel 1 exit /b 1 + echo. + echo.Build finished. The text files are in %BUILDDIR%/text. + goto end +) + +if "%1" == "man" ( + %SPHINXBUILD% -b man %ALLSPHINXOPTS% %BUILDDIR%/man + if errorlevel 1 exit /b 1 + echo. + echo.Build finished. The manual pages are in %BUILDDIR%/man. + goto end +) + +if "%1" == "texinfo" ( + %SPHINXBUILD% -b texinfo %ALLSPHINXOPTS% %BUILDDIR%/texinfo + if errorlevel 1 exit /b 1 + echo. + echo.Build finished. The Texinfo files are in %BUILDDIR%/texinfo. + goto end +) + +if "%1" == "gettext" ( + %SPHINXBUILD% -b gettext %I18NSPHINXOPTS% %BUILDDIR%/locale + if errorlevel 1 exit /b 1 + echo. + echo.Build finished. The message catalogs are in %BUILDDIR%/locale. + goto end +) + +if "%1" == "changes" ( + %SPHINXBUILD% -b changes %ALLSPHINXOPTS% %BUILDDIR%/changes + if errorlevel 1 exit /b 1 + echo. + echo.The overview file is in %BUILDDIR%/changes. + goto end +) + +if "%1" == "linkcheck" ( + %SPHINXBUILD% -b linkcheck %ALLSPHINXOPTS% %BUILDDIR%/linkcheck + if errorlevel 1 exit /b 1 + echo. + echo.Link check complete; look for any errors in the above output ^ +or in %BUILDDIR%/linkcheck/output.txt. + goto end +) + +if "%1" == "doctest" ( + %SPHINXBUILD% -b doctest %ALLSPHINXOPTS% %BUILDDIR%/doctest + if errorlevel 1 exit /b 1 + echo. + echo.Testing of doctests in the sources finished, look at the ^ +results in %BUILDDIR%/doctest/output.txt. + goto end +) + +:end diff --git a/monitoring-guide.rst b/monitoring-guide.rst deleted file mode 100644 index 2e985a6d3..000000000 --- a/monitoring-guide.rst +++ /dev/null @@ -1,11 +0,0 @@ -.. index:: Monitoring Guide - -.. _monitoring-guide: - -================ -Monitoring Guide -================ - -.. contents:: :local: - -.. include:: /contents/contents-monitoring-guide.rst diff --git a/operations.rst b/operations.rst deleted file mode 100644 index 8baff68c3..000000000 --- a/operations.rst +++ /dev/null @@ -1,11 +0,0 @@ -.. index:: Operations Guide - -.. _operations-guide: - -================ -Operations Guide -================ - -.. contents:: :local: - -.. include:: /contents/contents-operations.rst diff --git a/packaging.rst b/packaging.rst new file mode 100644 index 000000000..fd722f74d --- /dev/null +++ b/packaging.rst @@ -0,0 +1,11 @@ +.. _packaging: + +Packaging +========= + +.. toctree:: + :maxdepth: 3 + :numbered: + + packaging/package_versions + packaging/perestroika \ No newline at end of file diff --git a/packaging/package_versions.rst b/packaging/package_versions.rst new file mode 100644 index 000000000..c15782195 --- /dev/null +++ b/packaging/package_versions.rst @@ -0,0 +1,90 @@ +Package version problems +======================== + +The introduction of OpenStack updates brought up one non-obvious problem with +package versions. In order to update a package the new version should be +considered higher than the previous one. Package versions are compared between +the old and the new packages and a package manager then decides if the new +package installation is an upgrade or a downgrade. The algorithm used to +compare version numbers is different for rpm and deb packages and Puppet uses +its own implementation. + +Previously we have never tried to update our OSCI packages from the previous +version and did not think about version number comparison and many packages +were named badly. + +For example: +2014.1.fuel5.0-mira4 2014.1.1.fuel5.1-mira0 +In this case most of version comparison algorithms would find 5.0 version +to be larger than 5.1. + +:: + + * Native Puppet + 2014.1.fuel5.0-mira4 > 2014.1.1.fuel5.1-mira0 + * Puppet RPMVERCMP + 2014.1.fuel5.0-mira4 < 2014.1.1.fuel5.1-mira0 + * Native RPM + 0:2014.1.fuel5.0-mira4 < 0:2014.1.1.fuel5.1-mira0 + * Native DEB + 2014.1.fuel5.0-mira4 > 2014.1.1.fuel5.1-mira0 + +This is because we have not been using correct separation between package +version and revision and these packages should have been named like this: + +:: + + 2014.1-fuel5.0.mira4 2014.1.1-fuel5.1.mira0 + * Native Puppet + 2014.1-fuel5.0.mira4 < 2014.1.1-fuel5.1.mira0 + * Puppet RPMVERCMP + 2014.1-fuel5.0.mira4 < 2014.1.1-fuel5.1.mira0 + * Native RPM + 0:2014.1-fuel5.0.mira4 < 0:2014.1.1-fuel5.1.mira0 + * Native DEB + 2014.1-fuel5.0.mira4 < 2014.1.1-fuel5.1.mira0 + +This also affect other packages not only OpenStack ones. + +:: + + 1.0.8.fuel5.0-mira0 1.0.8-fuel5.0.2.mira1 + * Native Puppet + 1.0.8.fuel5.0-mira0 > 1.0.8-fuel5.0.2.mira1 + * Puppet RPMVERCMP + 1.0.8.fuel5.0-mira0 < 1.0.8-fuel5.0.2.mira1 + * Native RPM + 0:1.0.8.fuel5.0-mira0 > 0:1.0.8-fuel5.0.2.mira1 + * Native DEB + 1.0.8.fuel5.0-mira0 > 1.0.8-fuel5.0.2.mira1 + +The most complex part of this problem is that even if we change our current +package naming to be correct one we cannot change packages already installed +and used in production. So we have raised epoch for many 5.0.2 packages to make +it possible to upgrade them from incorrectly named 5.0 packages and move to the +correct naming scheme. In Fuel 5.1 and higher we will be using only correct +naming and epoch can be removed. + +:: + + 0:1.0.8.fuel5.0-mira0 1:1.0.8-fuel5.0.2.mira1 + * Native Puppet + 0:1.0.8.fuel5.0-mira0 < 1:1.0.8-fuel5.0.2.mira1 + * Puppet RPMVERCMP + 0:1.0.8.fuel5.0-mira0 < 1:1.0.8-fuel5.0.2.mira1 + * Native RPM + 0:1.0.8.fuel5.0-mira0 < 1:1.0.8-fuel5.0.2.mira1 + * Native DEB + 0:1.0.8.fuel5.0-mira0 < 1:1.0.8-fuel5.0.2.mira1 + +As you can see, raising epoch allows us to set which version is higher +regardless its actual value. +Removing epoch from 5.1 packages makes it impossible to seamlessly upgrade +5.0 or 5.0.2 packages to 5.1 ones. It’s not really a problem because we +don’t support such upgrades anyway but if you do try to make such upgrade +manually you should remove old packages manually before installing new packages. + +* My version checkers for all algorithms: https://github.com/dmitryilyin/vercmp +* RPM naming guidelines: http://fedoraproject.org/wiki/Packaging:NamingGuidelines +* RPM comparison: http://fedoraproject.org/wiki/Archive:Tools/RPM/VersionComparison +* DEB naming guidelines and version comparison: https://www.debian.org/doc/debian-policy/ch-controlfields.html#s-f-Version diff --git a/packaging/perestroika.rst b/packaging/perestroika.rst new file mode 100644 index 000000000..6362de20c --- /dev/null +++ b/packaging/perestroika.rst @@ -0,0 +1,165 @@ +Perestroika build system +======================== + +Introduction +------------ + +Fuel 7.0 introduces a new build system called Perestroika. It uses +standard upstream Linux distribution tools in order to: + +* build packages (SBuild/Mock) +* publish packages to repositories +* manage package repositories (using reprepro/createrepo tools). + +Every package is built in a clean and up-to-date buildroot. Packages, +their dependencies, and build dependencies are fully self-contained +for each Mirantis OpenStack release. Any package included in any +release can be rebuilt at any point in time using only the packages +from that release. + +The package build CI is reproducible and can be recreated from scratch +in a repeatable way. + +Perestroika is based on Docker which provides an easy distribution. +Each supported Linux distribution contains proper Docker images with +necessary tools and scripts. + +For the advantages of Perestroika over OBS build system, see +`Replace OBS with another build system `_. + +Perestroika structure +--------------------- + +Code storage +~~~~~~~~~~~~ + +Gerrit code review system is used as a code storage. + +Gerrit projects structure: + +* Mirantis OpenStack/Fuel Master node packages: + + - code projects: *[customer-name]/openstack/{package name}* + - spec projects: *[customer-name]/openstack-build/{package name}-build* + +* Mirantis OpenStack Linux packages: + + - code/spec projects: *[customer-name]/packages/{distribution}/{packagename}* + +* Fuel Master node Linux packages (separated from Mirantis OpenStack + Linux in 7.0): + + - code/spec projects: *[customer-name]/packages/fuel/{distribution}/{package name}* + +* Versioning scheme supported by project branches: + + - OpenStack: *openstack-ci/fuel-{fuel version}/{openstack version}* + - Mirantis OpenStack Linux/Fuel Master node: *{fuel version}* + +**where** + * *customer-name* should be empty for Mirantis OpenStack projects due + to a backward compatibility with releases older than 7.0. + * supported values of the ``{distribution}`` parameter are {centos6}, + {centos7} and {trusty}. + +Scheduler +~~~~~~~~~ + +This part is based on Jenkins CI tool. All jobs are configured using +``jenkins-job-builder``. Jenkins has a separate set of jobs for each +*[customer name]+[fuel version]* case. Gerrit-trigger is configured +to track events from the *{version}* branch of all the *[customer-name]* +Gerrit projects. + +Each set of jobs contains: + +* jobs for OpenStack packages for a cluster (``.rpm`` and ``.deb``) +* jobs for Mirantis OpenStack Linux packages for a cluster (``.rpm`` + and ``.deb``) +* jobs for OpenStack packages for Fuel Master node (``.rpm``). In case + of using cluster packages, they are optional. +* jobs for non-OpenStack Fuel Master node packages (``.rpm``) +* jobs for Fuel packages (``.rpm`` and ``.deb``) +* a job for package publishing + +Build workers +~~~~~~~~~~~~~ + +These are hardware nodes with preconfigured build tools for all the +supported distributions. They are configured as Jenkins slaves. + +Each worker contains: + +* preconfigured Docker images with native build tools for each + distribution type: + + - ``mockbuild`` builds packages using Mock (CentOS 6 and 7 target + distributions are supported). + - ``sbuild`` builds packages using SBuild tool (Ubuntu Trusty + Tahr target distribution is supported only). + +* prepared minimal build chroots for all the supported distributions: + + - These chroots are updated on a daily basis in order to be up-to-date + against the upstream state. + - Chroot updating is performed by a separate Jenkins job. + - No build jobs can run on a build host while the updating Jenkins job + is running on it. + +**Building stage flow**: + +#. Checking out sources from Gerrit. +#. Preparing sources to build (creating tarball files, updating + changelogs). +#. Building sources (performed in an isolated environment inside a + Docker container). +#. Getting the build stage exit status, build logs, and built + packages. +#. Parsing and archiving build logs for Jenkins artifacts. + +Packaging CI uses short-lived Docker containers to perform package +building. Docker images contain preconfigured build tools only. There +are no chroots inside images. Build chroots are mounted to a Docker +container at start in a read-only mode. Additionally *tmpfs* partition +is mounted over a read-only chroot folder with AUFS overlays inside +a Docker container. The container is destroyed once the build stage is +completed. + +**Goals of this scheme**: + +* It can run a number of containers with the only chroot simultaneously + on the same build host. +* There is no need to perform clean-up operations after the build (all + changes matter inside the container only and will be purged after the + container is destroyed). +* *tmpfs* works much faster than disk FS/LVM snapshots. + +Publisher node +~~~~~~~~~~~~~~ + +If the build stage finishes successfully, Jenkins runs a publishing +job. The Publisher node contains all repositories for all customer +projects. It is configured as a Jenkins slave. The repositories are +maintained by native tools of their respective distribution +(reprepro or createrepo). + +The Publisher slave is fully private and available from Jenkins Master +node only because of containing a GPG key. All the packages and +repositories are signed in terms of their respective distribution by +GPG keys that are stored on the Publisher node. + +**Publishing stage**: + +#. Getting built packages from the build host (over ``scp``). +#. Checking if packages can be added to a repository (version checking + against existing packages in order to prevent downgrading). +#. Signing new packages (all ``.rpm`` and source ``.deb``) with GPG keys. +#. Removing existing and adding new packages to a repository. +#. Resigning the repository metadata. +#. Syncing new repository state to a Mirror host (over ``rsync``). + +Mirror node +~~~~~~~~~~~ + +All repositories are available through http or rsync protocols and are +synced by a Publisher to a Mirror host. \ No newline at end of file diff --git a/pages/draft/fuel-install-guide/contents-upgrade.rst b/pages/draft/fuel-install-guide/contents-upgrade.rst deleted file mode 100644 index d0450bee6..000000000 --- a/pages/draft/fuel-install-guide/contents-upgrade.rst +++ /dev/null @@ -1,7 +0,0 @@ -.. include:: /pages/draft/fuel-install-guide/upgrade-intro.rst -.. include:: /pages/draft/fuel-install-guide/upgrade-internals.rst -.. include:: /pages/draft/fuel-install-guide/upgrade-table.rst -.. include:: /pages/draft/fuel-install-guide/upgrade-local-repo.rst -.. include:: /pages/draft/fuel-install-guide/upgrade-major-versions.rst -.. include:: /pages/draft/fuel-install-guide/upgrade-apply-patches.rst -.. include:: /pages/draft/fuel-install-guide/upgrade-uninstall-plugin.rst diff --git a/pages/draft/fuel-install-guide/contents-vsphere.rst b/pages/draft/fuel-install-guide/contents-vsphere.rst deleted file mode 100644 index 1c3e8f426..000000000 --- a/pages/draft/fuel-install-guide/contents-vsphere.rst +++ /dev/null @@ -1,8 +0,0 @@ -.. include:: /pages/draft/fuel-install-guide/vsphere-intro.rst -.. include:: /pages/draft/fuel-install-guide/vsphere-upload-iso.rst -.. include:: /pages/draft/fuel-install-guide/vsphere-configure-network.rst -.. include:: /pages/draft/fuel-install-guide/vsphere-create-vm.rst -.. include:: /pages/draft/fuel-install-guide/vsphere-mount-iso.rst -.. include:: /pages/draft/fuel-install-guide/vsphere-install-master.rst -.. include:: /pages/draft/fuel-install-guide/vsphere-boot-master.rst -.. include:: /pages/draft/fuel-install-guide/vsphere-verify-master.rst diff --git a/pages/draft/fuel-install-guide/install_before_you_install_fuel.rst b/pages/draft/fuel-install-guide/install_before_you_install_fuel.rst deleted file mode 100644 index 7aea0abfe..000000000 --- a/pages/draft/fuel-install-guide/install_before_you_install_fuel.rst +++ /dev/null @@ -1,32 +0,0 @@ -.. _install_before_you_install_fuel: - -Before you install Fuel -~~~~~~~~~~~~~~~~~~~~~~~ - -Before you install Fuel, verify that you have completed the following tasks: - -#. Read and complete the tasks described in the following sections: - -* :ref:`intro_install_overview` -* :ref:`sysreq_intro` - -#. If you use bare-metal hardware, set up and connect all hardware. -#. If you use virtual hardware, configure all required virtual machines, - network, and storage parameters. -#. Select a workflow: - -* If you install Fuel on a server with an Internet connection, follow this - workflow: - -.. image:: /_images/fig/d_install_w_internet.png - :width: 70% - :align: center - -* If you install Fuel on a server without an Internet connection, you must - configure a local repository and modify the default Fuel repositories, so - that Fuel installs the operating system packages from the local - repositories. Therefore, follow this workflow: - -.. image:: /_images/fig/d_install_wo_internet.png - :width: 70% - :align: center diff --git a/pages/draft/fuel-install-guide/install_boot_slave_nodes.rst b/pages/draft/fuel-install-guide/install_boot_slave_nodes.rst deleted file mode 100644 index 4caaf2ef2..000000000 --- a/pages/draft/fuel-install-guide/install_boot_slave_nodes.rst +++ /dev/null @@ -1,65 +0,0 @@ -.. _install_boot_nodes: - - -Boot the Fuel Slave nodes -~~~~~~~~~~~~~~~~~~~~~~~~~ - -Before you boot the Fuel Slave nodes, verify that you have completed -the following tasks: - -#. :ref:`Install the Fuel Master node `. - -#. If you plan using RAID arrays, configure you RAID-attached devices first. - -#. Configure the network: - - * If you use bare-metal servers, verify that the Fuel Slave nodes are - physically connected to the same network as the Fuel Master node. - - * If you use virtual servers, verify that the Fuel Slave nodes - are bridged to the same network as the Fuel Master node. - The Fuel Master node and the Fuel Slave nodes must be in - the same L2 network segment. - -**To boot the Fuel Slave nodes:** - -#. Power on a Fuel Slave node. - -#. Boot the Fuel Slave node through PXE using one of the following options: - - * Modify the boot order in BIOS to PXE boot. - * Press the appropriate key to initiate a PXE boot. - - .. warning:: - - If the Fuel Slave node has several network interfaces, enable - the PXE boot on the interface that is on the same network - as Admin (PXE) network on the Fuel Master node. - -#. Repeat the procedure for all the Fuel Slave nodes you will use for your - OpenStack environment. - -Boot workflow of a Fuel Slave node ----------------------------------- - -The boot workflow of a Fuel Slave node does not require any user interaction. -For general understanding of the processes that take place in the system when -the Fuel Slave node is booting, get acquainted with the boot procedure: - -#. The Fuel Slave node sends out a DHCP discovery request and gets the response - from the Fuel Master node that runs the DHCP server. - -#. On receiving the response, the Fuel Slave node fetches the PXELINUX - bootloader and the bootstrap image from the Fuel Master node's TFTP - server, and boots into it. - -#. On loading the image, the Fuel Slave node reports readiness and - configuration to the Fuel Master node. - -The number of discovered Fuel Slave nodes appears in the Fuel web UI. -When all nodes boot, you can create an OpenStack environment. - -.. seealso:: - - - :ref:`create-env-ug` - diff --git a/pages/draft/fuel-install-guide/install_change_network_interface.rst b/pages/draft/fuel-install-guide/install_change_network_interface.rst deleted file mode 100644 index 188a1a1ee..000000000 --- a/pages/draft/fuel-install-guide/install_change_network_interface.rst +++ /dev/null @@ -1,79 +0,0 @@ -.. _install_change_admin_network_interface: - -Change the Admin (PXE) network interface ----------------------------------------- - -By default, Fuel assigns ``eth0`` as a network interface for the Admin (PXE) -network. If you want to use the default network settings, skip this section. - -However, some environments may require you to configure other network -interfaces for the Admin (PXE) network. If you plan to use a network interface -that is differnt from the default setting, change it before you install the -Fuel Master node. - -.. warning:: - Do not change the network interface assigned for the Admin (PXE) network - after you install the Fuel Master node. - -**To change the Admin (PXE) network interface:** - -#. In the Fuel Setup screen, select **Network Setup**. -#. Select ``eth0``. -#. Change **Enable interface** to **No**. -#. Click **Apply**. - - Fuel disables ``eth0``. - -#. Select a network interface that you want to use for Admin (PXE) network - traffic. - - For example: ``eth1``. - -#. Change **Enable interface** to **Yes**. -#. Configure network parameters for ``eth1``. - - Default network parameters are: - - * IP address: 10.20.0.2 - * Netmask: 255.255.255.0 - * Gateway: 10.20.0.1 - -#. Click **Apply**. - - Fuel will now use ``eth1`` as a network interface for the Admin (PXE) - network. - -#. In Menu, select **PXE Setup**. -#. Set the DHCP pool range and gateway. -#. Verify your configuration by clicking **Check**. -#. Proceed to :ref:`install_login_fuel_master_node`. - -.. seealso:: - - - :ref:`install_configure_a_network_interface_for_fuel_web_ui` - - -.. _install_configure_a_network_interface_for_fuel_web_ui: - -Configure a network interface for the Fuel web UI -------------------------------------------------- - -You can configure a specific network interface through which users will access -the Fuel web UI. - -**To configure a network interface for the Fuel web UI:** - -#. In the Fuel Setup screen, select **Network Setup**. -#. Select an unassigned network interface. -#. Change **Enable interface** to **Yes**. -#. Enable DHCP. -#. Verify that the IP address, netmask, and gateway fields are empty. -#. Click **Apply**. - - Fuel now uses the selected interface for the Fuel web UI. - -#. Proceed to :ref:`install_login_fuel_master_node`. - -.. seealso:: - - - :ref:`install_login_fuel_master_node_multiple_nics` diff --git a/pages/draft/fuel-install-guide/install_download_iso.rst b/pages/draft/fuel-install-guide/install_download_iso.rst deleted file mode 100644 index 6730ef306..000000000 --- a/pages/draft/fuel-install-guide/install_download_iso.rst +++ /dev/null @@ -1,20 +0,0 @@ -.. _install_download_iso: - -Download the ISO image -~~~~~~~~~~~~~~~~~~~~~~ - -The Fuel ISO image includes Fuel software components, as well as the -latest release of OpenStack which is required to create your OpenStack -environment. Therefore, if you use Fuel, you do not need to download any -additional OpenStack components. - -However, the Fuel ISO does not include the operating system packages. The Fuel -Master node dynamically downloads the packages from the configured software -repository. - -**To download the ISO image:** - -#. Go to the `Fuel project page `_. -#. Download the ISO to your computer. -#. Proceed to :ref:`install_prepare_install_media`. - diff --git a/pages/draft/fuel-install-guide/install_install_fuel.rst b/pages/draft/fuel-install-guide/install_install_fuel.rst deleted file mode 100644 index e822aef39..000000000 --- a/pages/draft/fuel-install-guide/install_install_fuel.rst +++ /dev/null @@ -1,30 +0,0 @@ -.. _install_into: - -============ -Install Fuel -============ - -This section describes how to install Fuel on virtual or -bare-metal hardware. During the installation, you deploy the Fuel Master node -on the selected hardware and boot the servers or virtual machines that are -dedicated as Fuel Slave nodes. However, you do not install an operating -system or OpenStack components on the Fuel Slave nodes just yet. After you -deploy the Fuel Master node, you create an OpenStack environment using the -Fuel web UI or Fuel CLI. The Fuel Master node provisions the dedicated Fuel -Slave nodes with the selected operating system, OpenStack or other -components and roles when you deploy an OpenStack environment. - -This section includes the following topics: - -* : ref: `install_before_you_install_fuel` -* : ref: `install_download_iso` -* : ref: `install_prepare_install_media` -* : ref: `install_install_fuel_master_node` -* : ref: `install_configure_network_params` -* : ref: `install_boot_fuel_master_node` -* : ref: `install_boot_fuel_target_node` - -If you install Fuel on VMware vSphere, see: : ref: `Installing Fuel on VMware -vSphere`. - -If you install Fuel for testing purposes, see: : ref: `Fuel QuickStart Guide`. diff --git a/pages/draft/fuel-install-guide/install_install_fuel_master_node.rst b/pages/draft/fuel-install-guide/install_install_fuel_master_node.rst deleted file mode 100644 index a4c67fa59..000000000 --- a/pages/draft/fuel-install-guide/install_install_fuel_master_node.rst +++ /dev/null @@ -1,32 +0,0 @@ -.. _install_install_fuel_master_node: - -Install the Fuel Master node -~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -Before you install the Fuel Master node, complete the steps described in -:ref:`Before you install Fuel `, -:ref:`Download the ISO image `, and -:ref:`Preparing an installation media `. - -**To install the Fuel Master node:** - -#. Insert or mount through IPMI (or using any other remote control utility - supported by your hardware) the media with the Fuel ISO on the server - that will be your Fuel Master node. - -#. Verify that the Fuel installation media is the first device in the boot - order. - -#. Power on the server. The `Welcome to Fuel Installer` screen appears. - -#. Select the installation media. If necessary, modify the boot settings by - pressing the Tab key to display the loader command line. Using this command - line, configure the IP address, default gateway, and DNS server settings of - the Fuel Master node. - -#. Proceed to :ref:`Configure network parameters `. - -.. note:: - - You can install the Fuel Master node on VMware vSphere. For more information, - see: :ref:`Before you install Fuel on VMware vSphere `. diff --git a/pages/draft/fuel-install-guide/install_intro.rst b/pages/draft/fuel-install-guide/install_intro.rst deleted file mode 100644 index 2293bb78c..000000000 --- a/pages/draft/fuel-install-guide/install_intro.rst +++ /dev/null @@ -1,19 +0,0 @@ -.. _install_intro: - -Install Fuel -============ - -You can install Fuel on bare-metal or virtual hardware. For information about -specific virtual machine and network configurations on VMware vSphere, see: -:ref:`Install Fuel on VMware vSphere `. - -This section includes the following topics: - -* :ref:`Before you install Fuel ` -* :ref:`Download the ISO image ` -* :ref:`Prepare an installation media ` -* :ref:`Install the Fuel Master node ` -* :ref:`Set up Fuel ` -* :ref:`Log in to the Fuel Master node ` -* :ref:`Log in to the Fuel Master node with multiple NICs ` -* :ref:`Boot the Fuel Slave nodes ` diff --git a/pages/draft/fuel-install-guide/install_login_fuel_master_node.rst b/pages/draft/fuel-install-guide/install_login_fuel_master_node.rst deleted file mode 100644 index abb6238c7..000000000 --- a/pages/draft/fuel-install-guide/install_login_fuel_master_node.rst +++ /dev/null @@ -1,83 +0,0 @@ -.. _install_login_fuel_master_node: - -Log in to the Fuel Master node -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -When Fuel completes the installation of the Fuel Master node, the Fuel Master -node boots automatically and the *Welcome to the Fuel server* message displays. -The message contains Fuel web UI and Fuel command-line interface default login -credentials. - -.. warning:: - - Remove the installation media before booting the system. - You may damage or delete the entire environment - by booting the installation media once again accidentally. - This is especially important if you set the boot order - so that the USB or DVD drive boots before the hard disk. - -Log in to the Fuel Master node for further configuration using one of -the following options: - -* Log in to the Fuel web UI. -* Log in to the Fuel CLI. - -You can perform most of the operations in both Fuel web UI and Fuel CLI. -However, for your convenience, we recommend that you use the Fuel web UI for -initial configuration. - -**To log in to the Fuel web UI:** - -#. In a web browser, type the IP address and port number that you have - assigned for the Fuel web UI in :ref:`Set up Fuel `. - - Fuel prompts you for the login credentials. - -#. In a web browser, enter the Fuel UI login and password that you have - set for the Fuel web UI in :ref:`Set up Fuel `. - - If you use the default network settings, use the following values: - - * IP address: ``https://10.20.0.2:8443/`` - * Fuel UI login: ``admin`` - * Fuel UI password: ``admin`` - - .. note:: - - The IP address must be reachable from the machine on which you open - the Fuel web UI URL. - - .. warning:: - - For security reasons, change the default credentials for - the administrator account. - - The Fuel web UI initial screen displays. - -#. Proceed to :ref:`Boot the Fuel Slave nodes `. - -**To log in to the Fuel CLI:** - -#. In the Fuel Master node console, type the root login and password that you - have assigned in :ref:`Set up Fuel `. - - If you use the default settings, type the following login credentials: - - * Login: ``root`` - * Password: ``r00tme`` - - You can change the password using the :command:`passwd` command after - you log in. - - .. warning:: - - For security reasons, change the default credentials for the root - account. - -#. Alternatively, connect to the Fuel Master node :ref:`using SSH `. - -#. Proceed to :ref:`Boot the Fuel Slave nodes `. - -.. seealso:: - - - :ref:`Log in to the Fuel Master node with multiple NICs ` diff --git a/pages/draft/fuel-install-guide/install_login_fuel_master_node_multiple_nics.rst b/pages/draft/fuel-install-guide/install_login_fuel_master_node_multiple_nics.rst deleted file mode 100644 index 1bb19cdfb..000000000 --- a/pages/draft/fuel-install-guide/install_login_fuel_master_node_multiple_nics.rst +++ /dev/null @@ -1,26 +0,0 @@ -.. _install_login_fuel_master_node_multiple_nics: - -Log in to the Fuel Master node with multiple NICs -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -If the server on which the Fuel Master node is installed has more than one -network interface card (NIC), you can access the Fuel web UI with a particular -NIC. - -**To access the Fuel web UI with a particular NIC:** - -#. Connect the NIC to the appropriate switch. -#. On the Fuel Master node, set an IP address for the NIC. -#. Use the IP address that you assigned to log in to the Fuel web UI. - For example: ``https://IP_YOU_ASSIGN:8443/`` - -.. note:: - - The tasks above do not change the default administrator network settings. - You can access the Fuel web UI using the URL displayed on the Fuel boot - screen. - -.. seealso:: - - - `install_login_fuel_master_node` - diff --git a/pages/draft/fuel-install-guide/install_prepare_install_media.rst b/pages/draft/fuel-install-guide/install_prepare_install_media.rst deleted file mode 100644 index e2dd7e2c2..000000000 --- a/pages/draft/fuel-install-guide/install_prepare_install_media.rst +++ /dev/null @@ -1,85 +0,0 @@ -.. _install_prepare_install_media: - -Prepare an installation media -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -After downloading the :ref:`Fuel ISO image `, you must -prepare the installation media by mounting the ISO or burning a DVD/USB -drive. - - -.. _install_create_dvd: - -Create a DVD drive ------------------- - -You can create a DVD with the Fuel ISO to install Fuel on a virtual or -bare-metal hardware. - -**To create a DVD drive:** - -#. Select from the following options: - - * For a remote installation, use a remote control utility to mount the - ISO image directly to the server's virtual DVD drive. For example: - - * `IPMItool `_ - * HP Integrated Lights Out (iLO) - * Dell iDRAC - - * For a bare-metal installation, burn the ISO image to a DVD drive using any - standard software. For example: - - - *Linux*: - - * `Xfburn `_ - * `Brasero `_ - - - *Mac OS X*: - - * Disk Utility (a commonly pre-installed application) - * `Burn `_ - - - *Windows*: - - * `ImgBurn `_ - * `InfraRecorder `_ - -#. Proceed to the - :ref:`Fuel Master node installation `. - - -.. _install_create_usb: - -Create a USB drive with the Fuel ISO on a UNIX system ------------------------------------------------------ - -After downloading the Fuel ISO image, you can use a USB flash drive to -install Fuel on your machine. - -.. note:: Write the Fuel ISO image to the USB drive itself and not to one of - its partitions, if any. For example, if you have a USB ``/dev/sdc`` with - the ``/dev/sdc1`` and ``/dev/sdc2`` partititions, write the ISO to - ``/dev/sdc``. - -**To create a USB drive on a UNIX system:** - -#. Plug in a USB drive to your machine. -#. Run the following command: - - .. code-block:: console - - # dd if=/path-to-your-ISO of=/path-to-your-USB - - **Example:** - - .. code-block:: console - - # dd if=/home/user/fuel-isos/fuel-7.0.iso of=/dev/sdc - - .. warning:: This operation wipes all the data you have - on the USB drive and places a bootable Fuel ISO - on it. - -#. Proceed to - :ref:`Install the Fuel Master node `. diff --git a/pages/draft/fuel-install-guide/install_set_up_fuel.rst b/pages/draft/fuel-install-guide/install_set_up_fuel.rst deleted file mode 100644 index 4086249f3..000000000 --- a/pages/draft/fuel-install-guide/install_set_up_fuel.rst +++ /dev/null @@ -1,125 +0,0 @@ -.. _install_set_up_fuel: - -Set up Fuel -~~~~~~~~~~~ - -During installation, Fuel prompts you to access the Fuel setup screen where you -can modify the default network and authentication parameters. - -.. image:: /_images/fig/scr_fuel_setup.png - :width: 60% - :align: center - -Typically, you want to modify network settings to meet the requirements of -your existing network infrastructure. Also, you must change the default Fuel -administrator password. Although you can change some of the network interface -settings after you install the Fuel Master node, we recommend that you -finalize network configuration before you install the Fuel Master node. - -.. warning:: - Do not modify settings of the Admin (PXE) network after you deploy the Fuel - Master node, because Fuel will lose the ability to PXE boot and manage - OpentStack environments. - -If you are installing Fuel for testing purposes, you can keep the default -settings and proceed to :ref:`install_install_fuel_master_node`. - -**To set up Fuel:** - -#. Configure the following settings as required: - - +--------------------------------------+----------------------------------+ - | 1. Change the Fuel administrator | For security purposes, we | - | password. | strongly recommend that you | - | | change the Fuel administrator | - | | password during installation. | - +--------------------------------------+----------------------------------+ - | 2. Modify the network interface | By default, Fuel assigns the | - | settings. | following network parameters to | - | | the Admin (PXE) network | - | | (``eth0``): | - | | | - | | * Subnetwork: 10.20.0.2/24 | - | | * Gateway: 10.20.0.1 | - | | | - | | Modify these settings | - | | according to the requirements of | - | | your existing network | - | | infrastructure. | - +--------------------------------------+----------------------------------+ - | 3. Configure the Admin (PXE) network | By default, Fuel configures the | - | and a DHCP pool for the Fuel Slave| Admin (PXE) network on `eth0` and| - | nodes. | configures the following DHP pool| - | | settings: | - | | | - | | * DHCP pool start: 10.20.0.3 | - | | * DHCP pool end: 10.20.0.254 | - | | * DHCP gateway: 10.20.0.2 | - | | | - | | Modify these settings as needed. | - +--------------------------------------+----------------------------------+ - | 4. Configure DNS and hostname. | Configure the DNS and hostname | - | | settings, if needed. If your Fuel| - | | Master node is not connected to | - | | the Internet, leave the External | - | | DNS field blank. | - +--------------------------------------+----------------------------------+ - | 5. Configure the bootstrap image that| Fuel ISO includes the CentOS | - | Fuel will use to discover the Fuel| bootstrap image that Fuel uses | - | Slave nodes through PXE. | to discover the Fuel Slave nodes.| - | | Although CentOS is the default | - | | and preferred option, it may not | - | | include drivers for your | - | | hardware, therefore, you may want| - | | to use the Ubuntu bootstrap image| - | | instead. | - | | | - | | Some organizations may | - | | configure the Fuel Master node in| - | | a network protected by a | - | | firewall, | - | | so that the Fuel Master node may | - | | not have an access to the | - | | Internet. In this case, you can | - | | specify a repository located in | - | | the accessible network, HTTP or | - | | HTTPS, by adding proxy | - | | parameters in the Ubuntu | - | | repository field. To configure | - | | the Ubuntu repository mirror | - | | on a local host, use the | - | | ``fuel-createmirror`` script | - | | shipped with the Fuel ISO. | - | | | - | | For more information, see: | - | | :ref :`Set up local repository`. | - +--------------------------------------+----------------------------------+ - | 6. Configure the network time | To avoid issues with the time | - | protocol. | settings inconsistency on the | - | | Fuel Master node and other | - | | servers in your IT environment, | - | | verify that the Fuel Master node | - | | uses correct NTP settings. | - +--------------------------------------+----------------------------------+ - | 7. Change the root password. | For security reasons, change the | - | | default root password. Fuel will | - | | apply this password to all new | - | | OpenStack nodes. Existing | - | | OpenStack nodes will continue to | - | | use the old password. | - +--------------------------------------+----------------------------------+ - | 8. Configure network settings using | You can configure all settings | - | shell. | available on the Fuel Setup | - | | screen using shell. | - | | Particularly, use shell to | - | | apply complex network | - | | configurations. | - +--------------------------------------+----------------------------------+ - -2. Proceed to :ref:`install_install_fuel_master_node`. - -.. seealso:: - - - :ref:`Configure a network interface for the Fuel web UI - ` - - :ref:`Change the Admin (PXE) network interface ` diff --git a/pages/draft/fuel-install-guide/intro_fuel_install_intro.rst b/pages/draft/fuel-install-guide/intro_fuel_install_intro.rst deleted file mode 100644 index e443da048..000000000 --- a/pages/draft/fuel-install-guide/intro_fuel_install_intro.rst +++ /dev/null @@ -1,19 +0,0 @@ -.. _intro_fuel_install: - -Introduction to Fuel Installation -================================= - -This section provides an overview of the Fuel installation -process. You can install Fuel on a server with an Internet connection or -on a server that is isolated from the Internet for security reasons. Depending -on your choice, the workflow differs. - -This section includes the following topics: - -* :ref:`intro_fuel` -* :ref:`intro_install_overview` -* :ref:`intro_planning` - - - - diff --git a/pages/draft/fuel-install-guide/intro_fuel_intro.rst b/pages/draft/fuel-install-guide/intro_fuel_intro.rst deleted file mode 100644 index 2dceb8024..000000000 --- a/pages/draft/fuel-install-guide/intro_fuel_intro.rst +++ /dev/null @@ -1,43 +0,0 @@ -.. _intro_fuel: - -Introduction to Fuel -~~~~~~~~~~~~~~~~~~~~ - -Fuel is an open-source software application that simplifies the deployment of -highly available OpenStack environments, as well as enables you to -manage your OpenStack environments after deployment. - -Fuel provides a web user interface (WUI), as well as a command-line user -interface (CLI) and RESTful API for provisioning, configuration, and -management of OpenStack environments. A link to the Horizon OpenStack -Dashboard appears in the Fuel web UI after you deploy an OpenStack -environment. - -Using Fuel you can: - -- Deploy multiple highly-available OpenStack environments on virtual or bare - metal hardware. - -- Configure and verify network configurations. - -- Test interoperability between the OpenStack components. - -- Easily scale your OpenStack environment by adding and removing nodes. - -Fuel architecture includes: - -* Fuel Master node - A server with the installed Fuel application that performs initial - configuration, provisioning, and PXE booting of the Fuel Slave nodes, as - well as assigning the IP addresses to the Fuel Slave nodes. - -* Fuel Slave node - In the Fuel project terminology, a generic term that describes a server that - is provisioned by the Fuel Master node. A Fuel Slave node can be a - controller, compute, or storage node, among others. These terms are - interchangeable with the OpenStack terminology. - -.. seealso:: - - - `Fuel Architecture - `_ diff --git a/pages/draft/fuel-install-guide/intro_install_overview.rst b/pages/draft/fuel-install-guide/intro_install_overview.rst deleted file mode 100644 index 8cf251226..000000000 --- a/pages/draft/fuel-install-guide/intro_install_overview.rst +++ /dev/null @@ -1,35 +0,0 @@ -.. _intro_install_overview: - -Overview of the installation process -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -Deployment of an OpenStack environment requires extensive planning. -To ensure a successful deployment, review and understand the following -requirements and sequence of tasks that you must complete. - -#. Plan your OpenStack environment according to the official OpenStack - guidelines and :ref:`Planning your environment `. - -#. Verify that your environment meets the recommendations in - :ref:`System requirements `. - -#. Verify your hardware using the - :ref:`Hardware checklist `. - -#. Determine whether the server on which you plan to install the Fuel - Master node is connected to the Internet. - - * If the server does not have an Internet - connection, then you must configure a local repository. For more - information, see: :ref:`Set up a local repository `. - -#. If you plan to install Fuel on VMware vSphere, verify that your environment - meets the :ref:`VMware vSphere prerequisites ` - -#. Download and install Fuel as described in :ref:`Install Fuel ` - or if you are installing on VMware vSphere in - :ref:`Install Fuel on VMware vSphere `. - -#. Install the Fuel plug-ins, if needed. See: :ref:`Plug-ins `. - - diff --git a/pages/draft/fuel-install-guide/intro_planning_your_environment.rst b/pages/draft/fuel-install-guide/intro_planning_your_environment.rst deleted file mode 100644 index 6ecf039a4..000000000 --- a/pages/draft/fuel-install-guide/intro_planning_your_environment.rst +++ /dev/null @@ -1,33 +0,0 @@ -.. _intro_planning: - -Planning your environment -~~~~~~~~~~~~~~~~~~~~~~~~~ - -Before you install Fuel and OpenStack, determine what type of -configuration addresses your business needs. You must understand -how OpenStack will integrate and communicate with existing components -in your IT infrastructure, as well as calculate resources required to process -estimated workloads. - -If you are testing Fuel and OpenStack in a lab environment, you can -skip the planning and deploy the default configuration. However, for a -production environment, you must decide on the following: - -* Network topology and IP address management plan -* Storage -* Number, type, and flavor of compute, controller, storage, and other nodes -* Monitoring facilities -* Additional components: Sahara and Murano -* Fuel plug-ins - -This guide explains what OpenStack configurations you can deploy using Fuel, -as well as briefly describes guidelines and examples on how to plan resources -for your environment. However, we recommend that you read `OpenStack -Architecture Design Guide `__, -so you can better estimate your network, storage, and compute requirements. - -.. seealso:: - - - :ref:`System requirements ` - - diff --git a/pages/draft/fuel-install-guide/plugins_install_plugins.rst b/pages/draft/fuel-install-guide/plugins_install_plugins.rst deleted file mode 100644 index faa11cf15..000000000 --- a/pages/draft/fuel-install-guide/plugins_install_plugins.rst +++ /dev/null @@ -1,61 +0,0 @@ -.. _plugins_install_plugins: - - -Install a Fuel plugin -~~~~~~~~~~~~~~~~~~~~~ - -The installation procedure is common for all plugins. -For more details about the plugin installation and its requirements, -see the corresponding plugin documentation. - -**To install a Fuel plugin:** - -#. Install the Fuel Master node as described in - :ref:`Install the Fuel Master node `. - -#. Boot the Fuel Master node as described in - :ref:`Log in to the Fuel Master node `. - -#. Download a plugin from `Fuel Plugins - сatalog `_. - -#. Read a Plugin Guide to learn about prerequisites and limitations. - -#. Define variables with values suitable for your environment to be used - during the plugin installation process or replace them in your command - line when appropriate. - - .. code-block:: console - - export FUEL_PLUGIN_FILE=fuel-plugin.rpm - export FUEL_MASTER_NODE=10.20.0.2 - -#. Copy the plugin to the Fuel Master node. - - .. code-block:: console - - scp ${FUEL_PLUGIN_FILE} root@:${FUEL_MASTER_NODE}:/tmp - -#. Install the plugin by typing: - - .. code-block:: console - - ssh root@:${FUEL_MASTER_NODE} "fuel plugins --install /tmp/${FUEL_PLUGIN_FILE}" - -#. Create an OpenStack environment as described in - `Create a new OpenStack environment` in the `Fuel User Guide`. - -#. After completing the Create a new OpenStack environment wizard, click - :guilabel:`Settings` in the Fuel web UI. - -#. Enable plugin in the Fuel web UI as described in the plugin documentation. - -#. Configure and deploy your environment as described in - `Configure a new environment` in the `Fuel User Guide`. - - -.. seealso:: - - - Fuel plugins CLI - - `Fuel plugins catalog - `__ diff --git a/pages/draft/fuel-install-guide/plugins_intro.rst b/pages/draft/fuel-install-guide/plugins_intro.rst deleted file mode 100644 index f5eca485c..000000000 --- a/pages/draft/fuel-install-guide/plugins_intro.rst +++ /dev/null @@ -1,15 +0,0 @@ -.. _fuel-plugins: - -Fuel Plugins -============ - -You can extend Fuel functionality by installing the plugins -that companies and individual contributors develop for Fuel. - -This section includes the following topics: - -* :ref:`Fuel plugins overview ` -* :ref:`Prerequisites ` -* :ref:`Install a Fuel plugin ` -* :ref:`View Fuel plugins ` -* :ref:`Uninstall a plugin ` diff --git a/pages/draft/fuel-install-guide/plugins_overview.rst b/pages/draft/fuel-install-guide/plugins_overview.rst deleted file mode 100644 index 1a3b312e4..000000000 --- a/pages/draft/fuel-install-guide/plugins_overview.rst +++ /dev/null @@ -1,46 +0,0 @@ -.. _plugins_overview: - -Fuel plugins overview -~~~~~~~~~~~~~~~~~~~~~ - -Fuel provides plugins that you can use to extend the functionality -of your OpenStack environment and enable Fuel to work with various -third-party components and technologies. - -Most of the Fuel plugins are developed by OpenStack community -members, as well as by companies who support OpenStack. -The Fuel plugins are distributed free of charge. - -Fuel currently has the following plugins: - -* Networking plugins - Fuel plugins such as Firewall-as-a-Service and VPN-as-a-Service, - as well as plugins that enable Fuel to work with enterprise-grade - SDN and virtual networking. - -* Operations management plugins - Enable Fuel to work with the third-party monitoring tools such as - Zabbix and Grafana. - -* Storage plugins - Extend Fuel functionality by enabling OpenStack to use enterprise-class - storage platforms as a Cinder backend. - -* Compute plugins - Extend the Fuel compute functionality. For example, the XenServer plugin - enables you to use the XenServer hypervisor as a compute provider. - -.. note:: - - You must install all Fuel plugins that you plan to use in your OpenStack - environment before you deploy your environment. You will not be able to - add plugins after deployment. - -`Fuel Plugins SDK `__ enables -you to develop virtually any plugin that you need to meet your environment -prerequisites. - - -.. seealso:: - - - `Fuel Plugins catalog `__ diff --git a/pages/draft/fuel-install-guide/plugins_prerequisites.rst b/pages/draft/fuel-install-guide/plugins_prerequisites.rst deleted file mode 100644 index 111e2dee7..000000000 --- a/pages/draft/fuel-install-guide/plugins_prerequisites.rst +++ /dev/null @@ -1,18 +0,0 @@ -.. _plugins_prerequisites: - -Prerequisites -~~~~~~~~~~~~~ - -When planning to deploy an environment with Fuel plugins, mind the -following recommendations: - -* No enviroment should be deployed before that point. If you already have - the environment you want to upgrade, read the Upgrade Fuel section first. -* Use Fuel 6.1 or later for deployment. -* Read additional requirements provided by the selected plugin. - For more information, see :ref:`plugin-dev`. - -.. seealso:: - - - `Fuel plugins catalog - `__ diff --git a/pages/draft/fuel-install-guide/plugins_uninstall_upgrade.rst b/pages/draft/fuel-install-guide/plugins_uninstall_upgrade.rst deleted file mode 100644 index 22576bf2c..000000000 --- a/pages/draft/fuel-install-guide/plugins_uninstall_upgrade.rst +++ /dev/null @@ -1,29 +0,0 @@ -.. _plugins_upgrade_uninstall_plugin: - - -Uninstall a plugin -~~~~~~~~~~~~~~~~~~ - -Fuel does not support upgrades for plugins. The old plugin versions -may not be compatible with the new version of Fuel. Therefore, you must -uninstall the Fuel plugins before upgrading Fuel. - -**To uninstall a plugin:** - -#. Log in to the Fuel Master node CLI. -#. Create an ``uninstall.sh`` script with the following content:: - - #!/bin/bash - set -eux - echo uninstall > /tmp/myplugin_uninstall - - where ``myplugin`` is the name of your plugin. - -#. Put the ``uninstall.sh`` script in your plugin folder. -#. Type:: - - fuel plugins --remove myplugin - -.. seealso:: - - - `Fuel Plugin Wiki `_ diff --git a/pages/draft/fuel-install-guide/plugins_view_plugins.rst b/pages/draft/fuel-install-guide/plugins_view_plugins.rst deleted file mode 100644 index b95783288..000000000 --- a/pages/draft/fuel-install-guide/plugins_view_plugins.rst +++ /dev/null @@ -1,25 +0,0 @@ -.. _plugins_view_plugins: - -View Fuel plugins -~~~~~~~~~~~~~~~~~ - -You can view the list of installed plugins in the Fuel Web UI, as well as in -the Fuel CLI. - -To view the list of installed plugins using the Fuel Web UI, click the -:guilabel:`Plugins` button. It is located at the top of the screen at the -Fuel level. - -You can find the following information for every plugin: - -* version -* description -* homepage -* authors -* licenses -* releases - -.. seealso:: - - - `Fuel plugins CLI ` - diff --git a/pages/draft/fuel-install-guide/preinstall_hardware_checklist.rst b/pages/draft/fuel-install-guide/preinstall_hardware_checklist.rst deleted file mode 100644 index b90c57274..000000000 --- a/pages/draft/fuel-install-guide/preinstall_hardware_checklist.rst +++ /dev/null @@ -1,63 +0,0 @@ -.. index:: Hardware configuration, confirm - -.. _preinstall_chklist_hardware_checklist: - -Hardware checklist -~~~~~~~~~~~~~~~~~~ - -Before you install the Fuel Master node, verify that you have configured your -hardware correctly. If you install Fuel on virtual hardware for testing -purposes, skip this section. - -You must configure all items from the list below before you install Fuel. - -**Hardware checklist** - -+--------------------------------------------------------+--------------+ -| Item to confirm | Status [tick | -| | if done] | -+========================================================+==============+ -| The Fuel server has an IPMI or out-of-band management | | -| system that you can access. | | -+--------------------------------------------------------+--------------+ -| The Fuel server hardware can boot the Fuel ISO | | -| from a DVD, USB flash drive, or IPMI remote media. | | -+--------------------------------------------------------+--------------+ -| The server on which you plan to install the Fuel Master| | -| node can access all nodes through the L2 management | | -| network. | | -+--------------------------------------------------------+--------------+ -| The Admin (PXE) network does not have a configured DHCP| | -| server. Fuel acts as a DHCP server for Fuel Slave | | -| nodes configured to boot using PXE. | | -+--------------------------------------------------------+--------------+ -| The Spanning Tree Protocol (STP) is disabled on switch | | -| ports connected | | -| to the node servers’ ports or the switch ports are set | | -| to the edge/portfast mode. The edge/portfast mode is | | -| the preferred configuration. It allows the ports to | | -| forward immediately when they are linked up, but | | -| listens for network loops for 15 seconds. | | -+--------------------------------------------------------+--------------+ -| The switch assigned for the Admin network does not have| | -| any tagged VLANs configured. | | -+--------------------------------------------------------+--------------+ -| The node servers are set to network boot using PXE. | | -+--------------------------------------------------------+--------------+ -| The node servers have hardware virtualization | | -| enabled in BIOS. | | -+--------------------------------------------------------+--------------+ -| You have a method to reboot node servers (remotely or | | -| on-site). | | -+--------------------------------------------------------+--------------+ -| The network equipment supports VLANs. | | -+--------------------------------------------------------+--------------+ -| Your network switches support tagged ports. | | -| You need tagged ports in order to | | -| use the nova-network VLAN Manager or Neutron with | | -| VLAN segmentation. | | -+--------------------------------------------------------+--------------+ -| You have permit rules on TCP ports 22 and 8000 on the | | -| firewall for the Fuel server’s IP address (to access | | -| the Fuel server from your PC).  | | -+--------------------------------------------------------+--------------+ diff --git a/pages/draft/fuel-install-guide/preinstall_intro.rst b/pages/draft/fuel-install-guide/preinstall_intro.rst deleted file mode 100644 index b363fd968..000000000 --- a/pages/draft/fuel-install-guide/preinstall_intro.rst +++ /dev/null @@ -1,11 +0,0 @@ -.. _preinstall_intro: - -Pre-installation checklists -=========================== - -Before you install Fuel, verify that you configured your -environment for the installation. - -This section includes the following topics: - -* :ref:`preinstall_chklist_hardware_checklist` diff --git a/pages/draft/fuel-install-guide/sysreq_fuel_master_node_hw_requirements.rst b/pages/draft/fuel-install-guide/sysreq_fuel_master_node_hw_requirements.rst deleted file mode 100644 index bb6c78194..000000000 --- a/pages/draft/fuel-install-guide/sysreq_fuel_master_node_hw_requirements.rst +++ /dev/null @@ -1,23 +0,0 @@ -.. _sysreq_master_node_hardware_recs: - -Fuel Master node hardware requirements --------------------------------------- - -When planning hardware for the Fuel Master node, verify that your hardware -meets the following minimum requirements: - -For a production environment: - -* Quad-core CPU -* 4 GB RAM -* 10 gigabit network port -* 128 GB SAS Disk -* IPMI access through an independent management network - -For a testing environment: - -* Dual-core CPU -* 2 GB RAM -* 1 gigabit network port -* 50 GB disk -* Physical console access diff --git a/pages/draft/fuel-install-guide/sysreq_fuel_master_node_network_reqs.rst b/pages/draft/fuel-install-guide/sysreq_fuel_master_node_network_reqs.rst deleted file mode 100644 index fc38417c7..000000000 --- a/pages/draft/fuel-install-guide/sysreq_fuel_master_node_network_reqs.rst +++ /dev/null @@ -1,21 +0,0 @@ -.. _sysreq_fuel_master_node_network_reqs: - -Fuel Master Node network requirements -------------------------------------- - -To deploy the Fuel Slave nodes on which you will run your Controller, -Compute, Storage or other nodes, the Fuel Master node must have access to the -Internet. - -When you deploy the Fuel Slave nodes, the Fuel Master node connects to the -preconfigured repositories through the Internet and installs the selected -operating system and the OpenStack packages on the nodes. - -For security reasons, you may not want to connect the Fuel Master node to -the Internet. In this case, set up a local repository with the required -installation packages and configure these repositories on the Fuel Master -node. - -.. seealso:: - - - :ref:`upgrade_local_repo` diff --git a/pages/draft/fuel-install-guide/sysreq_fuel_slave_node_hw_recs.rst b/pages/draft/fuel-install-guide/sysreq_fuel_slave_node_hw_recs.rst deleted file mode 100644 index b88046e1b..000000000 --- a/pages/draft/fuel-install-guide/sysreq_fuel_slave_node_hw_recs.rst +++ /dev/null @@ -1,45 +0,0 @@ -.. _sysreq_fuel_slave_node_hw_recs: - -Fuel Slave nodes hardware recommendations -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -Determining the appropriate hardware for the slave nodes depends on the node -type, the workloads that you plan to run on the nodes, and whether you combine -different OpenStack components on one node or run them separately. Typically, -you need a two-socket server with the CPU, memory, and disk space that meet -your project requirements. -Read the `OpenStack Architecture Design Guide` for recommendations on how -to plan an OpenStack deployment. - -General guidelines for the Fuel Salve nodes: - -* Controller nodes - Use at least three controller nodes for high-availability. - High-availability is recommended for all production environments. However, - you can start with a single controller node for testing purposes and add - more nodes later. The controller nodes must form a quorum. Therefore, for - all deployments, the total number of controller nodes must be odd. Further - resource scaling depends on your use case and requires extensive assessment - of your environment and business needs. - -* Compute nodes - The number and hardware configuration of the compute nodes depend on the - following: - - * Number of virtual machines - * Applications that you plan to run on these virtual machines - * Types of workloads - -* Storage nodes - The number and capacity of the storage nodes highly depend on the type of - the storage, redundancy, and workloads that you run on the compute - nodes. Therefore, the storage configuration for every deployment will - vary significantly. - -.. seealso:: - - - `OpenStack Architecture Design Guide - `__ - - `OpenStack Operations Guide - `_ - - :ref:`sysreqs_sample_target_node_config` diff --git a/pages/draft/fuel-install-guide/sysreq_hw_intro.rst b/pages/draft/fuel-install-guide/sysreq_hw_intro.rst deleted file mode 100644 index 32137e33b..000000000 --- a/pages/draft/fuel-install-guide/sysreq_hw_intro.rst +++ /dev/null @@ -1,16 +0,0 @@ -.. _sysreq_hw_intro: - -Hardware requirements -~~~~~~~~~~~~~~~~~~~~~ - -Planning hardware requirements for an OpenStack environment is a complex task -that requires analysis of the applications that you plan to run in your cloud, -as well as understanding how your cloud will expand over time. Therefore, the -hardware requirements for Fuel Slave nodes will differ for each use case. -However, hardware requirements for Fuel Master node are identical for all -deployments. - -.. seealso:: - - - :ref:`sysreq_master_node_hardware_recs` - - :ref:`sysreq_fuel_slave_node_hw_recs` diff --git a/pages/draft/fuel-install-guide/sysreq_intro.rst b/pages/draft/fuel-install-guide/sysreq_intro.rst deleted file mode 100644 index bed5d026a..000000000 --- a/pages/draft/fuel-install-guide/sysreq_intro.rst +++ /dev/null @@ -1,19 +0,0 @@ -.. _sysreq_intro: - -System requirements -=================== - -This section describes how to configure hardware nodes to -accommodate your OpenStack workloads. Since there are many possible use cases -for an OpenStack environment, the number and configurations of your servers -will also vary. While this section provides clear hardware requirements for the -Fuel Master node, it can only provide guidelines on how to configure the Fuel -Slave nodes. For reference, a sample hardware configuration of -a medium-sized OpenStack environment is described at the end of this section. - -This section includes the following topics: - -* :ref:`Hardware requirements ` -* :ref:`Network requirements ` -* :ref:`Storage requirements ` -* :ref:`Sample hardware architecture ` diff --git a/pages/draft/fuel-install-guide/sysreq_network_requirements.rst b/pages/draft/fuel-install-guide/sysreq_network_requirements.rst deleted file mode 100644 index ceff8c8bb..000000000 --- a/pages/draft/fuel-install-guide/sysreq_network_requirements.rst +++ /dev/null @@ -1,143 +0,0 @@ -.. _sysreqs_network_reqs: - -Network requirements -~~~~~~~~~~~~~~~~~~~~ - -Your OpenStack environment must have an efficient, scalable, and manageable -network infrastructure that addresses your immediate business needs and -future growth. All nodes must communicate with each other through -allocated networks. Network configuration of your Fuel Slave nodes depends -significantly on the network topology that you select. - -Fuel can deploy the following network topologies: - -* Nova-network - Nova-network is a simple network manager that provides layer 3 network - virtualization. Use nova-network only if you use VMware vCenter as - a hypervisor. To configure nova-network, you must - have at least 1 NIC on each Fuel Slave node. Capacity and number of network - interfaces depends on the workloads that you plan to run in your environment - and requires extensive planning that is out of scope for this document. - - .. note:: - Since the introduction of Neutron, nova-network development efforts - have been gradually reduced and may be deprecated in the future - OpenStack releases. Neutron is recommended in all new deployments. - - If you select nova-network, you can configure the following using Fuel: - - * Nova-network FlatDHCP Manager - Nova-network FlatDHCP Manager is the simplest network configuration that - Fuel can create. FlatDHCP Manager ensures that each virtual machine - instance is connected to the network bridge on the compute node. - FlatDHCP Manager also provides a DHCP server (`dnsmasq`) that allocates - IP addresses from the subnetwork assigned by a network administrator to - virtual machine instances. You must configure switch ports as tagged - (trunk) to use this network configuration. - - * Nova-network VLAN Manager - Nova-network VLAN Manager enables you to isolate traffic that flows - in one tenant from the traffic that flows inside other tenants by tagging - IP frames. VLAN Manager creates a network bridge, a VLAN, and a - subnetwork for each tenant. Use this option if you plan to have - multiple tenants in your environment. Configure switch ports as tagged. - -* Neutron - Neutron is a flexible network manager that enables you to create - complex network configurations. Neutron provides both level 2 and 3 network - virtualization, as well as IP address management (IPAM). In addition, - Neutron has multiple open-source and enterprise-class plugins that enable - interoperability with such networking technologies as virtual switches and - software defined networking (SDN). - - If you select Neutron, you can configure the following using Fuel: - - * Neutron with VLAN segmentation - Similar to nova-network VLAN Manager, in Neutron's VLAN segmentation - topology a VLAN is assigned to each tenant. IP subnets and ranges in - different tenants can overlap. This is the default networking option - in Fuel. The disadvantage of this option is that you must configure your - networking equipment, as well as provide the total number of tenants, - before configuring the network. - - If you select Neutron with VLAN segmentation, you must have at least 3 - network interfaces (NICs). - - **Neutron with VLAN segmentation examples:** - - +----------+------------------------+-------------------------+ - | | 3 NICs | 4 NICs | - +----------+------------------------+-------------------------+ - | eth0 | Untagged port for | Port for Administrative | - | | Administrative network | network | - +----------+------------------------+-------------------------+ - | eth1 | Port for the following | Port for the following | - | (br-eth1)| networks: | networks: | - | | | | - | | * Public/Floating | * Public/Floating | - | | * Management | * Management | - | | * Storage | | - +----------+------------------------+-------------------------+ - | eth2 | Port for Private | Port for Private network| - | (br-eth2)| network. The number of | with defined VLAN ID | - | | VLANs depends on the | range | - | | number of tenant | | - | | networks with a | | - | | continuous range. | | - +----------+------------------------+-------------------------+ - | eth3 | N/A | Port for Storage | - | (br-eth3)| | network | - +----------+------------------------+-------------------------+ - - * Neutron with tunneling segmentation - You can choose between VXLAN and GRE segmentation, with VXLAN being a - default and preferred option. In both VXLAN and GRE segmentations, - tenant traffic is isolated by encapsulation the traffic in tunnels. - Both VXLAN and GRE segmentation is more flexible in terms of the number - of tenants (supports up to 65534 tenants). Network hardware configuration - is significantly simpler compared to the VLAN segmentation and does not - need to be synchronized with your L2 switch configuration. Both VXLAN - and GRE support subnet overlapping in different tenants. However, the - disadvantage of using GRE segmentation is that GRE encapsulation - decreases the network speed between the instances, as well as increases - the CPU usage on the compute and controller nodes. - - .. note:: - To use VXLAN segmentation, your network hardware must support VXLAN - segmentation. - - You can configure GRE segmentation using CLI. For more information, see: - `Fuel CLI Reference`. - - **Neutron with GRE segmentation examples:** - - +----------+-------------------+-------------------+---------------------+ - | | 2 NICs | 3 NICs | 4 NICs | - +----------+-------------------+-------------------+---------------------+ - | eth0 | Untagged port for | Untagged port for | Untagged port for | - | | Administrative | Administrative | Administrative | - | | network | network | network | - +----------+-------------------+-------------------+---------------------+ - | eth1 | Port for the | Port for the | Port for Management | - | (br-eth1)| following | following | network | - | | networks: | networks: | | - | | | | | - | | * Public/Floating | * Public/Floating | | - | | * Management | * Management | | - | | * Storage | | | - +----------+-------------------+-------------------+---------------------+ - | eth2 | N/A | Port for Storage | Port for Public/ | - | (br-eth2)| | network | Floating network | - +----------+-------------------+-------------------+---------------------+ - | eth3 | N/A | N/A | Port for Storage | - | (br-eth3)| | | network | - +----------+-------------------+-------------------+---------------------+ - - Routing recommendations: - - * Public network: use the default routing through the router. - * Management network: use management network to access your management - infrastructure (L3 connectivity, if necessary). - * Administrative network or only Fuel Master node: must have the Internet - access through a dedicated NIC. - * Storage and Private networks (VLANs): isolate from other networks. diff --git a/pages/draft/fuel-install-guide/sysreq_sample_configuration.rst b/pages/draft/fuel-install-guide/sysreq_sample_configuration.rst deleted file mode 100644 index 2173cbeef..000000000 --- a/pages/draft/fuel-install-guide/sysreq_sample_configuration.rst +++ /dev/null @@ -1,40 +0,0 @@ -.. _sysreqs_sample_target_node_config: - -Sample hardware configuration for Fuel Slave nodes -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -The example provided in this section is a general-purpose medium-size -hardware configuration that you can use for a variety of OpenStack -installations and later moderately scale to accommodate -growing requirements of your environment. - -.. note:: - This example is not a best practice document of how to design an - OpenStack environment. The purpose of the example is to help - OpenStack administrators to understand how to plan an installation - and demonstrate how an OpenStack environment may look. - -The sample OpenStack environment includes: - -+--------------------------+-----------------------------+ -| Number of servers | 12 | -| | The servers include: | -| | | -| | * 1 Fuel Master node | -| | * 3 Controller nodes | -| | * 3 Storage nodes | -| | * 5 Compute nodes | -+--------------------------+-----------------------------+ -| Network | Neutron, using VLAN or GRE | -| | topology | -+--------------------------+-----------------------------+ -| Storage | Ceph as back end for Cinder | -| | Glance and Nova (ephemeral | -| | storage) | -+--------------------------+-----------------------------+ -| Additional Components | No additional components. | -| | If you want to install | -| | Ceilometer with the MongoDB | -| | database, you must add three| -| | more servers. | -+--------------------------+-----------------------------+ diff --git a/pages/draft/fuel-install-guide/sysreq_sample_configuration_compute.rst b/pages/draft/fuel-install-guide/sysreq_sample_configuration_compute.rst deleted file mode 100644 index f267c48c0..000000000 --- a/pages/draft/fuel-install-guide/sysreq_sample_configuration_compute.rst +++ /dev/null @@ -1,24 +0,0 @@ -.. _sysreqs_sample_target_node_config_compute: - -Compute nodes -------------- - -Your virtual machines are hosted on the compute nodes; therefore, -you must allocate enough resources to run these virtual machines. - -Each compute node must include: - -+---------------+----------------------------------+ -| CPU | Dual-socket CPU with a minimum | -| | of 4 cores per socket | -+---------------+----------------------------------+ -| RAM | 64 GB | -+---------------+----------------------------------+ -| Storage | Hardware RAID 1 controller with | -| | at least 500 GB capacity for | -| | the host operating system disk | -+---------------+----------------------------------+ -| Network | * For testing: 2 x 1 Gbit/s NICs | -| | * For production: 2 x 10 Gbit/s | -| | NICs | -+---------------+----------------------------------+ diff --git a/pages/draft/fuel-install-guide/sysreq_sample_configuration_controllers.rst b/pages/draft/fuel-install-guide/sysreq_sample_configuration_controllers.rst deleted file mode 100644 index 59a1aad1f..000000000 --- a/pages/draft/fuel-install-guide/sysreq_sample_configuration_controllers.rst +++ /dev/null @@ -1,34 +0,0 @@ -.. _sysreqs_sample_target_node_config_controller: - -Controller nodes ----------------- - -In this example, we use Ceph as a back end for ephemeral storage. -Therefore, in addition to the basic OpenStack components and a MySQL database, -controller nodes require sufficient resources to run Ceph monitors. - -Each controller node must include: - -+--------------+-----------------------------------+ -| CPU | 2 CPUs with at least six physical | -| | cores each | -+--------------+-----------------------------------+ -| RAM | * For testing: 2 GB | -| | * For production: | -| | | -| | * 24 GB (minimum) | -| | * 64 GB for deployments of | -| | 1000 VMs or more | -+--------------+-----------------------------------+ -| Network | * For testing: 2 x 1 Gbit/s NICs | -| | * For production: 2 x 10 Gbit/s | -| | NICs | -+--------------+-----------------------------------+ -| Storage | Hardware RAID 1 with at least 1 TB| -| | formatted capacity for the host | -| | host operating system disk | -| | | -| | Larger disks may be warranted | -| | depending on the expected database| -| | and log storage requirements. | -+--------------+-----------------------------------+ diff --git a/pages/draft/fuel-install-guide/sysreq_sample_configuration_storage.rst b/pages/draft/fuel-install-guide/sysreq_sample_configuration_storage.rst deleted file mode 100644 index 5ad8fc57e..000000000 --- a/pages/draft/fuel-install-guide/sysreq_sample_configuration_storage.rst +++ /dev/null @@ -1,38 +0,0 @@ -.. _sysreqs_sample_target_node_config_storage: - -Storage nodes -------------- - -We recommend that you separate Ceph nodes for scalability and robustness. -The hardware estimate provided below is based on the requirement of 0.5 cores -per Ceph-OSD CPU and 1 GB of RAM per 1 TB of Ceph-OSD space. You can configure -all Ceph storage and journal hard disks in JBOD (Just a Bunch of Disks) mode -on the RAID controller or plug them directly to the available SATA or SAS ports -on the mainboard. - -Each storage node must include: - -+------------------------+---------------------------------+ -| CPU | Single-socket CPU with at least | -| | 4 physical cores | -+------------------------+---------------------------------+ -| RAM | 24 GB | -+------------------------+---------------------------------+ -| Storage | RAID 1 controller with at least | -| | 500 GB capacity for the host | -| | operating system disk | -| | | -| | For production installations, | -| | set the Ceph object replication | -| | factor to 3 or greater. | -+------------------------+---------------------------------+ -| Network | * For testing: 2 x 1 Gbit/s NICs| -| | * For production: 2 x 10 Gbit/s | -| | NICs | -+------------------------+---------------------------------+ -| Storage | * 18 TB for Ceph storage | -| | (6 x 3 TB) | -| | * 1-2 x 64 GB SSDs or more, for | -| | the Ceph journal | -+------------------------+---------------------------------+ - diff --git a/pages/draft/fuel-install-guide/sysreq_storage_reqs.rst b/pages/draft/fuel-install-guide/sysreq_storage_reqs.rst deleted file mode 100644 index 4726035b9..000000000 --- a/pages/draft/fuel-install-guide/sysreq_storage_reqs.rst +++ /dev/null @@ -1,37 +0,0 @@ -.. _sysreq_storge_reqs: - -Storage requirements -~~~~~~~~~~~~~~~~~~~~ - -When planning storage for your OpenStack environment, understand the -difference between the two types of storage that OpenStack uses: -persistent and ephemeral. - -The nova-compute service manages ephemeral storage that is used as temporary -storage for the operating system of virtual machine instances. When you -delete an instance, nova-compute deletes the ephemeral storage as well. -If you do not select any additional storage options, the virtual machine -volumes will be stored on the local disks of the compute nodes, in the -virtual storage partition. However, if you enable Ceph RBD back end for -ephemeral volumes, nova-compute stores virtual machine volumes in Ceph. - -Persistent storage is the storage that exists outside an instance, in contrast -to ephemeral storage. - -Fuel deploys storage for the following types of persistent data: - -* Glance, for image data, which can use either Swift or Ceph RBD as a - storage back end. -* Cinder, for block data, which can use either LVM or Ceph RBD as a - storage back end. -* Ceph RadosGW, for object storage, with Ceph RBD as storage back end. - -.. note:: - Fuel plugins may provide additional storage options. For more information, - see the - `OpenStack Driverlog for the Fuel project `_. - -.. seealso:: - - - `Storage Decisions - `_ diff --git a/pages/draft/fuel-install-guide/upgrade-apply-patches.rst b/pages/draft/fuel-install-guide/upgrade-apply-patches.rst deleted file mode 100644 index d1641273c..000000000 --- a/pages/draft/fuel-install-guide/upgrade-apply-patches.rst +++ /dev/null @@ -1,183 +0,0 @@ -.. _upgrade_apply_patches: - -Apply patches -~~~~~~~~~~~~~ - -You can apply only the patches you need one by one or you can -apply all accumulated patches in one go. - -**Apply a patch:** - -The documentation for each patch item is available in the - `Maintenance Update section `_. - -.. note:: Maintenance Updates are only available online. Currently - there is no option to run these updates from a local - repository. - -Check each patch item and proceed with the instructions. - -**To patch the Fuel Master node:** - -#. Log in to the Fuel Master node. - - * If you use a local repository, update it by typing:: - - fuel-createmirror -M - -#. Run the command specified in the documentation to download and install the patch. - -**To patch a Fuel Slave node:** - -#. Run the command specified in the documentation to download and - install the patch. - -**Apply all accumulated changes in one go:** - -Before starting the update, back up all sensitive data that -can be changed during the the whole lifetime of your environment -and the Fuel Master node. We recommend to apply the updates to one -node at a time, so that you can interrupt the update procedure whenever -an issue occurs. - -If you have configured any custom repositories, Fuel will use fetch -the upgrade packages from these repositories. - -.. note:: - This set of actions should be applied carefully and with - consideration. It is strongly recommended that you do this on your - test staging environment before applying the updates to production. - -Patch the Fuel Master node --------------------------- - -#. Back up your data with dockerctl backup. This will save the data - to ``/var/backup/fuel/``. -#. Run ``yum update``. -#. Run ``dockerctl destroy all``. -#. Run ``dockerctl start all``. -#. Wait for the new containers deployment to finish. - -Patch an Ubuntu slave node --------------------------- - -#. Run ``apt-get update``. -#. Run ``apt-get upgrade``. -#. Apply all the additional configuration options as described in the - supporting documentation. -#. Reboot the node. - -Apply Puppet changes on a slave node ------------------------------------- - -You may want to apply all changes on a slave node or run a single -granular task so that Fuel Puppet changes take effect. - -**To run a complete Puppet cycle on a Fuel Slave node:** - -#. Update fuel-libraryX.X on Fuel Master ``yum update`` -#. Run ``fuel node --node NODE_ID --deploy`` - -**To update Puppet manifests and apply a single task:** - -#. Update fuel-libraryX.X on Fuel Master ``yum update`` -#. Run ``fuel node --node node-XX --task rsync_core_puppet hiera globals TASK`` - -.. note:: - The tasks rsync_core_puppet, hiera, and globals are required for - processing any Puppet changes. - -**Verify a patch:** - -Verify a patch on the Fuel Master node --------------------------------------- - -To verify the packages on the Fuel Master node: - -#. Log in to the Fuel Master node CLI. -#. Type: - -:: - - yum clean expire-cache - yum -y update - -Verify a patch on a Fuel slave node ------------------------------------ - -To verify the packages are up-to-date on the Fuel Slave nodes: - -#. Log in to the Fuel Master node CLI. -#. Update the list of available packages:: - - apt-get update - -#. Update all packages:: - - apt-get dist-upgrade - -#. Log in to the Fuel Master node GUI: -#. Click :guilabel:`Support`. -#. Generate and download a diagnostic snapshot by clicking - :guilabel:`Generate Diagnostic Snapshot`. - - The Fuel Master node generates ``ubuntu_installed_debs.txt``. - -#. Analyze ``ubuntu_installed_debs.txt`` to verify the versions of the packages. - - Additionally, you can analyze the ``ubuntu_repo_list.txt`` file to verify - the repositories. - -**Roll back a patch:** - -.. note:: - The rollback instructions listed here are for advanced administrators. - If you are not sure how to plan and execute the rollbacks, - your best option is to contact `Mirantis support `__. - -Roll back the Fuel Master node ------------------------------- - -#. Roll back the packages on the Fuel Master node. - `Refer to this article `__ as an example. -#. Roll back all the changes to the configuration you made when applying - the patching instructions. -#. Run ``dockerctl destroy all``. -#. Run ``dockerctl start all``. -#. Wait for bootstrap to complete. - -Roll back an Ubuntu slave node ------------------------------- - -You must identify the packages to roll back and where to get -their specific versions, install the packages and roll back the -changes to the configuration. - -**To roll back an Ubuntu slave node:** - -#. Evacuate all the running resources from the node. -#. Make sure no new workloads are scheduled to the node: Put nova - services in maintenance, turn on Pacemaker maintenance mode. -#. Look up the packages you want to roll back in ``/var/log/apt/history.log`` - and ``/var/log/dpkg.log``. -#. Figure out where to get the old package version. Run ``apt-cache policy``. -#. Figure out if the old package version is available locally. -#. If it is, install these versions using dpkg. Otherwise, check the - snapshots of previous repositories on - `http://mirror.fuel-infra.org/mos/snapshots` and pick the - repository that contains the packages you need. -#. Add this repository to the environment configuration. -#. On the Fuel Master node run:: - - fuel node --node-id \ - --tasks upload_core_repos - - This will propagate the new repos configuration. - -#. Install the packages with specific versions:: - - apt-get install = = - -#. Roll back all the changes to the configuration you made when applying - the patching instructions. -#. Reboot the node. diff --git a/pages/draft/fuel-install-guide/upgrade-fuel-master.rst b/pages/draft/fuel-install-guide/upgrade-fuel-master.rst deleted file mode 100644 index fcd2aee34..000000000 --- a/pages/draft/fuel-install-guide/upgrade-fuel-master.rst +++ /dev/null @@ -1,37 +0,0 @@ -.. _upgrade_fuel_master: - -Upgrade the Fuel Master node -~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -The following procedure upgrades the Fuel software -that runs on the Fuel Master node. - -**To upgrade the Fuel Master node:** - -#. Verify there are no installations in progress in the environment. - -#. Download the upgrade tarball by going to - https://www.fuel-infra.org/#fuelget. Click :guilabel:`UPG.TORRENT`. - -#. Put the downloaded file to a location on the Fuel Master Node - that has at least 2 GB of free space for the archive, - and additional 6 GB on the partition where it will be unpacked. - -#. Extract the tarball contents:: - - cd /var/tmp # Use the directory where the tarball is located - lrzuntar filename.tar.lrz - -#. Run the upgrade script from that same directory. - -#. Provide the Fuel administrator (*admin* user) password:: - - ./upgrade.sh --password - - The upgrade process can take 30-60 minutes. - -#. Proceed to :ref:`upgrade_prepare_master`. - -.. seealso:: - - - :ref:`upgrade_prerequisites` diff --git a/pages/draft/fuel-install-guide/upgrade-internals.rst b/pages/draft/fuel-install-guide/upgrade-internals.rst deleted file mode 100644 index bde7bb663..000000000 --- a/pages/draft/fuel-install-guide/upgrade-internals.rst +++ /dev/null @@ -1,35 +0,0 @@ - -.. _upgrade-internals: - -Overview of the Fuel upgrade process -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -The upgrade is implemented with three upgrade engines, which are python -modules: - -* **Host system engine:** - - #. Copies new repositories to Fuel Master node. - #. Installs a package and all the required dependencies such as - Puppet manifests, bootstrap images, provisioning images etc. - -* **Docker engine:** - - #. Points the supervisor to a new directory with the configuration - files. No containers are started by the supervisor at this time. - #. Stops old containers. - #. Uploads new Docker images. - #. Runs containers one by one. - #. Generates new supervisor configuration files. - #. Verifies the services running in the containers. - -* **OpenStack engine:** - - #. Installs all data required for OpenStack patching. - #. Adds new releases using the :ref:`nailgun-term` REST API. - This allows the full list of OpenStack releases to be displayed - in the Fuel web UI. - -.. seealso:: - - - :ref:`upgrade-table` diff --git a/pages/draft/fuel-install-guide/upgrade-intro.rst b/pages/draft/fuel-install-guide/upgrade-intro.rst deleted file mode 100644 index 284993cbe..000000000 --- a/pages/draft/fuel-install-guide/upgrade-intro.rst +++ /dev/null @@ -1,29 +0,0 @@ -.. _upgrade_intro: - -Upgrade Fuel -============ - -If you are running Fuel 6.x, you can upgrade the Fuel Master node to -the latest Fuel version. - -There are two possible scenarios: - -* With an Internet connection -- a regular Fuel upgrade process. See: - - * :ref:`upgrade_prerequisites`. - -* Without an Internet connection -- first create a local repository, - then run a regular Fuel upgrade process from the created local - repository. See: - - * :ref:`upgrade_local_repo`. - * :ref:`upgrade_prerequisites`. - -.. note:: Fuel does not support upgrades for plugins. The old plugin - versions may not be compatible with the new version of Fuel. - Therefore, you must uninstall the Fuel plugins before - upgrading Fuel. See :ref:`plugins_upgrade_uninstall_plugin`. - -.. seealso:: - - - :ref:`upgrade-internals` diff --git a/pages/draft/fuel-install-guide/upgrade-local-repo.rst b/pages/draft/fuel-install-guide/upgrade-local-repo.rst deleted file mode 100644 index bc5e11fda..000000000 --- a/pages/draft/fuel-install-guide/upgrade-local-repo.rst +++ /dev/null @@ -1,77 +0,0 @@ -.. _upgrade_local_repo: - -Set up a local repository -~~~~~~~~~~~~~~~~~~~~~~~~~ - -Fuel downloads the OpenStack and operating system packages -from the predefined repositories on the Fuel Master node. -If your Fuel Master node does not have an Internet connection, -you must configure a local repository mirror with the required -packages and configure Fuel to use this repository. - -You can set up a local repository in the Fuel web UI -or through Fuel CLI using the ``fuel-createmirror`` script. - -**To set up a local repository in the Fuel web UI** - -#. In the Fuel web UI, navigate to the :guilabel:`Settings` tab - and then scroll down to the :guilabel:`Repositories` section. -#. Change the path under :guilabel:`URI`. - -**To set up a local repository with the ``fuel-createmirror`` script** - -#. Log in to the Fuel Master node CLI. -#. Run the ``fuel-createmirror`` script: - - * If you use the default Fuel root password, type: - - :: - - fuel-createmirror - - * If you change the default Fuel root password, type: - - :: - - fuel-createmirror --password PASSWORD - -#. Restart the the docker daemon - - :: - - service docker restart - - Alternatively (recommended), reboot the Fuel Master node. - -About the fuel-createmirror script ----------------------------------- - -The ``fuel-createmirror`` is a built-in Fuel script that enables -you to modify the Fuel repository sources from the CLI. - -* The script supports only RSYNC mirrors. - See the `the list of official upstream Ubuntu mirrors `_. - -* The script uses a Docker container with Ubuntu to support dependencies - resolution. - -* To view help information, type ``fuel-createmirror -h``. - -* The script supports running behind an HTTP proxy configured to - Port 873 (rsync). The following environment variables can be set either - system-wide (via ~/.bashrc), or in the script configuration file: - - :: - - http_proxy=http://username:password@host:port/ - RSYNC_PROXY=username:password@host:port - -* You can also configure Docker to use the proxy to download the Ubuntu - image needed to resolve the packages dependencies. Add the environment - variables to the `/etc/sysconfig/docker` file, and export them: - - :: - - http_proxy=http://username:password@host:port/ - RSYNC_PROXY=username:password@host:port - export http_proxy RYSNC_PROXY diff --git a/pages/draft/fuel-install-guide/upgrade-major-versions.rst b/pages/draft/fuel-install-guide/upgrade-major-versions.rst deleted file mode 100644 index 915f12d56..000000000 --- a/pages/draft/fuel-install-guide/upgrade-major-versions.rst +++ /dev/null @@ -1,227 +0,0 @@ -.. _upgrade_prerequisites: - -Prerequisites -~~~~~~~~~~~~~ - -There are the following prerequisite steps that you need to go through -before running the actual upgrade: - -#. Verify if your environment version is upgradeable. See :ref:`upgrade-table`. -#. Verify that your environment meets all following prerequisites: - - +----------------------------------------------------+------------------+ - | Constraint | Check if comply | - +====================================================+==================+ - | High Availability architecture | | - +----------------------------------------------------+------------------+ - | Ubuntu 14.04 as an operating system | | - +----------------------------------------------------+------------------+ - | Neutron networking manager with OVS+VLAN plugin | | - +----------------------------------------------------+------------------+ - | Cinder virtual block storage volumes | | - +----------------------------------------------------+------------------+ - | Ceph shared storage for volumes and ephemeral data | | - +----------------------------------------------------+------------------+ - | Ceph shared storage for images and objeсt storage | | - +----------------------------------------------------+------------------+ - -#. Select the environment that complies with the above prerequisites - and assign its ID to the ``ORIG_ID`` variable: - - #. On the Fuel Master node, type: - - :: - - fuel env - - #. Select the environment ID from the list. - #. Assign the environment ID to the ``ORIG_ID`` variable: - - :: - - export ORIG_ID= - -#. Upgrade the Fuel Master node. - See :ref:`Upgrade the Fuel Master node `. - -#. Proceed to :ref:`upgrade_prepare_master`. - -.. note:: During the upgrade, virtual machines and other resources - might experience temporary network disconnects. Schedule - the upgrade during a maintenance window. - -.. _upgrade_prepare_master: - -Prepare the Fuel Master node -~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -The upgrade preparation is automated with the script named ``octane``. -You need to download this script from the RPM repository and install it -on your Fuel Master node. - -**To download and install the script:** - -#. Install the ``octane`` script using ``yum`` package manager:: - - yum install -y fuel-octane - -Alternatively, you can use the Git version control system to install -the script from the source code that resides in the upstream repository. - -**To install the script from the repository:** - -#. Log in to the Fuel Master node CLI. -#. Install dependenecy packages using ``yum install``:: - - yum install -y git patch python-pip python-paramiko - -#. Clone the ``fuel-octane`` repository:: - - git clone https://git.openstack.org/openstack/fuel-octane -b stable/7.0 - -#. Change the current directory to ``fuel-octane``. - -#. Install the upgrade script:: - - cd fuel-octane && pip install -e ./ - -Clone environment settings -~~~~~~~~~~~~~~~~~~~~~~~~~~ - -You need to create a new Fuel 7.0 environment and copy the network and -settings parameters to the new environment. - -**To clone the environment settings:** - -#. Clone the environment settings by typing:: - - octane upgrade-env ${ORIG_ID} - - where ORIG_ID is the ID of the environment that you assigned at the - :ref:`upgrade_prerequisites` step. - -#. Running the ``octane upgrade-env ${ORIG_ID}`` command will display - the ID of the new Fuel 7.0 environment. - -#. Export this new ID into a variable:: - - export SEED_ID= - - where is the new Fuel 7.0 environment ID. - -Upgrade the Controller node -~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -You must deploy the Controller node with the following modifications: - -#. Disable checking access to the default gateway in Public network. -#. Skip adding physical interfaces to Linux bridges. -#. Skip creation of the 'default' Fuel-defined networks in Neutron. -#. Change default gateway addresses to the address of the Fuel Master node. - -**To upgrade the Controller node:** - -#. To run the Controller node upgrade, type:: - - octane upgrade-node ${SEED_ID} --isolated - - where is the ID of the node that you can get by issuing - the ``fuel nodes`` command. - -Upgrade the databases -~~~~~~~~~~~~~~~~~~~~~ - -To upgrade the databases, put the environment in :ref:`Maintenance Mode `. - -**To upgrade the databases:** - -#. Upgrade the state databases of the OpenStack services by typing: - - :: - - octane upgrade-db ${ORIG_ID} ${SEED_ID} - -Upgrade Ceph cluster -~~~~~~~~~~~~~~~~~~~~ - -To upgrade the Ceph cluster, you need to run the ``octane`` command -that will complete the following: - -#. Copy the configuration files, keyrings, and state directories - from the original environment to the new one. -#. Restore the cluster identity using the Ceph management tools. - -**To upgrade the Ceph cluster:** - -#. Run the following command: - - :: - - octane upgrade-ceph ${ORIG_ID} ${SEED_ID} - -Upgrade the Control Plane -~~~~~~~~~~~~~~~~~~~~~~~~~ - -Before upgrading the Control plane, verify that you have completed the -following tasks: - -- Clone the environment settings -- Deployed the Controller node in the new environment -- Upgraded the databases -- Upgraded the Ceph cluster - -**To upgrade the Control Plane:** - -Run the following command:: - - octane upgrade-control ${ORIG_ID} ${SEED_ID} - -This command switches the services from the original environment to the new -one and swaps the Controller connections to the Management and External -networks. - -Upgrade hypervisor host -~~~~~~~~~~~~~~~~~~~~~~~ - -To upgrade the hypervisor host, you need to run the ``octane`` command -that will complete the following tasks: - -#. Add the node to the new environment. -#. Provision the node. -#. Deploy the node. -#. Move the virtual machines to the node in the new environment - using live migration. - -**To upgrade the hypervisor host:** - -#. Log in to the Fuel Master node. -#. Type:: - - octane upgrade-node ${SEED_ID} ${NODE_ID} - -Upgrade Ceph OSD node -~~~~~~~~~~~~~~~~~~~~~ - -#. Log in to the Fuel Master node. -#. Type:: - - octane upgrade-node ${SEED_ID} ${NODE_ID} - -This command redeploys the Ceph OSD nodes with the original dataset. - -Complete the upgrade -~~~~~~~~~~~~~~~~~~~~ - -To complete the upgrade, you must delete the original environment. - -**To delete the original environment:** - -.. warning:: - - The following operation may cause data loss if your upgrade - operation was not completed successfully. Proceed with caution. - -#. Log in to the Fuel Master node. -#. Type:: - - fuel env --env $ORIG_ID --delete diff --git a/pages/draft/fuel-install-guide/upgrade-table.rst b/pages/draft/fuel-install-guide/upgrade-table.rst deleted file mode 100644 index 1642fe32b..000000000 --- a/pages/draft/fuel-install-guide/upgrade-table.rst +++ /dev/null @@ -1,76 +0,0 @@ - -.. _upgrade-table: - -Fuel upgrade table -~~~~~~~~~~~~~~~~~~ - -* If you are running Fuel 4.x or earlier, you cannot upgrade to 7.0. -* If you are running Fuel 5.x, you cannot upgrade *directly* to 7.0. - You will need to upgrade from 5.x to 6.x first, and then you can - upgrade to 7.0. -* If you are running Fuel 6.x, you can upgrade to Fuel 7.0. - -The following table summarizes the available progressions -for upgrades of the Fuel Master node: - -+----------------------+------------------------+--------------------------+ -| Initial Fuel version | Fuel is upgraded to | Upgraded Fuel can manage | -+======================+========================+==========================+ -| 5.0 | 5.1, then to 5.1.1, | 2014.1-5.0 | -| | then to 6.0 | | -| | | 2014.1.1-5.0.2 | -| | | | -| | | 2014.1.1-5.1 | -| | | | -| | | 2014.1.3-5.1.1 | -| | | | -| | | 2014.2-6.0 | -+----------------------+------------------------+--------------------------+ -| 5.0 | 5.0.1, then to 5.1, | 2014.1-5.0 | -| | | | -| | then to 5.1.1 | 2014.1.1-5.0.1 | -| | | | -| | then to 6.0 | 2014.1.1-5.0.2 | -| | | | -| | | 2014.1.1-5.1 | -| | | | -| | | 2014.1.3-5.1.1 | -| | | | -| | | 2014.2-6.0 | -+----------------------+------------------------+--------------------------+ -| 5.0.1 | 5.1, then to 5.1.1 | 2014.1.1-5.0.1 | -| | | | -| | then to 6.0 | 2014.1.1-5.0.2 | -| | | | -| | | 2014.1.1-5.1 | -| | | | -| | | 2014.1.3-5.1.1 | -| | | | -| | | 2014.2-6.0 | -+----------------------+------------------------+--------------------------+ -| 5.1 | 5.1.1, then to 6.0 | 2014.1.1-5.1 | -| | | | -| | | 2014.1.3-5.1.1 | -| | | | -| | | 2014.2-6.0 | -+----------------------+------------------------+--------------------------+ -| 6.0 | 6.1, then apply all 6.1| 2014.2.6.0 | -| | updates, then to 7.0 | 2014.2.2-6.1 | -| | | 2015.x-7.0 | -| | | | -| | | | -| | | | -+----------------------+------------------------+--------------------------+ -| 6.1 | Apply all 6.1 updates, | 2014.2-6.0 | -| | then to 7.0 | 2014.2.2-6.1 | -| | | 2015.x-7.0 | -+----------------------+------------------------+--------------------------+ - -.. note:: - - * Fuel 7.0 can only deploy 7.0 environments. - - * Fuel 7.0 can manage environments deployed with Fuel 6.x provided that - the Fuel Master node was upgraded to 7.0 rather than freshly installed. - You can always check environment versions that you can manage on the - "Releases" tab of your Fuel web UI. diff --git a/pages/draft/fuel-install-guide/vsphere-boot-master.rst b/pages/draft/fuel-install-guide/vsphere-boot-master.rst deleted file mode 100644 index aa21ec77d..000000000 --- a/pages/draft/fuel-install-guide/vsphere-boot-master.rst +++ /dev/null @@ -1,15 +0,0 @@ -.. _vsphere_boot_master: - -Boot the Fuel Master node -~~~~~~~~~~~~~~~~~~~~~~~~~ - -#. When the Mirantis ISO boot menu appears, press the **Tab** key - on the keyboard and modify the last kernel parameter ``showmenu`` - to ``yes``. Press **Enter**. -#. Wait for the Fuel Master node installation to complete. - -To access the Fuel Web UI, your browser must have an access -to the Fuel Master node through the IP gateway that is connected -to the Port Group network that you configured in :ref:. - -Proceed to :ref:`vsphere_verify_master`. diff --git a/pages/draft/fuel-install-guide/vsphere-configure-network.rst b/pages/draft/fuel-install-guide/vsphere-configure-network.rst deleted file mode 100644 index d97f2e393..000000000 --- a/pages/draft/fuel-install-guide/vsphere-configure-network.rst +++ /dev/null @@ -1,39 +0,0 @@ -.. _vsphere_configure_network: - -Configure networks -~~~~~~~~~~~~~~~~~~ - -To enable inter-node communication, you must configure networks on -VMware vCenter. - -Configure a network for Fuel Admin (PXE) traffic ------------------------------------------------- - -You must configure a network for the Fuel Admin (PXE) traffic -and enable Promiscuous mode. - -**To configure a network for the Fuel Admin (PXE) traffic:** - -#. Go to the vCenter screen. -#. Choose **Hosts**. -#. Select the host on which you want to run the Fuel Master node. -#. Click the **Networking** button. -#. Click the **Add Host Networking** icon. - -Create a vCenter Port Group network ------------------------------------ - -You must create a Port Group with Promiscuous mode. - -**To create a vCenter Port Group network:** - -#. Choose a Port Group connection type. -#. Choose a switch. -#. Name your network and set the VLAN number. This is optional - and depends on your underlying network infrastructure. -#. After the network is created, select the network on the network map; - then click the **Edit Settings** icon. -#. Click **Security**. -#. Verify that the **Promiscuous mode** is set to **Accept**. -#. Click "OK". -#. Proceed to :ref:`vsphere_create_vm`. diff --git a/pages/draft/fuel-install-guide/vsphere-create-vm.rst b/pages/draft/fuel-install-guide/vsphere-create-vm.rst deleted file mode 100644 index 4d76a5f6b..000000000 --- a/pages/draft/fuel-install-guide/vsphere-create-vm.rst +++ /dev/null @@ -1,20 +0,0 @@ -.. _vsphere_create_vm: - -Create the Fuel Master node virtual machine -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -You need to create a new virtual machine with a guest -operating system to run the Fuel Master node on it. - -**To create the Fuel Master node virtual machine:** - -#. On the vCenter screen choose **Virtual Machines**. -#. Click **Create a Virtual Machine**. -#. Click **Create a new virtual machine**. - Do not use templates. -#. Name your new VM and choose the datacenter where the Mirantis ISO - is located. -#. Select a compute resource (ESXi host), storage, and compatibility - for the VM. -#. Select a guest operating system. -#. Proceed to: :ref:`vsphere_mount_iso`. diff --git a/pages/draft/fuel-install-guide/vsphere-install-master.rst b/pages/draft/fuel-install-guide/vsphere-install-master.rst deleted file mode 100644 index 4c12e4bc4..000000000 --- a/pages/draft/fuel-install-guide/vsphere-install-master.rst +++ /dev/null @@ -1,20 +0,0 @@ -.. _vsphere_install_master: - -Install the Fuel Master node on VMware vSphere -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ -You need to install the Fuel Master node on the created -virtual machine. - -**To install the Fuel Master node on VMware vSphere:** - -#. At the Virtual Machines screen, select the Fuel VM and run it - by clicking the **Power on** icon. -#. Click the **Open a virtual machine console** icon. -#. When the BIOS appears, use the arrow keys on your keyboard - to navigate to the **Boot** tab. Then move the highlighted selection - to the **CD-ROM drive**. -#. Using the **+** button on the keyboard, move the **CD-ROM Drive** item - to the top level. -#. Navigate to the **Exit** tab, choose **Exit Saving Changes**, - and confirm your decision. -#. Proceed to :ref:`vsphere_boot_master`. diff --git a/pages/draft/fuel-install-guide/vsphere-intro.rst b/pages/draft/fuel-install-guide/vsphere-intro.rst deleted file mode 100644 index 0a2d695cd..000000000 --- a/pages/draft/fuel-install-guide/vsphere-intro.rst +++ /dev/null @@ -1,50 +0,0 @@ -.. _vsphere_intro: - -Install Fuel on VMware vSphere -============================== - -This section describes how to configure your VMware vSphere environment -to install Fuel. - -VMware vSphere prerequisites -~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -Before you install Fuel and use your Mirantis OpenStack environment -in intergration with vSphere, you must configure all components -of VMware vSphere. - -Complete the following steps: - -* Install ESXi. -* Install vCenter. -* Configure vCenter. -* Create Datacenter. -* Create vCenter cluster. -* Add ESXi hosts to clusters in vCenter. - -For more information, see the VMware vSphere documentation. - -Configure ESXi host networking -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -To integrate Mirantis OpenStack with VMware vCenter, -you must configure the VMware ESXi host networking. - -**To configure ESXi host networking**: - -#. In VMware vSphere web-client open the ESXi host page. -#. Select **Manage** > **Networking**. -#. Click **Add network**. - The **Add networking** wizard starts. -#. In the **Add Networking** wizard, select the Virtual Machine Port - group. -#. Select the **Virtual Machine Port Group** option - to ensure that the network is created in vSwitch0. -#. Create a network called **br100**. - -.. note:: - You must name the network ``br100``. Otherwise, Fuel will not - be able to communicate with VMware vSphere. - -#. In the VLAN ID field, type a VLAN Tag. -#. Proceed to :ref:`vsphere_upload_iso`. diff --git a/pages/draft/fuel-install-guide/vsphere-mount-iso.rst b/pages/draft/fuel-install-guide/vsphere-mount-iso.rst deleted file mode 100644 index c69cbcfda..000000000 --- a/pages/draft/fuel-install-guide/vsphere-mount-iso.rst +++ /dev/null @@ -1,20 +0,0 @@ -.. _vsphere_mount_iso: - -Mount the Fuel ISO -~~~~~~~~~~~~~~~~~~ - -You must mount the Fuel ISO to install the Fuel Master node -on the virtual machine. - -**To mount the Fuel ISO:** - -#. For the CD/DVD drive, choose **Datastore ISO File** from - the dropdown menu on the right. -#. Navigate through the datastore and choose the ISO you uploaded earlier. -#. Enable the CD/DVD drive by clicking the **Connect...** checkbox - opposite the drive. -#. Go to the **VM Options** tab and expand the **Boot Options** submenu. -#. Enable the "Force BIOS setup" item. -#. Click **Next**. -#. Verify the new Virtual Machine settings and proceed. -#. Proceed to :ref:`vsphere_install_master`. diff --git a/pages/draft/fuel-install-guide/vsphere-upload-iso.rst b/pages/draft/fuel-install-guide/vsphere-upload-iso.rst deleted file mode 100644 index 1e6eea460..000000000 --- a/pages/draft/fuel-install-guide/vsphere-upload-iso.rst +++ /dev/null @@ -1,17 +0,0 @@ -.. _vsphere_upload_iso: - -Upload the Fuel ISO to the VMware vSphere datastore -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -You need to download the `Fuel ISO `_ -and upload it do a vSphere datastore. - -**To upload the Fuel ISO to the VMware vSphere datastore:** - -#. Log into the vSphere web client. -#. Click **vCenter**. -#. Go to the Datastores and choose your datastore. -#. Go to the Actions menu and select **Browse Files**. -#. Click the **Upload Files** icon, browse your filesystem, - and select your Mirantis ISO. -#. Proceed to :ref:`vsphere_configure_network`. diff --git a/pages/draft/fuel-install-guide/vsphere-verify-master.rst b/pages/draft/fuel-install-guide/vsphere-verify-master.rst deleted file mode 100644 index b0b0bd922..000000000 --- a/pages/draft/fuel-install-guide/vsphere-verify-master.rst +++ /dev/null @@ -1,20 +0,0 @@ -.. _vsphere_verify_master: - -Verify the Fuel Master node operation -~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -You need to verify that the Fuel Master node operates correctly. - -**To verify the Fuel Master node operation:** - -#. Create a new VM on the same ESXi host. -#. Boot the created VM via PXE. - -If the boot is successful, -the "Total nodes" at the top right of the Fuel Web UI will increase -its value after two to five minutes. - -**To verify that the Fuel bootstrap node runs on ESXi:** - -#. Open the node information window in the Fuel Web UI. -#. Verify that the **Manufacturer** field says **VMWARE**. diff --git a/pages/draft/fuel-user-guide/README.txt b/pages/draft/fuel-user-guide/README.txt deleted file mode 100644 index 82f13647e..000000000 --- a/pages/draft/fuel-user-guide/README.txt +++ /dev/null @@ -1 +0,0 @@ -This directory contains the files for the Fuel User Guide. diff --git a/pages/draft/mos-planning-guide/README.txt b/pages/draft/mos-planning-guide/README.txt deleted file mode 100644 index 0d3c8d98c..000000000 --- a/pages/draft/mos-planning-guide/README.txt +++ /dev/null @@ -1,2 +0,0 @@ -This directory contains the files for the Planning Your OpenStack Environment -document. \ No newline at end of file diff --git a/pages/draft/mos-planning-guide/plugins_validation.rst b/pages/draft/mos-planning-guide/plugins_validation.rst deleted file mode 100644 index d9c9b3b72..000000000 --- a/pages/draft/mos-planning-guide/plugins_validation.rst +++ /dev/null @@ -1,19 +0,0 @@ -.. _plugins_validation: - -Plugins Validation -~~~~~~~~~~~~~~~~~~ - -Validation is the process that the Mirantis Partner Enablement team uses -to ensure the provided plugin can be used with Mirantis OpenStack. - -.. seealso:: - - - `Fuel Plugin validation`_ - - `Fuel Plugins SDK`_ - - `Fuel Plugins catalog - `__ - -.. links -.. _`Fuel Plugins SDK`: https://wiki.openstack.org/wiki/Fuel/Plugins -.. _`Fuel Plugin validation`: https://www.mirantis.com/partners/become-mirantis-unlocked-partner/fuel-plugin-development/fuel-plugin-validation/ - diff --git a/pages/file-ref/0000-intro.rst b/pages/file-ref/0000-intro.rst deleted file mode 100644 index d2fc1bb91..000000000 --- a/pages/file-ref/0000-intro.rst +++ /dev/null @@ -1,59 +0,0 @@ - -.. raw:: pdf - - PageBreak - -.. _file-reference: - -Fuel File Reference Pages -========================= - -This section provides reference pages -for select configuration files that Fuel uses. - -.. warning:: Be very careful when modifying the configuration files. - A simple typo when editing these files - may severely damage your environment. - - When you modify the YAML files, - you will receive a warning - that some attributes were modified from the outside. - Some features may become inaccessible - from the UI after you do this. - -These pages are under development; -the information presented here has been reviewed -but may not be complete. - -+-------------------------------+-------------+-------------------------------+ -| File | Node | Description | -+===============================+=============+===============================+ -| :ref:`astute-yaml-master-ref` | Fuel Master | Configuration attributes | -| | | passed to :ref:`puppet-term` | -+-------------------------------+-------------+-------------------------------+ -| :ref:`astute-yaml-target-ref` | Target | Configuration attributes | -| | | passed to Puppet | -+-------------------------------+-------------+-------------------------------+ -| :ref:`engine-yaml-ref` | Fuel Master | Provisioning engine (Cobbler) | -| | | and basic configuration of | -| | | target nodes | -+-------------------------------+-------------+-------------------------------+ -| :ref:`network-1-yaml-ref` | Fuel Master | Network Groups | -+-------------------------------+-------------+-------------------------------+ -| :ref:`openstack-yaml-ref` | Fuel Master | Basic configuration of target | -| | | nodes | -+-------------------------------+-------------+-------------------------------+ -| :ref:`settings-yaml-ref` | Fuel Master | Information from "Settings" | -| | | tab on UI | -+-------------------------------+-------------+-------------------------------+ -| | | | -+-------------------------------+-------------+-------------------------------+ - -.. include:: /pages/file-ref/astute-yaml-master.rst -.. include:: /pages/file-ref/astute-yaml-target.rst -.. include:: /pages/file-ref/engine-yaml.rst -.. include:: /pages/file-ref/network-1-yaml.rst -.. include:: /pages/file-ref/openstack-yaml.rst -.. include:: /pages/file-ref/settings-yaml.rst - - diff --git a/pages/file-ref/README.md b/pages/file-ref/README.md deleted file mode 100644 index 2359a8deb..000000000 --- a/pages/file-ref/README.md +++ /dev/null @@ -1,14 +0,0 @@ -This directory contains reference pages for files that -Fuel uses to deploy an environment. - -To add a page, copy the appropriate template file and -modify the content: - -- docker-template: template for files that are accessed - using dockerctl - -- fuel-env-template: template for files that are accessed - using fuel --env - -Then add an include line for the file at the bottom of the -0000-intro.rst file. diff --git a/pages/file-ref/astute-yaml-master.rst b/pages/file-ref/astute-yaml-master.rst deleted file mode 100644 index 95af53df2..000000000 --- a/pages/file-ref/astute-yaml-master.rst +++ /dev/null @@ -1,29 +0,0 @@ - -.. raw:: pdf - - PageBreak - - -.. _astute-yaml-master-ref: - -astute.yaml ------------ - -Fuel Master Node: -**/etc/fuel/astute.yaml** - -Fuel uses the *astute.yaml* file to pass configuration attributes -to :ref:`puppet`. - -Usage -~~~~~ - -The */etc/fuel/astute.yaml* file is installed -on the Fuel Master node -and must not be deleted. - - -File Format -~~~~~~~~~~~ - -The *xxx.yaml* file diff --git a/pages/file-ref/astute-yaml-target.rst b/pages/file-ref/astute-yaml-target.rst deleted file mode 100644 index f34b92672..000000000 --- a/pages/file-ref/astute-yaml-target.rst +++ /dev/null @@ -1,711 +0,0 @@ - -.. raw:: pdf - - PageBreak - - -.. _astute-yaml-target-ref: - -astute.yaml -- Target nodes ---------------------------- - -Target Nodes: -**/etc/astute.yaml** - -Fuel uses the *astute.yaml* file to pass configuration attributes -to :ref:`Puppet`. - -Usage -~~~~~ - -The */etc/astute.yaml* file is placed -on each target node when it is deployed -by **mcollective** and must not be deleted. -Facter extension reads data from this file -and uses it to create the `$::fuel_settings` data structure. -This structure contains all variables as a single hash -and supports embedding of other rich structures -such as nodes hash or arrays. - - -File Format -~~~~~~~~~~~ - -The *astute.yaml* file - -Basic networking configuration -++++++++++++++++++++++++++++++ - -:: - - libvirt_type: qemu - disable_offload: true - network_scheme: - roles: - management: br-mgmt - private: br-prv - fw-admin: br-fw-admin - storage: br-storage - provider: ovs - version: "1.0" - interfaces: - eth4: - L2: - vlan_splinters: "off" - eth3: - L2: - vlan_splinters: "off" - eth2: - L2: - vlan_splinters: "off" - eth1: - L2: - vlan_splinters: "off" - eth0: - L2: - vlan_splinters: "off" - endpoints: - br-prv: - IP: none - br-mgmt: - other_nets: [] - - IP: - - 10.108.22.6/24 - br-storage: - other_nets: [] - - IP: - - 10.108.24.5/24 - br-fw-admin: - other_nets: - - 10.108.20.0/24 - IP: - - 10.108.20.7/24 - default_gateway: true - gateway: 10.108.20.2 - transformations: - - action: add-br - name: br-eth0 - - bridge: br-eth0 - action: add-port - name: eth0 - - action: add-br - name: br-eth1 - - bridge: br-eth1 - action: add-port - name: eth1 - - action: add-br - name: br-eth2 - - bridge: br-eth2 - action: add-port - name: eth2 - - action: add-br - name: br-eth3 - - bridge: br-eth3 - action: add-port - name: eth3 - - action: add-br - name: br-eth4 - - bridge: br-eth4 - action: add-port - name: eth4 - - action: add-br - name: br-mgmt - - action: add-br - name: br-storage - - action: add-br - name: br-fw-admin - - trunks: - - 0 - action: add-patch - bridges: - - br-eth4 - - br-storage - - trunks: - - 0 - action: add-patch - bridges: - - br-eth2 - - br-mgmt - - trunks: - - 0 - action: add-patch - bridges: - - br-eth0 - - br-fw-admin - - action: add-br - name: br-prv - - action: add-patch - bridges: - - br-eth3 - - br-prv - -Nova configuration -++++++++++++++++++ - -:: - - nova: - db_password: Ns08DOge - state_path: /var/lib/nova - user_password: z8sJBhvw - -Swift configuration -+++++++++++++++++++ - -:: - - swift: - user_password: Li9DPL0d - -mp configuration -++++++++++++++++ - -:: - - mp: - - point: "1" - weight: "1" - - point: "2" - weight: "2" - -Glance configuration -++++++++++++++++++++ - -:: - - glance: - db_password: DgVvco7J - image_cache_max_size: "5368709120" - user_password: sRX4ksp6 - role: primary-mongo - deployment_mode: ha_compact - -Mellanox configuration -++++++++++++++++++++++ - -:: - - neutron_mellanox: - plugin: disabled - metadata: - label: Mellanox Neutron components - enabled: true - toggleable: false - weight: 50 - vf_num: "16" - mongo: - enabled: false - auth_key: "" - -NTP configuration -+++++++++++++++++ - -:: - - external_ntp: - ntp_list: 0.pool.ntp.org, 1.pool.ntp.org - metadata: - label: Upstream NTP - weight: 100 - -Zabbix configuration -++++++++++++++++++++ - -:: - - zabbix: - db_password: 7hQFiVYa - db_root_password: xB33AjUw - password: zabbix - metadata: - label: Zabbix Access - restrictions: - - condition: not ('experimental' in version:feature_groups) - action: hide - weight: 70 - username: admin - -Definition of puppet tasks -++++++++++++++++++++++++++ - -:: - - tasks: - - type: puppet - priority: 100 - parameters: - puppet_modules: /etc/puppet/modules - cwd: / - timeout: 3600 - puppet_manifest: /etc/puppet/manifests/site.pp - uids: - - "12" - auto_assign_floating_ip: false - -.. _astute-ceilometer-config-ref: - -Ceilometer configuration -++++++++++++++++++++++++ - -:: - - ceilometer: - db_password: ReBB1hdT - metering_secret: jzHL7r76 - enabled: true - user_password: p0JVzpHv - -Public networking configuration -+++++++++++++++++++++++++++++++ - -:: - - public_vip: 10.108.21.2 - public_network_assignment: - assign_to_all_nodes: false - metadata: - label: Public network assignment - restrictions: - - condition: cluster:net_provider != 'neutron' - action: hide - weight: 50 - -Heat configuration -++++++++++++++++++ - -:: - - heat: - db_password: Vv6vslci - enabled: true - rabbit_password: TOYQuiwH - auth_encryption_key: 3775079699142c1bcd7bd8b814648b01 - user_password: s54JsapR - -Fuel version -++++++++++++ - -:: - - fuel_version: "6.1" - -NSX configuration -+++++++++++++++++ - -:: - - nsx_plugin: - nsx_password: "" - nsx_username: admin - packages_url: "" - l3_gw_service_uuid: "" - transport_zone_uuid: "" - connector_type: stt - metadata: - label: VMware NSX - enabled: false - restrictions: - - condition: cluster:net_provider != 'neutron' or networking_parameters:net_l23_provider != 'nsx' - action: hide - weight: 20 - replication_mode: true - nsx_controllers: "" - -Controller nodes configuration -++++++++++++++++++++++++++++++ - -:: - - nodes: - - role: primary-controller - internal_netmask: 255.255.255.0 - storage_netmask: 255.255.255.0 - internal_address: 10.108.22.3 - uid: "9" - swift_zone: "9" - public_netmask: 255.255.255.0 - public_address: 10.108.21.3 - name: node-9 - storage_address: 10.108.24.2 - fqdn: node-9.test.domain.local - - role: controller - internal_netmask: 255.255.255.0 - storage_netmask: 255.255.255.0 - internal_address: 10.108.22.4 - uid: "10" - swift_zone: "10" - public_netmask: 255.255.255.0 - public_address: 10.108.21.4 - name: node-10 - storage_address: 10.108.24.3 - fqdn: node-10.test.domain.local - - role: controller - internal_netmask: 255.255.255.0 - storage_netmask: 255.255.255.0 - internal_address: 10.108.22.5 - uid: "11" - swift_zone: "11" - public_netmask: 255.255.255.0 - public_address: 10.108.21.5 - name: node-11 - storage_address: 10.108.24.4 - fqdn: node-11.test.domain.local - -.. _astute-mongodb-nodes-ref: - - -MongoDB nodes configuration -+++++++++++++++++++++++++++ - -Each OpenStack environment that uses :ref:`Ceilometer` -and :ref:`MongoDB` -must have a definition for each MongoDB node -in the *astute.yaml* file; -one node is designated the `primary-mongo` node -and all other nodes have just `mongo` specified for the role. -Ideally, you should have one MongoDB node for each -:ref:`Controller` node in the environment. - -You can use the Fuel Web UI to deploy -as many MongoDB nodes as you like -when you initially create your environment. -You must edit this file and use command line tools -to add MongoDB nodes to a deployed environment; -see :ref:`add-mongodb-ops` for instructions. - -The configuration for the primary MongoDB node is: - -:: - - - role: primary-mongo - internal_netmask: 255.255.255.0 - storage_netmask: 255.255.255.0 - internal_address: 10.108.22.6 - uid: "12" - swift_zone: "12" - name: node-12 - storage_address: 10.108.24.5 - fqdn: node-12.test.domain.local - -The fields are: - -:internal_netmask: Netmask used for the Internal - :ref:`logical network`. - -:storage_netmask: Netmask used for the Storage logical network. - -:internal_address: - -:uid: - -:swift_zone: - -:name: - -:storage_address: - -:fqdn: - -The configuration for each non-primary MongoDB node: -has the same fields. -The *astute.yaml* file includes one section like this -for each configured MongoDB node: - -:: - - - role: mongo - internal_netmask: 255.255.255.0 - storage_netmask: 255.255.255.0 - internal_address: 10.108.22.7 - uid: "13" - swift_zone: "13" - name: node-13 - storage_address: 10.108.24.6 - fqdn: node-13.test.domain.local - -Sahara configuration -++++++++++++++++++++ - -:: - - sahara: - db_password: 0VDkceJQ - enabled: false - user_password: 4zs7JZaY - deployment_id: 9 - -Provisioning configuration -++++++++++++++++++++++++++ - -:: - - provision: - method: cobbler - metadata: - label: Provision - restrictions: - - condition: not ('experimental' in version:feature_groups) - action: hide - weight: 80 - image_data: - /: - uri: http://10.108.20.2:8080/targetimages/ubuntu_1204_amd64.img.gz - format: ext4 - container: gzip - /boot: - uri: http://10.108.20.2:8080/targetimages/ubuntu_1204_amd64-boot.img.gz - format: ext2 - container: gzip - nova_quota: false - uid: "12" - repo_metadata: - 2014.2-6.0: http://10.108.20.2:8080/2014.2-6.0/ubuntu/x86_64 precise main - -Storage configuration -+++++++++++++++++++++ - -:: - - storage: - objects_ceph: false - pg_num: 128 - vc_user: "" - iser: false - images_ceph: false - ephemeral_ceph: false - vc_datastore: "" - vc_password: "" - osd_pool_size: "2" - volumes_vmdk: false - metadata: - label: Storage - weight: 60 - vc_host: "" - volumes_lvm: true - images_vcenter: false - vc_image_dir: /openstack_glance - volumes_ceph: false - vc_datacenter: "" - -Keystone configuration -++++++++++++++++++++++ - -:: - - keystone: - db_password: rwTdR4Vd - admin_token: YXauBQbY - priority: 200 - -Cinder configuration -++++++++++++++++++++ - -:: - - cinder: - db_password: fv85YGzr - user_password: cIVtXdbp - -Corosync configuration -++++++++++++++++++++++ - -:: - - corosync: - group: 226.94.1.1 - verified: false - metadata: - label: Corosync - restrictions: - - condition: "true" - action: hide - weight: 50 - port: "12000" - -Miscellaneous configs to look at later -++++++++++++++++++++++++++++++++++++++ - -:: - - management_vip: 10.108.22.2 - test_vm_image: - img_path: /usr/share/cirros-testvm/cirros-x86_64-disk.img - img_name: TestVM - min_ram: 64 - public: "true" - glance_properties: "--property murano_image_info='{\"title\": \"Murano Demo\", \"type\": \"cirros.demo\"}'" - os_name: cirros - disk_format: qcow2 - container_format: bare - quantum: true - cobbler: - profile: ubuntu_1204_x86_64 - status: discover - management_network_range: 10.108.22.0/24 - fail_if_error: true - puppet_modules_source: rsync://10.108.20.2:/puppet/2014.2-6.0/modules/ - master_ip: 10.108.20.2 - puppet_manifests_source: rsync://10.108.20.2:/puppet/2014.2-6.0/manifests/ - resume_guests_state_on_host_boot: true - -Syslog configuration -++++++++++++++++++++ - -:: - - syslog: - syslog_transport: tcp - syslog_port: "514" - metadata: - label: Syslog - weight: 50 - syslog_server: "" - debug: false - online: true - metadata: - label: Common - weight: 30 - access: - email: admin@localhost - user: admin - password: admin - metadata: - label: Access - weight: 10 - tenant: admin - openstack_version_prev: - use_cow_images: true - last_controller: node-11 - kernel_params: - kernel: console=ttyS0,9600 console=tty0 rootdelay=90 nomodeset - metadata: - label: Kernel parameters - weight: 40 - mysql: - wsrep_password: 6JoYdvoz - root_password: ZtwW8gk8 - external_dns: - dns_list: 8.8.8.8, 8.8.4.4 - metadata: - label: Upstream DNS - weight: 90 - rabbit: - password: GGcZVT4f - compute_scheduler_driver: nova.scheduler.filter_scheduler.FilterScheduler - openstack_version: 2014.2-6.0 - -External MongoDB configuration -++++++++++++++++++++++++++++++ - -:: - - external_mongo: - mongo_replset: "" - mongo_password: ceilometer - mongo_user: ceilometer - metadata: - label: External MongoDB - restrictions: - - condition: settings:additional_components.mongo.value == false - action: hide - weight: 20 - hosts_ip: "" - mongo_db_name: ceilometer - -Murano configuration -++++++++++++++++++++ - -:: - - murano: - db_password: 0PVsOHo9 - enabled: false - rabbit_password: FGjWVooK - user_password: crpWYkaY - -More miscellaneous configs -++++++++++++++++++++++++++ - -:: - - quantum_settings: - database: - passwd: yOL94I9n - L3: - use_namespaces: true - L2: - phys_nets: - physnet2: - vlan_range: 1000:1030 - bridge: br-prv - base_mac: fa:16:3e:00:00:00 - segmentation_type: vlan - predefined_networks: - net04_ext: - L2: - segment_id: - network_type: local - router_ext: true - physnet: - L3: - floating: 10.108.21.11:10.108.21.20 - subnet: 10.108.21.0/24 - enable_dhcp: false - gateway: 10.108.21.1 - nameservers: [] - - tenant: admin - shared: false - net04: - L2: - segment_id: - network_type: vlan - router_ext: false - physnet: physnet2 - L3: - floating: - subnet: 192.168.111.0/24 - enable_dhcp: true - gateway: 192.168.111.1 - nameservers: - - 8.8.4.4 - - 8.8.8.8 - tenant: admin - shared: false - keystone: - admin_password: gqWPu2Vg - metadata: - metadata_proxy_shared_secret: qoEcTup3 - fqdn: node-12.test.domain.local - storage_network_range: 10.108.24.0/24 - -vCenter configuration -+++++++++++++++++++++ - -:: - - vcenter: - datastore_regex: "" - host_ip: "" - vc_user: "" - vlan_interface: "" - vc_password: "" - cluster: "" - metadata: - label: vCenter - restrictions: - - condition: settings:common.libvirt_type.value != 'vcenter' - action: hide - weight: 20 - use_vcenter: true - -Syslog configuration -++++++++++++++++++++ - -:: - - base_syslog: - syslog_port: "514" - syslog_server: 10.108.20.2 diff --git a/pages/file-ref/docker-template b/pages/file-ref/docker-template deleted file mode 100644 index 733fb63f5..000000000 --- a/pages/file-ref/docker-template +++ /dev/null @@ -1,54 +0,0 @@ - -.. raw:: pdf - - PageBreak - - -.. _xxx-ref: - -xxx.yaml --------- - -Fuel Master Node: -**/usr/lib/python2.6/site-packages/nailgun/fixtures* - -The *xxx.yaml* file defines -the basic configuration of the target nodes -that Fuel deploys for the OpenStack environment. -Initially, it contains Fuel defaults; -these are adjusted in response to configuration choices -the user makes through the Fuel UI -and then fed to :ref:`Nailgun`. - -Usage -~~~~~ - -#. Log into the nailgun :ref:`docker-term` container: - :: - - dockerctl shell nailgun - -#. Edit file. - -#. Run the following commands to Nailgun - to reread its settings and restart: - :: - - manage.py dropdb && manage.py syncdb && manage.py loaddefault - killall nailgund - - -#. Exit the Nailgun docker container: - :: - - exit - -#. Run the following commands to Nailgun - to sync deployment tasks: - :: - - fuel rel --sync-deployment-tasks --dir /etc/puppet - -File Format -~~~~~~~~~~~ - diff --git a/pages/file-ref/engine-yaml.rst b/pages/file-ref/engine-yaml.rst deleted file mode 100644 index a536db20c..000000000 --- a/pages/file-ref/engine-yaml.rst +++ /dev/null @@ -1,49 +0,0 @@ - -.. raw:: pdf - - PageBreak - - -.. _engine-yaml-ref: - -engine.yaml ------------ - -Fuel Master Node: -**/root/provisioning_1** - -The *engine.yaml* file defines -the basic configuration of the target nodes -that Fuel deploys for the OpenStack environment. -Initially, it contains Fuel defaults; -these are adjusted in response to configuration choices -the user makes through the Fuel UI -and then fed to :ref:`Nailgun`. - -Usage -~~~~~ - -#. Dump provisioning information using this - :ref:`fuel CLI` command:: - - fuel --env 1 provisioning default - - where ``--env 1`` should be set to the specific environment - (id=1 in this example). - - -#. Edit file. - - -#. Upload the modified file: - :: - - fuel --env-1 provisioning upload - - -Description -~~~~~~~~~~~ - -The *engine.yaml* file defines the provisioning engine -being used (:ref:`cobbler-term` by default) -along with the password and URLs used to access it. diff --git a/pages/file-ref/fuel-env-template b/pages/file-ref/fuel-env-template deleted file mode 100644 index 973d97047..000000000 --- a/pages/file-ref/fuel-env-template +++ /dev/null @@ -1,41 +0,0 @@ - -.. raw:: pdf - - PageBreak - - -.. _xxx-ref: - -xxx.yaml --------- - -Fuel Master Node: -**yyy** - -The *xxx.yaml* file - -Usage ------ - -#. Dump provisioning information using this - :ref:`fuel CLI` command:: - - fuel --env 1 provisioning default - - where ``--env 1`` points to the specific environment - (id=1 in this example). - - -#. Edit file. - - -#. Upload the modified file: - :: - - fuel --env-1 provisioning upload - - -File Format -~~~~~~~~~~~ - -The *xxx.yaml* file diff --git a/pages/file-ref/network-1-yaml.rst b/pages/file-ref/network-1-yaml.rst deleted file mode 100644 index 32a2b7014..000000000 --- a/pages/file-ref/network-1-yaml.rst +++ /dev/null @@ -1,166 +0,0 @@ - -.. raw:: pdf - - PageBreak - - -.. _network-1-yaml-ref: - -network_1.yaml --------------- - -Fuel Master Node: -**/root/network_1.yaml** - -The *network_1.yaml* file contains the network configuration information -for the environment. - -To implement :ref:`Multiple Cluster Networks`, -follow the instructions in :ref:`mcn-ops` -to create additional Node Groups, -then download this file and configure the new Network Group(s). - -Usage -~~~~~ - -#. Dump network information using this - :ref:`fuel CLI` command:: - - fuel --env 1 network --download - - where ``--env 1`` points to the specific environment - (id=1 in this example). - - -#. Edit file and add information about the new Network Group(s). - - -#. Upload the modified file: - :: - - fuel --env-1 network --upload - -If you make a mistake when populating this file, -it seems to upload normally -but no network data changes are applied; -if you then download the file again, -the unmodified file may overwrite -the modifications you made to the file. -To protect yourself, -we recommend the following process: - -- After you edit the file but before you upload it, - make a copy in another location. -- Upload the file. -- Download the file again. -- Compare the current file to the one you saved. - If they match, you successfully configured your networks. - -If you configure your networking by editing this file, -you should create and configure the rest of your environment -using the Fuel CLI rather than the Web UI. -Especially do not attempt to configure your networking -using the Web UI screens. - -File Format -~~~~~~~~~~~ - -The *network_1.yaml* file contains -**global settings** and the **networks** section. - -Note that the *network_1.yaml* is dumped in dictionary order -so the sections may appear in a different order than -documented here. - -Global settings -+++++++++++++++ -are mostly at the beginning of the file -but one (**public_vip**) is at the end of the file, -When configuring a new environment, -you must set values for the **management_vip**, -**floating_ranges**, and **public_vip** parameters. - -:: - - management_vip: 10.108.37.2 - networking_parameters: - base_mac: fa:16:3e:00:00:00 - dns_nameservers: - - 8.8.4.4 - - 8.8.8.8 - floating_ranges: - - - 10.108.36.128 - - 10.108.36.254 - gre_id_range: - - 2 - - 65535 - internal_cidr: 192.168.111.0/24 - internal_gateway: 192.168.111.1 - net_l23_provider: ovs - segmentation_type: gre - vlan_range: - - 1000 - - 1030 - . . . - public_vip: 10.108.36.2 - -networks section -++++++++++++++++ - -The **networks** section contains the configurations -of each Network Group that has been created. - -You must set values for -the **cidr**, **gateway**, and **ip_ranges** parameters -for each logical network in the group. -This is what the configuration of one logical network (**public**)looks like. -A similar section is provided for each of the -logical networks that belong to the Node Group. - -:: - - networks: - - cidr: 10.108.36.0/24 - gateway: 10.108.36.1 - group_id: 1 - id: 1 - ip_ranges: - - - 10.108.36.2 - - 10.108.36.127 - meta: - assign_vip: true - cidr: 172.16.0.0/24 - configurable: true - floating_range_var: floating_ranges - ip_range: - - 172.16.0.2 - - 172.16.0.126 - map_priority: 1 - name: public - notation: ip_ranges - render_addr_mask: public - render_type: null - use_gateway: true - vlan_start: null - name: public - vlan_start: pull - - 10.108.35.254 - vlan_start: null - - -If you create additional Node Groups, -the file contains segments for each Node Group, -each identified by a unique **group_id**, -with configuration blocks for each -of the four logical networks associated with that Node Group. - - -See also -~~~~~~~~ - -- :ref:`mcn-ops` - -- :ref:`mcn-arch` - - - diff --git a/pages/file-ref/openstack-yaml.rst b/pages/file-ref/openstack-yaml.rst deleted file mode 100644 index bf5db0f49..000000000 --- a/pages/file-ref/openstack-yaml.rst +++ /dev/null @@ -1,121 +0,0 @@ - -.. raw:: pdf - - PageBreak - - -.. _openstack-yaml-ref: - -openstack.yaml --------------- - -Fuel Master Node: -**/usr/lib/python2.6/site-packages/nailgun/fixtures/openstack.yaml** - -The *openstack.yaml* file defines -the basic configuration of the target nodes -that Fuel deploys for the OpenStack environment. -Initially, it contains Fuel defaults; -these are adjusted in response to configuration choices -the user makes through the Fuel UI -and then fed to :ref:`Nailgun`. - -Usage -~~~~~ - -#. Log into the nailgun :ref:`docker-term` container: - :: - - dockerctl shell nailgun - -#. Edit file. - -#. Run the following commands to Nailgun - to reread its settings and restart: - :: - - manage.py dropdb && manage.py syncdb && manage.py loaddefault - killall nailgund - - -#. Exit the Nailgun docker container: - :: - - exit - -#. Run the following commands to Nailgun - to sync deployment tasks: - :: - - fuel rel --sync-deployment-tasks --dir /etc/puppet - -File Format -+++++++++++ - -The *openstack.yaml* file contains a number of blocks, -each of which may contain multiple parameters. -The major ones are described here. - -The file has two major sections: - -- The first is for VirtualBox and other limited deployments. - -- The second is for full bare-metal deployments. - -modes-metadata section -~~~~~~~~~~~~~~~~~~~~~~ - -Lists each of the roles available on the -:ref:`assign-roles-ug` screen -with the description. -Note that there are two `roles-metadata` sections in the file: - -- The limited deployments section - lists only the Controller, Compute, and Cinder LVM roles. - -- The "full_release" section - lists the Controller, Compute, Cinder LVM, - Ceph-OSD, MongoDB, and Zabbix Server roles. - -Roles that should not be deployed on the same server -are identified with "conflicts" statements -such as the following that prevents a Compute role -from being installed on a Controller node: -:: - - controller: - name: "Controller" - description: "The controller initiates orchestration activities..." - has_primary: true - conflicts: - - compute - -The "has_primary" line is added in Release 6.0 -to identify the Primary controller. -In earlier releases, -Galera searched for the Controller node with the lowest node-id value -(see :ref:`nodes-cli`) -and made that the Primary Controller. -This created problems when a new controller that had a lower node-id value -was added to an existing Controller cluster -and became the Primary Controller, -which conflicted with the existing Primary Controller in the cluster. -Persisting the Primary role in the database solves this problem. - -If you delete the "conflicts:" and "compute" line -and redeploy nailgun, -you can deploy a bare-metal deployment -that runs on a single server. - -.. warning:: Deploying Fuel on VirtualBox is a much better - way to install Fuel on minimal hardware - for demonstration purposes - than using this procedure. - Be extremely careful when using this "all-in-one" deployment; - if you create too many VM instances, - they may consume all the available CPUs, - causing serious problems accessing the MySQL database. - Resource-intensive services - such as Ceilometer with MongoDB, Zabbix, - and Ceph are also apt to cause problems - when OpenStack is deployed on a single server. diff --git a/pages/file-ref/settings-yaml.rst b/pages/file-ref/settings-yaml.rst deleted file mode 100644 index cf9f46239..000000000 --- a/pages/file-ref/settings-yaml.rst +++ /dev/null @@ -1,45 +0,0 @@ - -.. raw:: pdf - - PageBreak - - -.. _settings-yaml-ref: - -settings.yaml -------------- - -Fuel Master Node: -**/root/settings_x.yaml/** - -The *settings.yaml* file contains -the current values for the information -on the :ref:`Settings` page of the Fuel UI. - -Usage -~~~~~ - -#. Dump provisioning information using this - :ref:`fuel CLI` command:: - - fuel --env 1 settings default - - where ``--env 1`` that to the specific environment - (id=1 in this example). - - -#. Edit file. - - -#. Upload the modified file: - :: - - fuel --env-1 settings upload - - -File Format -~~~~~~~~~~~ - -.. warning:: You should usually modify these values using the - :ref:`Settings` tab of the Fuel UI. - diff --git a/pages/frequently-asked-questions/0030-add-remove-nodes-without-downtime b/pages/frequently-asked-questions/0030-add-remove-nodes-without-downtime deleted file mode 100644 index 07c8f2445..000000000 --- a/pages/frequently-asked-questions/0030-add-remove-nodes-without-downtime +++ /dev/null @@ -1,94 +0,0 @@ -.. This is not ready for inclusion into docs - -.. _add-remove-nodes-without-downtime: - -Add or Remove Controller and Compute Nodes Without Downtime -=========================================================== - -This document will help you become familiar with the process around lifecycle -management of controller and compute nodes within an OpenStack environment -deployed by Fuel. There are some specific details to note, so reading this -document is highly recommended. - -1. The addition of compute nodes works seamlessly - just specify its - IPs in `site.pp` file (if needed) and run puppet agent - -2. Deletion of computes is the same as deletion from OpenStack: migrate - machines, shutdown node, delete from database (Puppet class needed) - -3. Addition of controllers works as soon as puppet deploys. Which - testing is needed: - - - Test that altering the `site.pp` (adding new controller) and - running puppet consequently on all controllers does not break anything - -4. Deletion of controllers should work as soon as quorum for Galera and - pacemaker is OK. What to test: - - - Altering of quorum in case of node deletion - - If we need to alter quorum - we need to write classes for this - -Node deletion -^^^^^^^^^^^^^ - -Disclaimer: BTW, this is not included into folsom as cinder service -disabling is not supported: it is going to be there in grizzly. Even -though, cinder deletion and migration of volumes is not going to be there. -Artem Andreev says, they are working on cinder volume migration for Dell M2 -and it will be ready by the end of the May. - -Deletion of the node assumes the following sequence of actions: - -1. Backup databases (MySQL, AMQP(???), pacemaker) up - -2. Disable services hosted on this node: - - a. shutdown nova-compute and disable it (for computes) - - b. shutdown nova-api and other services residing on controllers - - c. move all the stuff from node being deleted: - - i. migrate VMS - - ii. migrate cinder volumes (HOW?????) - - iii. migrate singleton pacemaker services (if any) - - iv. avoid starting of pacemaker services on the node in case of - multistate primitive - - d. Disable all the services for the node (by use of database or by use - of client) - -3. For controllers: - - a. Delete node from galera cluster (HOW???) - - b. Delete node from pacemaker (crm node delete ???) - -4. For swift storages: - - a. remove node from the ring (for storage) - - b. rebuild ring - - c. rebalance - - d. rsync new rings to nodes - -5. For swift proxies: - - a. shutdown the node - - b. update haproxy backends by site.pp edit and puppet run - -6. Cleanup the database - -Necessity of special resources considerations -^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -Looks like we need to create special puppet resource called "node" with -different providers "controller/storage/proxy/etc." for it and specify the -:ensure property for them. Running the resource with corresponding property -generates corresponding resources and does all the steps needed. diff --git a/pages/frequently-asked-questions/0100-ha-notes.rst b/pages/frequently-asked-questions/0100-ha-notes.rst deleted file mode 100644 index d288b8b59..000000000 --- a/pages/frequently-asked-questions/0100-ha-notes.rst +++ /dev/null @@ -1,12 +0,0 @@ -.. raw:: pdf - - PageBreak - -.. index:: HA with Pacemaker and Corosync - -.. HA_Pacemaker_Corosync - -How HA with Pacemaker and Corosync Works -======================================== - - diff --git a/pages/frequently-asked-questions/0300-other-questions.rst b/pages/frequently-asked-questions/0300-other-questions.rst deleted file mode 100644 index b441f2ee9..000000000 --- a/pages/frequently-asked-questions/0300-other-questions.rst +++ /dev/null @@ -1,40 +0,0 @@ -.. raw:: pdf - - PageBreak - -Other Questions -=============== - -.. TODO(mihgen): Provide more clear and reflecting reality answer - -1. **[Q]** Why did you decide to provide OpenStack packages through your own - repository? - - **[A]** We are fully committed to providing our customers with working and - stable bits and pieces in order to make successful OpenStack deployments. - Please note that we do not distribute our own version of OpenStack; we rather - provide a plain vanilla distribution. Put simply, there is no vendor lock-in - with Fuel. For your convenience, we maintain repositories containing a - history of OpenStack packages certified to work with our Puppet manifests. - - We also ship patched or upgraded versions of some upstream packages. This is - necessary to incorporate fixes for known issues and performance improvements. - Sometimes these updates add features that are needed by OpenStack. - - The advantage of this approach is that you can install any OpenStack version - you want (with possible custom bug fixes). Even if you are running Essex, - just use the Puppet manifests which reference OpenStack packages for Essex - from our repository. With each new release we add new OpenStack packages to - our repository and create a new branch with Puppet manifests (which, in - turn, reference these packages) corresponding to each release. With EPEL - this would not be possible, as that repository only keeps the latest version - for OpenStack packages. - - -4. **[Q]** Is Neutron an active/standy HA? I got this understanding from the docs - and I want to understand why. I was told that Grizzly and Havanna support multiple - L3 agents but Mirantis OpenStack only supports a single L3 agent. - - **[A]** Neutron partly functions as a network router. If one of the L3 agents fail, - it loses data about the VM instances for which it manages traffic. This has been - worked around to some extent, but still operates with a single L3 agent. diff --git a/pages/install-guide/0000-intro.rst b/pages/install-guide/0000-intro.rst deleted file mode 100644 index a5b133019..000000000 --- a/pages/install-guide/0000-intro.rst +++ /dev/null @@ -1,5 +0,0 @@ - -.. _install-guide-intro: - -Introduction to the Installation Guide -====================================== diff --git a/pages/install-guide/0040-configure-hardware.rst b/pages/install-guide/0040-configure-hardware.rst deleted file mode 100644 index 3ff1ddfe5..000000000 --- a/pages/install-guide/0040-configure-hardware.rst +++ /dev/null @@ -1,18 +0,0 @@ - -.. _configure-hardware: - -Configure hardware -================== - -Follow the instructions for your hardware -to configure your hardware: - -- Connect the NICs on the Fuel Master and node servers to the switches. -- Connect the IPMI cards on the Fuel Master and node servers - to the out-of-band management network. -- Configure access to the node servers through IPMI. -- Prepare the proper physical network configuration - (configure switches, routers, and so forth). -- Connect the OpenStack networks - to the server Ethernet port on each server. - diff --git a/pages/install-guide/0060-download-fuel.rst b/pages/install-guide/0060-download-fuel.rst deleted file mode 100644 index 8c2390ea8..000000000 --- a/pages/install-guide/0060-download-fuel.rst +++ /dev/null @@ -1,2 +0,0 @@ -.. include:: /pages/install-guide/0060-download-fuel/0100-before-download.rst -.. include:: /pages/install-guide/0060-download-fuel/0200-download.rst diff --git a/pages/install-guide/0060-download-fuel/0100-before-download.rst b/pages/install-guide/0060-download-fuel/0100-before-download.rst deleted file mode 100644 index 22649284f..000000000 --- a/pages/install-guide/0060-download-fuel/0100-before-download.rst +++ /dev/null @@ -1,17 +0,0 @@ -.. raw:: pdf - - PageBreak - -.. index:: Download Fuel - -Before You Download and Install Fuel -==================================== - -Before downloading and installing Fuel: - -- Be sure that your hardware configuration is adequate; - check the `Prerequisites information `_. - -- Understand the network architecture and define your network configuration; - see `Understanding and Configuring the Network `_ - and `Network Architecture `_. diff --git a/pages/install-guide/0060-download-fuel/0200-download.rst b/pages/install-guide/0060-download-fuel/0200-download.rst deleted file mode 100644 index c5cdb13c3..000000000 --- a/pages/install-guide/0060-download-fuel/0200-download.rst +++ /dev/null @@ -1,14 +0,0 @@ -Downloading the installable image -================================= - -1. Go to the -`Mirantis Software Download Page `_ -and fill out the information to opt in to the Mirantis community. - -2. You should receive a response from Mirantis within the hour; -this mail includes credential you can use to download Fuel. -If you do not receive the acknowledgment from Mirantis, -write to: sw-access@mirantis.com. - - -.. seealso:: `Downloads `_ diff --git a/pages/install-guide/install.rst b/pages/install-guide/install.rst deleted file mode 100644 index ada127d53..000000000 --- a/pages/install-guide/install.rst +++ /dev/null @@ -1,2 +0,0 @@ -.. include:: /pages/install-guide/install/0100-install-master-header.rst -.. include:: /pages/install-guide/install/0200-install-bare-metal.rst diff --git a/pages/install-guide/install/0100-install-master-header.rst b/pages/install-guide/install/0100-install-master-header.rst deleted file mode 100644 index 0265673fc..000000000 --- a/pages/install-guide/install/0100-install-master-header.rst +++ /dev/null @@ -1,21 +0,0 @@ -.. raw:: pdf - - PageBreak - -.. index:: Installing Fuel Master Node - -Installing Fuel Master Node -=========================== - -.. contents :local: - -Fuel is distributed via an ISO image, which contains an installer for -Fuel Master node. The ISO image is used for CD media devices, iLO (HP) or -similar remote access systems. - -Once installed, Fuel can be used to deploy and manage OpenStack environments. -It will assign IP addresses to the nodes, perform PXE boot and initial -configuration, and provision of OpenStack nodes according to their roles in -the environment. - -See also :ref:`Writing a bootable Fuel 6.1 ISO to a USB drive `. diff --git a/pages/install-guide/install/0200-install-bare-metal.rst b/pages/install-guide/install/0200-install-bare-metal.rst deleted file mode 100644 index cf21f3dec..000000000 --- a/pages/install-guide/install/0200-install-bare-metal.rst +++ /dev/null @@ -1,37 +0,0 @@ -.. _Install_Bare-Metal: - -Bare-Metal Environment ----------------------- - -To install Fuel on bare-metal hardware, you need to burn the provided ISO to -a writable DVD or create a bootable USB stick. You would then begin the -installation process by booting from that media, very much like any other OS -install process. - -Burning an ISO to optical media is a commonly supported function on all OSes. -On Linux, there are several programs available, such as `Brasero` or `Xfburn`, -two commonly pre-installed desktop applications. There is also -a number for Windows such as `ImgBurn `_ and the -open source `InfraRecorder `_. - -Burning an ISO in Mac OS X is quite simple. Open `Disk Utility` from -`Applications > Utilities`, drag the ISO into the disk list on the left side -of the window and select it, insert blank DVD, and click `Burn`. If you prefer -a different utility, check out the open source `Burn -`_. - -For detailed instructions on writing to a USB drive -see `Writing a bootable Fuel 6.1 ISO to a USB drive `. - -On Windows, you can write the installation image with a number of different -utilities. The following list links to some of the more popular ones and they -are all available at no cost: - -- `Win32 Disk Imager `_. -- `ISOtoUSB `_. - -After the installation is complete, you will need to make your bare-metal nodes -available for your OpenStack environment. Attach them to the same L2 network -(broadcast domain) as the Master node, and configure them to automatically -boot via network. The UI will discover them and make them available for -installing OpenStack. diff --git a/pages/monitoring-guide/appendix/appendix.rst b/pages/monitoring-guide/appendix/appendix.rst deleted file mode 100644 index e82e15671..000000000 --- a/pages/monitoring-guide/appendix/appendix.rst +++ /dev/null @@ -1,10 +0,0 @@ -.. _mg-appendix: - -Appendix -======== - -We put additional materials in this appendix that are out of -the scope but which could, nonetheless, be of interest. - -.. include:: /pages/monitoring-guide/appendix/virtual-machine-monitoring.rst -.. include:: /pages/monitoring-guide/appendix/vm-network-traffic.rst diff --git a/pages/monitoring-guide/appendix/virtual-machine-monitoring.rst b/pages/monitoring-guide/appendix/virtual-machine-monitoring.rst deleted file mode 100644 index 6e98f6eb7..000000000 --- a/pages/monitoring-guide/appendix/virtual-machine-monitoring.rst +++ /dev/null @@ -1,47 +0,0 @@ -.. _mg-virtual-machine-monitoring: - -Virtual Machine Monitoring --------------------------- - -It is possible to collect guests statistics from libvirt, -see `libvirt-domain `_ -for details. - -#. Block IO - - * read_reqs - * read_bytes - * write_reqs - * write_bytes - -#. Network IO - - * rx_bytes - * rx_packets - * rx_errors - * rx_drops - * tx_bytes - * tx_packets - * tx_errors - * tx_drops - -#. CPU - - * cputime - * vcputime - * systemtime - * usertime - -.. note:: - The VCPU time is global and cumulative and is reported - in nanoseconds since the last boot. To calculate a VCPU - usage percentage you need to divide vcputime by the number - of VCPUS divided by the wallclock time of the sampling interval. - -Guest agent -+++++++++++ - -A guest agent allows running scripts or applications inside -an instance while it runs. Unfortunately, there is no support -of the guest agent with KVM hypervisor at the moment, only XEN -driver supports it. diff --git a/pages/monitoring-guide/appendix/vm-network-traffic.rst b/pages/monitoring-guide/appendix/vm-network-traffic.rst deleted file mode 100644 index feb40c2ce..000000000 --- a/pages/monitoring-guide/appendix/vm-network-traffic.rst +++ /dev/null @@ -1,25 +0,0 @@ -.. _mg-vm-network-traffic: - -VM Network Traffic ------------------- - -The traffic across VMs can be monitored from the virtual -switches by enabling monitoring sampling with `sFlow`_ on -each Open vSwitch server. - -The basic principle is to sample network traffic and send -all the samples to the `sFlow collector`_ for analysis. -Known open source software that supports sFlow include `pmacct`_, -`Ganglia`_, and `Ntop`_. - -NetFlow is a commercial standard embedded in many physical -devices with the main difference that it does not sampling -network traffic, which is more resource-intensive than sFlow -but also more accurate. - - -.. _`sFlow`: http://www.inmon.com/technology/ -.. _`sFlow collector`: http://www.sflow.org/products/collectors.php -.. _`pmacct`: http://www.pmacct.net/ -.. _`Ganglia`: http://ganglia.sourceforge.net/ -.. _`Ntop`: http://www.ntop.org/ diff --git a/pages/monitoring-guide/assumptions.rst b/pages/monitoring-guide/assumptions.rst deleted file mode 100644 index cda2223c7..000000000 --- a/pages/monitoring-guide/assumptions.rst +++ /dev/null @@ -1,12 +0,0 @@ -.. _mg-assumptions: - -Assumptions -=========== - -We assume that the reader is already familiar with the concepts, architecture -principles, and day-to-day administration tasks of Mirantis OpenStack. It -further assumes that you have deployed Mirantis OpenStack following the -recommendations of :ref:`the Mirantis OpenStack Planning Guide` -with :ref:`high availability` support using Neutron with -:ref:`VLAN` or :ref:`GRE` -networking segmentation. diff --git a/pages/monitoring-guide/common-monitoring-practices/common-monitoring-practices.rst b/pages/monitoring-guide/common-monitoring-practices/common-monitoring-practices.rst deleted file mode 100644 index 0dbdebb77..000000000 --- a/pages/monitoring-guide/common-monitoring-practices/common-monitoring-practices.rst +++ /dev/null @@ -1,11 +0,0 @@ -.. _mg-common-monitoring-practices: - -Common Monitoring Practices -=========================== - -This chapter describes the common monitoring practices we recommend -that you use to design and implement an effective monitoring solution -for OpenStack. - -.. include:: /pages/monitoring-guide/common-monitoring-practices/monitoring-domains.rst -.. include:: /pages/monitoring-guide/common-monitoring-practices/monitoring-activities.rst diff --git a/pages/monitoring-guide/common-monitoring-practices/diagnosing-versus-alerting.rst b/pages/monitoring-guide/common-monitoring-practices/diagnosing-versus-alerting.rst deleted file mode 100644 index 58ef62fab..000000000 --- a/pages/monitoring-guide/common-monitoring-practices/diagnosing-versus-alerting.rst +++ /dev/null @@ -1,16 +0,0 @@ -.. _mg-diagnosing-versus-alerting: - -Diagnosing versus Alerting -++++++++++++++++++++++++++ - -The operational data gathering, that results from the common -monitoring practices described above, should serve two different -purposes that should not be confused. One is to identify the root -cause of a problem. Hereafter, this is referred to as diagnosing. -The other one is to send real-time notifications to the operator -when something is broken that needs to be repaired. Hereafter, this -is referred to as alerting. But those **alerts** have to be smart. -As stated multiple times it is pointless and ineffective to flood -the operator with alerts that are not reflective of a situation that -requires the operator’s attention whether it is immediate or -deferred. diff --git a/pages/monitoring-guide/common-monitoring-practices/logs-indexing.rst b/pages/monitoring-guide/common-monitoring-practices/logs-indexing.rst deleted file mode 100644 index 89246a68c..000000000 --- a/pages/monitoring-guide/common-monitoring-practices/logs-indexing.rst +++ /dev/null @@ -1,20 +0,0 @@ -.. _mg-logs-indexing: - -Logs Indexing -+++++++++++++ - -Another common practice is to index all the logs in a central -database like Elasticsearch with Kibana running on top of it -to easily search and correlate those logs for root cause -analysis and troubleshooting. With complex distributed systems -like OpenStack, it is no longer possible to use ad hoc tools like -``grep`` and ``awk`` to search the logs for troubleshooting. - -.. note:: - The LMA Toolchain provides a `Fuel plugin that allows deploying - ElasticSearch and Kibana`_ you can use to search and correlate the - OpenStack logs and notifications. - - -.. Links -.. _`Fuel plugin that allows deploying ElasticSearch and Kibana`: https://github.com/stackforge/fuel-plugin-elasticsearch-kibana diff --git a/pages/monitoring-guide/common-monitoring-practices/logs-processing.rst b/pages/monitoring-guide/common-monitoring-practices/logs-processing.rst deleted file mode 100644 index bc3f267ea..000000000 --- a/pages/monitoring-guide/common-monitoring-practices/logs-processing.rst +++ /dev/null @@ -1,48 +0,0 @@ -.. _mg-logs-processing: - -Logs Processing -+++++++++++++++ - -In addition to performing health checks and collecting metrics, a -common monitoring practice is to exploit the information that is -available in the logs that are produced by the system. Valuable -operational data can be extracted from those unstructured messages -which should be indexed for search and troubleshooting. The log -messages that are produced by the Mirantis OpenStack distribution -are sent to syslog at the INFO level by default. Fuel allows to -easily configure OpenStack to send all the logs to an external -*rsyslog* server. Those logs contain information about the severity -level, the program that issued the log, the service (Nova, Glance, -Cinder, …) that issued the log -(:ref:`syslogfacility `), metadata info like -``tenant_id`` and ``request_id`` that are useful for aggregation and -correlation, *error codes* like the HTTP error codes of the service -endpoints, performance info like the HTTP response time, and so forth. - -.. _syslog_facility: - -*Ideally, we should have one syslog facility per service but there are -only eight local facilities.* - -.. note:: - The HTTP requests response time is meaningful only for synchronous - transactions. Asynchronous transactions like those involved in the - creation of an instance or volume will only account for the time it - takes for the service API endpoint to authenticate and transmit the - request to the AMQP bus, and as such, is not reflective of the - actual time it takes to process a request end-to-end. - -| Operations metrics can be derived from those logs for diagnostic and - alerting purposes. This includes but is not limited to: - -* Operations errors. A sudden spike of errors in the logs, like those - found in service API endpoint logs (HTTP return code 5xx), should - be monitored since they may be the manifestation of a critical - condition. - -* HTTP transactions time. The HTTP transactions time should be - monitored since it directly affects the end user experience. - -* Logs rate. A sudden drop-off of the logs rate should be monitored - since it can indicate something went wrong in the system or users - do not have access to the cloud any more. diff --git a/pages/monitoring-guide/common-monitoring-practices/metering.rst b/pages/monitoring-guide/common-monitoring-practices/metering.rst deleted file mode 100644 index 7a72e1c19..000000000 --- a/pages/monitoring-guide/common-monitoring-practices/metering.rst +++ /dev/null @@ -1,20 +0,0 @@ -.. _mg-metering: - -Metering -++++++++ - -Metering is usually done at the source of measurement point with the -help of a monitoring agent running on each node being measured. The -goal of metering is to collect operational data **metrics** which are -collections of numeric values organized in groups of consecutive, -chronologically ordered lists. Each data input consists of a recorded -measurement value, a timestamp at which the measurement took place, -and a set of properties describing it. When data inputs from a metric -are segmented into fixed intervals and summarized by a mathematical -transformation in some meaningful way, they can be stored as time -series and interpreted on two-dimensional plots. - -The benefits of using time series for monitoring are in their ability -to accurately illustrate the process of change in the context of -historical data. They are indispensable as they answer the -question when and what has changed in an OpenStack cloud. diff --git a/pages/monitoring-guide/common-monitoring-practices/monitoring-activities.rst b/pages/monitoring-guide/common-monitoring-practices/monitoring-activities.rst deleted file mode 100644 index bef546e51..000000000 --- a/pages/monitoring-guide/common-monitoring-practices/monitoring-activities.rst +++ /dev/null @@ -1,19 +0,0 @@ -.. _mg-common-monitoring-activities: - -Monitoring Activities ---------------------- - -As stated earlier, this document is not prescriptive of a particular -monitoring system or solution. Instead, it strives to describe common -monitoring practices with problem domains and activities to address them -that are key to get clear operational insights in order to take actions -when problems occur. In this chapter, we try to describe what those -activities are as clearly as possible. - -.. include:: /pages/monitoring-guide/common-monitoring-practices/services-processes-cluster-checks.rst -.. include:: /pages/monitoring-guide/common-monitoring-practices/metering.rst -.. include:: /pages/monitoring-guide/common-monitoring-practices/logs-processing.rst -.. include:: /pages/monitoring-guide/common-monitoring-practices/logs-indexing.rst -.. include:: /pages/monitoring-guide/common-monitoring-practices/notifications-processing.rst -.. include:: /pages/monitoring-guide/common-monitoring-practices/diagnosing-versus-alerting.rst -.. include:: /pages/monitoring-guide/common-monitoring-practices/time-sync.rst diff --git a/pages/monitoring-guide/common-monitoring-practices/monitoring-domains.rst b/pages/monitoring-guide/common-monitoring-practices/monitoring-domains.rst deleted file mode 100644 index 62a4431ff..000000000 --- a/pages/monitoring-guide/common-monitoring-practices/monitoring-domains.rst +++ /dev/null @@ -1,100 +0,0 @@ -.. _mg-monitoring-domains: - -Monitoring Domains ------------------- - -An effective monitoring solution is comprised of distinct activities -aimed at addressing the different problem domains that the operations -staff will have to handle. These activities are summarized below. - -Availability Monitoring - Availability monitoring, in its broadest sense, is a monitoring activity - that is responsible for ensuring that the resources for compute, storage, - and networking, as well as the services mediating their access (via the - service API endpoints), are effectively available for end-users to consume - while meeting the performance requirements of the SLA. In terms of - availability monitoring, we use relevant indicators (or metrics); they provide - information on how many resources are currently available in the cloud - infrastructure as well as the process checks ensuring that the services - delivering the access are up and running. Those indicators are obtained - from running synthetic transactions, parsing the logs, metrics collectors - deployed throughout the system, and so forth. - -Performance Monitoring - Performance monitoring is supposes measuring how fast a particular - resource can be served by the cloud infrastructure in response to a user - request. For example, measuring how much time it takes to create an - instance or a volume. Key metrics for performance monitoring can be - obtained not only from synthetic transactions simulating an end-user - interaction with a service endpoint but also from analysing the logs, - instrumenting the code, and extracting performance metrics from the - OpenStack notifications. - - OpenStack performance and availability monitoring are the two main - monitoring issues developed in this document since they directly - relate to the SLA. - -Resource Usage Monitoring - Resource usage monitoring is only partially addressed here. We view it as - a derivative activity by which a cloud operator can retrieve how much - resources were consumed by a particular user or tenant during a particular - time period for chargeback. Resource usage monitoring supposes measuring - consumable resources of the cloud via the APIs. Another key difference - between resource usage monitoring and availability monitoring is that - resource usage monitoring does not have to be performed in real-time. - Readers interested in resource usage monitoring for OpenStack - should take a look at the :ref:`Ceilometer` project. - -Alerting - Alerting is a process by which the monitoring system notifies the cloud - operator about an undesirable situation. The situation is typically described - in an alarm like manner, for example, when the value of a key indicator - crosses a threshold or unexpectedly changes a value from OK to NOT OK. - An unexpected change of state, if not the direct manifestation of a problem, - is often a precursor of it. Besides, alerting should have the following properties: - - - Provide a comprehensive description of the problem. - - Provide information about which service is affected. - - Provide a severity level. - - Provide the ability to be disabled to avoid false positives during - maintenance. - - Provide the ability to combine alarms to express more complex situations. - - Provide the ability to refer to time-series statistics like median, - standard deviation and percentiles. - - Furthermore, we recommend that the health status of any OpenStack service - is expressed using three different values: - - - **Healthy** - when both the HA functions of the controller cluster are - still being ensured and no critical errors are being reported by the - monitoring system for a service. - - **Degraded** - when one or more critical errors are reported by the - monitoring system for a service but the HA functions of the controller - cluster are still being ensured. - - **Failed** - when both the HA functions of the controller cluster are - not being ensured anymore and one or more critical errors are being - reported by the monitoring system for a service. - - **A critical error should always be reported in an alert.** - - The immediacy of the operations staff’s response to an alert depends on - the actual status of the HA cluster. It can be any of the following: - - - **Immediate** - when a service is failed. It is a critical situation - and so, the alert should be sent to the operations staff for human - intervention. - - **Deferred** - when a service is degraded. While a degraded service - may have a negative impact on the quality of service, the nominal - function of the cloud service should continue to be ensured by the - system and so, the handling of the alert could be safely prioritized - through a ticketing system. - - Obviously, not all errors are critical. An effective monitoring solution - should put a great deal of care at defining the proper level of alerting - (smart alerting), in order to avoid flooding the operations staff with - benign notifications that are not reflective of a critical situation. - This document strives to provide some hints about how to set your alarms - with threshold values and status checks but your mileage may vary depending - on your particular OpenStack environment. :ref:`Rally` is a load - generator for OpenStack that you could use to calibrate the alarms of your - monitoring system. diff --git a/pages/monitoring-guide/common-monitoring-practices/notifications-processing.rst b/pages/monitoring-guide/common-monitoring-practices/notifications-processing.rst deleted file mode 100644 index a0181c4c1..000000000 --- a/pages/monitoring-guide/common-monitoring-practices/notifications-processing.rst +++ /dev/null @@ -1,49 +0,0 @@ -.. _mg-notifications-processing: - -OpenStack Notifications Processing -++++++++++++++++++++++++++++++++++ - -The `OpenStack notifications`_ are another source of valuable -operational data information that can be exploited by a monitoring -system. The OpenStack notifications, as opposed to logs, are -structured messages that are sent to the AMQP bus through the -*notifications* topic with an *info* priority by default. Some -OpenStack services send notifications with a *warning* and *error* -priority. Notifications contain rich data sets that can be exploited -to extract performance metrics and operations status for the service -workers at different levels of the stack. Most of the OpenStack -services publish notifications to the AMQP bus. See the list of -notifications for details. - -.. note:: - Currently, if you enable the notifications, you also need to take - care of effectively consuming them otherwise the queue will grow - indefinitely. - -In addition to the built-in notifications, there is a possibility to -configure each service endpoint to emit notifications of type -``http.request`` and ``http.response`` for all HTTP transactions. This -is achieved by adding the `notification middleware`_ in the WSGI -*pipeline*. - -The LMA Collector plugin, that can be deployed on the controller -nodes, taps into the AMQP bus to collect and process the -notifications. Out of those notifications, the LMA Collector plugin -creates new metrics that can be sent to a time-series database. It -includes: - -* Nova instance creation time -* Cinder volume creation time - -Other asynchronous operations like ``Glance image creation time`` or -``Neutron network/port creation time`` can be computed the same way. - -.. note:: - The LMA Toolchain provides a `Fuel plugin that allows to deploy - InfluxDB and Grafana`_ to plot those metrics. - - -.. Links -.. _`OpenStack notifications`: https://wiki.openstack.org/wiki/SystemUsageData -.. _`notification middleware`: https://github.com/openstack/oslo.messaging/blob/master/oslo_messaging/notify/middleware.py -.. _`Fuel plugin that allows to deploy InfluxDB and Grafana`: https://github.com/stackforge/fuel-plugin-influxdb-grafana diff --git a/pages/monitoring-guide/common-monitoring-practices/services-processes-cluster-checks.rst b/pages/monitoring-guide/common-monitoring-practices/services-processes-cluster-checks.rst deleted file mode 100644 index 1358c7c47..000000000 --- a/pages/monitoring-guide/common-monitoring-practices/services-processes-cluster-checks.rst +++ /dev/null @@ -1,72 +0,0 @@ -.. _mg-services-processes-cluster-checks: - -Services, Processes and Clusters Checks -+++++++++++++++++++++++++++++++++++++++ - -Service checks - Checking the availability of the OpenStack services from the point - of view of the user is absolutely necessary in order to make sure - that all the services respond to the user requests as expected. - - Those service checks should be performed on a regular basis using - synthetic transactions that perform various HTTP requests against - the OpenStack service endpoints. The service checks should return - an availability status that is either ``pass`` or ``failed``. - - The synthetic transactions should use a dedicated *project* - (*tenant*) and *user* so that it is always possible to differentiate - between the load generated by the service checks versus the load - generated by the genuine activity. - - The service checks should be performed against the service endpoints - using the HAProxy’s **Virtual IP** (VIP) to ensure that both the - service APIs and as the HAProxy, which distributes the load above - them, are traversed by the HTTP requests. - - The service checks should strive to minimize the **observer effect** - by using lightweight and non-intrusive (read only) requests. The - service checks should also avoid using requests that propagate to - other services than the service being watched. A general rule of - thumb to avoid overloading the system is to use a non-aggressive - polling interval as a tradeoff between being alerted of errors - quickly and generating a load that is too heavy. - - The service checks should also strive to record the response time of - synthetic transactions in order to establish a performance baseline - and produce statistics (average, mean, percentile, standard - deviation) that can be used to detect anomalies. - -Process checks - Process checks can be performed either remotely (via SSH) or - locally using a monitoring agent running on each of the OpenStack - nodes. The goal of process checks is to ensure that all the processes - participating in the support of an OpenStack role, such as controller, - are indeed up and running. Those processes include the service - endpoints (nova-api), the service workers connected to the AMQP bus - (nova-scheduler), as well as the various processes supporting - the auxiliary functions such as RabbitMQ, MySQL and so forth. - - The process checks should also ensure that the OpenStack processes - are bound to their respective **networking ports**. - -Cluster checks - The :ref:`Mirantis OpenStack Planning Guide ` - mandates the deployment of an HA cluster supporting different - availability functions in the cloud infrastructure. For example, - the service endpoints are distributed in an active/active HA cluster - along with an HAProxy running on top of them on each controller - node. There is only one active HAProxy at a time that is responsible - for detecting service endpoints failures and distributing the load - between them. The high availability of the HAProxy itself is - supported by an active/passive HA cluster based on Corosync and - Pacemaker. Corosync and Pacemaker are collectively responsible for - ensuring the transparent failover of the HAProxy and VIP when the - master node is failed. Same thing for the MySQL database. So a - correct appraisal of the OpenStack services' availability status - depends on the HA cluster healthiness appraisal. That is why we - stated earlier that the criticality of an OpenStack error should be - evaluated differently depending on whether the HA functions of the - cloud infrastructure are still being ensured by the HA cluster or - not. In a nutshell, the HA functions are not being ensured anymore - when there is no more failover node available in the cluster or - when the HA cluster itself is broken. diff --git a/pages/monitoring-guide/common-monitoring-practices/time-sync.rst b/pages/monitoring-guide/common-monitoring-practices/time-sync.rst deleted file mode 100644 index ff425a768..000000000 --- a/pages/monitoring-guide/common-monitoring-practices/time-sync.rst +++ /dev/null @@ -1,20 +0,0 @@ -.. _mg-time-sync: - -Time Synchronization -++++++++++++++++++++ - -Lastly, it is utterly important that all the OpenStack nodes and the -monitoring system be on the exact same time clock. Without a proper -time synchronisation across the system it will be impossible to make -any kind of sensible root cause analysis, metrics time-series will -be useless, it will cause all sorts of high availability and -operations management problems. It is also a good practice to set up -the **UTC** time zone for all the nodes. Usually, the *Network Time -Protocol(NTP)* is used to synchronize the system clocks with remote -NTP time servers. The **ntpd** daemon must run on each node and -should be configured to use several external time servers. The Linux -distributions provide packages with pre-configured NTP servers but -it is necessary to use a pool of geographically closest NTP servers. -The monitoring system should check that the *ntpd* server is alive -and kicking to ensure that the OpenStack cloud is time synchronized -across all the nodes. diff --git a/pages/monitoring-guide/corosync-pacemaker.rst b/pages/monitoring-guide/corosync-pacemaker.rst deleted file mode 100644 index cd545ae1d..000000000 --- a/pages/monitoring-guide/corosync-pacemaker.rst +++ /dev/null @@ -1,107 +0,0 @@ -.. _mg-corosync-pacemaker: - -Corosync/Pacemaker ------------------- - -The Mirantis OpenStack HA cluster for the controller nodes is -implemented using :ref:`Pacemaker ` -and :ref:`Corosync `. Corosync provides messaging -and membership services while Pacemaker performs resources -management. Resources management includes detecting and recovering -the nodes and resources under its control from a failure. Please -check the documentation for further details about :ref:`how HA with -Pacemaker and Corosync work ` in Mirantis -OpenStack. - -For Corosync you should perform regular checks to verify that the -ring is in the ``active with no faults`` state as shown below:: - - # corosync-cfgtool -s - Printing ring status. - Local node ID 33597632 - RING ID 0 - id= 192.168.0.2 - status= ring 0 active with no faults - -Pacemaker is responsible for handling the failover of OpenStack -services in the HA cluster in case of a hardware or software failure. -To achieve this goal, Pacemaker monitors the state of the resources -under its control (every 30 seconds by default) to return a health -status for each of those resources. With Pacemaker, you should -perform regular checks to verify that its resources are in the -``started`` state on the Fuel Master node node when HA is handled in -active/passive mode, and that at least one resource is in the -``started`` state on each of the cluster nodes when HA is -handled in active/active mode. You can make that verification with -the :command:`crm status` command as shown below:: - - # crm status - -Example of the output for the above command:: - - ============ - Last updated: Tue Jun 23 08:47:23 2015 - Last change: Mon Jun 22 17:24:32 2015 - Stack: corosync - Current DC: node-1.domain.tld (1) - partition with quorum - Version: 1.1.12-561c4cf - 3 Nodes configured - 43 Resources configured - ============ - - Online: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - - Clone Set: clone_p_vrouter [p_vrouter] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - vip__management (ocf::fuel:ns_IPaddr2): Started node-1.domain.tld - vip__public_vrouter (ocf::fuel:ns_IPaddr2): Started node-1.domain.tld - vip__management_vrouter (ocf::fuel:ns_IPaddr2): Started node-1.domain.tld - vip__public (ocf::fuel:ns_IPaddr2): Started node-2.domain.tld - Master/Slave Set: master_p_conntrackd [p_conntrackd] - Masters: [ node-1.domain.tld ] - Slaves: [ node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_haproxy [p_haproxy] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_dns [p_dns] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_mysql [p_mysql] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Master/Slave Set: master_p_rabbitmq-server [p_rabbitmq-server] - Masters: [ node-1.domain.tld ] - Slaves: [ node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_heat-engine [p_heat-engine] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-plugin-openvswitch-agent [p_neutron-plugin-openvswitch-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-dhcp-agent [p_neutron-dhcp-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-metadata-agent [p_neutron-metadata-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-l3-agent [p_neutron-l3-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_ntp [p_ntp] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_ping_vip__public [ping_vip__public] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - -Here, the :command:`crm status` command provides an easy method to -inform the monitoring system that the HA cluster is comprised of -three controller nodes (node-1, node-2, and node-3), and that node-1 -is the actual master node. It also tells the monitoring -system that the VIPs for the public and management interfaces are -started on the master node and that the HAProxy is started on all -the nodes of the HA cluster. - -The :command:`crm_resource` command can also be used to verify on -which node a particular resource is active. Execution of the command -below, for example, tells the monitoring system that the Neutron DHCP -agent is active on node-1:: - - # crm_resource --locate --quiet --resource p_neutron-dhcp-agent - node-1 - -Use the :option:`--resource vip_public` option to find out on which -node the public VIP is active:: - - # crm_resource --locate --quiet --resource vip__public - node-2 diff --git a/pages/monitoring-guide/document-scope.rst b/pages/monitoring-guide/document-scope.rst deleted file mode 100644 index f3f80a34a..000000000 --- a/pages/monitoring-guide/document-scope.rst +++ /dev/null @@ -1,46 +0,0 @@ -.. _mg-document-scope: - -Document Scope -============== - -This guide is about how to monitor an OpenStack cloud from the perspective -of the operations staff with a focus on the infrastructure. As a result, -this guide is not directly intended to serve the monitoring needs of a -cloud user whether it has access to the administrator role or not because -as a cloud user you do not have root access to the servers and host -operating systems. The scope therefore includes some hardware monitoring -through IPMI, monitoring of the host operating system, monitoring of the -cloud management system and processes that are part of its ecosystem. - -The processes supporting the cloud management system are roughly of two kind: - -* The OpenStack service API endpoints, like *nova-api*, which receive the user - requests. -* The OpenStack service workers connected to the AMQP bus, like *nova-scheduler*, - which process the user requests. - -The OpenStack services depend on a number of additional programs that are -not part of the OpenStack code base itself but which nonetheless are -critically important to monitor as we will see below. This includes but is -not limited to Libvirt, :ref:`MySQL`, :ref:`RabbitMQ`, -:ref:`Memcached`, :ref:`HAProxy`, :ref:`Corosync` -and :ref:`Pacemaker`. - -The scope also includes the host operating systems, the servers and devices such -as the disks and network interface cards. Some amount of hardware health -checks via IPMI are performed to monitor the status of equipments such as the -fans and CPU temperature in an attempt to help with anticipating hardware -failures. - -The scope of this document does not include the monitoring of the end-user -applications as well as the monitoring of the hardware equipments that are -vendor-specific or too complex to be practically addressed in this document. -This includes but is not limited to the following equipment categories. - -The network gears - The monitoring of the network gears such as switches and routers is - vendor-specific and too large to be addressed here. - -The storage gears - The monitoring of the storage gears like SANs and NASs is vendor-specific - and too large to be addressed here. diff --git a/pages/monitoring-guide/ha-cluster.rst b/pages/monitoring-guide/ha-cluster.rst deleted file mode 100644 index 81417a102..000000000 --- a/pages/monitoring-guide/ha-cluster.rst +++ /dev/null @@ -1,6 +0,0 @@ -.. _mg-ha-cluster: - -HA Cluster -========== - -.. include:: /pages/monitoring-guide/corosync-pacemaker.rst diff --git a/pages/monitoring-guide/hardware-and-system-monitoring/disks-monitoring.rst b/pages/monitoring-guide/hardware-and-system-monitoring/disks-monitoring.rst deleted file mode 100644 index a401b2789..000000000 --- a/pages/monitoring-guide/hardware-and-system-monitoring/disks-monitoring.rst +++ /dev/null @@ -1,71 +0,0 @@ -.. _mg-disks-monitoring: - -Disks Monitoring ----------------- - -The disks are often the primary cause of server failures. You should -monitor the disks of your servers to detect and whenever possible -anticipate the occurrence of those failures. First signs of problems -with your disks are generally reported by the kernel. Usually, disks -errors are logged in ``/var/log/kern.log`` or ``/var/log/messages``, -but the location may differ depending on your Linux distribution. - -A recommended approach is to watch your system logs for bad drives using -programs like `Logstash`_ or `Heka`__ or even dedicated tools like -`swift-drive-audit`_ that can be run using `Cron`_. - -Another approach to check the status of your disks is to rely on the `S.M.A.R.T`_ -interface when it is supported although some differences may be found between -Hard Disk Drives (HDD) and Solid State Disks (SSD) devices. - -Many attributes/counters are available through the S.M.A.R.T interface but your -mileage may vary depending on the disk manufacturer. - -It is hard to `anticipate disk failures`_ in a deterministic way. The handling of -disk failures is generally addressed on a case-by-case basis using S.M.A.R.T -attributes that can be indicative of a dysfunctioning and as such conductive -of future problems. - -For HDD: - -* Uncorrectable sector/event count -* Reallocated sector/event count -* Spin retry count -* Temperature: should usually be lower than 50°C - -And for SDD: - -* Media Wearout Indicator: indicator of the cells health, where 0 is the worst - value. When the value reaches around 20 you should consider changing the disk. - -* Temperature: should usually be lower than 50°C - -Linux distributions provide the `smartmontools`_ package to play with the -S.M.A.R.T interface. - -To read the attributes of your sda disk run:: - - # smartctl -a /dev/sda - -The :command:`smartctl` command displays a health status or pending alerts when -used with the :option:`-H` option. - -:: - - # smartctl -H /dev/sda - === START OF READ SMART DATA SECTION === - SMART overall-health self-assessment test result: PASSED - - - - -.. _`Logstash`: https://www.elastic.co/products/logstash -.. __: http://hekad.readthedocs.org/ -.. _`swift-drive-audit`: http://docs.openstack.org/developer/swift/admin_guide.html#detecting-failed-drives -.. _`Cron`: http://en.wikipedia.org/wiki/Cron -.. _`S.M.A.R.T`: http://en.wikipedia.org/wiki/S.M.A.R.T. -.. _`anticipate disk failures`: http://static.googleusercontent.com/media/research.google.com/en//archive/disk_failures.pdf -.. _`smartmontools`: https://www.smartmontools.org/ - - - diff --git a/pages/monitoring-guide/hardware-and-system-monitoring/hardware-and-system-monitoring.rst b/pages/monitoring-guide/hardware-and-system-monitoring/hardware-and-system-monitoring.rst deleted file mode 100644 index f7d2e995a..000000000 --- a/pages/monitoring-guide/hardware-and-system-monitoring/hardware-and-system-monitoring.rst +++ /dev/null @@ -1,19 +0,0 @@ -.. _mg-hardware-and-system-monitoring: - -Hardware and System Monitoring -============================== - -An effective monitoring solution for OpenStack should also check -the host operating system and the underlying infrastructure on top -of which your cloud is running. - -As we stated earlier in this document, we are not going to address -the monitoring of the network and storage equipments, because these -topics are too broad and vendor specific to be addressed here. However, -we recommend that you perform some amount of server monitoring to -anticipate hardware failures using IPMI since it is a relatively -standard interface that is supported by most hardware vendors. - -.. include:: /pages/monitoring-guide/hardware-and-system-monitoring/ipmi.rst -.. include:: /pages/monitoring-guide/hardware-and-system-monitoring/disks-monitoring.rst -.. include:: /pages/monitoring-guide/hardware-and-system-monitoring/operating-system-monitoring.rst diff --git a/pages/monitoring-guide/hardware-and-system-monitoring/ipmi.rst b/pages/monitoring-guide/hardware-and-system-monitoring/ipmi.rst deleted file mode 100644 index aa0553f0e..000000000 --- a/pages/monitoring-guide/hardware-and-system-monitoring/ipmi.rst +++ /dev/null @@ -1,85 +0,0 @@ -.. _mg-ipmi: - -IPMI ----- - -**IPMI** is a `standard`_ driven by Intel that has been widely adopted by -the server manufacturers. It provides hardware **Sensors Data Records** -to collect information such as: - -* Components temperature -* Fan rotation -* Components voltage -* Power supply status (redundancy check) -* Power status (on or off) - -The IPMI **System Event Log** provides a timed journal of all events that occurred -in the server. Each threshold crossing of previous sensors is logged with a severity -level that can be one of the following: recoverable, non-critical, critical, unrecoverable. -See the `IPMI specifications`_ for further details. - -Other events can also be logged, such as: - -* Memory Error-Correcting-Code memory (ECC) detection that can be reported in an - alert if they happen too often. - -* Chassis intrusion detections that can be reported in an alert for security reasons. - -Most Linux distributions provide the ``ipmitool`` package that allows to interact with -the IPMI interface. - -Retrieve the SDR records for voltage by running:: - - # /usr/bin/ipmitool -I lan -L operator -U root -H \ - -P sdr type "Voltage" list - - VTT | 30h | ok | 7.10 | 0.99 Volts - CPU1 Vcore | 21h | ok | 3.3 | 0.83 Volts - CPU2 Vcore | 22h | ns | 3.4 | Disabled - VDIMM AB | 61h | ok | 32.1 | 1.49 Volts - VDIMM CD | 62h | ok | 32.2 | 1.49 Volts - VDIMM EF | 63h | ns | 32.3 | Disabled - VDIMM GH | 64h | ns | 32.4 | Disabled - +1.1 V | 31h | ok | 7.11 | 1.09 Volts - +1.5 V | 32h | ok | 7.12 | 1.47 Volts - 3.3V | 33h | ok | 7.13 | 3.26 Volts - +3.3VSB | 34h | ok | 7.14 | 3.36 Volts - 5V | 35h | ok | 7.15 | 5.06 Volts - +5VSB | 36h | ok | 7.16 | 5.06 Volts - 12V | 37h | ok | 7.17 | 12.30 Volt - VBAT | 38h | ok | 7.18 | 3.22 Volts - -To get the system events logs, run:: - - # /usr/bin/ipmitool -I lan -L operator -U root -H -P sel list - - 17 | 01/27/2015 | 11:31:21 | OS Boot | C: boot completed | Asserted - 18 | 01/27/2015 | 11:41:08 | Memory | Correctable ECC | Asserted | CPU 0 DIMM 8 - 19 | 01/27/2015 | 12:07:14 | Physical Security #0x51 \ - | General Chassis intrusion | Asserted - 1a | 01/27/2015 | 17:37:46 | Memory | Correctable ECC | Asserted | CPU 0 DIMM 8 - 1b | 01/28/2015 | 06:27:27 | Memory | Correctable ECC | Asserted | CPU 0 DIMM 8 - 1c | 01/28/2015 | 12:03:13 | Memory | Correctable ECC | Asserted | CPU 0 DIMM 8 - 1d | 01/28/2015 | 17:39:00 | Memory | Correctable ECC | Asserted | CPU 0 DIMM 8 - 1e | 01/28/2015 | 23:14:46 | Memory | Correctable ECC | Asserted | CPU 0 DIMM 8 - 1f | 01/29/2015 | 04:50:33 | Memory | Correctable ECC | Asserted | CPU 0 DIMM 8 - 20 | 01/29/2015 | 10:26:19 | Memory | Correctable ECC | Asserted | CPU 0 DIMM 8 - 3e | 02/01/2015 | 17:14:54 | VBAT | 38h | lcr | 7.18 | 2.54 Volts - -Get the power status:: - - # /usr/bin/ipmitool -I lan -L operator -U root -H \ - -P power status - Chassis Power is on - -.. note:: - When coupled with the Ironic project, Ceilometer - has the ability to collect `IPMI sensors`_. - - - - - -.. _`standard`: http://www.intel.com/content/www/us/en/servers/ipmi/ipmi-specifications.html -.. _`IPMI specifications`: http://www.intel.com/content/www/us/en/servers/ipmi/ipmi-second-gen-interface-spec-v2-rev1-1.html -.. _`IPMI sensors`: http://docs.openstack.org/developer/ceilometer/sourcecode/ceilometer/ceilometer.ipmi.platform.ipmi_sensor.html diff --git a/pages/monitoring-guide/hardware-and-system-monitoring/operating-system-monitoring.rst b/pages/monitoring-guide/hardware-and-system-monitoring/operating-system-monitoring.rst deleted file mode 100644 index 858e678b2..000000000 --- a/pages/monitoring-guide/hardware-and-system-monitoring/operating-system-monitoring.rst +++ /dev/null @@ -1,258 +0,0 @@ -.. _mg-operating-system-monitoring: - -Operating System Monitoring ---------------------------- -Getting access to an operating system’s health status and key metrics -is largely supported by all Linux distributions through a plethora -of tools and monitoring applications including `Nagios`_, `Zabbix`_, -`Collectd`_, `Diamond`_, `Ganglia`_, `Sensu`_, and others. - -Below is the list of key metrics that we think are critical to collect in -the context of OpenStack monitoring. Whenever possible we try to provide -alerting criteria that should be applied to these metrics, but they largely -depend on the node’s role (workload characterisation) and hardware -characteristics of the servers. - - -Host Monitoring -+++++++++++++++ - -============================ ============== ========================================== -Metrics Unit Purpose -============================ ============== ========================================== -node uptime check second diag -OS version string diag -kernel version string diag -host is alive (simple ping) bool alert: When host is down -============================ ============== ========================================== - - -Disk Usage Monitoring -+++++++++++++++++++++ - -============================ ============== ========================================== -Metrics Unit Purpose -============================ ============== ========================================== -read bytes/sec diag -write bytes/sec diag -operation read operation/sec diag -read time millisecond diag -write time millisecond diag -============================ ============== ========================================== - - -Soft RAID Monitoring -++++++++++++++++++++ - -============================ ========================================================= -Checks Alert criteria -============================ ========================================================= -pool state missing member -synchronization synchronization running -============================ ========================================================= - - -Filesystem Usage Monitoring -+++++++++++++++++++++++++++ - -============================ ========================================================== -Metrics Purpose -============================ ========================================================== -free space Alert: static thresholds like <10% or <5% free space in - the file system can generate false positives. - It is instead recommended to set a smarter alarm that is - based on the trend observed from historical data so that - you are alerted only when it is projected that the file - system becomes full within the next 24 hours for example. - -used space diag - -free inodes Alert: Below 10% free inodes may indicate too many small - files or zero sized files on disk. An exhaustion of inodes - raises the error “no space left” regardless of whether there - is still plenty of free space on the file system or not. - -used inodes diag -============================ ========================================================== - - -CPU Usage Monitoring -++++++++++++++++++++ - -============================ ========================================================== -Metric Purpose -============================ ========================================================== -% CPU user diag - -% CPU system diag - -% CPU wait Alert: Above 10% of CPU wait could be suspicious - depending on the node’s role which calls for further - investigations. For example, a CPU wait above around - 10% on the compute nodes is probably not a desirable - situation because it means that the local disk(s) are - a performance bottleneck for the hypervisor. - -% CPU idle Alert: Below 20% CPU idle could be a problem depending - on the node’s role which calls for further investigations. - For example, below 20% CPU idle on controller nodes is - probably not a desirable situation because it means that - the cloud management system is overloaded. On the other - hand, below 20% CPU idle on the compute nodes may be - considered as normal and even expected depending on the - operator’s overcommitment policies. - -system load (5, 10, 15) diag - -context switches diag: It is important to take a closer look at the rate of - context switches. A rate that is too high should be - interpreted as an anomaly that may result from having too - many processes running on a node or from running poorly - parallelized applications that are too heavily competing - for shared resources. -============================ ========================================================== - - -RAM Usage Monitoring -++++++++++++++++++++ - -Setting alarms for RAM usage is not necessarily appropriate, because it could -generate false positives. This is due to the fact that some applications -allocate more memory than they currently need, for example, to support caches. -And so, in order to correctly identify a condition of memory shortage in an -alarm, you would have to take into account how the applications actually use -the memory, which is not really possible in practice. - -================== ================== ================== -Metrics Unit Purpose -================== ================== ================== -free megabytes diag -used megabytes diag -cached megabytes diag -buffered megabytes diag -================== ================== ================== - - -Swap Usage Monitoring -+++++++++++++++++++++ - -Same thing for the swap usage. Swap usage may be an indication of a memory -shortage situation when you observe a steady increase of swap space usage -over a relatively long period of time. But, probably, not in terms of usage -percentage, because files may stay in swap for a long period of time without -any further access to them. - -================== ================== ================== -Metrics Unit Purpose -================== ================== ================== -free megabytes diag -used megabytes diag -cached megabytes diag -io in/out megabytes diag -================== ================== ================== - - -Process Statistics Monitoring -+++++++++++++++++++++++++++++ - -It is generally a good idea to collect process statics to be stored in a -time-series database for trend analysis and anomaly detection using statistical -models. - -===================================== ================== -Metrics Purpose -===================================== ================== -number of processes running diag -number of processes paging diag -number of processes blocked diag -number of processes sleeping diag -number of processes zombies diag -number of processes stopped diag -fork rate megabytes diag -===================================== ================== - -More fine-grained statistics could be collected for key processes like those -supporting the OpenStack services: - -===================================== ================== -Metrics Purpose -===================================== ================== -number of threads diag -memory usage (Mbytes) diag -cpu usage (user/system) diag -===================================== ================== - - -Network Interface Card (NIC) Monitoring -+++++++++++++++++++++++++++++++++++++++ - -**Collected metrics** - -=============== =================================================================== -Metrics Purpose -=============== =================================================================== -bandwidth Alert: When bandwidth is consumed steadily approaching the nominal - bandwidth of the network link. - -errors Alert: When errors rate is too high. -=============== =================================================================== - -**Status checks** - -=============== =================================================================== -Checks Purpose -=============== =================================================================== -link status diag -bonding status diag -=============== =================================================================== - -.. note:: - Bonding can be achieved with Linux bonding or Open vSwitch. - - Linux bonding status information is found in - ``/sys/class/net//operate``. - See as an example how Nagios performs `linux bonding checks`_. - - Open vSwitch bonding status information is displayed with the - :command:`ovs-appctl bond/show`. - - -Firewall (iptables) Monitoring -++++++++++++++++++++++++++++++ - -=============== =================== =============================================== -Checks Source Purpose -=============== =================== =============================================== -status iptables -L Alert: When firewall is not enabled -=============== =================== =============================================== - -It is generally a good idea to collect firewall metrics for diagnostic. -The :command:`iptstate` command allows the number of connections and TCP -sessions metrics collection. - -=================================== =============================================== -Metrics Purpose -=================================== =============================================== -dropped packets diag -number of connection TCP diag -number of connection UDP diag -number of connection ICMP diag -number of TCP sessions SYN diag -number of TCP sessions TIME_WAIT diag -number of TCP sessions ESTABLISHED diag -number of TCP sessions CLOSE diag -=================================== =============================================== - - - -.. _`Nagios`: http://www.nagios.org/ -.. _`Zabbix`: http://www.zabbix.com/ -.. _`Collectd`: http://collectd.org/ -.. _`Diamond`: https://github.com/BrightcoveOS/Diamond/wiki/ -.. _`Ganglia`: http://ganglia.sourceforge.net/ -.. _`Sensu`: https://sensuapp.org/ -.. _`linux bonding checks`: http://exchange.nagios.org/directory/Plugins/Operating-Systems/Linux/check_linux_bonding/details - - - - diff --git a/pages/monitoring-guide/intended-audience.rst b/pages/monitoring-guide/intended-audience.rst deleted file mode 100644 index fe742083a..000000000 --- a/pages/monitoring-guide/intended-audience.rst +++ /dev/null @@ -1,27 +0,0 @@ -.. _mg-intended-audience: - -Intended Audience -================= - -The primary audience of this document are the architects and technical staff -involved in the design and deployment of an OpenStack cloud. The other -audiences are the members of the operations staff that are in charge of managing -and maintaining the OpenStack cloud in a healthy state on a daily basis. -This includes: - -Line of Business Owner - The Line of Business Owner needs to know how "things" are running and if there - are any problems that may affect the SLA. This person focuses on marketing and - business, not IT, and, thus, is interested in top level indicators to know about - services health. - -Operational support - Provides support to customers encountering issues. Is generally organized with a - service desk and two support levels for problem escalation. The support relies on - monitoring solutions to perform diagnostics and also should benefit from preventive - alerts. - -Subject Matter Expert - Investigates and resolves a domain-specific problem. Validates the resolution. - Uses the monitoring system to troubleshoot and observe the cloud infrastructure - behaviour. diff --git a/pages/monitoring-guide/introduction.rst b/pages/monitoring-guide/introduction.rst deleted file mode 100644 index 2c1a3d877..000000000 --- a/pages/monitoring-guide/introduction.rst +++ /dev/null @@ -1,36 +0,0 @@ -.. _mg-introduction: - -Introduction -============ - -This document does not attempt to tout a particular solution or monitoring -system for OpenStack. Instead, it strives to provide best practices and -provide specific guidelines about how to monitor OpenStack effectively -irrespectively of the technology being used. This includes specific examples -about how to collect and process key metrics to increase your operational -visibility, check various health indicators to detect critical failure -conditions, index and search the logs for root cause analysis and -troubleshooting. Also, it must be highlighted from the start that this -document provides guidelines for monitoring the OpenStack **infrastructure** -and host services. It is not a guide for the monitoring the virtual machines -nor the applications running on top of them. - -The expected outcome is two-fold: - -* Gain insights into what is critically important to watch in OpenStack so that - operators can be alerted in near real-time to anticipate and react to - undesirable situations. -* Provide a comprehensive set of guidelines to implement - your own monitoring system. In that sense, this document can also be viewed as - a specification you can use to implement your own solution using technologies - like Zabbix or the LMA Toolchain that are provided as `Fuel plugins - `_ for Mirantis - OpenStack 6.1 onward. - -In addition, we think that an effective monitoring solution for OpenStack should -have the following main characteristics. - -* Provide near real-time insights and alerting. -* Support discovery and configuration management automation so that the error - prone manual setup can be completely avoided. -* The monitoring system supports its own self-monitoring and high availability. diff --git a/pages/monitoring-guide/monitoring-activities-details/ceilometer.rst b/pages/monitoring-guide/monitoring-activities-details/ceilometer.rst deleted file mode 100644 index e063dfc7c..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/ceilometer.rst +++ /dev/null @@ -1,111 +0,0 @@ -.. _mg-ceilometer: - -Ceilometer ----------- - -Ceilometer is the OpenStack telemetry project which aims to provide -a unique point of information to acquire all of the resource usage measurements that operators need for chargeback and billing. - -| - -**Process checks** - -.. list-table:: - :header-rows: 1 - :widths: 30 15 15 20 20 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - Dependencies - - HA mode - - * - ceilometer-api - - HTTP 8777 - - controller - - storage - - active/active - - * - :ref:`ceilometer-agent-central ` - - RPC - - controller - - amqp - - active/passive - - * - :ref:`ceilometer-agent-compute ` - - RPC - - compute - - amqp - - active/passive - - * - ceilometer-agent-notification - - RPC - - controller - - amqp - - active/active - - * - ceilometer-collector - - RPC - - controller - - amqp,storage - - active/active - - * - ceilometer-alarm-evaluator - - RPC - - controller - - ceilometer api, storage - - active/active - - * - ceilometer-alarm-notifier - - RPC - - controller - - amqp, external system - - active/active - -.. _agents: - -*ceilometer-agent-central* and *ceilometer-agent-compute* are -replaced by a single process named *ceilometer-polling*. - -.. note:: - Since several storage backends can be used by Ceilometer, the - monitoring of these backends is not addressed in this document. - See `Ceilometer backends list `_. - -| - -**API checks** - -Check the proper functioning of the API with a read operation like -listing of samples: - -* GET /v2/samples - -.. note:: - When requesting the API, you must use the ``limit`` option not - to overload the service by retrieving too much data. - -| - -**Collected Metrics** - -.. list-table:: - :header-rows: 1 - :widths: 20 40 40 - :stub-columns: 0 - :class: borderless - - * - Metrics - - Source - - Purpose - - * - API errors - - Logs or HAProxy: - - All HTTP 500 error code. - - Alert: - - When a sudden spike of errors is detected. diff --git a/pages/monitoring-guide/monitoring-activities-details/cinder.rst b/pages/monitoring-guide/monitoring-activities-details/cinder.rst deleted file mode 100644 index f14363dcc..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/cinder.rst +++ /dev/null @@ -1,129 +0,0 @@ -.. _mg-cinder: - -Cinder ------- - -Cinder is the OpenStack service for block storage. It allows users -to manage block storage resources that could be attached to the -instances. - -| **Process checks** - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - Dependencies - - HA mode - - * - cinder-api - - 8776 - - controller - - db, amqp - - active/active - - * - cinder-scheduler - - RPC - - controller - - amqp - - active/active - - * - cinder-volume - - RPC - - storage-cinder - - db, amqp, :ref:`storage ` - - active/active (Ceph backend) - - n/a (LVM backend) - -.. _cinder-storage: - -Cinder can use different block storage backends like LVM or Ceph. - -| **API checks** - -Check the proper functioning of the API with a read operation. -For example: - -* list volume - - * GET /v2/{tenant_id}/volumes - -A more intrusive test may want to check the complete creation of a volume: - -* create a volume - - * POST /v2/{tenant_id}/volumes - -* get volume details - - * GET /v2/{tenant_id}/volumes/{volume_id}​ - -* delete a volume - - * DELETE /v2/{tenant_id}/volumes/{volume_id}​ - -| **Collected Metrics** - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Metrics - - Source - - Purpose - - * - number of volumes in error state - - poll SQL: - - select count(*) from volumes where status=’error’ - - Alert: - - When the value of error state ratio is beyond a certain - threshold. - - * - number of volumes deleting - - poll SQL: - - select count(*) from volumes where status='deleting' - - diag - - * - number of snapshots in progress - - poll SQL: - - select count(*) from snapshots where progress NOT LIKE '100%' - - diag - - * - number of snapshots deleting - - poll SQL: - - select count(*) from snapshots where status='deleting' - - diag - - * - total number of volumes - - poll SQL: - - select count(*) from volumes where deleted != 1; - - diag - - * - total size of active volumes - - poll SQL: - - select sum(size) from volumes where deleted != 1 and - status = 'available'; - - diag - - * - API errors - - Logs or HAProxy: - - All with HTTP 500 error code. - - alert: - - When a sudden spike of errors is detected. diff --git a/pages/monitoring-guide/monitoring-activities-details/dhcp-agent.rst b/pages/monitoring-guide/monitoring-activities-details/dhcp-agent.rst deleted file mode 100644 index 75260db50..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/dhcp-agent.rst +++ /dev/null @@ -1,14 +0,0 @@ -.. _mg-dhcp-agent: - -DHCP agent -++++++++++ - -The *neutron-dhcp-agent* relies on **dnsmasq** to handle the DHCP -requests which provide network configuration to instances. - -| We recommend you perform the following checks to detect anomalies: - -* There must be at least one **dnsmasq** process per tenant network - when DHCP is enabled. -* Too many DHCPNAK entries in dnsmasq logs could be the symptom of - connectivity issues with the instances. diff --git a/pages/monitoring-guide/monitoring-activities-details/glance.rst b/pages/monitoring-guide/monitoring-activities-details/glance.rst deleted file mode 100644 index 330940e0c..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/glance.rst +++ /dev/null @@ -1,116 +0,0 @@ -.. _mg-glance: - -Glance ------- - -Glance is the OpenStack service allowing users to upload and discover -data assets that are meant to be used with other services. This -currently includes images and metadata definitions used by the nova -service. - -**Process checks** - -.. list-table:: - :header-rows: 1 - :widths: 20 20 15 20 20 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - Dependencies - - HA mode - - * - glance-api - - 9292 - - controller - - db, amqp - - active/active - - * - glance-registry - - 9191 - - controller - - db, amqp, :ref:`storage ` - - active/active - -.. _storage: - -Glance can use different storage backends: Swift or Ceph that are -used by default in HA deployments. - -| - -**API checks** - -Check the proper functioning of the API with a read operation. -Example: - -* list images - - * GET /v1/images - -A more intrusive test checks the complete creation of an image: - -* create an image by uploading a small image (a few megabytes in size) - - * POST /v1/images - -* get image details - - * GET /v1/images/{image_id} - -* delete an image - - * DELETE /v1/images/{image_id} - -| - -**Collected Metrics** - -.. list-table:: - :header-rows: 1 - :widths: 25 45 30 - :stub-columns: 0 - :class: borderless - - * - Metrics - - Source - - Purpose - - * - Number of active images public/private - - poll API - - GET /v2/images - - diag - - and/or alert: - - Too few active images could be the symptom of a deeper problem. - - * - Number of images per status (active, queued, saving) - - poll API - - GET /v2/images - - diag - - * - Total size of active images - - poll API - - GET /v2/images?visibility=public&status=active - - diag - - * - API errors - - Logs or HAProxy: - - All HTTP 500 error code. - - Examples of a log entry containing a failed image upload error: - - 2015-03-02 12:44:12.438 1212 INFO glance.wsgi.server - [{request-id} {user-id} {tenant-id} - - -] 192.168.0.1 - - - [04/ Mar/2015 12:38:55] "POST /v1/images HTTP/1.1" - **500** 877 49.117649 - - Alert: - - When a sudden spike of errors is detected. diff --git a/pages/monitoring-guide/monitoring-activities-details/haproxy.rst b/pages/monitoring-guide/monitoring-activities-details/haproxy.rst deleted file mode 100644 index cf6771125..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/haproxy.rst +++ /dev/null @@ -1,153 +0,0 @@ -.. _mg-haproxy: - -HAProxy -------- - -HAproxy is the HTTP load balancer in front of all OpenStack services -endpoints and a TCP load balancer for MySQL. - -**Process checks** - -.. list-table:: - :header-rows: 1 - :widths: 30 30 30 40 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - HA mode - - * - haproxy - - All API requests through HTTP port and MySQL requests through TCP - port - - active controller - - active/passive - -Performing checks against the HAProxy process through the VIP -requires one to know which node is the active (master) controller -node in the Corosync/Pacemaker cluster. This is detailed below in the -:ref:`Corosync/Pacemaker HA cluster` section. - -The active controller handles all the OpenStack services requests -through HAProxy which in turn, distributes the load across the -API endpoints of the controller cluster. - -**Collected Metrics** - -It is critical to monitor the status of the *backend* from the point -of view of HAProxy. A *backend* is in ``down`` state when all the -API endpoints behind the load-balancer are failed, and, therefore, -should be reported immediately to the operator in an alert. - -.. list-table:: - :header-rows: 1 - :widths: 20 20 40 - :stub-columns: 0 - :class: borderless - - * - Metrics - - Source - - Purpose - - * - backend connections errors - - haproxy socket - - Alert: When a sudden spike of errors is detected. - - * - number of current sessions - - haproxy socket - - diag - - * - number of denied requests - - haproxy socket - - diag - - Can be useful for security audit - - * - number of denied responses - - haproxy socket - - diag - - Can be useful for security audit - - * - bytes in/out - - haproxy socket - - diag - - * - max queued requests - - haproxy socket - - diag - - * - number of queued requests - - haproxy socket - - Alert: Beyond a certain threshold, the number of queued requests - can be a symptom of a performance bottleneck in the workflow - - * - queue limit - - haproxy socket - - diag - - * - request errors - - haproxy socket - - Alert: When a sudden spike of errors is detected - -HAProxy provides a CLI to collect statistics for its *frontends* -and *backends*. `Several statistics`_ are available. - -For example, you can use the command below to detect that the -*backend* is in ``down`` state. Here, the nova-api stopped -responding:: - - echo "show stat" | socat /var/lib/haproxy/stats stdio | grep BACKEND \ - | awk -F , '{print $1, $2, $18}' | grep DOWN - nova-api node-10 DOWN - -As another example, you can use the command below to get a list of -the API endpoints with their respective status:: - - echo "show stat" | socat /var/lib/haproxy/stats stdio | grep BACKEND \ - | awk -F , '{print $1, $2, $18}' - horizon BACKEND UP - keystone-1 BACKEND UP - keystone-2 BACKEND UP - nova-api-1 BACKEND DOWN - nova-api-2 BACKEND UP - nova-metadata-api BACKEND UP - cinder-api BACKEND UP - glance-api BACKEND UP - neutron BACKEND UP - glance-registry BACKEND UP - mysql BACKEND UP - swift BACKEND UP - heat-api BACKEND UP - heat-api-cfn BACKEND UP - heat-api-cloudwatch BACKEND UP - nova-novncproxy BACKEND UP - -With the command below, you can see that the **glance-api** endpoints -on node-7 and node-10 are ``down`` while the *backend* is still -``up``. However, the HA status of the Glance service as a whole is no -longer ensured and therefore should be reported immediately to the -operator in an alert. - -.. code:: - - echo "show stat" | socat /var/lib/haproxy/stats stdio | awk -F , \ - '{print $1, $2, $18}' | grep glance-api - - glance-api FRONTEND OPEN - glance-api node-6 UP - glance-api node-7 DOWN - glance-api node-10 DOWN - glance-api BACKEND UP - -Finally, the command below can be used to collect all the HAProxy -statistics:: - - echo "show stat" | socat /var/lib/haproxy/stats stdio - - - -.. Links -.. _`Several statistics`: http://cbonte.github.io/haproxy-dconv/configuration-1.5.html#9 diff --git a/pages/monitoring-guide/monitoring-activities-details/heat.rst b/pages/monitoring-guide/monitoring-activities-details/heat.rst deleted file mode 100644 index def1f3a58..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/heat.rst +++ /dev/null @@ -1,91 +0,0 @@ -.. _mg-heat: - -Heat ----- - -Heat is the OpenStack service to orchestrate the deployment of -multiple composite cloud applications using the `Heat Orchestration -Template (HOT)`_ and also compatible with the AWS CloudFormation template -format through both an OpenStack-native ReST API and a -CloudFormation-compatible Query API. - -| **Process checks** - - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - Dependencies - - HA mode - - * - heat-api - - 8004 - - controller - - db, amqp - - active/active - - * - heat-engine - - RPC - - controller - - db, amqp, other OpenStack services - - active/active - - * - heat-api-cfn - - 8000 - - controller - - db, amqp - - active/active - -.. note:: - - The heat-api-cloudwatch service is not addressed here as it is - deprecated by the Heat team. - -| **Collected Metrics** - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Metric - - Source - - Purpose - - * - number of active stacks - - API - - GET /v1/{tenant_id}/stacks - - diag - - * - number of stacks in error - - API - - GET /v1/{tenant_id}/stacks - - diag - - * - number of stacks in progress - - API - - GET /v1/{tenant_id}/stacks - - diag - - * - API errors - - Logs or HAProxy: - - All HTTP 500 error code. - - Alert: - - When a sudden spike of errors is detected. - - -.. Links -.. _`Heat Orchestration Template (HOT)`: http://docs.openstack.org/developer/heat/template_guide/hot_guide.html - diff --git a/pages/monitoring-guide/monitoring-activities-details/horizon.rst b/pages/monitoring-guide/monitoring-activities-details/horizon.rst deleted file mode 100644 index 4bad68ff6..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/horizon.rst +++ /dev/null @@ -1,121 +0,0 @@ -.. _mg-horizon: - -Horizon -------- - -Horizon is a canonical implementation of the OpenStack dashboard, -which provides a web-based user interface to OpenStack services -including Nova, Swift, Keystone, and others. Horizon is often the -main, if not the only, interface to the OpenStack services, and it is -critical to ensure that it is always available and responsive to -users. - -The *Apache* HTTP server hosts the Horizon dashboard that is -implemented as a WSGI application. The HTTP server running the -Horizon dashboard is deployed behind the HAProxy load balancer which -distributes the load across the controller nodes cluster. This -application does not use the OpenStack database. It is simply a web -interface facade for the OpenStack services API endpoints. - -**Process checks** - -.. list-table:: - :header-rows: 1 - :widths: 28 20 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - Dependencies - - HA mode - - * - apache2 or httpd - - HTTP 80 - - controller - - n/a - - active/active - -**Interface checks** - -* A synthetic HTTP transaction process performing login/logout - sequences against the Horizon’s VIP should be executed on a regular - basis to ensure it is responding properly to user requests. - -**Collected Horizon Metrics** - -Horizon metrics should be extracted from the Apache server(s) logs in -order to detect errors. - -.. list-table:: - :header-rows: 1 - :widths: 20 30 30 - :stub-columns: 0 - :class: borderless - - * - Metrics - - Source - - Purpose - - * - number of logins - - logs: - - `dashboard-openstack_auth.forms: INFO Login successful for user - "admin"`. - - alert: - - The absence of logins during a certain period may indicate - that users do not have access to Horizon anymore. - - * - login errors - - logs: - - `dashboard-openstack_auth.forms: WARNING Login failed for user - "xxx"`. - - alert: - - When a sudden spike of errors is detected. Could indicate a - brute force attack situation. - -**Collected Apache Metrics** - -Apache server should be sized and configured according to the -expected load. Here are some metrics we suggest that you collect: - -.. list-table:: - :header-rows: 1 - :widths: 20 30 30 - :stub-columns: 0 - :class: borderless - - * - Metrics - - Source - - Purpose - - * - number of requests/sec - - server-status - - diag - - * - number of bytes served/sec - - server-status - - diag - - * - number of busy workers - - server-status - - diag - - * - number of idle workers - - server-status - - alert: - - The continuous observation of zero idle workers may be the - symptom of a server that is too busy or improperly configured. - -.. note:: - `Server-status`_ must be enabled in the Apache’s configuration to - provide information on the server’s activity and performance. - -.. Links -.. _`Server-status`: http://httpd.apache.org/docs/2.2/mod/mod_status.html - diff --git a/pages/monitoring-guide/monitoring-activities-details/keystone.rst b/pages/monitoring-guide/monitoring-activities-details/keystone.rst deleted file mode 100644 index fb11df66b..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/keystone.rst +++ /dev/null @@ -1,119 +0,0 @@ -.. _mg-keystone: - -Keystone --------- - -Keystone is an OpenStack service that provides identity, token, -catalog, and policy services to users and to other OpenStack -services. As such, the availability of all the OpenStack services -depends on the availability of Keystone. - -**Process Checks** - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - Dependencies - - HA mode - - * - keystone-all - - HTTP - 5000 (public) and - 35357 (admin) - - controller - - db, memcached, Apache - - active/active - -**API checks** - -Check the proper functioning of authentication and token revocation -operations: - -* POST /v2.0/tokens -* DELETE /v2.0/tokens/{token-id} or DELETE /v3/auth/tokens - -| - -**Collected Metrics** - -.. list-table:: - :header-rows: 1 - :widths: 20 40 40 - :stub-columns: 0 - :class: borderless - - * - Metrics - - Source - - Purpose - - * - authentication errors - - log: - - POST /v2.0/tokens HTTP/1.1" 401 330 0.205647 - - 401 error code indicates an authentication error - - alert: - - When a sudden spike of errors is detected. A high - authentication errors rate can be the symptom of a - brute-force attack. - - * - authentication response time - - log: - - POST /v2.0/tokens HTTP/1.1" 200 4199 0.092479 - - where 0.092479 is the response time in seconds - - alert: - - When the value is beyond standard deviation or top - percentiles threshold depending on the data-points - distribution. - - * - token validation errors - - logs - - GET /v3/auth/tokens HTTP/1.1" 404 7317 0.071319 - - #404 indicates a token validation error - - alert: - - When a sudden spike of errors is detected. - - * - token validation response time - - logs: - - GET /v3/auth/tokens HTTP/1.1" 200 7317 0.071319 - - # 0.071319 is the response time in seconds - - alert: - - When the value is beyond standard deviation or top - percentiles threshold depending on the data-points - distribution. - - * - number of users - - poll API: - - GET /v2.0/users - - diag - - * - number of tenants - - poll API: - - GET /v2.0/tenants - - diag - - * - API errors - - Logs or HAProxy: - - All HTTP 500 error code. - - alert: - - When a sudden spike of errors is detected. diff --git a/pages/monitoring-guide/monitoring-activities-details/libvirt.rst b/pages/monitoring-guide/monitoring-activities-details/libvirt.rst deleted file mode 100644 index 2ef5eaa3a..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/libvirt.rst +++ /dev/null @@ -1,67 +0,0 @@ -.. _mg-libvirt: - -Libvirt -------- - -Libvirt provides a common layer on top of hypervisors or containers -like KVM and LXC. Nova uses libvirt to manage instances. The libvirt -daemon must be started on all compute nodes, otherwise no instances -can be spawned. - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - HA mode - - * - libvirtd - - internal RPC protocol, XML format - - compute - - n/a - -**Collected Metrics** - -Collecting statistics about hypervisors can be done either by -requesting them directly from libvirt or by using the following Nova -API ``/os-hypervisors/detail`` and ``/os-hypervisors/statistics``, -which is the recommended approach. These metrics are described above -in the :ref:`Nova section `. - -Furthermore, libvirt provides per instance statistics like CPU, -Disk, and Network IO which are further discussed -in :ref:`appendix `. These -statistics are mainly useful if they are associated with their -respective user, tenant, and cloud resource ID. To associate them, it -is necessary to either request Nova API and perform the mapping -between libvirt instance ID and OpenStack ID (prior to Juno), or more -effectively, by using the libvirt instance metadata set by Nova and -providing all the necessary information:: - - # virsh edit instance-00000002 - - instance-00000002 - 01c2d829-e480-4568-92c2-7dc0432a2549 - - - z - 2015-06-05 08:52:12 - - 64 - 0 - 0 - 0 - 1 - - - - - - ... - -Libvirt logs are under the ``/var/log/libvirt/`` directory. diff --git a/pages/monitoring-guide/monitoring-activities-details/memcached.rst b/pages/monitoring-guide/monitoring-activities-details/memcached.rst deleted file mode 100644 index ddaea9b47..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/memcached.rst +++ /dev/null @@ -1,138 +0,0 @@ -.. _mg-memcached: - -Memcached ---------- - -Memcache is an in-memory storage server. It is mainly used by -*Keystone* to store tokens. The availability of memcache is therefore -critical to ensure that the authentication requests performed by the -OpenStack services can be satisfied. - -The *consoleauth* Nova service also uses memcache to share -authorization tokens and to ensure the high availability of the -service. - -**Process checks** - -Memcached process checks should be performed for each controller -node. - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 40 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - HA mode - - * - memcached - - TCP port 11211 - - controller - - active/active - -Memcache statistics per server can be collected with the command:: - - echo -e "\nquit" | nc 127.0.0.1 11211 - - # where command is one of “stats” or “stats items” - -Refer to the `memcached documentation`_ for the complete list of stats available. Below is a selected list of metrics: - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Metrics - - Source - - Purpose - - * - curr_item - - command stats: number of current items - - diag - - * - total_item - - command stats items: total number of items - - diag - - * - cmd_get - - command stats: number of get - - diag - - * - cmd_set - - command stats: number of set - - diag - - * - get_hits - - command stats: number of hits - - diag - - * - get_misses - - command stats: number of get misses - - Alert: high number of misses indicates a misconfiguration - somewhere (TTL too short or memory starvation) - - * - curr_connections - - command stats: number of current connections - - diag - - * - total_connections - - command stats: counter total of connections - - diag - - * - evictions - - command stats: number of valid items removed from cache - to free memory for new items - - Alert: should never happen. Requires to increase the memory size - - * - bytes_read - - command stats: bytes read from cache - - diag - - * - bytes_written - - command stats: bytes write in cache - - diag - - * - limit_maxbytes - - command stats: max bytes to use for storage - - diag - - * - threads - - command stats: number of threads - - diag - - * - conn_yields - - command stats: connection yield - - diag - - when > 0 consider increasing the connection limit - - * - maxbytes - - command stats: maximum memory bytes to use - - diag - - * - maxconns - - command stats: maximum connection - - diag - - * - evicted - - command stats: counter of evicted items - - diag - - * - outofmemory - - command stats: number of times the server fails to store a new - item due to a lack of memory available - - Alert: Unable to store item should never happen - - * - errors - - ``/var/log/memcached.log`` - - Alert: When a sudden spike of errors is detected - - - -.. Links: -.. _`memcached documentation`: https://github.com/memcached/memcached/blob/master/doc/protocol.txt diff --git a/pages/monitoring-guide/monitoring-activities-details/monitoring-activities-details.rst b/pages/monitoring-guide/monitoring-activities-details/monitoring-activities-details.rst deleted file mode 100644 index e988e5b7e..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/monitoring-activities-details.rst +++ /dev/null @@ -1,70 +0,0 @@ -.. _mg-monitoring-activities-details: - -Monitoring Activities Details -============================= - -In this chapter we are getting into the details of how the monitoring -activities introduced above can be implemented. It is worth -restating that a common trait of those monitoring activities is to -collect and process the operational data that should increase the -operational visibility about how an OpenStack cloud behaves over -time. In other words, get the level of insights that is required to -make value judgments about what should be done to keep your -OpenStack cloud kicking and healthy. - -.. note:: - The `LMA Collector`_, available as a `Fuel plugin`_, does all the - heavy lifting work of collecting and processing those operational - data for you. Please refer to the `LMA Collector documentation`_ to - understand how it works and how it can be used. Now, you have the - choice between using the LMA Collector directly or build your own - solution based on the guidelines described below. - -| The chapter is organized in sections where each section covers a - particular OpenStack service or auxiliary component like RabbitMQ - for the AMQP bus or Corosync/Pacemaker for the HA cluster. Then, - each section is further divided into subsections describing: - -* The process checks, which gives you a list of all processes - involved in the support of a particular service function, including - details about the role of the node, where the process is running, - the incoming connections and a port number and their dependencies. - As we have seen above, a failed process check should always be - reported as a critical error, but the ensuing alert will not - necessarily require an immediate attention. - -* The service API checks, which gives you a list of the API endpoints - that you should monitor with an example of synthetic transaction you - can use to verify that the service responds properly to user - requests. A failed service API check should always be reported as a - critical error and the ensuing alert should call for immediate - attention. - -* The operational data metrics, which aims to increase your - operational visibility along with a simple method to retrieve their - values. Those metrics can be used for both diagnosis and alerting - purposes. - - -.. Links -.. _`LMA Collector`: https://github.com/stackforge/fuel-plugin-lma-collector -.. _`Fuel plugin`: https://wiki.openstack.org/wiki/Fuel/Plugins -.. _`LMA Collector documentation`: http://fuel-plugin-lma-collector.readthedocs.org/en/latest/ - - -.. include:: /pages/monitoring-guide/monitoring-activities-details/keystone.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/nova.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/network.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/glance.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/cinder.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/horizon.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/heat.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/ceilometer.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/sahara.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/murano.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/libvirt.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/haproxy.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/rabbitmq.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/mysql.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/memcached.rst - diff --git a/pages/monitoring-guide/monitoring-activities-details/murano.rst b/pages/monitoring-guide/monitoring-activities-details/murano.rst deleted file mode 100644 index 33bcc8798..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/murano.rst +++ /dev/null @@ -1,160 +0,0 @@ -.. _mg-murano: - -Murano ------- - -Murano is an OpenStack service which provides a catalog of -applications that can be readily deployed in an OpenStack cloud. -Murano orchestrates the deployment of those applications -automatically using other OpenStack services. - -| **Process checks** - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - Dependencies - - HA mode - - * - murano-api - - HTTP 8082 - - controller - - db, amqp - - active/active - - * - murano-engine - - RPC - - controller - - murano-api, heat, :ref:`neutron `, :ref:`amqp ` - - active/active - -.. _neutron: - -In MOS 7.0, Neutron will be an optional dependency. If not found in -Keystone, Murano will fall back to use Nova Network. - -.. _amqp: - -May be configured to use an additional instance of RabbitMQ. Note -that the RabbitMQ instance used by Murano resides on the primary -controller node and listens on port 55572 on the public network. - - -| **API checks** - -Check the proper functioning of the API with a read operation. For -example: - -* list available packages: - - /v1/catalog/packages - -* check if the package with Core Murano library is registered: - - /v1/catalog/packages?fqn=io.murano - - This API call should return a JSON object with “packages” property - set to a json-array containing at least one object. - -| **Collected Metrics** - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Metrics - - Source - - Purpose - - * - API errors - - Logs or HAProxy: - - All HTTP 500 error code. - - Alert: - - When a sudden spike of errors is detected. - - * - Number of environments - - Poll SQL: - - select count(id) from environment; - - diag - - * - Number of successful deployments - - Poll SQL: - - select count(id) from session where state='deployed' - - diag - - * - Number of running deployments - - Poll SQL: - - select count(id) from session where state='deploying' - - diag - - * - Number of deployments which failed to complete or failed to be deleted - - Poll SQL: - - select count(id) from session where state like '%failure' - - diag - - * - Number of running deployments which have not been updated for - more than 2 hours - - Poll SQL: - - select count(id) from session where state='deploying' and - updated < (now() - INTERVAL 2 HOUR) - - Alert: - - Deployment in ``deploying`` state which has not been updated - for a long period of time likely indicates a job which has - hung up and needs some attention. - - * - Total number of application packages in catalog - - Poll SQL: - - select count(id) from package; - - diag - - -Murano RabbitMQ instance -++++++++++++++++++++++++ - -| **Process checks:** - -Murano RabbitMQ instance runs as a named instance - -``murano@localhost``. - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - HA mode - - * - beam - - TCP 41056, 55572 - - controller - - no - -The command below returns the status of the Murano RabbitMQ instance:: - - # rabbitmqctl -n murano@localhost status - -And the following command returns the pid of the Murano RabbitMQ -instance if it exists:: - - # ps axf | grep beam | grep 'murano@localhost' | grep -oP '(?<=(^\s))(\d+)' - diff --git a/pages/monitoring-guide/monitoring-activities-details/mysql.rst b/pages/monitoring-guide/monitoring-activities-details/mysql.rst deleted file mode 100644 index cf520671c..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/mysql.rst +++ /dev/null @@ -1,181 +0,0 @@ -.. _mg-mysql: - -MySQL ------ - -The MySQL database running on the OpenStack controller nodes is a -central component because it is used by almost all the OpenStack -components as their primary data persistence storage. Therefore, it -is critical to monitor the healthiness of this component on each -of the controller nodes in the cluster. - -**Process checks** - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - Dependencies - - HA mode - - * - mysqld - - TCP 3306 - - controller - - storage - - active/passive - -In addition to checking the existence of the process, it is necessary -to check the availability status of the MySQL database. This can be -verified using the command:: - - # mysqladmin ping - - -| **Collected Metrics** - - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Metrics - - Source - - Purpose - - * - bytes received (bytes/sec) - - :ref:`poll SQL ` - - diag - - * - bytes sent (bytes/sec) - - :ref:`poll SQL ` - - diag - - * - begin operations - - :ref:`poll SQL ` - - diag - - * - commit operations - - :ref:`poll SQL ` - - diag - - * - delete operations - - :ref:`poll SQL ` - - diag - - * - insert operations - - :ref:`poll SQL ` - - diag - - * - rollback operations - - :ref:`poll SQL ` - - diag - - * - select operations - - :ref:`poll SQL ` - - Alert: - The absence of select operations could indicate that - the connection to the database is broken unless the MySQL - server is in maintenance. - - * - update operations - - :ref:`poll SQL ` - - diag - - * - number of queries - - :ref:`poll SQL ` - - :ref:`diag ` - - * - slow queries - - :ref:`poll SQL ` - - diag - - * - Database physical size (Mbyte) - - poll SQL: - - SELECT table_schema "database", sum( data_length + - index_length ) / 1024 / 1024 "size_mb" FROM - information_schema.TABLES GROUP BY table_schema order by 2 - desc; - - diag - -.. _poll_SQL: - -These poll SQL metrics can be collected using the following SQL command:: - - SHOW GLOBAL STATUS WHERE Variable_name=; - -See MySQL `server status variables`_ for details. - -.. _diag: - -.. note:: - - You should pay attention to MySQL logs to detect slow queries - for diagnostic purposes. You can activate slow queries log with - the following configuration parameters: - ``slow_query_log=1``, ``long_query_time=5``, and - ``slow_query_log_file=``. - - -| **Metrics related to the MySQL cluster** - -The high availability of the MySQL database is supported in -active/passive mode with one master and several slave nodes. -To ensure that the MySQL cluster remains highly available, you should -continuously monitor that slave nodes are ready to take over in case -of a master node failure. - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Metrics - - Source - - Purpose - - * - wsrep_ready - - :ref:`SQL ` possible values: ``ON``/``OFF`` - - Alert: node not ready if ``OFF`` - - * - wsrep_cluster_size - - :ref:`SQL: ` number of nodes - - diag - - * - wsrep_replicated_bytes - - :ref:`SQL: ` bytes sent to other nodes - - diag - - * - wsrep_received_bytes - - :ref:`SQL: ` bytes received from other nodes - - diag - - * - wsrep_cluster_status - - :ref:`SQL: ` Primary/Non- Primary/Disconnected - - Alert: A node is disconnected from the cluster. - - * - wsrep_local_commits - - :ref:`SQL ` number of commit - - diag - - * - errors - - ``/var/log/mysqld.log`` - - Alert: When a sudden spike of errors is detected. - -.. _SQL: - -These metrics can be collected with the SQL command:: - - SHOW STATUS WHERE Variable_name REGEXP 'wsrep.*'; - - -.. Links -.. _`server status variables`: http://dev.mysql.com/doc/refman/5.6/en/server-status-variables.html diff --git a/pages/monitoring-guide/monitoring-activities-details/network.rst b/pages/monitoring-guide/monitoring-activities-details/network.rst deleted file mode 100644 index 325c284d8..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/network.rst +++ /dev/null @@ -1,10 +0,0 @@ -.. _mg-network: - -Network -------- - -.. include:: /pages/monitoring-guide/monitoring-activities-details/neutron.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/dhcp-agent.rst -.. include:: /pages/monitoring-guide/monitoring-activities-details/open-vswitch.rst - - diff --git a/pages/monitoring-guide/monitoring-activities-details/neutron.rst b/pages/monitoring-guide/monitoring-activities-details/neutron.rst deleted file mode 100644 index 1b85c0731..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/neutron.rst +++ /dev/null @@ -1,133 +0,0 @@ -.. _mg-neutron: - -Neutron -+++++++ - -Neutron is the OpenStack service providing network connectivity as a -service between network interfaces (vNICs) managed by other OpenStack services like Nova. - -.. note:: - Neutron plugins *load balancer*, *firewall*, and *ipsec monitoring* - are not covered in this version of the document. - -**Process Checks** - -.. list-table:: - :header-rows: 1 - :widths: 30 15 15 15 25 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - Dependencies - - HA mode - - * - neutron-server - - HTTP 9696 - - controller - - db, amqp - - active/active - - * - neutron-dhcp-agent - - RPC - - active controller - - amqp, dnsmasq - - active/passive - - * - neutron-l3-agent - - RPC - - active controller - - db, iptables - - active/passive - - * - neutron-metadata-agent - - RPC - - compute - - amqp, db - - active/active - - * - neutron-ns-metadata-proxy - - RPC - - controller - - amqp, db - - active/passive - - * - neutron-openvswitch-agent - - RPC - - all nodes - - amqp, ovs - - active/passive - - * - dnsmasq - - UDP port 67 - - controller - - - - active/passive, see :ref:`DHCP agent` below - -| - -**API checks** - -Check the proper functioning of the API with a read operation. -Example: - -* list subnets - - * GET /v2.0/subnets - -| - -**Collected Metrics** - -.. list-table:: - :header-rows: 1 - :widths: 25 45 30 - :stub-columns: 0 - :class: borderless - - * - Metric - - Source - - Purpose - - * - Number of networks - - poll API - - GET /v2.0/networks - - Alert: - - Too few active networks could be the symptom of a deeper - problem. - - * - Number of subnets - - poll API - - GET /v2.0/subnets - - diag - - * - Number of routers - - poll API - - GET /v2.0/routers - - diag - - * - Number of ports - - poll API - - GET /v2.0/ports - - diag - - * - API errors - - Logs or HAProxy: - - All HTTP 500 error code. - - Log example: - INFO neutron.wsgi [{req-id} None] 192.168.0.1 - - [11/Mar/2015 - 19:17:22] "POST /v2.0/networks.json HTTP/1.1" 500 324 0.178729 - - # where 500 indicates an error - - Alert: - - When a sudden spike of errors is detected. diff --git a/pages/monitoring-guide/monitoring-activities-details/nova.rst b/pages/monitoring-guide/monitoring-activities-details/nova.rst deleted file mode 100644 index 1b4803fef..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/nova.rst +++ /dev/null @@ -1,301 +0,0 @@ -.. _mg-nova: - -Nova ----- - -Nova is the OpenStack service for Compute, a cloud computing fabric -controller, the main part of a cloud system. Nova is composed of -several processes, each assuring a particular function. The Nova -processes are distributed on the controller node(s) and compute -nodes. - -**Process checks** - -.. list-table:: - :header-rows: 1 - :widths: 25 20 15 20 20 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - Dependencies - - HA mode - - * - nova-api - - HTTP 8774 (Nova API), 8773 (Nova EC2 API) - - controller - - amqp - - active/active - - * - nova-scheduler - - RPC - - controller - - amqp - - active/active - - * - nova-conductor - - RPC - - controller - - db, amqp - - active/active - - * - nova-consoleauth - - RPC - - controller - - amqp - - active/active - - * - nova-console - - RPC - - controller - - amqp - - active/active - - * - nova-novncproxy - - RPC - - controller - - amqp - - active/active - - * - nova-cert - - RPC - - controller - - amqp - - active/active - - * - nova-compute - - RPC - - controller - - libvirt - - not available - -**API checks** - -Check the proper functioning of the API with a read operation. -Example: - -* list of flavors - - * GET /v2//flavors - - -A more intrusive operation checks if it’s possible to create and -delete a keypair: - -* create and delete a keypair - - * POST /v2/os-keypairs '{"keypair": {"name": "test-mon"}}' - * DELETE /v2/os-keypairs/test-mon - - -| -| **Collected Metrics** - -.. list-table:: - :header-rows: 1 - :widths: 25 45 30 - :stub-columns: 0 - :class: borderless - - * - Metrics - - Source - - Purpose - - * - Total number of instances in error state - - poll SQL: - - select count(*) from instances where vm_state='error' and - deleted=0 - - or poll API: - - /v2/{tenant_id}/servers/detail/?all_tenant=1 - - diag - - That should probably not trigger an alert, since those errors - may be due to the user mistakes. - - * - Total number of instances in running state - - poll SQL: - - select count(*) from instances where deleted=0 and - vm_state='active' - - poll API: - /v2/{tenant_id}/servers/detail/?all_tenant=1 - - Alert: - - Too few running instances could be a symptom of a deeper problem. - - * - Total number of instances per state, where state can be: - ``deleted``, ``paused``, ``resumed``, ``rescued``, ``resized``, - ``shelved_offloaded``, or ``suspended``. - - - poll SQL: - - select instances.vm_state, count(instances.id) from instances - where deleted=0 group by vm_state - - or poll API: - - GET /v2/{tenant_id}/servers/detail/?all_tenant=1 - - diag - - * - Number of compute nodes in operational state - - poll API - GET /v2/{tenant_id}/os-services - - or SQL: - - select count(services.id) from services where disabled=0 and - deleted=0 and services.binary = ‘nova-compute’ and - timestampdiff(SECOND,updated_at,utc_timestamp())<60; - - Alert: - - Too few running instances could a symptom of a deeper problem. - - * - Number of compute nodes in not operational state - - poll API: - GET /v2/{tenant_id}/os-services - - or SQL: - - select count(services.id) from services where disabled=0 and - deleted=0 and services.binary = ‘nova-compute’ and - timestampdiff(SECOND,updated_at,utc_timestamp())>60; - - diag - - * - Number of services offline - - poll API: - GET /v2/{tenant_id}/os-services - - or poll SQL: - select count(*) from services where disabled=1 and deleted=0 - and timestampdiff(SECOND,updated_at,utc_timestamp())>60 - - diag - - * - Number of services available per function: conductor, - scheduler - - poll API: - GET /v2/{tenant_id}/os-services - - poll SQL: - select services.binary, count(services.id) from services where - disabled=0 and deleted=0 and timestampdiff - (SECOND,updated_at,utc_timestamp())>60 group by - services.binary; - - diag - - * - Number of running instances per compute node - - API: - GET /v2/{tenant-id}/os-hypervisors/detail - - diag - - * - Total number of VCPUs - - poll SQL: - - select ifnull(sum(vcpus), 0) from compute_nodes where - deleted=0 - - poll API: - /v2/{tenant_id}/os-hypervisors/statistics - - diag - - * - Total number of VCPUs used - - poll SQL: - - select ifnull(sum(vcpus), 0) from instances where - deleted=0 and vm_state='active' - - poll API: - /v2/{tenant_id}/os-hypervisors/statistics - - diag - - * - Total number of free VCPUs - - calculated from previous metrics - - poll API: - /v2/{tenant_id}/os-hypervisors/statistics - - Alert: - - Too few running instances could be a symptom of a deeper problem. - - * - Total memory available - - poll SQL: - - select ifnull(sum(memory_mb), 0) from compute_nodes where - deleted=0 - - poll API: - /v2/{tenant_id}/os-hypervisors/statistics - - diag - - * - Total memory used by instances - - poll SQL: - - select ifnull(sum(memory_mb), 0) from instances where - deleted=0 and vm_state='active' - - poll API: - /v2/{tenant_id}/os-hypervisors/statistics - - diag - - * - Total free memory - - calculated from previous metrics - - or poll API: - /v2/{tenant_id}/os-hypervisors/statistics - - diag - - * - API response time - - Logs: - - see :ref:`examples ` below - - - Alert: - - When the value is beyond standard deviation or top percentiles - threshold depending on the data-points distribution. - - * - API errors - - Logs or HAProxy: - - All HTTP 500 error code. - - Log example: - POST /v2/{tenant-id}/os-volumes_boot HTTP/1.1" - status: 500 len: 354 time: 32.3032150 - #where status: 500 indicates error - - Alert: - - When a sudden spike of errors is detected. - -.. note:: - The main advantage of using SQL queries versus using API checks is - execution speed and lower overhead. The disadvantage of using SQL - queries is that your checks won’t work anymore when the SQL schema - changes. - -.. _examples_log_entries: - -**Examples of log entries containing response times:** - -Synchronous operations response time is logged in nova-api.log. -Example of *nova key pair* creation log entry: - - 2015-03-02 12:33:59.898 6819 INFO nova.osapi_compute.wsgi.server - [req-c0391ca2-e0e2-41bf-af64-0df222654620 None] 192.168.0.5 - "POST /v2/{tenant-id}/os-keypairs HTTP/1.1" status: 200 - len: 2473 time: **1.4112680** - -HTTP response code is logged in nova-api.log. Example of an instance creation log entry: - - 2015-03-02 12:43:59.898 6819 INFO nova.osapi_compute.wsgi.server - [req-c0391ca2-e0e2-41bf-af64-0df222654620 None] 192.168.0.5 - "POST /v2/{tenant-id}/servers HTTP/1.1" status: 202 - len: 780 time: **2.4308009** - - # 202 (ACCEPTED) return code indicates the request has been - accepted for processing. diff --git a/pages/monitoring-guide/monitoring-activities-details/open-vswitch.rst b/pages/monitoring-guide/monitoring-activities-details/open-vswitch.rst deleted file mode 100644 index d2a2ce9e2..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/open-vswitch.rst +++ /dev/null @@ -1,49 +0,0 @@ -.. _mg-open-vswitch: - -Open vSwitch -++++++++++++ - -*Open vSwitch* is a central component of tenant networking. You -should check that the following processes are up and running. - -.. list-table:: - :header-rows: 1 - :widths: 30 20 50 - :stub-columns: 0 - :class: borderless - - * - Process name - - Role - - HA mode - - * - ovsdb-server - - all nodes - - not available - - * - ovs-vswitchd - - all nodes - - not available - -Also, a good practice for diagnosis is to collect the number of -dropped packets and packets in the error state per interface. We -recommend, however, not to consider those errors as critical ones -since they do not necessarily represent a service failure. - -.. code:: - - # ovs-vsctl get Interface br-tun statistics - {collisions=0, - rx_bytes=648, - rx_crc_err=0, - rx_dropped=0, - rx_errors=0, - rx_frame_err=0, - rx_over_err=0, - rx_packets=8, - tx_bytes=0, - tx_dropped=0, - tx_errors=0, - tx_packets=0} - -The Open vSwitch logs are stored in the ``/var/log/openvswitch/`` -directory. diff --git a/pages/monitoring-guide/monitoring-activities-details/rabbitmq.rst b/pages/monitoring-guide/monitoring-activities-details/rabbitmq.rst deleted file mode 100644 index 800734174..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/rabbitmq.rst +++ /dev/null @@ -1,165 +0,0 @@ -.. _mg-rabbitmq: - -RabbitMQ --------- - -All OpenStack services depend on RabbitMQ message queues to -communicate and distribute the workload across workers. Therefore, it -is critical to monitor the healthiness of this component to ensure -there are no communication issues or performance bottlenecks -especially between the API endpoints and the workers. Furthermore, in -order to appraise correctly the availability status of the message -queues you need to take into account that RabbitMQ operates in a -`cluster`_ of `highly available queues`_. - -**Process checks** - -RabbitMQ is composed of two processes which run in pairs located -on each controller node of the HA cluster. - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - HA mode - - * - epmd - - beam - - TCP 4369 - - TCP 41055, 5673 - HTTP 15672 (management port used to monitor servers) - - controller - - active/active - -.. note:: - In order to enable the monitoring of RabbitMQ, the - `management plugin`_ must be installed to expose RabbitMQ’s - management Rest API. As for the service checks, a - dedicated user should be used to query the Rest API or - use :command:`rabbitmqctl` command line. For example, the - following command returns the status of the cluster: - - ``rabbitmqctl cluster_status`` - -**RabbitMQ Cluster status** - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Check - - Source - - Purpose - - * - Unmirror queues - - API management: In response from resource ``/queues``, check - for each queue with **x-ha-policy** *arguments* that - **synchronised_slave_nodes** is more than 0. - - Alert: Slaves are not synchronized. - - * - Missing nodes in cluster - - API management: Check the **running** status for each node, - resource ``/nodes``. - - Alert: One or more nodes are not being viewed as running. - This should not happen unless they are in maintenance. - - * - Number of queues without consumer - - API management: The number of consumers is directly accessible - within the response from resources ``/queues/``. - - Alert: Queues without consumers should not happen. This could - be a symptom of a resource leak situation. - -**Collected Metrics** - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Metric - - Source - - Purpose - - * - Total number of nodes in cluster - - API management - - diag - - * - Number of connections - - API management - - diag - - * - Number of consumers - - API management - - Alert: Zero consumers should never happen. Something is - probably deeply broken. - - * - Number of exchanges - - API management - - Alert: Zero exchanges should never happen. Something is - probably deeply broken. - - * - Number of queues - - API management - - Alert: Zero queues should never happen. Something is - probably deeply broken. - -**Metrics per queue** - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Metric - - Source - - Purpose - - * - Number of ready messages - - API management - - Alert: When the value is beyond standard deviation or top - percentiles threshold depending on the data-points - distribution. This could be the symptom of a resource - congestion situation. - - * - Number of consumers - - API management - - diag - - * - Number of published messages - - API management - - diag - - * - Number of delivered messages - - API management - - diag - - * - Number of acked messages - - API management - - diag - - * - Number of memory used - - API management - - diag - - * - Errors - - ``/var/log/rabbitmq/``\*.log - - Alert: When a sudden spike of errors is detected. - - - -.. Links -.. _`cluster`: https://www.rabbitmq.com/clustering.html -.. _`highly available queues`: https://www.rabbitmq.com/ha.html -.. _`management plugin`: https://www.rabbitmq.com/management.html - diff --git a/pages/monitoring-guide/monitoring-activities-details/sahara.rst b/pages/monitoring-guide/monitoring-activities-details/sahara.rst deleted file mode 100644 index 6dc906e5e..000000000 --- a/pages/monitoring-guide/monitoring-activities-details/sahara.rst +++ /dev/null @@ -1,159 +0,0 @@ -.. _mg-sahara: - -Sahara ------- - -Sahara is the OpenStack Data processing service. Sahara performs two -types of activities in OpenStack: - -* Hadoop cluster provisioning -* Executing Elastic Data Processing (EDP) jobs - -Sahara runs as a single process service on each controller in MOS -6.x. This, however, will change in MOS 7.x. - -**Process checks** - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - Dependencies - - HA mode - - * - sahara-all - - HTTP 8386 - - controller - - db - - active/active - -**API checks** - -Check the proper functioning of the API with a read operation. For -example: - -* list provisioning plugins - - * GET /v1.1//plugins - -| -| **Collected Metrics for Cluster related activities** - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Metrics - - Source - - Purpose - - * - Total number of Sahara clusters in ``Active`` state - - poll SQL: - - select count(*) from clusters where status="Active"; - - diag - - * - Total number of Sahara clusters in ``Error`` state - - poll SQL: - - select count(*) from clusters where status="Error"; - - Alert: - - Too many clusters in ``Error`` state may be a sign of the - provisioning engine failure or failures in other OpenStack - services. - - * - Total number of Sahara clusters doing provisioning at the - moment - - poll SQL: - - select count(*) from clusters where status not in ("Active", - "Error"); - - Alert: - - Too many clusters in provisioning state may be a sign of a - slow network throughput or even missing network connectivity - between VMs. - - It may also be a sign of a corrupted image being used for the - clusters. - - * - Total number of VMs used in Sahara clusters - - poll SQL - - select count(*) from instances; - - diag - - * - Total number of Cinder Volumes attached to Sahara VMs - - poll SQL (cross project) - - select count(*) from cinder.volumes where instance_uuid in - (select instance_id from sahara.instances) and - attach_status="attached"; - - diag - - * - Total number of Security Group Rules generated by Sahara - - poll SQL (neutron) - - select count(*) from neutron.securitygrouprules where - security_group_id in (select id from neutron.securitygroups - where description LIKE "%Auto security group created by - Sahara%"); - - diag - - * - Total number of Floating IPs attached to Sahara VMs - - poll SQL: - - select count(*) from instances where management_ip is not - NULL; - - diag - - * - Total number of Glance Images uploaded for Sahara clusters - - poll SQL (glance): - - select count(*) from glance.image_properties where - name="_sahara_username" and deleted=0; - - diag - -**Collected Metrics for Elastic Data Processing (EDP) related activities** - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Metrics - - Source - - Purpose - - * - Total number of EDP jobs that have finished successfully - - poll SQL: - - select count(*) from job_executions where info like - '%"status": "SUCCEEDED"%'; - - diag - - * - Total number of EDP jobs that have failed - - poll SQL: - - select count(*) from sahara.job_executions where info like - '%"status": "KILLED"%' or info like '%"status": "Error"%'; - - Alert: - - Too many errors in EDP may be a sign of deeper problems. - - * - Total number of EDP jobs that are running at the moment - - poll SQL: - - select count(*) from sahara.job_executions where not info like - '%"status": "KILLED"%' and not info like '%"status": "Error"%' - and not info like '%"status": "SUCCEEDED"%'; - - diag diff --git a/pages/monitoring-guide/storage-clusters/ceph.rst b/pages/monitoring-guide/storage-clusters/ceph.rst deleted file mode 100644 index 192c32797..000000000 --- a/pages/monitoring-guide/storage-clusters/ceph.rst +++ /dev/null @@ -1,298 +0,0 @@ -.. _mg-ceph: - -Ceph ----- - -Ceph is a unified and distributed storage system that can be used as a -storage backend for Cinder volumes and Glance images. - -.. note:: - Ceph Filesystem monitoring is not covered in this document since - its capabilities are not natively supported by Mirantis OpenStack. - Mirantis OpenStack uses a single Ceph cluster named *ceph*. - -**Process Checks** - -.. list-table:: - :header-rows: 1 - :widths: 20 20 20 20 20 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connections - - Role - - Dependencies - - HA mode - - * - ceph-mon - - n/a - - controller - - - - active/active - - * - ceph-osd - - n/a - - storage - - - - data replication mechanisms - - * - apache/httpd - - HTTP 6780 - - controller - - apache mod_fastcgi - - active/active - - -**Collected Metrics** - -.. list-table:: - :header-rows: 1 - :widths: 30 30 40 - :stub-columns: 0 - :class: borderless - - * - Metrics - - Details - - Purpose - - * - cluster health - - command: :ref:`ceph health ` - - alert: When the status is something else than ``HEALTH_OK`` - - * - cluster total space available (Mbyte) - - command: :ref:`ceph df ` - - diag - - * - cluster space used (Mbyte) - - command: :ref:`ceph df ` - - diag - - * - cluster free space - - calculated from previous metrics - - alert: Not enough disk space before more storage capacity can be - physically provisioned - - * - total number of monitor - - command: :ref:`ceph mon dump ` - - diag - - * - number of monitor in Quorum - - command: :ref:`ceph mon dump ` - - diag - - * - number of OSD daemons per state - - command: :ref:`ceph osd dump `, where states are ``UP`` or ``DOWN`` and - ``IN`` or ``OUT`` - - diag - - * - rate Kbytes read/write (per pool) - - command: :ref:`ceph osd pool ` - - diag - - * - operation/second (per pool) - - command: :ref:`ceph osd pool ` - - diag - - * - number of object (per pool) - - command: :ref:`ceph osd pool ` - - diag - - * - total number of Placement Groups (PG) per status - - command: :ref:`ceph pg dump ` - - diag - - * - filesystem commit latency (per OSD daemon) - - command: :ref:`ceph pg dump ` - - diag - - * - filesystem apply latency (per OSD daemon) - - command: :ref:`ceph pg dump ` - - diag - - * - KByte used (per OSD daemon) - - command: :ref:`ceph pg dump ` - - diag - - * - cluster write latency - - command: :ref:`rados bench ` - - diag - - -**Ceph Cluster Health Checks** - -.. _ceph_health: - -**ceph health** - -The monitoring system should perform regular checks to verify that the -Ceph cluster is healthy. This can be achieved using the :command:`ceph health` -command:: - - # ceph health - HEALTH_OK - -Anything else than ``HEALTH_OK`` should be reported in an alert like the following:: - - HEALTH_WARN clock skew detected on mon.node-16, mon.node-17 - - -.. _ceph_df: - -**ceph df** - -.. code:: - - # ceph df - GLOBAL: - SIZE AVAIL RAW USED %RAW USED - 380G 368G 12560M 3.22 - POOLS: - NAME ID USED %USED MAX AVAIL OBJECTS - data 0 0 0 184G 0 - metadata 1 0 0 184G 0 - rbd 2 0 0 184G 0 - images 3 13696k 0 184G 5 - volumes 4 0 0 184G 0 - compute 5 0 0 184G 0 - -.. _ceph_mon_dump: - -**ceph mon dump** - -.. code:: - - # ceph mon dump --format json - { - "created": "0.000000", - "epoch": 3, - "fsid": "bbec22eb-b852-4f6f-89f8-9d7fcceb062a", - "modified": "2015-03-19 14:41:32.374329", - "mons": [ - { - "addr": "192.168.0.3:6789/0", - "name": "node-28", - "rank": 0 - }, - { - "addr": "192.168.0.4:6789/0", - "name": "node-29", - "rank": 1 - }, - { - "addr": "192.168.0.5:6789/0", - "name": "node-30", - "rank": 2 - } - ], - "quorum": [ - 0, - 1, - 2 - ] - } - - -.. _ceph_osd_dump: - -**ceph osd dump** - -.. code:: - - # ceph osd dump (output truncated) - ... - osd.0 up in weight 1 up_from 7 up_thru 23 down_at 0 ... - osd.1 up in weight 1 up_from 10 up_thru 23 down_at 0 ... - osd.2 up in weight 1 up_from 15 up_thru 23 down_at 0 ... - osd.3 up in weight 1 up_from 18 up_thru 23 down_at 0 ... - osd.4 up in weight 1 up_from 23 up_thru 23 down_at 0 ... - osd.5 up in weight 1 up_from 23 up_thru 23 down_at 0 ... - - -.. _ceph_osd_pool: - -**ceph osd pool** - -.. code:: - - # ceph osd pool stats -f json - [ - { - "client_io_rate": { - "op_per_sec": 1, - "read_bytes_sec": 242, - "write_bytes_sec": 2982616 - }, - "pool_id": 4, - "pool_name": "volumes", - "recovery": {}, - "recovery_rate": {} - }, - ... - - -.. _ceph_pg_dump: - -**ceph pg dump** - -.. code:: - - # ceph pg dump -f json (output truncated) - { - "full_ratio": "0.950000", - "last_osdmap_epoch": 25, - "last_pg_scan": 4, - "near_full_ratio": "0.850000", - "osd_stats": [ - { - "fs_perf_stat": { - "apply_latency_ms": 3, - "commit_latency_ms": 2 - }, - "hb_in": [ - 1, - 2, - 3, - 4, - 5 - ], - "hb_out": [], - "kb": 66497820, - "kb_avail": 64344180, - "kb_used": 2153640, - "num_snap_trimming": 0, - "op_queue_age_hist": { - "histogram": [], - "upper_bound": 1 - }, - "osd": 0, - "snap_trim_queue_len": 0 - }, - ... - -.. _rados_bench: - -**rados bench** - -The write latency can be obtained with the :command:`rados` command. -It writes objects in different pools. You should keep the frequency -of these checks lightweight to avoid overwhelming the cluster. - -For example:: - - rados -p data bench 5 write -t 2 --run-name monit_perf - # where command options are: - # -p data: use the pool named ‘data’ - # bench: the rados command ‘bench’ - # 5 : run the bench for 5 seconds - # write: perform write operations - # -t 2 : number of concurrent thread - -.. note:: - Another way to collect metrics related to OSD daemons is to grab - from each node the OSD daemon's socket. This command retrieves - all metrics available, but the output is really verbose and not - all metrics are useful to monitor: - - ``echo '{"prefix": "perf dump"}\0' | socat /var/run/\ - ceph/-osd..asok stdio`` diff --git a/pages/monitoring-guide/storage-clusters/storage-clusters.rst b/pages/monitoring-guide/storage-clusters/storage-clusters.rst deleted file mode 100644 index 22fd6d30b..000000000 --- a/pages/monitoring-guide/storage-clusters/storage-clusters.rst +++ /dev/null @@ -1,8 +0,0 @@ -.. _mg-storage-clusters: - -Storage clusters -================ - -.. include:: /pages/monitoring-guide/storage-clusters/ceph.rst -.. include:: /pages/monitoring-guide/storage-clusters/swift.rst - diff --git a/pages/monitoring-guide/storage-clusters/swift.rst b/pages/monitoring-guide/storage-clusters/swift.rst deleted file mode 100644 index 7dca1e45d..000000000 --- a/pages/monitoring-guide/storage-clusters/swift.rst +++ /dev/null @@ -1,85 +0,0 @@ -.. _mg-swift: - -Swift ------ - -Swift is the OpenStack project, which provides highly available, distributed -and eventually consistent storage services for objects. It is used by default -as a storage backend to store Glance images. - -**Process Checks** - -.. list-table:: - :header-rows: 1 - :widths: 25 25 25 25 - :stub-columns: 0 - :class: borderless - - * - Process name - - Incoming connection - - Role - - HA mode - - * - swift-proxy-server - - HTTP 8080 - - controller - - active/active - - * - swift-object-replicator - - n/a - - controller - - active/active - - * - swift-object-server - - HTTP 6000 - - controller - - active/active - - * - swift-container-server - - HTTP 6001 - - controller - - active/active - - * - swift-container-replicator - - n/a - - controller - - active/active - - * - swift-account-server - - HTTP 6002 - - controller - - active/active - - * - swift-account-replicator - - n/a - - controller - - active/active - - -**API Checks** - -Check the availability of the service through synthetic HTTP transactions -against the Swift API endpoint: - -* create a container -* upload a small (few kilobytes) object -* delete the container and object - - -**Collected Metrics** - -The Swift project is made to collect metrics natively. Indeed, it is the only -OpenStack project that is natively instrumented to send metrics to `statsd`_ or -any statsd enabled data acquisition service like `Heka`_. It provides real-time -operational data about the object storage cluster activity and errors across -all components. Please check the documentation for further information about -how to enable statsd metrics in the `Swift developer documentation`_. - - - -.. Links: -.. _`statsd`: https://github.com/etsy/statsd/ -.. _`Heka`: https://github.com/mozilla-services/heka -.. _`Swift developer documentation`: http://docs.openstack.org/developer/swift/admin_guide.html#reporting-metrics-to-statsd - - diff --git a/pages/operations/0000-intro.rst b/pages/operations/0000-intro.rst deleted file mode 100644 index d693b16b2..000000000 --- a/pages/operations/0000-intro.rst +++ /dev/null @@ -1,17 +0,0 @@ - -.. raw:: pdf - - PageBreak - -.. _Operations-Guide-top: - -.. index Operations Guide - -Introduction -============ -This is a collection of useful procedures -for using and managing your Mirantis OpenStack environment. -The information given here supplements the information in: - -- `OpenStack Admin User Guide `_ -- `OpenStack Cloud Administrator Guide `_ diff --git a/pages/operations/0400-shell.rst b/pages/operations/0400-shell.rst deleted file mode 100644 index 1c951a6ce..000000000 --- a/pages/operations/0400-shell.rst +++ /dev/null @@ -1,20 +0,0 @@ - -.. _shell-ops: - -Accessing the shell on the nodes -================================ - -Many maintenance and advanced configuration tasks -require that you access the Fuel Master and target nodes -at the shell level. -All these systems run the **bash** shell -and support standard Linux system commands. -Each system has its own console that you can use directly -but the standard practice is to use SSH -to access the consoles of the different nodes. - -.. include:: /pages/operations/shell/0100-public-keys.rst -.. include:: /pages/operations/shell/0200-ssh-fuel-master.rst -.. include:: /pages/operations/shell/0300-ssh-target-nodes.rst - - diff --git a/pages/operations/0500-kernel-parameters.rst b/pages/operations/0500-kernel-parameters.rst deleted file mode 100644 index 419708f04..000000000 --- a/pages/operations/0500-kernel-parameters.rst +++ /dev/null @@ -1,109 +0,0 @@ - -.. _kernel-parameters-ops: - -How To: Modify Kernel Parameters -================================ - -Kernel parameters are options that are passed to the kernel -when a Linux system is booted. -Kernel parameters can be set in any of the following ways: - -- Use the Fuel Welcome screen to define kernel parameters - that will be set for the Fuel Master node when it is installed. - -- Use the :ref:`Initial parameters` field - on the Settings tab to define kernel parameters - that Fuel will set on the target nodes. - This only affects target nodes that will be deployed in the future, - not those that have already been deployed. - -- Use the Cobbler web UI (see :ref:`kernel-cobbler-ops`) - to change kernel parameters - for all nodes using or for specific nodes. - The nodes appear in Cobbler only after they are deployed; - to change parameters before deployment, - stop the deployment, change the parameters, then proceed. - -- Issue the **dockerctl** command on each node - where you want to set kernel parameters; - see :ref:`kernel-cmd-line-ops`. - -Any kernel parameter supported by Ubuntu -can be set for the target nodes and the Fuel Master node. -Some parameters that are frequently set for Fuel and OpenStack are: - -**ttys0=** - serial console for videoless servers - -**console=ttyS0,9600** - enable serial console - -**nofb** - disable Linux framebuffer - -**nomodeset** - disable kernel handling of the video card; - required for some older integrated server video chips - -**intel_iommu and amd_iommu** - enable/disable physical-to-virtual address translation for peripheral devices. - Some devices (such as Mellanox cards) require this to be on; - other peripheral devices may be incompatible - with device virtual address space - and may work only with real address space. - If you are unable to boot a node or the node has a kernel panic - soon after being booted, - setting this parameter to "off" may fix the problem. - -**unsupported_hardware** - instructs the operating system to boot - even if it does not recognize some configured hardware. - If this parameter is not set, - Linux does not boot when it detects critical hardware required at boot time - (usually a new CPU model). - Because most hardware provides backward compatibility - with older versions, - setting this kernel parameter may enable the system to boot. - Note that, if no backward compatibility is provided, - the system may panic or fail in other ways - even with this parameter set. - -.. _kernel-cobbler-ops: - -Using the Cobbler web UI to set kernel parameters -------------------------------------------------- - -You can use the Cobbler web UI to set kernel parameters: - -- Use the https:///cobbler_web URL - to access the Cobbler web UI; - replace with the IP address for your Fuel Master Node. - -- Log in, using the user name and password - defined in the `cobbler` section of the */etc/fuel/astute.yaml* file. - -- Select `Systems` from the menu on the right. - This lists the nodes that are deployed in your environment. - Select the node(s) for which you want to set new parameters - and click "Edit". - The following screen is displayed: - -.. image:: /_images/user_screen_shots/cobbler-edit-system.png - :width: 80% - -- Add the kernel parameters and values to the - `Kernel Options (Post-install) field - then click the `Save` button. - -.. _kernel-cmd-line-ops: - -Using the dockerctl command to set kernel parameters ----------------------------------------------------- - -Use the **dockerctl** console command on the Fuel Master node -to add a kernel parameter definition. -For example, the following command sets the **intel_iommu=off** parameter: -:: - - `dockerctl shell cobbler cobbler profile edit --name bootstrap --kopts="intel_iommu=off" --in-place` - diff --git a/pages/operations/2290-exclude-from-raid.rst b/pages/operations/2290-exclude-from-raid.rst deleted file mode 100644 index bc2df36e2..000000000 --- a/pages/operations/2290-exclude-from-raid.rst +++ /dev/null @@ -1,49 +0,0 @@ - -.. _exclude-from-raid: - -How To: Exclude some drives from RAID-1 array -============================================= - -RAID-1 spans all configured disks on a node, -putting a boot partition on each disk -because OpenStack does not have access to the BIOS. -It is not currently possible to exclude some drives -from the Fuel configuration on the Fuel UI. -This means that one cannot, for example, -configure some drives to be used for backup and recover -or as b-cache. - -You can work around this issue as follows. -This example is for a system that has three disks: sda, sdb, and sdc. -Fuel will provision sda and sdb as RAID-1 for OpenStack -but sdc will not be used as part of the RAID-1 array: - -#. Use the Fuel CLI to obtain provisioning data: - :: - - fuel provisioning --env-id 1 -d - -#. Remove the drive which you do not want to be part of RAID: - :: - - - size: 300 - type: boot - - file_system: ext2 - mount: /boot - name: Boot - size: 200 - type: raid - -#. Run deployment - :: - - fuel provisioning --env-id 1 -u - -#. Confirm that your partition is not included in the RAID array: - :: - - [root@node-2 ~]# cat /proc/mdstat - Personalities : [raid1] - md0 : active raid1 sda3[0] sdb3[1] 204736 blocks - super 1.0 [2/2] [UU] - diff --git a/pages/operations/2310-create-xfs.rst b/pages/operations/2310-create-xfs.rst deleted file mode 100644 index 68f218fbe..000000000 --- a/pages/operations/2310-create-xfs.rst +++ /dev/null @@ -1,43 +0,0 @@ -.. index:: HowTo: Create an XFS disk partition - -.. _create-the-XFS-partition: - -HowTo: Create an XFS disk partition -=================================== - -In most cases, Fuel creates the XFS partition for you. -If for some reason you need to create it yourself, use this procedure: - -.. note:: Replace ``/dev/sdb`` with the appropriate block device you wish to - configure. - -1. Create the partition itself - :: - - fdisk /dev/sdb - n(for new) - p(for partition) - (to accept the defaults) - (to accept the defaults) - w(to save changes) - - -2. Initialize the XFS partition - :: - - mkfs.xfs -i size=1024 -f /dev/sdb1 - -3. For a standard swift install, all data drives are mounted directly under - /srv/node, so first create the mount point - :: - - mkdir -p /srv/node/sdb1 - -4. Finally, add the new partition to fstab so it mounts automatically, then - mount all current partitions - :: - - echo "/dev/sdb1 /srv/node/sdb1 xfs \ - noatime,nodiratime,nobarrier,logbufs=8 0 0" >> /etc/fstab - mount -a - diff --git a/pages/operations/2320-redeploy-node.rst b/pages/operations/2320-redeploy-node.rst deleted file mode 100644 index 6aa230fde..000000000 --- a/pages/operations/2320-redeploy-node.rst +++ /dev/null @@ -1,17 +0,0 @@ - -.. _redeploy-node-ops: - -Adding, Redeploying, and Replacing Nodes -======================================== - -This section discusses how to add, redeploy, and replace -:ref:`nodes` in your OpenStack environment. -Compute and Storage nodes have always been expandable; -Controller nodes could not be added or replaced -before Mirantis OpenStack 5.1. - -.. include:: /pages/operations/redeploy/1000-redeploy.rst -.. include:: /pages/operations/redeploy/2000-add-compute-storage.rst -.. include:: /pages/operations/redeploy/2500-add-mongodb.rst -.. include:: /pages/operations/redeploy/3000-add-controller.rst -.. include:: /pages/operations/redeploy/4000-remove-controller.rst diff --git a/pages/operations/2360-config-operating-system-node.rst b/pages/operations/2360-config-operating-system-node.rst deleted file mode 100644 index d17b6d60a..000000000 --- a/pages/operations/2360-config-operating-system-node.rst +++ /dev/null @@ -1,38 +0,0 @@ - -.. _operating-system-role-ops: - -Configuring an Operating System node ------------------------------------------ - -Fuel provisions -the :ref:`Operating System Role` -with the supported operating system -that was selected for the environment -but :ref:`Puppet` does not deploy other packages -on this node. -You can find out more about what Fuel installs -on such nodes in :ref:`operating-system-role-arch`. - -You can access an Operating System node using **ssh**, -just as you would access any other node; -see :ref:`shell-ops`. -Some general administrative tasks you may need to perform are: - -- Create file systems on partitions you created - and populate the *fstab* file so they will mount automatically. -- Configure additional :ref:`logical networks` - you need; Fuel only configures the Admin/PXE network. -- Set up any monitoring facilites you want to use - such as **monit** and **atop**; - configure **syslog** to send error messages to a centralized syslog server. -- Tune kernel resources to optimize performance for the particular applications - you plan to run here. - -You are pretty much free to install and configure -this node any way you like. -By default, all the repositories from the Fuel Master node are configured so -you can install packages from these repositories by running the -**apt-get install ** command. -You can also use **scp** to copy other software packages to this node -and then install them using **apt-get** or **yum**. - diff --git a/pages/operations/2410-galera-autorebuild.rst b/pages/operations/2410-galera-autorebuild.rst deleted file mode 100644 index bfc1badef..000000000 --- a/pages/operations/2410-galera-autorebuild.rst +++ /dev/null @@ -1,56 +0,0 @@ - -.. index:: HowTo: Galera Cluster Autorebuild - -.. _enable-galera-autorebuild: - -HowTo: Enable/Disable Galera Cluster Autorebuild Mechanism -========================================================== - -By default, the autorebuild mechanism is enabled, -so Fuel reassembles a Galera cluster automatically -without any user interaction. - - - The OCF Galera script checks every node in the Galera Cluster - for the SEQNO position. - This allows it to find the node with the most recent data. - - - The script checks for the status of the current node, - if it is synchronized with the quorum, the procedure stops; - otherwise, SEQNO is obtained and - stored in the Corosync CIB as a variable. - - - The script sleeps for 300 seconds, - allowing other nodes to join the Corosync quorum - and push their UUIDs and SEQNOs, too. - - - For every node in the quorum, the script compares the UUID and SEQNO. - If at least one node has a higher SEQNO, - it bootstraps the node as the Primary Component, - allowing other nodes to join the newly formed cluster later; - - - The Primary Component node is started with - the `--wsrep-new-cluster` option, forming a new quorum. - -To prevent the `autorebuild feature` you should do:: - - crm_resource unmanage clone_p_mysql - -To re-enable `autorebuild feature` you should do:: - - crm_resource manage clone_p_mysql - -To check GTID and SEQNO across all nodes saved in Corosync CIB you should do:: - - cibadmin --query --xpath "//nodes/*/*/nvpair[@name=\"gtid\"]" - -To try an automated reassemble without reboot if cluster is broken just issue:: - - crm resource restart clone_p_mysql - -To remove all GTIDs and SEQNOs from Corosync CIB -and allow the OCF script to reread the data -from the `grastate.dat` file, you should do:: - - cibadmin --delete-all --query --xpath "//nodes/*/*/nvpair[@name=\"gtid\"]" --force - - diff --git a/pages/operations/2450-galera-backport-ocf.rst b/pages/operations/2450-galera-backport-ocf.rst deleted file mode 100644 index ae5e5280b..000000000 --- a/pages/operations/2450-galera-backport-ocf.rst +++ /dev/null @@ -1,96 +0,0 @@ -.. index:: HowTo: Backport Galera Pacemaker OCF script - -.. _backport-galera-ocf-op: - -HowTo: Backport Galera Pacemaker OCF script -=========================================== - -Starting from Fuel 5.1, OCF script was completely redesigned which -makes the :ref:`Galera cluster` cluster more -reliable and predictable. The script can be backported to the Fuel -pre-5.1 releases following the instructions below; similar steps could -be used to backport to the older versions by adjusting the MySQL -commands to match those used by the specific version of MySQL. - -.. warning:: Before performing any operations with Galera, - you should schedule the maintenance window, - perform backups of all databases, - and stop all MySQL related services. - -#. Set the p_mysql primitive in maintenance mode: - :: - - crm configure edit p_mysql \ - meta is-managed=false - -#. Check the status. It should show clone_p_mysql primitives as Unmanaged: - :: - - crm_mon -1 - -#. Download the latest OCF script from the fuel-library repository - to the Fuel Master node: - :: - - wget --no-check-certificate -O \ - /etc/puppet/modules/galera/files/ocf/mysql-wss \ - https://raw.githubusercontent.com/stackforge/fuel-library/master/deployment/puppet/ \ - galera/files/ocf/mysql-wss - -#. The OCF script requires some modification - as it was originally designed for MySQL 5.6: - - :: - - perl -pi -e 's/--wsrep-new-cluster/--wsrep-cluster-address=gcomm:\/\//g' \ - /etc/puppet/modules/galera/files/ocf/mysql-wss - -#. Copy the script to all controllers: - :: - - for i in $(fuel nodes | awk '/ready.*controller.*True/{print $1}'); \ - do scp /etc/puppet/modules/galera/files/ocf/mysql-wss \ - node-$i:/etc/puppet/modules/galera/files/ocf/mysql-wss; done - - for i in $(fuel nodes | awk '/ready.*controller.*True/{print $1}'); \ - do scp /etc/puppet/modules/galera/files/ocf/mysql-wss \ - node-$i:/usr/lib/ocf/resource.d/mirantis/mysql-wss; done - - -#. Configure the p_mysql resource for the new Galera OCF script: - :: - - crm configure edit p_mysql - - Example of primitive for Ubuntu: - :: - - crm configure primitive p_mysql ocf:mirantis:mysql-wss \ - params socket="/var/run/mysqld/mysqld.sock" \ - pid="/var/run/mysqld/mysqld.pid" \ - test_passwd="password" test_user="wsrep_sst" \ - op monitor timeout="55" interval="60" enabled=true \ - op start timeout="475" interval="0" \ - op stop timeout="175" interval="0" \ - meta is-managed=true - - .. note:: During this operation, the MySQL/Galera cluster will be restarted. - This may take up to 5 minutes. - -#. Check whether Galera Cluster is synced and functioning: - :: - - mysql -e "show global status like 'wsrep_cluster_status'" - -#. IPs of all nodes should be present in Galera Cluster. This guarantees that - all nodes participate in Cluster operations and acting properly. - :: - - mysql -e "show global status like 'wsrep_incoming_addresses'" - -#. Restart MySQL related services: - - - Restart neutron on every Controller (if installed). - - Restart the remaining OpenStack services - on each Controller and Storage node. - - Restart the OpenStack services on the Compute nodes. diff --git a/pages/operations/2451-rabbitmq-backport-ocf.rst b/pages/operations/2451-rabbitmq-backport-ocf.rst deleted file mode 100644 index 2ec91c514..000000000 --- a/pages/operations/2451-rabbitmq-backport-ocf.rst +++ /dev/null @@ -1,312 +0,0 @@ -.. index:: HowTo: Backport RabbitMQ Pacemaker OCF script - -.. raw:: pdf - - PageBreak - -.. _backport-rabbitmq-ocf-op: - -HowTo: Backport RabbitMQ Pacemaker OCF script -============================================= - -Fuel 6.1 contains many fixes to the RabbitMQ OCF script -which makes the :ref:`RabbitMQ` -cluster more reliable and predictable. -This can be backported to the Fuel 5.1 and 6.0 releases -following the instructions below. -The older Fuel versions do not use Pacemaker for -RabbitMQ cluster management, hence the given changes to the OCF -script are not applicable for them. - -.. note:: The OCF script in the Fuel 6.1 release also - distributes and ensures the consistent Erlang - cookie file among the all controller nodes. - For backports to the older Fuel versions, this feature - is disabled by default in the OCF script. - If you think you want to enable it, please read - carefully the details below. - -#. Schedule maintenance window. - - .. warning:: Before performing any operations with RabbitMQ, - you should schedule maintenance window, - perform backups of all RabbitMQ mnesia files and OCF scripts, - and stop all OpenStack services an all environment nodes, - see :ref:`manage-openstack-services-op` for details. - - Mnesia files are located at ``/var/lib/rabbitmq/mnesia/`` and - OCF files can be found at ``/usr/lib/ocf/resource.d/mirantis/``. - -#. Inside the maintenance window, put the p_rabbitmq-server primitive - in unmanaged state at one of the controller nodes: - :: - - pcs resource unmanage master_p_rabbitmq-server - - or with the crm tool: - :: - - crm resource unmanage master_p_rabbitmq-server - - .. note:: Normally, the crm tool can be installed from the - crmsh package, by commands: - :: - - yum install crmsh || apt-get install crmsh - -#. Check the status. It should show p_rabbitmq-server primitives - as "Unmanaged": - :: - - pcs resource show - - or with the crm tool: - :: - - crm_mon -1 - - Unmanaged p_rabbitmq-server resources should look like: - :: - - Master/Slave Set: master_p_rabbitmq-server [p_rabbitmq-server] (unmanaged) \ - p_rabbitmq-server (ocf::fuel:rabbitmq-server): Master node-1 (unmanaged) \ - p_rabbitmq-server (ocf::fuel:rabbitmq-server): Slave node-2 (unmanaged) \ - p_rabbitmq-server (ocf::fuel:rabbitmq-server): Slave node-3 (unmanaged) \ - -#. Download the latest OCF script from the fuel-library repository - to the Fuel Master node: - :: - - wget --no-check-certificate -O /etc/puppet/modules/nova/files/ocf/rabbitmq \ - https://raw.githubusercontent.com/stack\ - forge/fuel-library/stable/6.0/deployment/puppet/nova/files/ocf/rabbitmq - chmod +x /etc/puppet/modules/nova/files/ocf/rabbitmq - - .. note:: For the Fuel 5.1 release update the link to use - a "5.1" version in the download path. - -#. Copy the script to all controllers: - :: - - for i in $(fuel nodes --env | awk '/ready.*controller.*True/{print $1}'); \ - do scp /etc/puppet/modules/nova/files/ocf/rabbitmq \ - node-$i:/etc/puppet/modules/nova/files/ocf/rabbitmq; done - for i in $(fuel nodes --env | awk '/ready.*controller.*True/{print $1}'); \ - do scp /etc/puppet/modules/nova/files/ocf/rabbitmq \ - node-$i:/usr/lib/ocf/resource.d/mirantis/rabbitmq-server; done - - .. note:: This step assumes the environment id is a "1" and the - controller nodes names have a standard Fuel notation, - like "node-1", "node-42", and so on. - -#. Update the configuration of the p_rabbitmq-server resource for - the new RabbitMQ OCF script at any controller node: - - :: - - crm configure edit p_rabbitmq-server - - An example primitive may look like: - :: - - primitive p_rabbitmq-server ocf:mirantis:rabbitmq-server \ - params node_port="5673" \ - meta failure-timeout="60s" migration-threshold="INFINITY" \ - op demote interval="0" timeout="60" \ - op notify interval="0" timeout="60" \ - op promote interval="0" timeout="120" \ - op start interval="0" timeout="120" \ - op monitor interval="30" timeout="60" \ - op stop interval="0" timeout="60" \ - op monitor interval="27" role="Master" timeout="60" - - or in an XML notation: - :: - - xml - - \ - - - - - - - \ - \ - - \ - \ - - \ - \ - - #vim:set syntax=pcmk - - Make sure the following changes are applied: - - - To the `params` stanza: - - - Add the parameter ``command_timeout`` with the value ``--signal=KILL`` - - .. note:: The ``command_timeout`` parameter value is given for Ubuntu OS. - - Use ``some_param="some_value"`` notation, or for the XML case: - :: - - - - - - Add the ``erlang_cookie`` parameter with the value ``false`` - - .. note:: If you want to allow the OCF script to manage the - Erlang cookie files, provide the existing Erlang cookie - from ``/var/lib/rabbitmq/.erlang.cookie`` as an ``erlang_cookie`` - parameter, otherwise set this parameter to a ``false``. - Note, that a different Erlang cookie would require to - erase mnesia files for all controller nodes as well. - - .. warning:: Erasing the mnesia files will also - erase all custom users, vhosts, queues, and other - RabbitMQ entities, if any. - - - To the `meta` stanza: - - - Set the ``failure-timeout`` to a ``"360s"`` - - - To the `op` stanzas: - - - Set the ``notify interval`` to a ``"0"`` and the ``timeout`` to a ``"180"`` - - Set the ``start interval`` to a ``"0"`` and the ``timeout`` to a ``"360"`` - - Or the same with the pcs tool: - :: - - pcs resource meta p_rabbitmq-server failure-timeout=360s - pcs resource op remove p_rabbitmq-server notify interval=0 timeout=60 - pcs resource op add p_rabbitmq-server notify interval=0 timeout=180 - pcs resource op remove p_rabbitmq-server start interval=0 timeout=60 - pcs resource op add p_rabbitmq-server start interval=0 timeout=360 - - .. note:: Ignore messages like "Error: Unable to find operation matching:" - - .. note:: You cannot add resource attributes with pcs tool, you should install - crmsh package and use crm tool in order to update ``command_timeout`` and - ``erlang_cookie`` parameters, see details above. - - As a result, the given example resource should look like: - :: - - # pcs resource show p_rabbitmq-server - - Resource: p_rabbitmq-server (class=ocf provider=fuel type=rabbitmq-server) - Attributes: node_port=5673 debug=false command_timeout=--signal=KILL erlang_cookie=EOKOWXQREETZSHFNTPEY - Meta Attrs: migration-threshold=INFINITY failure-timeout=360s - Operations: monitor interval=30 timeout=60 (p_rabbitmq-server-monitor-30) - monitor interval=27 role=Master timeout=60 (p_rabbitmq-server-monitor-27) - monitor interval=103 role=Slave timeout=60 OCF_CHECK_LEVEL=30 (p_rabbitmq-server-monitor-103) - start interval=0 timeout=360 (p_rabbitmq-server-start-0) - stop interval=0 timeout=120 (p_rabbitmq-server-stop-0) - promote interval=0 timeout=120 (p_rabbitmq-server-promote-0) - demote interval=0 timeout=120 (p_rabbitmq-server-demote-0) - notify interval=0 timeout=180 (p_rabbitmq-server-notify-0) - - - - or with the crm tool: - :: - - # crm configure show p_rabbitmq-server - primitive p_rabbitmq-server ocf:fuel:rabbitmq-server \ - op monitor interval=30 timeout=60 \ - op monitor interval=27 role=Master timeout=60 \ - op monitor interval=103 role=Slave timeout=60 OCF_CHECK_LEVEL=30 \ - op start interval=0 timeout=360 \ - op stop interval=0 timeout=120 \ - op promote interval=0 timeout=120 \ - op demote interval=0 timeout=120 \ - op notify interval=0 timeout=180 \ - params node_port=5673 debug=false command_timeout="--signal=KILL" erlang_cookie=EOKOWXQREETZSHFNTPEY \ - meta migration-threshold=INFINITY failure-timeout=360s - - - The output also may have an XML - notation and may look like: - - :: - - - xml \ - \ - - - - - - - - \ - \ - - - \ - \ - \ - - \ - \ - - - -#. Put the p_rabbitmq-server to management state and restart it: - :: - - pcs resource manage master_p_rabbitmq-server - pcs resource disable master_p_rabbitmq-server - pcs resource enable master_p_rabbitmq-server - pcs resource cleanup master_p_rabbitmq-server - - or with the crm tool: - :: - - crm resource manage master_p_rabbitmq-server - crm resource restart master_p_rabbitmq-server - crm resource cleanup master_p_rabbitmq-server - - .. note:: During this operation, the RabbitMQ cluster will be restarted. - This may take from a 1 up to 20 minutes. If there are any issues, see - :ref:`crm-ops`. - -#. Check whether the RabbitMQ cluster is functioning on each controller node: - :: - - rabbitmqctl cluster_status - rabbitmqctl list_users - -#. Restart RabbitMQ related services: - - See :ref:`manage-openstack-services-op` for details. diff --git a/pages/operations/2452-backport-memcached-fixes-op.rst b/pages/operations/2452-backport-memcached-fixes-op.rst deleted file mode 100644 index 9e30f0853..000000000 --- a/pages/operations/2452-backport-memcached-fixes-op.rst +++ /dev/null @@ -1,82 +0,0 @@ -.. index:: HowTo: Backport Memcached backend fixes - -.. _backport-memcached-fixes-op: - -HowTo: Backport Memcached backend fixes -======================================= - -Fuel 6.1 contains several High Availability (HA) fixes to the configuration of -memcache_pool (see :ref:`Memcached`) -backend for Keystone which makes response time of OpenStack -services shorter if a memcached node fails. -There is also a security fix to the Keystone configuration -which makes the revocation of tokens to be kept in the MySQL -backend instead of memcached. -These patches can be backported to the Fuel 6.0 release -following the instructions below. Note, Fuel 5.0 or older -does not support memcache_pool backend and -the fixes are not applicable for them. - -.. warning:: Before performing any operations with Keystone, - you should schedule a maintenance window, - perform backups of Keystone configuration files, - and stop all Keystone related services. - -#. Download the related fixes for puppet modules - from the `fuel-library `_ repository - to the Fuel Master node: - :: - - wget --no-check-certificate -O /etc/puppet/modules/keystone/manifests/init.pp \ - https://raw.githubusercontent.com/stack \ - forge/fuel-library/stable/6.0/deployment/puppet/keystone/manifests/init.pp - wget --no-check-certificate -O /etc/puppet/modules/keystone/spec/classes \ - /keystone_spec.rb \ - https://raw.githubusercontent.com/stack \ - forge/fuel-library/stable/6.0/deployment/puppet/keystone/spec/classes \ - /keystone_spec.rb - wget --no-check-certificate -O /etc/puppet/modules/openstack/manifests/keystone.pp \ - https://raw.githubusercontent.com/stack \ - forge/fuel-library/stable/6.0/deployment/puppet/deployment/puppet/openstack \ - /manifests/keystone.pp - -#. Copy the fixed files to all Controllers: - - :: - - for i in $(fuel nodes --env | awk '/ready.*controller.*True/{print $1}'); do - scp /etc/puppet/modules/keystone/manifests/init.pp \ - node-$i:/etc/puppet/modules/keystone/manifests/init.pp;\ - scp /etc/puppet/modules/keystone/spec/classes/keystone_spec.rb \ - node-$i:/etc/puppet/modules/keystone/spec/classes/keystone_spec.rb; \ - scp /etc/puppet/modules/openstack/manifests/keystone.pp \ - node-$i:/etc/puppet/modules/openstack/manifests/keystone.pp;\ - done - - .. note:: This step assumes the environment id is a "1" and the - controller nodes names have a standard Fuel notation, - like "node-1", "node-42" and so on. - -#. Update the */etc/keystone/keystone.conf* configuration file on - all of the controller nodes as the following: - :: - - [revoke] - driver = keystone.contrib.revoke.backends.sql.Revoke - - [cache] - memcache_dead_retry = 30 - memcache_socket_timeout = 1 - memcache_pool_maxsize = 1000 - - [token] - driver = keystone.token.persistence.backends.memcache_pool.Token - -#. Restart all Keystone related services: - - - Restart Keystone on every Controller. - - Restart Neutron on every Controller (if installed). - - Restart the remaining OpenStack services - on each Controller and Storage node. - - Restart the OpenStack services on the Compute nodes. - diff --git a/pages/operations/2455-manage-openstack-services.rst b/pages/operations/2455-manage-openstack-services.rst deleted file mode 100644 index 80bcb8ea6..000000000 --- a/pages/operations/2455-manage-openstack-services.rst +++ /dev/null @@ -1,144 +0,0 @@ -.. index:: HowTo: Manage OpenStack services - -.. _manage-openstack-services-op: - -HowTo: Manage OpenStack services -================================ - -#. Stop or start OpenStack services - - In order to get a full list of OpenStack services from the corresponding - list of `OpenStack projects `_ - and their statuses in SysV or Upstart use the following commands: - - On Ubuntu: - :: - - services=$(curl http://git.openstack.org/cgit/open\ - stack/governance/plain/reference/projects.yaml | \ - egrep -v 'Security|Documentation|Infrastructure' | \ - perl -n -e'/^(\w+):$/ && print "openstack-",lc $1,".*\$|",lc $1,".*\$|"') - - initctl list | grep -oE $services | grep start - - - Now you can start, stop, or restart the OpenStack services, see details about - recommended order below. - - .. warning:: Fuel configures some services, like Neutron agents, Heat engine, - Ceilometer agents, to be managed by Pacemaker instead of generic init - scripts. These services should be managed only with the pcs or crm tools! - - In order to figure out the list of services managed by Pacemaker, you should - first find disabled or not running services with the command: - - On Ubuntu: - :: - - initctl list | grep -oE $services | grep stop - - Next, you should inspect the output of command ``pcs resource`` - (or ``crm resource list``) and find the corresponding services listed, if any. - - The Pacemaker resources list is: - :: - - root@node-1:~# crm status - - Stack: corosync - Current DC: node-1.domain.tld (1) - partition with quorum - Version: 1.1.12-561c4cf - 3 Nodes configured - 43 Resources configured - - Online: [ node-1.domain.tld node-2.domain.tld node-5.domain.tld ] - - Clone Set: clone_p_vrouter [p_vrouter] - Started: [ node-1.domain.tld node-2.domain.tld node-5.domain.tld ] - vip__management (ocf::fuel:ns_IPaddr2): Started node-1.domain.tld - vip__public_vrouter (ocf::fuel:ns_IPaddr2): Started node-1.domain.tld - vip__management_vrouter (ocf::fuel:ns_IPaddr2): Started node-1.domain.tld - vip__public (ocf::fuel:ns_IPaddr2): Started node-2.domain.tld - Master/Slave Set: master_p_conntrackd [p_conntrackd] - Masters: [ node-1.domain.tld ] - Slaves: [ node-2.domain.tld node-5.domain.tld ] - Clone Set: clone_p_haproxy [p_haproxy] - Started: [ node-1.domain.tld node-2.domain.tld node-5.domain.tld ] - Clone Set: clone_p_dns [p_dns] - Started: [ node-1.domain.tld node-2.domain.tld node-5.domain.tld ] - Clone Set: clone_p_mysql [p_mysql] - Started: [ node-1.domain.tld node-2.domain.tld node-5.domain.tld ] - Master/Slave Set: master_p_rabbitmq-server [p_rabbitmq-server] - Masters: [ node-1.domain.tld ] - Slaves: [ node-2.domain.tld node-5.domain.tld ] - Clone Set: clone_p_heat-engine [p_heat-engine] - Started: [ node-1.domain.tld node-2.domain.tld node-5.domain.tld ] - Clone Set: clone_p_neutron-plugin-openvswitch-agent [p_neutron-plugin-openvswitch-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-5.domain.tld ] - Clone Set: clone_p_neutron-dhcp-agent [p_neutron-dhcp-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-5.domain.tld ] - Clone Set: clone_p_neutron-metadata-agent [p_neutron-metadata-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-5.domain.tld ] - Clone Set: clone_p_neutron-l3-agent [p_neutron-l3-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-5.domain.tld ] - Clone Set: clone_p_ntp [p_ntp] - Started: [ node-1.domain.tld node-2.domain.tld node-5.domain.tld ] - Clone Set: clone_ping_vip__public [ping_vip__public] - Started: [ node-1.domain.tld node-2.domain.tld node-5.domain.tld ] - - You may notice, that there is only a heat-engine service is managed by - Pacemaker and disabled in OS. At any controller node, use the following - command to start or stop cluster-wide: - :: - - pcs resource enable clone_p_openstack-heat-engine - pcs resource disable clone_p_openstack-heat-engine - - or with crm tool: - :: - - crm resource start clone_p_openstack-heat-engine - crm resource stop clone_p_openstack-heat-engine - -#. Start, stop, restart order for OpenStack services. - - - Start/stop/restart keystone on every Controller. - - Start/stop/restart neutron-server and agents on every Controller (if installed). - - .. note :: Use pcs or crm tools for corresponding services, - when managed by Pacemaker - - - Start/stop/restart the remaining OpenStack services - on each Controller and Storage node, in any order. - - .. note :: Use pcs or crm tools for corresponding services, - when managed by Pacemaker - - - Start/stop/restart the OpenStack services on the Compute nodes, in any order. - -#. Unmanage, manage services controlled by Pacemaker. - - In order to put a resource in uncontrolled state, use the following commands: - :: - - pcs resource unmanage - - or with crm tool - - :: - - crm resource unmanage - - This will not stop the running resources. - - And to bring the resource back to be managed by Pacemaker: - :: - - pcs resource manage - - or with crm tool - - :: - - crm resource manage - diff --git a/pages/operations/2500-delete-ceph-osd.rst b/pages/operations/2500-delete-ceph-osd.rst deleted file mode 100644 index a672b706e..000000000 --- a/pages/operations/2500-delete-ceph-osd.rst +++ /dev/null @@ -1,105 +0,0 @@ - -.. _delete-ceph-osd: - -How To: Safely remove a Ceph OSD node -============================================= - -Before a Ceph OSD node can be deleted from an environment all data -must be moved to other OSDs. Fuel prevents the deletion of OSDs -that still have data on them. The following process will move -any data present on the soon-to-be-deleted node to other OSDs -in the cluster. - - -#. Determine which OSD processes are running on the target node - (node-35 in this case): - - :: - - # ceph osd tree - # id weight type name up/down reweight - -1 0.4499 root default - -2 0.09998 host node-35 - 0 0.04999 osd.0 up 1 - 1 0.04999 osd.1 up 1 - - - From this output we can see that OSDs 0 and 1 are running - on this node. - -#. Remove the OSDs from the Ceph cluster: - - .. code-block:: none - - # ceph osd out 0 - # ceph osd out 1 - - This will trigger a rebalance. Placement groups will be moved to - other OSDs. Once that has completed we can finish removing the - OSD. This process can take minutes or hours depending on the amount - of data to be rebalanced. While the rebalance is in progress the - cluster state will look something like: - - :: - - # ceph -s - cluster 7fb97281-5014-4a39-91a5-918d525f25a9 - health HEALTH_WARN recovery 2/20 objects degraded (10.000%) - monmap e1: 1 mons at {node-33=10.108.2.4:6789/0}, election epoch 1, quorum 0 node-33 - osdmap e172: 7 osds: 7 up, 5 in - pgmap v803: 960 pgs, 6 pools, 4012 MB data, 10 objects - 10679 MB used, 236 GB / 247 GB avail - 2/20 objects degraded (10.000%) - 1 active - 959 active+clean - - Once the rebalance is complete it will look like: - - :: - - # ceph -s - - cluster 7fb97281-5014-4a39-91a5-918d525f25a9 - health HEALTH_OK - monmap e1: 1 mons at {node-33=10.108.2.4:6789/0}, election epoch 1, quorum 0 node-33 - osdmap e172: 7 osds: 7 up, 5 in - pgmap v804: 960 pgs, 6 pools, 4012 MB data, 10 objects - 10679 MB used, 236 GB / 247 GB avail - 960 active+clean - - - When the cluster is in state HEALTH_OK the OSD(s) can be removed - from the CRUSH map: - - :: - - On Ubuntu hosts: - # stop ceph-osd id=0 - - # ceph osd crush remove osd.0 - # ceph auth del osd.0 - # ceph osd rm osd.0 - - - After all OSDs have been deleted the host can be removed from - the CRUSH map: - - .. code-block:: none - - # ceph osd crush remove node-35 - - -#. This node can now be deleted from the environment with Fuel. - -Caveats: - -* Ensure that at least replica count hosts remain in the cluster. - If the replica count is 3 then there should always be at least 3 - hosts in the cluster. - -* Do not let the cluster reach its full ratio. By default when the - cluster reaches 95% utilization Ceph will prevent clients from - writing data to it. - See `Ceph documentation `_ - for additional details. - diff --git a/pages/operations/2510-ceph-osd-placement-groups.rst b/pages/operations/2510-ceph-osd-placement-groups.rst deleted file mode 100644 index 451a6d390..000000000 --- a/pages/operations/2510-ceph-osd-placement-groups.rst +++ /dev/null @@ -1,61 +0,0 @@ - -.. _ceph-osd-placement-groups: - -How To: Adjust Placement Groups when adding additional Ceph OSD node(s) -======================================================================= - -When adding additional Ceph OSD nodes to an environment, it may be -necessary to addjust the placement groups (pg_num) and the placement -groups for placement (pgp_num) for the pools. The following process -can be used to update these two values for the Ceph cluster. -These adjustments may not be necessary unless you add a significant -number of OSDs to an existing cluster. Fuel attempts to calculate -appropriate values for the initial deployment but does not adjust them -when adding additional OSDs. - - -#. Determine the current values for pg_num and pgp_num for each pool - that will be touched. The pools that may need to be adjusted are the - 'backups', 'images', 'volumes' and 'compute' pools. - - First get the list of pools that are currently configured. - - :: - - # ceph osd lspools - 0 data,1 metadata,2 rbd,3 images,4 volumes,5 compute, - - The pools that may need to be adjusted are the 'backups', 'images', - 'volumes', and 'compute' pools. You can query each pool to see what the - current value of pg_num and pgp_num is for a pool individually. - - :: - - # ceph osd pools get {pool-name} pg_num - # ceph osd pools get {pool-name} pgp_num - - -#. Calculate the correct value for pg_num and pgp_num that should be - used based on the number of OSDs the cluster has. See the - `Ceph Placement Groups documentation `_ - for additional details on how to properly calculate these values. - Ceph.com has a `Ceph PGs Per Pool Calculator `_ - that can be helpful in this calculation. - - -#. Adjust the pg_num and pgp_num for each of the pools as necessary. - - :: - - # ceph osd pool set {pool-name} pg_num {pg_num} - # ceph osd pool set {pool-name} pgp_num {pgp_num} - - It should be noted that this will cause a cluster rebalance to occur - which may have performance impacts on services consuming Ceph. - -Caveats: - -* It is also not advisable to set pg_num and pgp_num to large values unless - necessary as it does have an impact on the amount of resources required. - See the `Choosing the Number of Placement Groups documentation `_ - for additional details. diff --git a/pages/operations/2800-experimental.rst b/pages/operations/2800-experimental.rst deleted file mode 100644 index a14183307..000000000 --- a/pages/operations/2800-experimental.rst +++ /dev/null @@ -1,59 +0,0 @@ - -.. _experimental-features-op: - -Enable Experimental Features -============================ - -Beginning with Fuel 5.1 and in later release versions, -:ref:`experimental features` -are disabled by default. -Experimental features provide useful functionality -but may not be mature enough to be appropriate -for environments that require high levels of stability. - -To enable experimental features, -execute the following on a running Fuel Master node. -You should do this before -:ref:`creating` and -:ref:`configuring` your environment -if you want to have access to Experimental features -during those phases, -or after you have deployed your cloud -if you want to access the experimental features post-deployment. -You can also enable Experimental Features -after you :ref:`upgrade` your Fuel Master to 5.1. - -- Log into your Fuel Master console as *root*. - -- Manually modify the */etc/fuel/version.yaml* file - to add "experimental" to the "feature_groups" list - in the "VERSION" section. - For example: - :: - - VERSION: - ... - feature_groups: - - mirantis - - experimental - -- Restart the :ref:`nailgun-term` container with dependencies by running: - :: - - dockerctl restart nailgun - dockerctl restart nginx - dockerctl shell cobbler - cobbler sync - exit - -For more details about configuring nailgun settings -see `Extending OpenStack Settings -`_. - -Alternatively, you can build a custom ISO -with the experimental features enabled: -:: - - make FEATURE_GROUPS=experimental iso - - diff --git a/pages/operations/3000-ml2-create.rst b/pages/operations/3000-ml2-create.rst deleted file mode 100644 index 172f07adb..000000000 --- a/pages/operations/3000-ml2-create.rst +++ /dev/null @@ -1,51 +0,0 @@ - -.. _ml2-create-ops: - -Creating and Configuring ML2 Drivers for Neutron -================================================ - -Fuel 5.1 and later supports :ref:`ml2-term` mechanism drivers for Neutron. -Some network configurations, -such as advanced features provided by :ref:`mellanox-adapters`, -require ML2 mechanism driver configuration. - -You can add ML2 configuration data to the quantum_settings section -of the *node.yaml* file -(see :ref:`yaml-config-ops`); -this updates the *astute.yaml* file: - -:: - - quantum_settings: - server: - service_plugins: - 'neutron.services.l3_router.l3_router_plugin.L3RouterPlugin, - neutron.services.firewall.fwaas_plugin.FirewallPlugin, - neutron.services.metering.metering_plugin.MeteringPlugin' - L2: - provider:'ml2' - mechanism_drivers: 'openvswitch' - type_drivers: "local,flat,l2[:segmentation_type]" - tenant_network_types: "local,flat,l2[:segmentation_type]" - flat_networks: '*' - segmentation-type:'vlan' - tunnel_types: l2[:segmentation_type] - tunnel_id_ranges: l2[:tunnel_id_ranges] - vxlan_group: 'None' - vni_ranges: l2[:tunnel_id_ranges] - -Note the following: - -- The following values should be set - only if L2[enable_tunneling] is true: - tunnel_types, tunnel_id_ranges, vxlan_group, vni_ranges. - -- The l2[:item] settings refer to values - that are already in the quantum_settings. - -- This only shows new items that are related to ml2 configuration. - The values shown are the defaults that are used - if no other value is set. - -- All Neutron component packages are available to download. - diff --git a/pages/operations/3500-mcn.rst b/pages/operations/3500-mcn.rst deleted file mode 100644 index bfd5b98f3..000000000 --- a/pages/operations/3500-mcn.rst +++ /dev/null @@ -1,66 +0,0 @@ -.. _mcn-ops: - -Configuring Multiple Cluster Networks -===================================== - -You can configure multiple network domains per single OpenStack environment -using :ref:`Fuel CLI`. -You should run the commands described here -after Fuel is installed but before booting the target nodes. -For background information about how this feature is implemented, -see :ref:`mcn-arch`. - -Requirements for an environment that runs multiple cluster networks are: - -- Must use an encapsulation protocol - such as :ref:`Neutron GRE`. - -- A gateway must be defined for each - :ref:`logical network` - when the cluster has multiple :ref:`Node Groups`. - -- All controllers must be members of the same Node Group; - if they are not, the :ref:`HAProxy` VIP does not work. - - .. note:: It is possible to use ECMP to work around this restriction; - documenting how to do this is beyond the scope of this document. - -To configure an environment that uses multiple cluster networks, -do the following. - -#. Start a **dhcp-helper** process: - - .. code-block:: sh - - dhcp-helper -s -i - - **-s** specifies the system to which packets are relayed, - so is set to the IP address of the Fuel Master node. - **-i** specifies the local interface where DHCP packets arrive, - so is set to the IP address of the NIC that is connected to your DHCP network. - -#. Create each new Node Group with a command like this: - - .. code-block:: sh - - fuel --env 1 nodegroup --create --name "alpha" - - Assign a meaningful name to each `group` you create. - -#. Configure the new Network Group(s) by uploading a new - :ref:`network-1.yaml` file - and modifying it as discussed in the reference page, - then upload the modified file. - -#. Boot the nodes for all environments. - -#. When you assign roles to your target nodes, - Fuel tries to automatically determine the node's group based on the DHCP address. - If that fails, the group can be manually assigned with the following command: - - :: - - fuel nodegroup --env 1 --assign --node --group - - See :ref:`fuel-cli-node-group` for complete information about - using the Fuel CLI to manage node groups. diff --git a/pages/operations/5400-puppet-custom-attributes.rst b/pages/operations/5400-puppet-custom-attributes.rst deleted file mode 100644 index 8f72c6c79..000000000 --- a/pages/operations/5400-puppet-custom-attributes.rst +++ /dev/null @@ -1,149 +0,0 @@ -.. raw:: pdf - - PageBreak - -.. _yaml-config-ops: - -Using YAML configuration files -============================== - -.. contents :local: - -Fuel uses `YAML `_ files -to pass configuration attributes -to :ref:`puppet` - -Passing custom attributes are useful -when you have some Puppet manifests that should be run -but are not supported by Fuel itself. - -.. warning:: Be very careful when modifying the configuration files. - A simple typo when editing these files - may severely damage your environment. When you modify the YAML files, - you will receive a warning - that some attributes were modified from the outside. - Some features may become inaccessible - from the UI after you do this. - Please, read :ref:`Using Fuel CLI ` section carefully. - -To do this: - -#. Create an environment following the instructions in :ref:`create-env-ug`. - -#. Assign roles to nodes following the instructions in :ref:`assign-roles-ug` - but do not start deployment yet. - -#. Log into the Fuel Master node - and dump provisioning information using this - :ref:`fuel CLI` command: - :: - - fuel --env 1 provisioning default - - where ``--env 1`` that points to the specific environment - (id=1 in this example). - - To dump deployment information, the command is: - :: - - fuel --env 1 deployment default - - For a full list of configuration types that can be dumped, - see the :ref:`fuel CLI` section. - - - These commands create a directories called - *provisioning_1* or *deployment_1*, - which include a number of YAML files - that correspond to roles - that are currently assigned to nodes. - Each file includes parameters for current role, - so you can freely modify and save them. - -Customizing Passwords ---------------------- - -A few service passwords are not managed -by the :ref:`keystone-term` based -:ref:`access control` facility -that was introduced in Fuel 5.1. -You may want to set your own passwords in some cases. - -You can edit files and modify password values. -For example, you can set the MySQL root password in this block:: - - "mysql": { - "root_password": "mynewpassword" - }, - -Adding new modules ------------------- - -You can extend Fuel functionality by adding new Puppet modules. -You can do this either by adding them to the */etc/puppet/modules* file -on the Fuel Master node, -or you can edit existing modules -to change the deployment behavior in some way. - -As an example, let's add a new module called *'packages'* -that installs some useful packages from the repository -that is located on the Master node. - -The module should have the following structure:: - - packages/ - packages/manifests - packages/manifests/init.pp - -**init.pp** should have this content:: - - class profile { - $tools = $::fuel_settings['tools'] - package { $tools : - ensure => installed, - } - } - -To implement this module: - -#. Copy this module to the */etc/puppet/modules* directory - on the Master node. - - -#. Add 'include profile' to the end of - the */etc/puppet/manifests/site.pp* file to enable this module. - Placing new `include` statements in the middle of the file - may break the deployment process and/or its dependencies. - -#. As you can see, there is list of packages to install - that should be passed through the Fuel parameters system. - - Let's add this attribute to the downloaded file’s top level hash:: - - “tools”: [ - “htop”, - “tmux”, - ] - - Provisioned nodes will have this addition in their parameters - and our 'profile' module will be able to access their values - and install the given list of packages during node deployment. - -#. Upload the modified configuration:: - - fuel --env 1 deployment upload - - You can also use the ``--dir`` option - to set a directory from which to load the parameters. - -#. Start the deployment process as usual. - -This operation has following effects: - -* Parameters that are about to be sent to the orchestrator - are replaced completely with the ones you specified. -* The cluster sets the *is_customized* flag, - which is checked by the UI - so you will get a message about attributes customization. - - diff --git a/pages/operations/6500-fuel-auth.rst b/pages/operations/6500-fuel-auth.rst deleted file mode 100644 index 433442b7f..000000000 --- a/pages/operations/6500-fuel-auth.rst +++ /dev/null @@ -1,103 +0,0 @@ - -.. _fuel-passwd-ops: - -Fuel Access Control -=================== - -Access to the Fuel Dashboard is controlled -in Mirantis OpenStack 5.1 and later. -Authentication is under control of :ref:`keystone-term`. - -The default username/password can be changed: - -- During Fuel installation; see :ref:`fuel-passwd-ug`. - -- From the main Fuel UI screen; see :ref:`start-create-env-ug`. - -- Using the Fuel CLI; see :ref:`cli-fuel-password` - -If the password for the Fuel Dashboard -is changed using the Fuel UI or the Fuel CLI, -the new password is stored only in Keystone; -it is not written to any file. -If you forget the password, -you can change it -by using the **keystone** command on the Fuel Master Node: - -:: - - keystone --os-endpoint=http://:35357/v2.0 --os-token= password-update - -The default value of is 10.20.0.2. -The port number of 35357 never changes. - -The is stored in the */etc/fuel/astute.yaml* file -on the Fuel Master node. - -To run or disable authentication, -modify */etc/nailgun/settings.yaml* (``AUTHENTICATION_METHOD``) -in the Nailgun container. - -All endpoints except the agent updates and version endpoint -are protected by an authentication token, -obtained from Keystone by logging into Fuel -as the `admin` user with the appropriate password. - -Services such as :ref:`astute-term`, :ref:`cobbler-term`, -Postgres, MCollective, and :ref:`keystone-term`), -which used to be protected with the default password, -are now each protected by a user/password pair -that is unique for each Fuel installation. - -Beginning with release 6.0, -the `Nailgun` and `OSTF` services endpoints are added to -Keystone and now it is possible to use the Keystone service -catalog to obtain URLs of those services instead -of hardcoding them. - -Fuel Authentication is implemented by a dedicated Keystone instance -that Fuel installs in a new :ref:`docker` container on the Fuel Master. - -- Fuel Menu generates passwords for fresh installations; - the upgrade script generates passwords when upgrading. - The password is stored in the Keystone database. - -- The `nailgun` and `ostf` users are created - in the `services` project with admin roles. - They are used to authenticate requests in middleware, - rather than requiring that each request by middleware - be validated using the Keystone admin token - as was done in Release 5.1. - -- Some Nailgun URLs are not protected; - they are defined in *nailgun/middleware/keystone.py* - in the public_url section. - -- The authentication token does not expire for 24 hours - so it is not necessary to store the username and password in - the browser cache. - -- A cron script runs daily in the Keystone container - to delete outdated tokens - using the **keystone-manage token_flush** command. - It can be seen using the **crontab -l** command - in the Keystone container. - -- Support for storing authentication token in cookies - is added in releases 5.1.1 and later; - this allows the API to be tested from the browser. - -- The **keystonemiddleware** python package replaces - the deprecated **keystoneclinet.middleware** package; - this is an internal change that makes the implementation more stable. - All recent fixes and changes are made to **keystonemiddleware**; - which was extracted from **keystoneclinet.middleware** - in earlier releases. - -Beginning with releases 5.1.1 and later, -the user must supply a password -when upgrading Fuel from an earlier release. -This password can be supplied on the command line -when running the installation script -or in response to the prompt (this is the same password -that is used to access Fuel UI). diff --git a/pages/operations/6700-ceph.rst b/pages/operations/6700-ceph.rst deleted file mode 100644 index 6df5b10c9..000000000 --- a/pages/operations/6700-ceph.rst +++ /dev/null @@ -1,12 +0,0 @@ - -.. _ceph-manage-ops: - -Managing your Ceph cluster -========================== - -.. include:: /pages/operations/ceph/0100-manifest.rst -.. include:: /pages/operations/ceph/0200-verify.rst -.. include:: /pages/operations/ceph/0300-test-openstack.rst -.. include:: /pages/operations/ceph/0500-reset.rst -.. include:: /pages/operations/ceph/0600-s3api.rst - diff --git a/pages/operations/7000-sahara.rst b/pages/operations/7000-sahara.rst deleted file mode 100644 index 3218ab93e..000000000 --- a/pages/operations/7000-sahara.rst +++ /dev/null @@ -1,50 +0,0 @@ - -.. index:: Sahara Deployment - - -.. _sahara-deployment-label: - - -Sahara Deployment -================= - -Sahara is a service for launching Hadoop clusters on OpenStack. -It is vendor-agnostic and currently supports the following distributions: - -- Vanilla Apache Hadoop -- Hortonworks Data Platform (HDP) -- Cloudera Hadoop Distribution (CDH) -- Apache Spark -- MapR - -Sahara can install Hadoop clusters on demand. -The user must populate several parameters -such as the Hadoop version and cluster topology -and Sahara will deploy this cluster in a few minutes. -It can also scale the cluster by adding or removing nodes as needed. - -- For Sahara usage guidelines, read the User Guide section of the - `Sahara documentation `_. - -- The list of prebuilt images is available here: :ref:`sahara-images-ops`. - The images are usually - provided in a QCOW2 format which works with the default OpenStack - hypervisors QEMU/KVM. - If the cloud is installed with a different hypervisor - the image should be converted to an appropriate format before being uploaded - to Glance. The instructions for the Vmware Nova backend are here - :ref:`sahara-vmware`. - -- Planning considerations for running Sahara are in :ref:`sahara-plan`. -- Installation instructions for Sahara are in :ref:`sahara-install` - -This section provides additional information -about running Sahara. - - -.. include:: /pages/operations/sahara/7600-security-groups.rst -.. include:: /pages/operations/sahara/7700-prepare-to-test.rst -.. include:: /pages/operations/sahara/7740-sahara-vmware.rst -.. include:: /pages/operations/sahara/7750-test-details.rst -.. include:: /pages/operations/sahara/7760-sahara-images.rst - diff --git a/pages/operations/7400-murano.rst b/pages/operations/7400-murano.rst deleted file mode 100644 index cba45a4a8..000000000 --- a/pages/operations/7400-murano.rst +++ /dev/null @@ -1,44 +0,0 @@ -.. raw:: pdf - - PageBreak - -.. index:: Murano-operations - -.. _Murano-deployment-notes: - -Murano Deployment Notes -======================= - -.. contents :local: - -Murano provides an application catalog -that application developers and administrators can use -to publish various cloud-ready applications -in a browsable, categorized catalog. -Users can select applications from this catalog -and deploy them easily. - -Some highlights of Murano features include: - -* Native to OpenStack -* Application catalog; - see ``_ -* Introduction of abstraction level -* Support for Availability Zones and Disaster Recovery scenarios -* Use of native Windows features to provide HA solutions - -Note that, because Microsoft Windows and other necessary components -can only be obtained directly from Microsoft, -Murano is still to some degree a do-it-yourself project. -Fuel is able to configure Murano's dashboard, API, and engine services, -but you will need to read documentation on the steps -to set up a Murano base image; -see `Creating a Murano Image `_. -Images can be uploaded via Glance. - -.. include:: /pages/operations/murano/7410-components.rst -.. include:: /pages/operations/murano/7482-test-prepare.rst -.. include:: /pages/operations/murano/7485-test-details.rst -.. include:: /pages/operations/murano/7490-troubleshoot.rst - - diff --git a/pages/operations/7450-mm-ops.rst b/pages/operations/7450-mm-ops.rst deleted file mode 100644 index 258ed67cf..000000000 --- a/pages/operations/7450-mm-ops.rst +++ /dev/null @@ -1,283 +0,0 @@ - -.. _mm-ops: - -Maintenance Mode -================= - -Overview --------- - -Maintenance mode (MM) is the state of operating system when it has only -critical set of working services which are needed for basic network and -disk operations. Also node in MM is reachable with ssh from network. - -You can put your system in :ref:`maintenance-mode-term` for system -repair or other service operations. - -The maintenance mode is enforced by using the ``umm`` -parameter in one of the following ways: - -* by selecting the respective option in the boot menu; - -* by forcing the reboot into maintenance mode from shell with - the :command:`umm on` command; - -* automatically, by reaching an number of unclean-reboots specified in - ``REBOOT_COUNT`` parameters. - -`Unclean reboot` means that system reboots unexpectedly without a -direct call from the user. - -You can also disable the maintenance mode functionality -if you do not need it (for example, you do not want to -be automatically booted into it every time). - -You can operate in maintenance mode through ssh or tty2. - -A return back into normal mode is issued with the :command:`umm off` -command. - -.. Note :: - - If you manually start a service in the maintenance mode, it will not - be automatically restarted when you put the system back in the normal - mode with the :command:`umm off` command. - - -Using the :command:`umm` command --------------------------------- - -There are several parameters to use with the :command:`umm` command: - -- ``umm on [cmd]`` - enter the maintenance mode, and execute cmd when MM is reached; - -- ``umm status`` - check the mode status. There are three statuses: - - - ``runlevel`` - the system is in the normal mode. - - - ``reboot`` - the system is starting to enter the maintenance mode. - - - ``umm`` - the system is in the maintenance mode. - - - ``disabled`` - the maintenance mode functionality is disabled. - -- ``umm off [reboot]`` - resume boot or reboot into normal mode. - -- ``umm enable`` - enable the maintenance mode functionality. - -- ``umm disable`` - disable the maintenance mode functionality. - - -Configuring the `UMM.conf` file ---------------------------------- - -You can automate the maintenance mode start by editing the `/etc/umm.conf` file. - -The configuration options are: - -* UMM=yes -* REBOOT_COUNT=2 -* COUNTER_RESET_TIME=10 - - -where: - -UMM - tells the system to go into the maintenance mode based on - the ``REBOOT_COUNT`` and ``COUNTER_RESET_TIME`` values. If the value is - anything other than ``yes`` (or if the `UMM.conf` file is missing), the - system will go into the native Ubuntu recovery mode. - -REBOOT_COUNT - determines the number of unclean reboots that trigger the system to go - into the maintenance mode. - -COUNTER_RESET_TIME - determines the period of time (in minutes) before the `Unclean reboot` - counter reset. - - -Example of using MM on one node -------------------------------- - -- Switching node into MM: - - .. code-block:: bash - :linenos: - - root@node-1:~#umm on - umm-gr start/running, process 6657 - - Broadcast message from root@node-1 - (/dev/pts/0) at 14:29 ... - - The system is going down for reboot NOW! - root@node-1:~# umm status - rebooting - root@node-1:~# Connection to node-1 closed by remote host. - Connection node-1:~# closed. - root@fuel:~#:~$ - - root@node-1:~#ssh - - root@node-1:~# umm status - umm - root@node-1:~#ps -Af - - - We can see only small set of working processes. - -- Start the service: - - .. code-block:: bash - :linenos: - - root@node-1:~# /etc/init.d/apache2 start - root@node-1:~# /etc/init.d/apache2 status - Apache2 is running (pid 1907). - - -- Switch back to the working mode: - - .. code-block:: bash - :linenos: - - root@node-1:~#umm off - -- Continue booting into working mode: - - .. code-block:: bash - :linenos: - - root@node-1:~#umm status - runlevel N 2 - root@node-1:~#/etc/init.d/apache2 status - Apache2 is running (pid 1907). - - - We can see that service was not restarted during switching from MM to - working mode. - -- Check the state of the OpenStack services: - - .. code-block:: bash - :linenos: - - root@node-1:~#crm status - -- If you want to reach working mode by reboot, you should use the following - command: - - .. code-block:: bash - :linenos: - - root@node-1:~# umm off reboot umm-gr start/running, process 2825 - - Broadcast message from root@node-1 - (/dev/pts/0) at 11:23 ... - - The system is going down for reboot NOW! - root@node-1:~# Connection to node-1 closed by remote host. - Connection to node-1 closed. - [root@fuel ~]# - - -Example of putting all nodes into the maintenance mode at the same time ------------------------------------------------------------------------ - -The following maintenance mode sequence is called `Last input First out`. -This guarantees that there is going to be the most recent data on -the Cloud Infrastructure Controller (CIC) that comes back first. - - -- Determine which nodes have Controller (CIC) role: - - .. code-block:: bash - :linenos: - - [root@fuel ~]# fuel nodes - id | status | name | cluster| ip | mac | roles | pending_roles| online - ---|--------|------------------|--------|-----------|-------------------|------------|--------------|------- - 2 | ready | Untitled (c0:02) | 1 | 10.20.0.4 | e6:6a:42:96:a4:45 | controller | | True - 4 | ready | Untitled (c0:04) | 1 | 10.20.0.6 | 66:10:2e:0c:12:4a | compute | | True - 1 | ready | Untitled (c0:01) | 1 | 10.20.0.3 | fa:a1:39:94:7f:4c | controller | | True - 3 | ready | Untitled (c0:03) | 1 | 10.20.0.5 | 82:cb:bb:50:40:47 | controller | | True - -- Copy ``id_rsa`` to the CICs for passwordless ssh authentification: - - .. code-block:: bash - :linenos: - - [root@fuel ~]# scp .ssh/id_rsa node-1:.ssh/id_rsa - Warning: Permanently added 'node-1' (RSA) to the list of known hosts. - id_rsa 100% 1675 1.6KB/s 00:00 - [root@fuel ~]# scp .ssh/id_rsa node-2:.ssh/id_rsa - Warning: Permanently added 'node-2' (RSA) to the list of known hosts. - id_rsa 100% 1675 1.6KB/s 00:00 - [root@fuel ~]# scp .ssh/id_rsa node-3:.ssh/id_rsa - Warning: Permanently added 'node-3' (RSA) to the list of known hosts. - id_rsa 100% 1675 1.6KB/s 00:00 - -- Enforce switching into MM mode on all nodes: - - .. code-block:: bash - :linenos: - - [root@fuel ~]# ssh node-1 umm on ssh node-2 umm on ssh node-3 umm on - Warning: Permanently added 'node-1' (RSA) to the list of known hosts. - umm-gr start/running, process 24318 - Connection to node-1 closed by remote host. - Connection to node-1 closed. - [root@fuel ~]# - [root@fuel ~]# ssh -tt node-1 ssh -tt node-2 ssh -tt node-3 sleep 1 - Warning: Permanently added 'node-1' (RSA) to the list of known hosts. - ECDSA key fingerprint is 84:17:0d:ea:27:1f:4e:08:f7:54:b2:8c:fe:8a:13:1a. - Are you sure you want to continue connecting (yes/no)? yes - Warning: Permanently added 'node-2,10.20.0.4' (ECDSA) - to the list of known hosts. established. - ECDSA key fingerprint is - c3:c6:ca:7d:11:d3:53:01:15:64:20:f7:c7:44:fb:d1. - Are you sure you want to continue connecting (yes/no)? yes - Warning: Permanently added 'node-3,192.168.0.6' (ECDSA) - to the list of known hosts. - Connection to node-3 closed. - Connection to node-2 closed. - Connection to node-1 closed. [root@fuel ~]# - -- Wait until the last node reboots: - - .. code-block:: bash - :linenos: - - [root@fuel ~]# ssh node-3 - Warning: Permanently added 'node-3' (RSA) to the list of known hosts. - Welcome to Ubuntu 12.04.4 LTS (GNU/Linux 3.13.0-32-generic x86_64) - * Documentation: https://help.ubuntu.com/ - Last login: Tue Dec 23 05:55:47 2014 from 10.20.0.2 - root@node-3:~# - Broadcast message from root@node-3 - (unknown) at 6:00 ... - The system is going down for reboot NOW! - Connection to node-3 closed by remote host. - Connection to node-3 closed. - [root@fuel ~]# - -- Perform all the steps planned for MM. - - -- Enforce a return back into normal mode in reverse state: - - .. code-block:: bash - :linenos: - - [root@fuel ~]# ssh node-3 umm off - Warning: Permanently added 'node-3' (RSA) to the list of known hosts. - [root@fuel ~]# ssh node-2 umm off - Warning: Permanently added 'node-2' (RSA) to the list of known hosts. - [root@fuel ~]# ssh node-1 umm off - Warning: Permanently added 'node-1' (RSA) to the list of known hosts. - - - - - diff --git a/pages/operations/7800-vcenter.rst b/pages/operations/7800-vcenter.rst deleted file mode 100644 index 9e774088c..000000000 --- a/pages/operations/7800-vcenter.rst +++ /dev/null @@ -1,38 +0,0 @@ -.. _vcenter-operate: - -Running vCenter -=============== -After the OpenStack environment -that is integrated with the vCenter server is deployed, -you can manage the VMware cluster using the Horizon dashboard -and/or the Nova CLI: - -- Log into the Horizon dashboard. -- Open the Hypervisor tab - and select the VMware vCenter Server. -- To boot a new VM in vCenter: - - - Open the "Manage Compute" tab - and go to the Instances page. - - - Press the "Launch instance" button - and specify the VM parameters in the pop-up window. - This launches a new VM - which can be seen in a vSphere web client. -- Use the Horizon UI or the Nova CLI to stop or delete booted VMs in the vCenter. -- Use the Nova CLI to see the VMware cluster resources - or to boot a new VM in vCenter. - -.. _1-1 mapping: - -Nova-compute and vSphere clusters mapping ------------------------------------------ - -In earlier Fuel releases, 1-N mapping between nova-compute service -and vSphere cluster (cluster that is formed from ESXi hosts by vCenter server) was used. -In most cases, a single nova-compute service instance uses many vSphere clusters, managed by a single vCenter. -Beginning with 6.1 Fuel release, this behaviour was changed to 1-1 mapping, so that a single nova-compute service -instance now interacts with a single vSphere cluster. - -.. image:: /_images/1-1-mapping.png - diff --git a/pages/operations/8000-performance.rst b/pages/operations/8000-performance.rst deleted file mode 100644 index 7aee57c2e..000000000 --- a/pages/operations/8000-performance.rst +++ /dev/null @@ -1,8 +0,0 @@ - -.. _performance-ops: - -Performance Notes -================= - -.. include:: /pages/operations/perform/8200-keystone-tokens.rst - diff --git a/pages/operations/8100-backup.rst b/pages/operations/8100-backup.rst deleted file mode 100644 index 32c97ebcb..000000000 --- a/pages/operations/8100-backup.rst +++ /dev/null @@ -1,73 +0,0 @@ -.. index:: HowTo: Backup and Restore Fuel Master - -.. _Backup_and_restore_Fuel_Master: - -HowTo: Backup and restore Fuel Master -===================================== - -Because the Fuel Master itself is not available with high availability, -it is strongly recommended to create a backup after each deployment. This -allows for recovery in the event of data corruption or hardware loss. -The backup process requires the operator to place the backup on a remote -location so that it survives a complete system failure. Note that this -backup is only for the Fuel Master itself and not for OpenStack deployments. -In order to be able to manage existing OpenStack environments deployed by Fuel, -it is necessary to restore a backed up Fuel Master if a reinstall was -performed. - -You can back up your Fuel Master without downtime. What this means is -Fuel API, Fuel UI, DHCP, DNS, and NTP services continue to operate -during the backup process, causing no impact for any deployed or -bootstrapped nodes. - -In order to back up the Fuel Master, you need to meet these requirements: - -* No deployment tasks are currently running -* You have at least 11GB free disk space - -The backup contains the following items: - -* All docker containers (including Fuel DB) -* PXE deployment configuration -* All OpenStack environment configurations -* Package repositories -* Deployment SSH keys -* Puppet manifests - -Items not backed up include logs and host network configuration. -If preserving log data is important, back up the */var/log* directory -separately. This could be done by using *scp* to transfer */var/log* to another -host. Network configuration needs to be done manually via Fuel Setup if you -reinstall your Fuel Master before restoring it. - -Running the backup ------------------- - -To start a backup, run **dockerctl backup**. Optionally, you can specify a -path for backup. The default path is */var/backup/fuel*. -This process takes approximately 30 minutes -and is dependent on the performance of your hardware. -After the backup is done, you may want to copy the backup to -a separate storage medium. - -.. note:: If you make further changes to your environment after a backup, - you should make a new backup. - -Restoring Fuel Master ---------------------- - -The restore is quite similar to the backup process. -This process can be run any time after installing a Fuel Master -node. Before starting a restore operation, ensure the following: - -* The Fuel version is the same release as the backup -* There are no deployments running -* At least 11GB free space in */var* - - -If you reinstall your Fuel Master host, you need to configure your network -settings via Fuel Setup the same way it was configured originally. It is -particularly important that the configuration for the Admin (PXE) network -is the same as before. - -To run the restore, simply run **dockerctl restore /path/to/backup**. diff --git a/pages/operations/8200-slave-nodes-pxe.rst b/pages/operations/8200-slave-nodes-pxe.rst deleted file mode 100644 index 8451fe834..000000000 --- a/pages/operations/8200-slave-nodes-pxe.rst +++ /dev/null @@ -1,56 +0,0 @@ -.. _8200-slave-nodes-pxe: - -How slave nodes choose the interface to use for PXE booting -=========================================================== - -Fuel configures the NIC name/order based on the data seen by the -Nailgun agent (*/opt/nailgun/bin/agent*) on the discovered nodes. -This is in turn the result of how the NICs are named/ordered -by the bootstrap node. - -The device used by the Admin (PXE) network will be the -interface that is directly attached to this network. -If one is not available, it will fall back to the interface -with the default gateway. - -For example: - -+---------------+----------+------+ -|Physical device|Interface |MAC | -+---------------+----------+------+ -|0 |eth0 |:FE:A0| -+---------------+----------+------+ -|1 |eth1 |:BC:6D| -+---------------+----------+------+ -|2 |eth2 |:E1:B2| -+---------------+----------+------+ - -If physical device 0 is connected to the Admin (PXE) network, -then eth0 will be the admin interface in Fuel. - -If instead physical device 1 is connected to the Admin (PXE) network, -then eth1 will be the admin interface in Fuel. - -A common issue here is that physical device 0, -may not always be assigned device eth0. -You may see: - -+---------------+----------+------+ -|Physical device|Interface |MAC | -+---------------+----------+------+ -|0 |eth2 |:FE:A0| -+---------------+----------+------+ -|1 |eth0 |:BC:6D| -+---------------+----------+------+ -|2 |eth1 |:E1:B2| -+---------------+----------+------+ - -In this case, having physical device 0 connected to -the Admin (PXE) network will result in the eth2 interface -being used as the admin interface in Fuel. - -You can confirm that the right interface -is in use because the MAC address did not change even though -the device name did. - - diff --git a/pages/operations/8500-ceilometer.rst b/pages/operations/8500-ceilometer.rst deleted file mode 100644 index 3218150e8..000000000 --- a/pages/operations/8500-ceilometer.rst +++ /dev/null @@ -1,113 +0,0 @@ - -.. _ceilometer-ops: - -Running Ceilometer -================== - -Fuel can deploy the OpenStack Telemetry component -:ref:`Ceilometer` -to run in your OpenStack environment. -When enabled, Ceilometer collects and shares measurement data -gathered from all OpenStack components. -This data can be used for monitoring and capacity planning purposes -as well as for an alarming service. -Ceilometer's REST API can also provide data -to external monitoring software for a customer's billing system. -See :ref:`ceilometer-mongodb-plan` for information -about the resources required to run Ceilometer. - -For complete information about configuring and running Ceilometer, -see `Ceilometer Developer Documentation `_. - -.. _ceilometer-config-ops: - -Configuring Ceilometer ----------------------- - -Three types of measurement are defined: - -- Cumulative -- increasing over time (instance hours) -- Gauge -- Discrete items (floating IPs, image uploads) - and fluctuating values (disk I/O) -- Delta -- Changing over time (bandwidth) - -For a complete list of meter types by component -that are currently implemented, see -``_ - -For a complete list of Configuration Options, see -``_ - -.. _ceilometer-vcenter: - -Configuring Ceilometer for vCenter ----------------------------------- - -The default Fuel deployment -does not configure Ceilometer -to collect metering information from vCenter. -This also means that, -if the vCenter installation is used with Heat, -autoscaling does not work correctly -because the alarms sent to Heat -are implemented using meters. - -To configure Ceilometer to collect -metering information for vCenter: - -Install **ceilometer-compute-agent** on the Controller node -using the appropriate command: -:: - - apt-get install ceilometer-agent-compute (Debian) - -Configure Ceilometer by adding the following lines -to the *ceilometer.conf* file: -:: - - [DEFAULT] - default_log_levels=amqp=WARN,amqplib=WARN,boto=WARN,qpid=WARN, \ - sqlalchemy=WARN,suds=INFO,iso8601=WARN, \ - requests.packages.urllib3.connectionpool=WARN,oslo.vmware=WARN - hypervisor_inspector=vsphere - - [vmware] - # See Note [1] below. - - [alarm] - evaluation_interval= # See Note [2] below. - -:Note [1]: Configure according to the `VMware documentation `_. - -:Note [2]: This value of should be >= than - the configured pipeline interval for the collection of the - underlying metrics. - -You must also patch a known -`Icehouse bug `_ with the VMware inspector. -Use `this fix `_. - -When you have completed these steps, -restart **ceilometer-agent-compute**, **ceilometer-alarm-evaluator** -and **ceilometer-alarm-notifier**. - -.. _ceilometer-api-ops: - -Performance and database backend --------------------------------- - -Ceilometer can be configured to collect a large amount of metering data -and thus perform a high volume of database writes. -For example, with 100 resources and default configs -Ceilometer collects around 16k samples per hour. - -Starting with version 5.0, Mirantis OpenStack defaults to installing -:ref:`mongodb-term` as the recommended back-end database for Ceilometer. -The Fuel Master Node enables you to choose -the installation of MongoDB as a role onto a node; -see :ref:`assign-roles-ug` for instructions. -This resolves the Ceilometer performance issues caused -by the volume of concurrent read/write operations. - - -.. include:: /pages/operations/ceilometer/8510-prepare-to-test.rst diff --git a/pages/operations/8600-heat.rst b/pages/operations/8600-heat.rst deleted file mode 100644 index 41660e5c7..000000000 --- a/pages/operations/8600-heat.rst +++ /dev/null @@ -1,57 +0,0 @@ -.. raw:: pdf - - PageBreak - -.. index:: Heat - -.. _heat-operations: - -Heat Deployment Notes -================================== - -.. contents :local: - -Overview --------- - -Heat is the OpenStack Orchestration service. Its main goal is to implement -a framework for managing the entire lifecycle of your infrastructure inside -the OpenStack cloud. Heat uses human-readable templates to describe the -deployment process of instances, but also supports AWS CloudFormation -template format. - -Heat Components ---------------- - -heat-api -++++++++ - -This component provides a native REST API and processes API requests. - -heat-api-cfn -++++++++++++ - -This component is similar to *heat-api*, -but provides AWS CloudFormation compatible API. - -heat-engine -+++++++++++ - -This is the main component of the Heat framework. -It does all the work of reading templates, -launching instances and providing events to the API users. - -Installation ------------- - -When using Fuel 4.1 and later, Heat is installed by default -when you deploy your environment. - -For more information: - -* The official `documentation of the Heat project `_ -* `Development documentation `_ -* Mirantis `blog record `_ about Heat. - - -.. include:: /pages/operations/health-checks/0650-heat-test-details.rst diff --git a/pages/operations/8800-horizon.rst b/pages/operations/8800-horizon.rst deleted file mode 100644 index 7aab2eff2..000000000 --- a/pages/operations/8800-horizon.rst +++ /dev/null @@ -1,18 +0,0 @@ -.. raw:: pdf - - PageBreak - -.. index:: Horizon - -.. _horizon-operations: - -Horizon Deployment Notes -======================== - -.. contents :local: - -Overview --------- - -Horizon is the OpenStack web dashboard which provides a web based -user interface to OpenStack services including Nova, Swift, Keystone, etc. diff --git a/pages/operations/8900-testing-details.rst b/pages/operations/8900-testing-details.rst deleted file mode 100644 index 9d9757878..000000000 --- a/pages/operations/8900-testing-details.rst +++ /dev/null @@ -1,16 +0,0 @@ - -.. _Post-Deployment-Check-details: - -Details of Health Checks -======================== - -The Health Checks are run from the Fuel console. -This section provides background details -on the actual checks these tests perform. - -.. include:: /pages/operations/health-checks/0400-sanity-tests-about.rst -.. include:: /pages/operations/health-checks/0410-functional-tests-about.rst -.. include:: /pages/operations/health-checks/0500-test-network.rst -.. include:: /pages/operations/health-checks/0411-ha-test-about.rst -.. include:: /pages/operations/health-checks/0412-configuration-tests-about.rst -.. include:: /pages/operations/health-checks/0413-cloud-validation-about.rst diff --git a/pages/operations/9000-troubleshoot.rst b/pages/operations/9000-troubleshoot.rst deleted file mode 100644 index 12bcbd264..000000000 --- a/pages/operations/9000-troubleshoot.rst +++ /dev/null @@ -1,15 +0,0 @@ - -.. _troubleshoot-top: - -Troubleshooting -=============== - -.. include:: /pages/operations/troubleshoot/1000-logs.rst -.. include:: /pages/operations/troubleshoot/2000-docker-disk-full.rst -.. include:: /pages/operations/troubleshoot/9100-tshoot-corosync-pacemaker.rst -.. include:: /pages/operations/troubleshoot/9110-verify-neutron-ha-crm.rst -.. include:: /pages/operations/troubleshoot/9120-corosync-crashes.rst -.. include:: /pages/operations/troubleshoot/9140-amqp.rst -.. include:: /pages/operations/troubleshoot/9200-openstack-api-timeout.rst - - diff --git a/pages/operations/9600-upgrade.rst b/pages/operations/9600-upgrade.rst deleted file mode 100644 index 826a3cf99..000000000 --- a/pages/operations/9600-upgrade.rst +++ /dev/null @@ -1,15 +0,0 @@ -.. index:: OpenStack-Upgrade Guide - -.. _OS-Upgrade-Guide: - -.. contents:: :local: - :depth: 2 - -Upgrade Environment (EXPERIMENTAL) -================================== - -.. include:: /pages/operations/upgrade/1000-overview.rst -.. include:: /pages/operations/upgrade/1010-quick-start.rst -.. include:: /pages/operations/upgrade/2000-solution-overview.rst -.. include:: /pages/operations/upgrade/3000-upgrade-script.rst -.. include:: /pages/operations/upgrade/4000-finalize-upgrade.rst diff --git a/pages/operations/backport-ocf.rst b/pages/operations/backport-ocf.rst deleted file mode 100644 index bf96e4476..000000000 --- a/pages/operations/backport-ocf.rst +++ /dev/null @@ -1,61 +0,0 @@ -.. index:: HowTo: Backport Galera Pacemaker OCF script - -HowTo: Backport Galera Pacemaker OCF script -------------------------------------------- - -Fuel 5.1 has completely redesigned OCF script which makes Galera cluster more reliable and predictible - -.. note:: Schedule the maintenance window, Perform backups of all databases, Stop MySQL related services before any operations with Galera - -1. Set p_mysql primitive in maintenance mode - :: - - crm configure edit p_mysql - meta is-managed=false - -2. Check the status. It should show clone_p_mysql primitives as Unmanaged: - :: - - crm_mon -1 - -3. Download the latest OCF script from fuel-library repository to master node - :: - - wget --no-check-certificate -O /etc/puppet/modules/galera/files/ocf/mysql-wss https://raw.githubusercontent.com/stackforge/fuel-library/master/deployment/puppet/galera/files/ocf/mysql-wss - -4. OCF script is required a bit modification as it was designed for MySQL 5.6 originally - :: - - perl -pi -e 's/--wsrep-new-cluster/--wsrep-cluster-address=gcomm:\/\//g' /etc/puppet/modules/galera/files/ocf/mysql-wss - -5. Copy the script to all controllers: - :: - - for i in $(fuel nodes | awk '/ready.*controller.*True/{print $1}'); do scp /etc/puppet/modules/galera/files/ocf/mysql-wss node-$i:/etc/puppet/modules/galera/files/ocf/mysql-wss; done - for i in $(fuel nodes | awk '/ready.*controller.*True/{print $1}'); do scp /etc/puppet/modules/galera/files/ocf/mysql-wss node-$i:/usr/lib/ocf/resource.d/mirantis/mysql-wss; done - -6. Configure p_mysql resource for new Galera OCF script: - :: - - crm configure edit p_mysql - -Primitive for Ubuntu: - :: - - crm configure primitive p_mysql ocf:mirantis:mysql-wss \ - params socket="/var/run/mysqld/mysqld.sock" \ - pid="/var/run/mysqld/mysqld.pid" \ - test_passwd="password" test_user="wsrep_sst" \ - op monitor timeout="55" interval="60" enabled=true \ - op start timeout="475" interval="0" \ - op stop timeout="175" interval="0" \ - meta is-managed=true - -.. note:: During this operation MySQL cluster will be restarted. This may take up to 5 minute - -7. Check Galera Cluster is fully assembled: - :: - - mysql -e "show global status like 'wsrep_incoming_addresses'" - -8. Start MySQL related services. diff --git a/pages/operations/ceilometer/8510-prepare-to-test.rst b/pages/operations/ceilometer/8510-prepare-to-test.rst deleted file mode 100644 index b142e2b21..000000000 --- a/pages/operations/ceilometer/8510-prepare-to-test.rst +++ /dev/null @@ -1,33 +0,0 @@ - -.. _ceilometer_test_prepare: - -Preparing Ceilometer for Testing --------------------------------- - -The Platform Tests that are run as a part of the Health Tests -test Ceilometer if the Environment is configured accordingly. -Before running the test, -please read the requirements below. - -Note that the tests are run in the tenant -that you specify in the `OpenStack Settings` tab -during the OpenStack installation. -By default, the `admin` tenant is used for the tests. - -To run Ceilometer Platform Tests, you must have at least 6 GB -of RAM on each controller node. - -To run the "Ceilometer test to check notifications from Sahara" test, -you must have at least 4096 MB of available RAM in the tenant -you are using for the Ceilometer Platform Tests, otherwise the test may fail. -Also you must get an image with Hadoop for Sahara -and register it with Sahara. For instructions, -see the `Sahara deployment (Preparing Sahara for Testing) -`_. - -To run the "Ceilometer test to check notifications from Nova" test, -you must have at least 100 MB of available RAM in the tenant -you are using for the Ceilometer Platform Tests, otherwise the test may fail. - -If the requirements above are satisfied, Ceilometer is ready -to be tested. \ No newline at end of file diff --git a/pages/operations/ceph/0100-manifest.rst b/pages/operations/ceph/0100-manifest.rst deleted file mode 100644 index 80eff2381..000000000 --- a/pages/operations/ceph/0100-manifest.rst +++ /dev/null @@ -1,30 +0,0 @@ - -.. _ceph-manifest-ops: - -Accessing the Puppet manifest for Ceph --------------------------------------- - -The **node** parameter defines the names -of the Ceph pools to pre-create. -By default, `volumes` and `images` are required -to set up the OpenStack hooks. -:: - - node 'default' { - ... - } - - -The **class** section configures components -for all Ceph-OSD nodes in the environment: -:: - - class { 'ceph::deploy': - auth_supported => 'cephx', - osd_journal_size => '2048', - osd_mkfs_type => 'xfs', - } - -You can modify the authentication type, -Journal size (specified in KB), -and the filesystem architecture to use. diff --git a/pages/operations/ceph/0200-verify.rst b/pages/operations/ceph/0200-verify.rst deleted file mode 100644 index f82ab475c..000000000 --- a/pages/operations/ceph/0200-verify.rst +++ /dev/null @@ -1,125 +0,0 @@ - -.. _ceph-verify-ops: - -Verify the deployment ---------------------- - -Use the **ceph -s** -or **ceph health** command -on one of the Controller or Ceph-OSD nodes -to check the current status of the Ceph cluster. - -The output of this command looks like: -:: - - root@fuel-ceph-02:~# ceph -s - health HEALTH_OK - monmap e1: 2 mons at {fuel-ceph-01=10.0.0.253:6789/0,fuel-ceph-02=10.0.0.252:6789/0}, election epoch 4, quorum 0,1 fuel-ceph-01,fuel-ceph-02 - osdmap e23: 4 osds: 4 up, 4 in - pgmap v275: 448 pgs: 448 active+clean; 9518 bytes data, 141 MB used, 28486 MB / 28627 MB avail - mdsmap e4: 1/1/1 up {0=fuel-ceph-02.local.try=up:active} - - -Look for the following two lines: - -- monmap: should display the correct number of Ceph-MON processes. -- osdmap: should display the correct number of Ceph-OSD instances - (one per node per volume) - -**ceph -s** may return an error similar to the following: -:: - - root@fuel-ceph-01:~# ceph -s - health HEALTH_WARN 63 pgs peering; 54 pgs stuck inactive; 208 pgs stuck unclean; recovery 2/34 degraded (5.882%) - ... - -**ceph** commands return "missing keyring" error, -such as: -:: - - 2013-08-22 00:06:19.513437 7f79eedea760 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication - 2013-08-22 00:06:19.513466 7f79eedea760 -1 ceph_tool_common_init failed. - -To analyze the problem: - -- Check the links in */root/ceph\*.keyring*. - There should be one for each admin, osd, and mon role - that is configured. - If any are missing, it may be the cause of the error. - To correct use soft-links: - :: - - ceph-deploy gatherkeys {monitor host} - - Place the downloaded keys to /etc/ceph/. Remove the original files from /root and create symlinks with the same names in /root, pointing to the actual files in /etc/ceph/. - -- Try to run the following command: - :: - - ceph-deploy gatherkeys {mon-server-name} - - If this does not work, - an error may have occurred when initializing the cluster. - -- Run the following command to find running ceph processes: - :: - - ps axu | grep ceph - - - If this lists a python process running for `ceph-create-keys`, - it usually indicates that the Ceph-MON processes - are unable to communicate with each other. - - - Check the network and firewall for each Ceph-MON. - Ceph-MON defaults to port 6789. - - - If `public_network` is defined in the *ceph.conf* file, - `mon_host` and DNS names must be inside the `public_network` - or **ceph-deploy** does not create the Ceph-MON processes. - -Missing OSD instances -+++++++++++++++++++++ - -For the default configuration, -you should have one Ceph-OSD instance per volume -for each Ceph-OSD node listed in the configuration. -If one or more of these is missing, -it may indicate a problem initializing and mounting the disks. -Common causes: - -- The disk or volume is in use. -- The disk partition did not refresh in the kernel. -- Customized Ceph.conf may contain errors on mount - parameters string. Ceph-deploy fails to mount such partitions. - -Check the osd tree: -:: - - #ceph osd tree - - # id weight type name up/down reweight - -1 6 root default - -2 2 host controller-1 - 0 1 osd.0 up 1 - 3 1 osd.3 up 1 - -3 2 host controller-2 - 1 1 osd.1 up 1 - 4 1 osd.4 up 1 - -4 2 host controller-3 - 2 1 osd.2 up 1 - 5 1 osd.5 up 1 - - -Ceph pools -++++++++++ - -To see which Ceph pools have been created, -use the **ceph osd lspools** command: -:: - - # ceph osd lspools - 0 data,1 metadata,2 rbd,3 images,4 volumes, - -By default, two pools -- `image` and `volumes` are created. -In this case, we also have `data`, `metadata`, and `rbd` pools. diff --git a/pages/operations/ceph/0300-test-openstack.rst b/pages/operations/ceph/0300-test-openstack.rst deleted file mode 100644 index b71e4d898..000000000 --- a/pages/operations/ceph/0300-test-openstack.rst +++ /dev/null @@ -1,256 +0,0 @@ - -.. _test-ceph-openstack-op: - -Test that Ceph works with OpenStack components ----------------------------------------------- - -Glance -++++++ - -Upload an image to Glance to see if it is saved in Ceph: - - :: - - source ~/openrc - glance image-create --name cirros --container-format bare \ - --disk-format qcow2 --is-public yes --location \ - https://launchpad.net/cirros/trunk/0.3.0/+download/cirros-0.3.0-x86_64-disk.img - - -This should return something similar to the following: - - :: - - +------------------+--------------------------------------+ - | Property | Value | - +------------------+--------------------------------------+ - | checksum | None | - | container_format | bare | - | created_at | 2013-08-22T19:54:28 | - | deleted | False | - | deleted_at | None | - | disk_format | qcow2 | - | id | f52fb13e-29cf-4a2f-8ccf-a170954907b8 | - | is_public | True | - | min_disk | 0 | - | min_ram | 0 | - | name | cirros | - | owner | baa3187b7df94d9ea5a8a14008fa62f5 | - | protected | False | - | size | 0 | - | status | active | - | updated_at | 2013-08-22T19:54:30 | - +------------------+--------------------------------------+ - -Then check rbd: - - :: - - rbd ls images - rados -p images df - -Cinder -++++++ - -Create a small volume and see if it is saved in Cinder: - - :: - - source openrc - cinder create 1 - - -This will instruct Сinder to create a 1 GB volume. This should return -something similar to the following: - - :: - - +=====================+======================================+ - | Property | Value | - +=====================+======================================+ - | attachments | [] | - +---------------------+--------------------------------------+ - | availability_zone | nova | - +---------------------+--------------------------------------+ - | bootable | false | - +---------------------+--------------------------------------+ - | created_at | 2013-08-30T00:01:39.011655 | - +---------------------+--------------------------------------+ - | display_description | None | - +---------------------+--------------------------------------+ - | display_name | None | - +---------------------+--------------------------------------+ - | id | 78bf2750-e99c-4c52-b5ca-09764af367b5 | - +---------------------+--------------------------------------+ - | metadata | {} | - +---------------------+--------------------------------------+ - | size | 1 | - +---------------------+--------------------------------------+ - | snapshot_id | None | - +---------------------+--------------------------------------+ - | source_volid | None | - +---------------------+--------------------------------------+ - | status | creating | - +---------------------+--------------------------------------+ - | volume_type | None | - +---------------------+--------------------------------------+ - - - -Check the status of the image using its *id* with the *cinder show * command: - - :: - - cinder show 78bf2750-e99c-4c52-b5ca-09764af367b5 - - +==============================+======================================+ - | Property | Value | - +==============================+======================================+ - | attachments | [] | - +------------------------------+--------------------------------------+ - | availability_zone | nova | - +------------------------------+--------------------------------------+ - | bootable | false | - +------------------------------+--------------------------------------+ - | created_at | 2013-08-30T00:01:39.000000 | - +------------------------------+--------------------------------------+ - | display_description | None | - +------------------------------+--------------------------------------+ - | display_name | None | - +------------------------------+--------------------------------------+ - | id | 78bf2750-e99c-4c52-b5ca-09764af367b5 | - +------------------------------+--------------------------------------+ - | metadata | {} | - +------------------------------+--------------------------------------+ - | os-vol-host-attr:host | controller-19.domain.tld | - +------------------------------+--------------------------------------+ - | os-vol-tenant-attr:tenant_id | b11a96140e8e4522b81b0b58db6874b0 | - +------------------------------+--------------------------------------+ - | size | 1 | - +------------------------------+--------------------------------------+ - | snapshot_id | None | - +------------------------------+--------------------------------------+ - | source_volid | None | - +------------------------------+--------------------------------------+ - | status | available | - +------------------------------+--------------------------------------+ - | volume_type | None | - +------------------------------+--------------------------------------+ - - - -If the image shows *status available*, it was successfully created in Ceph. -You can check this with the *rbd ls volumes command*. - - :: - - rbd ls volumes - volume-78bf2750-e99c-4c52-b5ca-09764af367b5 - -Rados GW -++++++++ - -First confirm that the cluster is *HEALTH_OK* using *ceph -s* or *ceph health detail*. -If the cluster is not healthy most of these tests will not function. - -.. note:: - - RedHat distros: mod_fastcgi's /etc/httpd/conf.d/fastcgi.conf - must have FastCgiWrapper Off or rados calls will return 500 errors. - - -Rados relies on the service *radosgw* (Debian) *ceph-radosgw* (RHEL) to run and create a socket for the webserver's script service to talk to. -If the radosgw service is not running, or not staying running then you need to inspect it closer. - -The service script for radosgw might *exit 0* and not start the service. -An easy way to test this is to simply *service ceph-radosgw restart* if -the service script can not stop the service, it was not running in the first place. - -You can also check to see if the radosgw service is be running with the *ps axu | grep radosgw* command, but this might also show the webserver script server processes as well. - -Most commands from *radosgw-admin* will work regardless of whether the radosgw service is running or not. - -Swift -+++++ - -Create a new user: - - :: - - radosgw-admin user create --uid=test --display-name="username" --email="username@domain.com" - { "user_id": "test", - "display_name": "username", - "email": "username@domain.com", - "suspended": 0, - "max_buckets": 1000, - "auid": 0, - "subusers": [], - "keys": [ - { "user": "test", - "access_key": "CVMC8OX9EMBRE2F5GA8C", - "secret_key": "P3H4Ilv8Lhx0srz8ALO\/7udwkJd6raIz11s71FIV"}], - "swift_keys": [], - "caps": []} - -Swift authentication works with subusers. In OpenStack this will be *tenant:user*, so you need to mimic it: - -:: - - radosgw-admin subuser create --uid=test --subuser=test:swift --access=full - - { "user_id": "test", - "display_name": "username", - "email": "username@domain.com", - "suspended": 0, - "max_buckets": 1000, - "auid": 0, - "subusers": [ - { "id": "test:swift", - "permissions": "full-control"}], - "keys": [ - { "user": "test", - "access_key": "CVMC8OX9EMBRE2F5GA8C", - "secret_key": "P3H4Ilv8Lhx0srz8ALO\/7udwkJd6raIz11s71FIV"}], - "swift_keys": [], - "caps": []} - -Generate a secret key. - -.. note:: - - *--gen-secret* is required in - Cuttlefish and newer. - - -:: - - radosgw-admin key create --subuser=test:swift --key-type=swift --gen-secret - { "user_id": "test", - "display_name": "username", - "email": "username@domain.com", - "suspended": 0, - "max_buckets": 1000, - "auid": 0, - "subusers": [ - { "id": "test:swift", - "permissions": "full-control"}], - "keys": [ - { "user": "test", - "access_key": "CVMC8OX9EMBRE2F5GA8C", - "secret_key": "P3H4Ilv8Lhx0srz8ALO\/7udwkJd6raIz11s71FIV"}], - "swift_keys": [ - { "user": "test:swift", - "secret_key": "hLyMvpVNPez7lBqFlLjcefsZnU0qlCezyE2IDRsp"}], - "caps": []} - - -Sample test commands should look as follows: - - :: - - swift -A http://localhost:6780/auth/1.0 -U test:swift -K "eRYvzUr6vubg93dMRMk60RWYiGdJGvDk3lnwi4cl" post test - swift -A http://localhost:6780/auth/1.0 -U test:swift -K "eRYvzUr6vubg93dMRMk60RWYiGdJGvDk3lnwi4cl" upload test myfile - swift -A http://localhost:6780/auth/1.0 -U test:swift -K "eRYvzUr6vubg93dMRMk60RWYiGdJGvDk3lnwi4cl" list test - - - diff --git a/pages/operations/ceph/0500-reset.rst b/pages/operations/ceph/0500-reset.rst deleted file mode 100644 index fb4881dd5..000000000 --- a/pages/operations/ceph/0500-reset.rst +++ /dev/null @@ -1,33 +0,0 @@ - -.. _ceph-reset-ops: - -Reset the Ceph cluster ----------------------- - -You can reset the Ceph cluster if necessary -after correcting configuration errors. -This is often easier than having to re-deploy -the entire OpenStack environment. - -To do this, create a simple shell script -with the following contents (below), then -edit the string *export all="compute-4 controller-1 controller-2 controller-3"* -and define the variable *$all* to contain all nodes -that contain Ceph-MON and Ceph-OSD services that -you want to re-initialize as well as all Compute nodes. - -You can get the node names with the *fuel node list* command. - -:: - - export all="compute-4 controller-1 controller-2 controller-3" - for node in $all - do - ssh $node 'service ceph -a stop ; - umount /var/lib/ceph/osd/ceph* ; - done; - ceph-deploy purgedata $all; - ceph-deploy purge $all; - yum install -y ceph-deploy; - rm ~/ceph* ; - ceph-deploy install $all diff --git a/pages/operations/ceph/0600-s3api.rst b/pages/operations/ceph/0600-s3api.rst deleted file mode 100644 index c92ec4fdc..000000000 --- a/pages/operations/ceph/0600-s3api.rst +++ /dev/null @@ -1,193 +0,0 @@ - -.. _ceph-s3-api: - -S3 API in Ceph RADOS Gateway ----------------------------- - -Introduction -++++++++++++ - -`Ceph RADOS Gateway `_ offers accessing the same objects and containers using many different APIs. The two most important are: `OpenStack Object Storage API v1 (aka Swift API) `_ and `Amazon S3 (Simple Storage Service) `_. Beside these, radosgw supports several internal interfaces dedicated for logging, replication, and administration. Covering them is not the purpose of this document. - -Getting started -+++++++++++++++ - -Assumption has been made that you posses a working Ceph cluster and the radosgw is able to access the cluster. In case of using cephx security system, which is the default scenario, both radosgw and cluster must authenticate to each other. Please note this is not related to any user-layer authentication mechanism used in radosgw like Keystone, `TempURL `_, or `TempAuth `_. If radosgw is deployed with Fuel, `cephx `_ should work out of the box. In case of manual deployment, `official documentation `_ will be helpful. - -To enable or just verify whether S3 has been properly configured, the configuration file used by radosgw (usually `/etc/ceph/ceph.conf`) should be inspected. Please take a look at radosgw's section (usually `client.radosgw.gateway`) and consider the following options: - -* *rgw_enable_apis* - if present, it must contain at least ``s3`` - -User authentication -+++++++++++++++++++ - -The component providing S3 API implementation inside radosgw actually supports two methods of user authentication: Keystone-based and RADOS-based (internal). Each of them may be separately enabled or disabled with an appropriate configuration option. The first one takes precedence over the second. That is, if both methods are enabled and Keystone authentication fails for any reason (wrong credentials, connectivity problems etc.), the RADOS-based will be treated as fallback. - -Keystone-based -^^^^^^^^^^^^^^ - -**Configuration** - -Keystone authentication for S3 is not enabled by default, even if using Fuel. Please take a look at appropriate section (usually `client.radosgw.gateway`) in radosgw's configuration file and consider following options: - -.. list-table:: - :widths: 42 15 70 20 - :header-rows: 1 - - * - Option name - - Default value in rgw - - Comment - - Present in Fuel-deployed configuration - * - rgw_s3_auth_use_keystone - - false - - must be present and set to true - - no - * - rgw_keystone_url - - empty - - must be present and set to point admin interface of Keystone (usually port 35357, *some versions of Fuel wrongly set the port to 5000*). - - yes - * - rgw_keystone_admin_token - - empty - - must be present and match the admin token set in Keystone configuration - - yes - * - rgw_keystone_accepted_roles - - Member, admin - - should correspond the Keystone schema. Fuel setting seems to be OK - - yes - -In case of using Keystone-based authentication, user management is fully delegated to Keystone. You may use :command:`keystone` CLI command to do that. Please be aware that the EC2/S3 `:` credentials pair do not map well into Keystone (there is no a direct way to specify a tenant), so special compatibility layer has been introduced. Practically, it means you need to tell Keystone about the mapping parameters manually. For example: - -:: - - keystone ec2-credentials-create --tenant-id=68a23e70b5854263ab64f2ddc16c2a38 --user-id=2ccdd07ae153484296d308eab10c85dd - - WARNING: Bypassing authentication using a token & endpoint (authentication credentials are being ignored). - - +-----------+----------------------------------+ - | Property | Value | - +-----------+----------------------------------+ - | access | 3862b51ecc6a43a78ffca23a05e7c0ad | - | secret | a0b4cb375d5a409893b05e36812fb811 | - | tenant_id | 68a23e70b5854263ab64f2ddc16c2a38 | - | trust_id | | - | user_id | 2ccdd07ae153484296d308eab10c85dd | - +-----------+----------------------------------+ - -``access`` and ``secret`` are the parameters needed to authenticate a client to S3 API. - -**Performance Impact** - -Please be aware that Keystone's PKI tokens are not available together with S3 API. Moreover, radosgw doesn't cache Keystone responses while using S3 API. This could lead to authorization service overload. - -RADOS-based (internal) -^^^^^^^^^^^^^^^^^^^^^^ - -**Configuration** - -The RADOS-based authentication mechanism should work out of the box. It is enabled by default in radosgw and Fuel does not change this setting. However, in case of necessity to disable it, the `rgw_s3_auth_use_rados` may be set to `false`. - -User management could be performed with command line utility :command:`radosgw-admin` provided with Ceph. For example, to create a new user the following command should be executed: - -:: - - radosgw-admin user create --uid=ant --display-name="aterekhin" - { "user_id": "ant", - "display_name": "aterekhin", - "email": "", - "suspended": 0, - "max_buckets": 1000, - "auid": 0, - "subusers": [], - "keys": [ - { "user": "ant", - "access_key": "9TEP7FTSYTZF2HZD284A", - "secret_key": "8uNAjUZ+u0CcpbJsQBgpoVgHkm+PU8e3cXvyMclY"}], - "swift_keys": [], - "caps": [], - "op_mask": "read, write, delete", - "default_placement": "", - "placement_tags": [], - "bucket_quota": { "enabled": false, - "max_size_kb": -1, - "max_objects": -1}, - "user_quota": { "enabled": false, - "max_size_kb": -1, - "max_objects": -1}, - "temp_url_keys": []} - -``access_key`` and ``secret_key`` are the parameters needed to authenticate a client to S3 API. - -**Verification** - -To check whether everything works fine a low-level S3 API client might be very useful, especially if it can provide assistance in the matter of authentication signature generation. S3 authentication model requires that the client provides a key identifier (`AccessKeyId`) and `HMAC-based `_ authentication signature, which is calculated against a user key (`secret`) and some HTTP headers present in the request. The well-known solution is `s3curl `_ application. However, unpatched versions contain severe bugs (see `LP1446704 `_). We fixed them already and sent a pull request to its author. However, until it is not merged, we may recommend trying `this version `_ of s3curl. - -*Step-by-step instruction* - -#. Install the `libdigest-hmac-perl` package -#. Download the S3 API client using the following link:: - - git clone https://github.com/rzarzynski/s3curl - -#. Set permisions for s3curl.pl:: - - chmod u+x s3curl.pl - -#. Create `.s3curl` file in your home directory. - This file should contain your `AccessKeyId` and `SecretAccessKey` pairs. - - :: - - %awsSecretAccessKeys = ( - # your account - ant => { - id => '9TEP7FTSYTZF2HZD284A', - key => '8uNAjUZ+u0CcpbJsQBgpoVgHkm+PU8e3cXvyMclY', - }, - ); - -#. Set the S3 endpoint in `s3curl.pl` file, for example:: - - my @endpoints = ('172.16.0.2'); - - or use `s3curl.pl` script to add it:: - - ./s3curl.pl --id ant --endpoint - - Example:: - - ./s3curl.pl --id ant --endpoint 172.16.0.2 - - .. note:: - - You can get your S3 endpoint using the keystone CLI command as follows:: - - keystone endpoint-get --service 's3' - +--------------+------------------------+ - | Property | Value | - +--------------+------------------------+ - | s3.publicURL | http://172.16.0.2:8080 | - +--------------+------------------------+ - - -#. Try to run the s3curl command to test S3 API, for example: - - * To get an object :: - - ./s3curl.pl --id -- // - - Example:: - - ./s3curl.pl --id ant -- http://172.16.0.2:8080/bucket/key - - * Upload a file :: - - ./s3curl.pl --id --put -- // - - Example:: - - ./s3curl.pl --id ant --put file -- http://172.16.0.2:8080/bucket/key - -.. note:: - - Known issues: `LP1477457 `_ in Fuel 6.1. - diff --git a/pages/operations/configuring-repos-ops.rst b/pages/operations/configuring-repos-ops.rst deleted file mode 100644 index 9c9136acd..000000000 --- a/pages/operations/configuring-repos-ops.rst +++ /dev/null @@ -1,39 +0,0 @@ -.. _configuring-repos-ops: - -Configuring repositories -======================== - -You may need to configure repositories to: - -* :ref:`Download Ubuntu packages` -* :ref:`Apply patches` - -By default, your environments will have the configuration of the -repositories that point to the Mirantis update and security -repository mirrors. There is also an 'Auxiliary' repository configured -on the Fuel Master node which can be used to deliver packages -to the nodes. - -.. image:: /_images/patchingRepos.png - -To change the list of repositories, you will need to -amend the three fields which contain the required information -for the repositories configuration depending on the -distribution you install. - -For Ubuntu ----------- - -:: - - |repo-name|apt-sources-list-string|repo-priority| - - my-repo deb http://my-domain.local/repo trusty main 1200 - -Repository priorities ---------------------- - -The process of setting up repositories and repository priorities -is the same one you normally do on your Linux distribution. - -For more information, see the documentation to your Linux distribution. diff --git a/pages/operations/corosync2.rst b/pages/operations/corosync2.rst deleted file mode 100644 index 8b360942b..000000000 --- a/pages/operations/corosync2.rst +++ /dev/null @@ -1,19 +0,0 @@ -.. _corosync2: - -Notes on Corosync and Pacemaker -=============================== - -Keep in mind the following on -Corosync and Pacemaker: - -* If you restart the Corosync service, you will need to - restart the Pacemaker as well. - -* Corosync 1.x cannot be upgraded to 2.x without full - cluster downtime. All Pacemaker resources, such as Neutron - agents, DB and AMQP clusters and others, will be hit by the - downtime as well. - -* All location constraints for cloned the Pacemaker resources - must be removed as a part of the Corosync version upgrade - procedure. diff --git a/pages/operations/db-backup-ops.rst b/pages/operations/db-backup-ops.rst deleted file mode 100644 index cdabaaddc..000000000 --- a/pages/operations/db-backup-ops.rst +++ /dev/null @@ -1,156 +0,0 @@ -.. _db-backup-ops: - -OpenStack Database Backup and Restore with Percona XtraBackup -============================================================= - -With the procedure described in this topic -you will be able to back up and restore -your OpenStack MySQL database. - -You will need to put the OpenStack -environment into maintenance mode. - -In the maintenance mode the following services -will be unavailable: - - * MySQL and HAProxy on the selected controller node - * HAProxy on other controller nodes in the cluster for a short time - -Backing up with Percona XtraBackup ----------------------------------- - -#. Enable the HAProxy stats socket for every controller in a cluster: - - #. Open the */etc/haproxy/haproxy.cfg* file for editing. - - #. Find the *stats socket /var/lib/haproxy/stats* line in the global section - and add *level admin* at the end of the line. - -#. Restart HAProxy in one of the following ways: - - * Execute /usr/lib/ocf/resource.d/mirantis/ns_haproxy reload on every controller - - Or - - * Reload all HAProxy instances on all controllers in a cluster with a temporary - services stop by running the *crm resource restart p_haproxy* command. - -#. On the Fuel Master node, run the *fuel nodes | grep controller* command. - If the node that you are going to back up is a host for a Neutron agent, - you can move the agent to a different controller with the following command: - - :: - - ssh node-1 - pcs resource move agent_name node_name - - where "node-1" is the name of the node from which you would like to move. - -#. For every controller in the cluster, put the MySQL service into - maintenance mode by running the following command from the Fuel Master node: - - :: - - ssh -t node-1 'echo "disable server mysqld/node-1" | socat stdio /var/lib/haproxy/stats' - -#. Put the node into maintenance mode for Pacemaker: - - :: - - ssh node-1 - crm node maintenance - - where "node-1" is the name of the node from which you would like to move. - -#. Stop data replication on the selected MySQL instance: - - :: - - mysql -e "SET GLOBAL wsrep_on=off;" - -#. Run the backup: - - :: - - xtrabackup --backup --stream=tar ./ | gzip - > backup.tar.gz - -#. Make a streaming backup as described in - `Percona Guide `_. - -#. Move the archive file to a safe place. - -#. Re-enable the data replication: - - :: - - mysql -e "SET GLOBAL wsrep_on=on;" - -#. Take the MySQL service out of maintenance mode with - the following command for every controller in the cluster: - - :: - - ssh -t node-1 'echo "enable server mysqld/node-1" | socat stdio /var/lib/haproxy/stats' - -#. Put the node into the ready mode: - - :: - - ssh -t node-1 crm node ready - - where "node-1" is the node that you have backed up. - -Restoring with Percona XtraBackup ---------------------------------- - -#. Remove grastate.dat (e.g. move to a different place) оn all nodes: - - :: - - ssh node-1 mv /var/lib/mysql/grastate.dat /var/lib/mysql/grastate.old - ssh node-2 mv /var/lib/mysql/grastate.dat /var/lib/mysql/grastate.old - ssh node-3 mv /var/lib/mysql/grastate.dat /var/lib/mysql/grastate.old - -#. Extract the database backup file on the first controller: - - :: - - ssh node-1 'cd /var/lib/mysql/ ;tar -xvzf clear-base.tgz' - - where "node-1" is the node that you have backed up. - -#. Change the owner: - - :: - - chown -R mysql:mysql /var/lib/mysql - -#. Export the variables for *mysql-wss* on all nodes: - - :: - - export OCF_RESOURCE_INSTANCE=p_mysql - export OCF_ROOT=/usr/lib/ocf - export OCF_RESKEY_socket=/var/run/mysqld/mysqld.sock - -#. Export the variable for *mysql-wss on* the first node: - - :: - - export OCF_RESKEY_additional_parameters="--wsrep-new-cluster" - -#. Start *mysqld* on the first controller: - - :: - - /usr/lib/ocf/resource.d/fuel/mysql-wss start - -#. Start *mysqld* on all other controllers: - - :: - - /usr/lib/ocf/resource.d/fuel/mysql-wss start - -#. Copy the extracted database backup. - -#. Check the crm status for all nodes. diff --git a/pages/operations/docker-on-master.rst b/pages/operations/docker-on-master.rst deleted file mode 100644 index 661e70106..000000000 --- a/pages/operations/docker-on-master.rst +++ /dev/null @@ -1,178 +0,0 @@ -.. _docker-ops: - -Docker Containers and Dockerctl -=============================== - -Docker provides user-friendly commands -that can be used to deploy :ref:`lxc-term` containers. - -* Docker brings LXC to the foreground by wrapping it with user-friendly commands. -* Dockerctl is a simple wrapper for Docker - that improves Docker's offline image handling and container versioning. - It adds additional management tools - that are useful when managing your Fuel deployment. - -See :ref:`docker-term` for more background information. - -Container types ---------------- - -Application Container - An application container is the most common type of container. - It usually runs a single process in the foreground and writes logs to stdout/stderr. - Docker traps these logs and saves them automatically in its database. - -Storage Container - A storage container is a minimalistic container - that runs Busybox and acts as a sharer of one or more directories. - It needs to run only one time and then spends - the majority of its existence in Exited state. - -Command reference ------------------ - -Below is a list of commands that are useful when managing LXC containers on the Fuel Master. - -Basic usage -+++++++++++ -Get a list of available commands: -:: - - docker help - - -Get a list of all running containers: -:: - - docker ps - -Get a list of all containers available: -:: - - docker ps -a - -.. note:: the storage containers used for sharing files among application containers - are usually in Exited state. Exited state means that the - container exists, but no processes inside are running. - -Start a new Docker container with the specified commands: -:: - - docker run [options] imagename [command] - -*Example:* The command below creates a temporary postgres container that is -ephemeral and not tied to any other containers. -This is useful for testing without impacting production containers. -:: - - docker run --rm -i -t fuel/postgres /bin/bash - -Import a Docker image: -:: - - docker load -i (archivefile) - -Loads in a Docker image in the following formats: .tar, .tar.gz, .tar.xz. -lrz is not supported. - -Save a Docker image to a file: -:: - - docker save image > image.tar - -Dockerctl -+++++++++ - -Build and run storage containers, then run application containers: -:: - - dockerctl build all - -.. note:: This can take a few minutes, depending on your hardware. - -Launch a container from its image with the necessary options. -If the container already exists, -will ensure that this container is in a running state: -:: - - dockerctl start [--attach] - -Optionally, *--attach* option can be used to monitor the process and view its stdout and -stderr. - - -Display the entire container log for /app/. Useful for troubleshooting: -:: - - dockerctl logs - -Stop or restart a container: -:: - - dockerctl stop|restart - -Create a shell or run a command: -:: - - dockerctl shell [command] - -.. note:: The container must be running first in order to use this feature. - Additionally, quotes must be escaped if your command requires them. - -Stop and destroy a container: -:: - - dockerctl destroy - -.. note:: This is not reversible, so use with caution. - -Find containets names by running: -:: - - dockerctl list - -.. _fuel-docker-changes: - -System changes for Docker affecting Fuel 5.0 and later ------------------------------------------------------- - -The Fuel Master base system is modified in 5.0. -These changes were made mostly to enable directory sharing -between containers to operate smoothly: - -* /etc/astute.yaml moved to /etc/fuel/astute.yaml -* /etc/nailgun/version.yaml moved to /etc/fuel/version.yaml -* Base OS puppet is now run from - /etc/puppet/modules/nailgun/examples/host-only.pp -* Postgres DB is now inside a container. - You can access it if you run "dockerctl shell postgres" - or connect to localhost from base host. -* DNS resolution is now performed inside the cobbler container. - Additional custom entries should be added inside /etc/dnsmasq.d/ - inside the cobbler container or via Cobbler itself. -* Starting with Fuel 6.1, Docker containers with host networking are used. - This means that dhcrelay is not used anymore because cobbler/dnsmasq - are bound to the host system. -* Application logs are inside /var/log/docker-logs, - including astute, nailgun, cobbler, and others. -* Supervisord configuration is located inside /etc/supervisord.d/(CurrentRelease)/ -* Containers are automatically restarted by supervisord. - If you need to stop a container for any reason, - first run supervisorctl stop /app/, and then dockerctl stop /app/ - -Fuel Master architecture changes for Docker -------------------------------------------- - -Starting with Fuel 5.1, in order to enable containerization of the Fuel -Master's services, several pieces of the Fuel Master node design were changed. -Most of that change came from Puppet, but below is a list of modifications -to Fuel to enable Docker: - -* DNS lookups come from Cobbler container -* App containers launch in order, but not in a synchronous manner. - Retries were added to several sections of deployment - in case a dependent service is not yet ready. -* The version.yaml file is extended to include production key - with values docker and docker-build. -* Extended Docker's default iptables rules to ensure - that traffic visibility is appropriate for each service. diff --git a/pages/operations/empty-role.rst b/pages/operations/empty-role.rst deleted file mode 100644 index c730b08a2..000000000 --- a/pages/operations/empty-role.rst +++ /dev/null @@ -1,112 +0,0 @@ - -.. _empty-role: - -Deploying an Empty Role through Fuel CLI -======================================== - -Make sure there are zero environments: - -:: - - [root@nailgun tmp]# fuel env - id | status | name | mode | release_id | pending_release_id - ---|--------|------|------|------------|------------------- - - -Check the operating systems: - -:: - - [root@nailgun tmp]# fuel release - id | name | state | operating_system | version - ---|----------------------|-------------|------------------|------------- - 2 | Kilo on Ubuntu 14.04 | available | Ubuntu | 2015.1.0-7.0 - 1 | Kilo on CentOS 6.5 | unavailable | CentOS | 2015.1.0-7.0 - -Note down the numbers under the ``id`` column. You will -need these later. - -Check the existing nodes: - -:: - - [root@nailgun tmp]# fuel node - id | status | name | cluster | ip | mac | roles | - ---|----------|------------------|---------|-------------|-------------------|-------| - 10 | discover | Untitled (8a:15) | None | 10.109.0.4 | 64:dd:40:75:8a:15 | | - 8 | discover | Untitled (96:c1) | None | 10.109.0.5 | 64:2e:f0:06:96:c1 | | - 9 | discover | Untitled (8b:4a) | None | 10.109.0.3 | 64:7b:44:59:8b:4a | | - 7 | discover | Untitled (d2:bf) | None | 10.109.0.12 | 64:79:31:7a:d2:bf | | - - pending_roles | online | group_id - --------------|------------------ - True | None - True | None - True | None - False | None - -There are three nodes online: 8,9,10 - -Create a new environment: - -:: - - [root@nailgun tmp]# fuel env create --name test --release 1 - Environment 'test' with id=4, mode=ha_compact and network-mode=neutron was created! - -Check if the environment has been created: - -:: - - [root@nailgun tmp]# fuel env - id | status | name | mode | release_id | pending_release_id - ---|--------|------|------------|------------|------------------- - 4 | new | test | ha_compact | 1 | None - -Note down the ``id`` of the environment. You will need this later. - -Check the existing roles: - -:: - - [root@nailgun tmp]# fuel role --release 1 - name | id - --------------|--- - controller | 1 - compute | 2 - cinder | 3 - cinder-vmware | 4 - ceph-osd | 5 - mongo | 6 - base-os | 7 - -The role that you need is ``base-os``. - -Add the node whose ``id`` is 8 and the role is ``base-os`` to -the environment whose ``id`` is 4: - -:: - - [root@nailgun tmp]# fuel node set --env 4 --node 8 --role base-os - Nodes [8] with roles ['base-os'] were added to environment 4 - -Check the results: - -:: - - [root@nailgun tmp]# fuel node - id | status | name | cluster | ip | mac | roles | - ---|----------|------------------|---------|-------------|-------------------|-------| - 10 | discover | Untitled (8a:15) | None | 10.109.0.4 | 64:dd:40:75:8a:15 | | - 8 | discover | Untitled (96:c1) | 4 | 10.109.0.5 | 64:2e:f0:06:96:c1 | | - 9 | discover | Untitled (8b:4a) | None | 10.109.0.3 | 64:7b:44:59:8b:4a | | - 7 | discover | Untitled (d2:bf) | None | 10.109.0.12 | 64:79:31:7a:d2:bf | | - - pending_roles | online | group_id - ---------------|--------|--------- - | True | None - base-os | True | 4 - | True | None - | False | None - -Your node with an empty role has been added to the cluster. diff --git a/pages/operations/enable_ubuntu_bootstrap.rst b/pages/operations/enable_ubuntu_bootstrap.rst deleted file mode 100644 index ba94231db..000000000 --- a/pages/operations/enable_ubuntu_bootstrap.rst +++ /dev/null @@ -1,21 +0,0 @@ - -.. _enable_ubuntu_bootstrap: - -Enable Ubuntu bootstrap (EXPERIMENTAL) -====================================== - -By default, Fuel 7.0 uses CentOS 6.6 bootstrap operating system. Ubuntu 14.04 -bootstrap is only available as an experimental feature. See -:ref:`Release notes ` for details about known issues with -this feature. - -To enable Ubuntu 14.04 bootstrap: - -#. Enable :ref:`experimental features `. -#. Verify that you are logged as root into your Fuel Master node console and - that your Master node has an access to the Internet. -#. Run the :command:`fuel-bootstrap-image-set ubuntu` command. -#. Run the :command:`ls -l /var/www/nailgun/bootstrap/ubuntu/root.squashfs` - command to verify that the Ubuntu image is built successfully. The build - log is available in `/var/log/fuel-bootstrap-image-build.log`. -#. Reboot the discovered nodes. \ No newline at end of file diff --git a/pages/operations/external-ubuntu-ops.rst b/pages/operations/external-ubuntu-ops.rst deleted file mode 100644 index e432da6b6..000000000 --- a/pages/operations/external-ubuntu-ops.rst +++ /dev/null @@ -1,263 +0,0 @@ - -.. _external-ubuntu-ops: - -Downloading Ubuntu system packages -================================== - -In Fuel 6.0 and older there is an option -to select an Ubuntu release in Fuel -and deploy it, since all the Ubuntu packages -are located on the Fuel Master node by default. - -Now all Ubuntu packages are downloaded from -the Ubuntu official mirrors by default, -but you can specify another mirror in -Fuel UI or by using Fuel CLI. - -Updates to the Mirantis packages are fetched -from the Mirantis mirrors by default. - -.. note:: To be able to download Ubuntu system packages - from the official Ubuntu mirrors and Mirantis - packages from the Mirantis mirrors you need to make - sure your Fuel Master node and Slave nodes have - Internet connectivity. - -To change the Ubuntu system package repositories -from the official ones to your company's local ones, -do the following: - -#. In Fuel web UI, navigate to the **Settings** tab - and then scroll down to the **Repositories** section. -#. Change the path under **URI**: - -.. image:: /_images/externalUbuntu.png - -.. note:: You can also change the repositories - after a node is deployed, but the new - repository paths will only be used for - the new nodes that you are going to add - to a cluster. - -See also :ref:`Configuring repositories`. - -There is also a ``fuel-createmirror`` script on the -Fuel Master node that you can use to synchronize Ubuntu -packages to the Fuel Master node. - -Setting up local mirrors ------------------------- - -You can create and update local mirrors of Mirantis OpenStack -and/or Ubuntu packages using the ``fuel-createmirror`` script. - -.. note:: The script supports only rsync mirrors. - Please refer to the `official upstream Ubuntu mirrors list `_. - -The script uses a Docker container with Ubuntu to support -dependencies resolution. - -The script can be installed on any Red Hat based -or Debian based system. On a Debian based system -it requires only bash and rsync. On a Red Hat based system -it also requires docker-io, -dpkg, and dpkg-devel packages (from Fedora). - -When run on the Fuel Master -node, the script will attempt to set the created Mirantis OpenStack -and/or Ubuntu local repositories as the default -ones for new environments, and apply these -repositories to all the existing environments -in the "new" state. This behavior can be -changed by using the command line options -described below. - -The script supports running behind an HTTP proxy -as long as the proxy is configured to allow -proxying to Port 873 (rsync). The following -environment variables can be set either -system-wide (via ~/.bashrc), or in the script -configuration file (see below): - -:: - - http_proxy=http://username:password@host:port/ - RSYNC_PROXY=username:password@host:port - -You may also want to configure Docker to use the proxy to -download the Ubuntu image needed to resolve the packages -dependencies. Add the above environment variables to the -file `/etc/sysconfig/docker`, and export them: - -:: - - http_proxy=http://username:password@host:port/ - RSYNC_PROXY=username:password@host:port - export http_proxy RSYNC_PROXY - -Then, restart the docker daemon: - -:: - - service docker restart - -Or alternatively (recommended), reboot the Fuel Master node. - -Issue the following command to get the *fuel-createmirror* help: - -:: - - fuel-createmirror -h - -OR - -:: - - fuel-createmirror --help - -To create or update a local Mirantis OpenStack mirror only, -issue: - -:: - - fuel-createmirror -M - -OR - -:: - - fuel-createmirror --mos - -To create or update a local Ubuntu mirror only, -issue: - -:: - - fuel-createmirror -U - -OR - -:: - - fuel-createmirror --ubuntu - -If no parameters are specified, the script will create/update -both Mirantis OpenStack and Ubuntu mirrors. - -.. note:: Options ``-M/--mos`` and ``-U/--ubuntu`` can't be used simultaneously. - -To disable changing the default repositories for new environments, -issue: - -:: - - fuel-createmirror -d - -OR - -:: - - fuel-createmirror --no-default - -To disable applying the created repositories to all environments, -in the "new" state, issue: - -:: - - fuel-createmirror -a - -OR - -:: - - fuel-createmirror --no-apply - -.. note:: If you change the default password (admin) in Fuel web UI, - you will need to run the utility with the - ``--password`` switch, or it will fail. - -The following configuration file can be used to modify the -script behavior: - -:: - - /etc/fuel-createmirror/common.cfg - -In this file you can redefine the upstream mirrors, set local -paths for repositories, configure the upstream packages mirroring -mode, set proxy settings, enable or disable using Docker, and -set a path for logging. Please refer to the comments inside the file -for more information. - -The following configuration file contains the settings related to -Fuel: - -:: - - /etc/fuel-createmirror/fuel.cfg - -If you run the script outside of Fuel node, you may need -to redefine the FUEL_VERSION and the FUEL_SERVER parameters. - -Installing on a Red Hat based server ------------------------------------- - -1. Configure MOS RPM repository: - -:: - - tee /etc/yum.repos.d/mos-rpm.repo <`_. - -Having done that, restart the script. -This will download all the missing packages and recreate a local -partial mirror. diff --git a/pages/operations/ha-testing-scenarios-ops.rst b/pages/operations/ha-testing-scenarios-ops.rst deleted file mode 100644 index 0e242a7d2..000000000 --- a/pages/operations/ha-testing-scenarios-ops.rst +++ /dev/null @@ -1,635 +0,0 @@ -.. _ha-testing-scenarios-ops: - -HA testing scenarios -==================== - -Currently, several testing scenarios are provided -to check HA environment. - -Regular testing scenarios -------------------------- - -Nova-network -++++++++++++ - -You can run the following tests on the supported operating system. - -1. Deploy a cluster in HA mode with VLAN Manager. - Steps to perform: - - * Create a cluster. - - * Add 3 nodes with controller role. - - * Add 2 nodes with compute role. - - * Set up a cluster to use Network VLAN manager with 8 networks. - - * Deploy the cluster. - - * Make sure that the cluster is configured correctly: there should be no dead - services or no errors in the logs. Also, you should check - that all nova services are running and they are in up state; - TestVM must appear in Glance and only one nova-network should be present. - - * Run network verification test. - - * Run OSTF. - - -2. Deploy a cluster in HA mode with nova-network - and Flat DHCP manager enabled. - Steps to perform: - - * Create a cluster. - - * Add 3 nodes with controller role. - - * Add 2 nodes with compute role. - - * Deploy the cluster. - - * Make sure that the cluster is configured correctly: there should be no dead - services or no errors in the logs. Also, you should check - that all nova services are running and they are in up state; - TestVM must appear in Glance and only one nova-network should be present. - - * Run network verification test. - - * Perform a security check: verify that it is impossible - to access TCP or UDP unused ports. - - * Run OSTF. - -3. Add a compute node to a cluster in HA mode with nova-network with Flat DHCP - manager enabled. - Steps to perform: - - * Create cluster - - * Add 3 nodes with controller role - - * Add 2 nodes with compute role. - - * Deploy the cluster. - - * Make sure that the cluster is configured correctly: there should be no dead - services or no errors in the logs. Also, you should check - that all nova services are running and they are in up state; - TestVM must appear in Glance and only one nova-network is present. - - * Add one node with compute role. - - * Re-deploy the cluster. - - * Make sure that the cluster is configured - correctly: there should be no dead - services or no errors in the logs. Also, you should check - that all nova services are running and they are in up state; - TestVM must appear in Glance and only one nova-network should be present. - - * Run network verification test. - - * Run OSTF. - -4. Deploy an HA cluster with Ceph and nova-network: - Steps to perform: - - * Create a cluster: use Ceph for volumes and images. - - * Add 3 nodes with controller and Ceph OSD roles. - - * Add one node with Ceph OSD role. - - * Add 2 nodes with compute and Ceph OSD roles. - - * Start cluster deployment. - - * Check Ceph status with **ceph health** command. - Command output should have **HEALTH_OK**. - - * Run OSTF. - -5. Stop and reset nova-network cluster in HA mode. - Steps to perform: - - * Create a cluster. - - * Add 3 nodes with controller role. - - * Start cluster deployment. - - * Stop deployment. - - * Reset settings. - - * Add 2 nodes with compute role. - - * Re-deploy the cluster. - - * Run OSTF. - - * Run network verification test. - -6. Deploy nova-network cluster in HA mode with Ceilometer. - Steps to perform: - - * Create a cluster. On **Settings** tab of the Fuel web UI, - select **Install Ceilometer** option. - - * Add 3 nodes with controller role. - - * Add one node with compute role. - - * Add one node with MongoDB role. - - * Deploy the cluster. - - * Check that partitions on MongoDB node - are the same as those selected on the Fuel web UI. - - * Make sure that Ceilometer API is running (it must be - present in *ps ax* output). - - * Run OSTF. - -7. Check HA mode on scalability. - Steps to perform: - - * Create a cluster. - - * Add 1 controller node. - - * Deploy the cluster. - - * Add 2 controller nodes. - - * Deploy the changes. - - * Check Pacemaker status: all nodes must be online after running **crm_mon -1** command. - - * Run network verification test. - - * Add 2 controller nodes. - - * Deploy the changes. - - * Check that public and management vIPs have started after running **crm_mon -1** command. - - * Run network verification test. - - * Run OSTF. - -8. Backup/restore Fuel Master node with HA cluster. - Steps to perform: - - * Create a cluster with 3 controllers and 2 compute nodes. - - * Backup Fuel Master node. - - * Check if the backup succeeded. - - * Run OSTF. - - * Add 1 node with compute role. - - * Restore Fuel Master node. - - * Check if restore procedure succeeded. - Before backup, a file is created and - its checksum is saved. - After backuping and restoring the environment, - you get the checksum of this file and verify that - it is equal to the checksum that was saved before backup. - - * Run OSTF. - -Neutron -+++++++ - -You can run the following tests on the supported operating system. - -1. Deploy a cluster in HA mode with Neutron GRE segmentation. - Steps to perform: - - * Create a cluster. - - * Add 3 nodes with controller role. - - * Add 2 nodes with compute role. - - * Deploy the cluster. - - * Run network verification test. - - * Run OSTF. - -2. Deploy a cluster in HA mode with Neutron - GRE segmentation and public network - assigned to all nodes. - Steps to perform: - - * Create a cluster. - - * Add 3 nodes with controller role. - - * Add 2 nodes with compute role. - - * On **Settings** tab of the Fuel web UI, - select *Assign public networks to all nodes* option. - - * Deploy the cluster. - - * Check that public network is assigned to all nodes. - - * Run network verification test. - - * Perform a security check: verify that it is impossible - to access TCP or UDP unused ports. - - * Run OSTF. - -3. Deploy a cluster in HA mode with Neutron VLAN. - Steps to perform: - - * Create a cluster. - - * Add 3 nodes with controller role. - - * Add 2 nodes with compute role. - - * Deploy the cluster. - - * Run network verification test. - - * Run OSTF. - -4. Deploy cluster in HA mode with Neutron VLAN - and public network - assigned to all nodes. - Steps to perform: - - * Create a cluster. - - * Add 3 nodes with controller role. - - * Add 2 nodes with compute role. - - * On **Settings** tab of the Fuel web UI, - select *Assign public networks to all nodes* option. - - * Deploy the cluster. - - * Check that public network is assigned to all nodes. - - * Run network verification test. - - * Perform a security check: verify that it is impossible - to access TCP or UDP unused ports. - - * Run OSTF. - -5. Deploy a cluster in HA mode with Murano and Neutron GRE segmentation. - Steps to perform: - - * Create a cluster. On **Settings** tab of the - Fuel web UI, select *Install Murano* option. - - * Add 3 nodes with controller role. - - * Add 1 node with compute role. - - * Deploy the cluster. - - * Verify that Murano services are up and running - (check that *murano-api* is present in 'ps ax' output on every controller). - - * Run OSTF. - - * Register Murano image. - - * Run Murano platform OSTF tests. - -6. Deploy Heat cluster in HA mode. - Steps to perform: - - * Create a cluster. - - * Add 3 nodes with controller role. - - * Add one node with compute role. - - * Deploy the cluster. - - * Verify that Heat services are up and running - (check - that *heat-api* is present in 'ps ax' output on every controller). - - * Run OSTF. - - * Register Heat image. - - * Run OSTF platform tests. - -7. Deploy a new Neutron GRE cluster - in HA mode after Fuel Master is upgraded. - Steps to perform: - - * Create a cluster with 1 controller with Ceph, 2 - compute nodes with Ceph; - Ceph for volumes and images should also be enabled. - - * Run upgrade on Fuel Master node. - - * Check that upgrade has succeeded. - - * Deploy a new upgraded cluster with HA Neutron VLAN manager, 3 controllers, - 2 compute - nodes and 1 Cinder. - - * Run OSTF. - - -Bonding -+++++++ - -You can run the following tests on the supported operating system: - -1. Deploy cluster in HA mode for Neutron VLAN with bonding. - Steps to perform: - - * Create a cluster. - - * Add 3 nodes with controller role. - - * Add 2 nodes with compute role. - - * Set up bonding for all interfaces in **active-backup** mode. - - * Deploy the cluster. - - * Run network verification test. - - * Run OSTF. - -2. Deploy cluster in HA mode for Neutron GRE with bonding. - Steps to perform: - - * Create a cluster. - - * Add 3 nodes with controller role. - - * Add 2 nodes with compute role. - - * Setup bonding for all interfaces in **balance-slb** mode. - - * Deploy the cluster. - - * Run network verification test. - - * Run OSTF. - - -Failover testing scenarios --------------------------- - -.. warning:: These scenarios are destructive and you should not - try to reproduce them. - -1. Neutron L3-agent rescheduling after L3-agent dies. - Steps to perform: - - * Create a cluster (HA mode, Neutron with GRE segmentation). - - * Add 3 nodes with controller role. - - * Add 2 nodes with compute role. - - * Add one node with Cinder role. - - * Deploy the cluster. - - * Manually reschedule router from the primary controller - to another one. - - * Stop L3-agent on a new node with - **- pcs resource ban p_neutron-l3-agent NODE** command. - - * Check whether L3-agent has been rescheduled. - - * Check network connectivity from the instance with - *dhcp namespace*. - - * Run OSTF. - -2. Deploy nova-network environment with Ceph in HA mode. - Steps to perform: - - * Create a cluster with Ceph for images and volumes. - - * Add 3 nodes with controller and Ceph OSD roles. - - * Add 1 node with Ceph OSD role. - - * Add 2 nodes with compute and Ceph OSD roles. - - * Deploy the cluster. - - * Check Ceph status with **ceph-health** command. - Command output should have *HEALTH_OK*. - - * Destroy a node with Ceph role and check Ceph status. - - * Run OSTF and check Ceph status. - - * Destroy the compute node with Ceph and check Ceph status. - - * Run OSTF and check Ceph status. - - * Restart 4 online nodes. - - * Run OSTF and check Ceph status. - -3. `Monit `_ on - compute nodes for nova-network and Neutron. - Steps to perform: - - * Deploy HA cluster with nova-network or Neutron 3 controllers and 2 compute nodes. - - * SSH to each compute node. - - * Kill nova-compute service. - - * Check that service has been restarted by Monit. - -4. Pacemaker restarts heat-engine when AMQP connection is lost - Steps to perform: - - * Deploy HA cluster with nova-network or Neutron, - 3 controllers and 2 compute nodes. - - * SSH to any controller. - - * Check heat-engine status. - - * Block heat-engine AMQP connections. - - * Check that heat-engine has stopped on the current controller. - - * Unblock heat-engine AMQP connections. - - * Check that heat-engine process is running with new pid. - - * Check that AMQP connection has re-appeared for heat-engine. - -The following testing scenarios (from 5 to 11) may be mixed with Nova or -Neutron. - -5. Shut down primary controller. - Steps to perform: - - * Deploy a cluster with 3 controllers and 2 compute nodes. - - * Destroy the primary controller. - - * Check Pacemaker status: all nodes must be online - after running **crm_mon -1** command. - - * Wait until MySQL Galera is up (command should return "On"): - - :: - - - SELECT VARIABLE_VALUE FROM information_schema.GLOBAL_STATUS WHERE VARIABLE_NAME \ - = 'wsrep_ready' - - * Run OSTF. - -6. Shut down non-primary controller. - Steps to perform: - - * Deploy a cluster with 3 controllers and 2 compute nodes. - - * Destroy non-primary controller. - - * Check Pacemaker status: all nodes must be online - after running **crm_mon -1** command. - - * Wait until MySQL Galera is up (it must return "On"): - - :: - - - "SELECT VARIABLE_VALUE FROM information_schema.GLOBAL_STATUS WHERE VARIABLE_NAME \ - = 'wsrep_ready' - - * Run OSTF. - -7. Shut down management interface on the primary controller. - - .. note:: When you use **ifdown**, **ifup**, or commands that call them, - it can cause the Corosync service to update the cluster state - and in most cases leads to so-called split-brain: the test will fail. - Instead, use **ip link set down ** - or physically disconnect the interface. - - - Steps to perform: - - * Deploy a cluster with 3 controllers and 2 compute nodes. - - * Disconnect eth2 of the first controller via iptables. - - * Check Pacemaker status: all nodes must be online - after running **crm_mon -1** command. - - * Wait for vip\_\_ resources to migrate to the working controllers. - - * Run 'smoke' OSTF tests. - - * Restore connectivity to the first controller. - - * Wait until Pacemaker specifies the *lost* controller as *online*. - - * Wait for Pacemaker resources to become operational on all controllers. - - * Run "sanity" and "smoke" OSTF tests. - - * Repeat steps described above (from disconnecting eth2) for another controller. - - * Run OSTF. - -8. Delete all management and public vIPs on all controller nodes: - Steps to perform: - - * Delete all secondary vIPs. - - * Wait till it gets restored. - - * Ensure that vIp has restored. - - * Run OSTF. - -9. Terminate HAProxy on all controllers one by one: - Steps to perform: - - * Terminate HAProxy on every controller in cycle. - - * Wait till it gets restarted. - - * Go to another controller and repeat steps above. - - * Run OSTF. - -10. Terminate MySQL on all controllers one by one - Steps to perform: - - * Terminate MySQL on every controller in cycle. - - * Wait until it gets restarted. - - * Verify that MySQL has restarted. - - * Go to another controller. - - * Run OSTF. - -11. Verify that resources are configured. - Steps to perform: - - * SSH to controller node. - - * Verify that all resources are configured. - - * Go to another controller. - -Rally -+++++ - - -1. Run `Rally `_ - for generating typical activity on a cluster (for example, - create or delete instance and/or volumes). Shut down the primary controller - and start Rally: - - * Ensure that vIP addresses have moved to another controller. - - * Ensure that VM is reachable from the outside world. - - * Check the state of Galera and RabbitMQ clusters. - -2. HA load testing with Rally. - Steps to perform: - - * Deploy HA cluster with Neutron GRE or VLAN, 3 MongoDB controllers and 4 Ceph compute nodes. - You should also have Ceph volumes and images enabled for Storage. - - * Create an instance. - - * Wait until instance is created. - - * Delete the instance. - - * Run `Rally `_ - for generating the same activity on the cluster. - In average, 500-1000 VMs should be created using 50, 70 or 100 parallel requests. diff --git a/pages/operations/health-checks/0400-sanity-tests-about.rst b/pages/operations/health-checks/0400-sanity-tests-about.rst deleted file mode 100644 index 107913f41..000000000 --- a/pages/operations/health-checks/0400-sanity-tests-about.rst +++ /dev/null @@ -1,25 +0,0 @@ -Sanity tests description ------------------------- - -Sanity checks work by sending a query to all OpenStack components to get a -response back from them. Many of these tests are simple in that they ask -each service for a list of their associated objects and then wait for a -response. The response can be something, nothing, an error, or a timeout, -so there are several ways to determine if a service is up. The following list -includes the suite of sanity tests implemented: - -* Instance list availability -* Images list availability -* Volume list availability -* Snapshots list availability -* Flavor list availability -* Limits list availability -* Services list availability -* User list availability -* Stack list availability -* Check if all the services execute normally -* Check Internet connectivity from a Compute node -* Check DNS resolution on a Compute node -* Murano environment and service creation, listing and deletion -* Networks availability -* Ceilometer meter, alarm and resource list availability diff --git a/pages/operations/health-checks/0410-functional-tests-about.rst b/pages/operations/health-checks/0410-functional-tests-about.rst deleted file mode 100644 index 531491308..000000000 --- a/pages/operations/health-checks/0410-functional-tests-about.rst +++ /dev/null @@ -1,29 +0,0 @@ -Functional tests description ----------------------------- - -Functional tests verify how your system handles basic OpenStack operations -under normal circumstances. -The Functional Test series gives you information about the speed of your -environment and runs timeout tests. - -All tests use the basic OpenStack services (Nova, Glance, Keystone, -Cinder, etc), so, if any of these are inactive, the test using it will -fail. You should run all sanity checks before running the functional -checks to verify that all services are alive. -This helps ensure that you do not get false negatives. -The following is a description of each sanity test available: - -* Create instance flavor -* Create instance volume -* Launch instance, create snapshot, launch instance from snapshot -* Keypair creation -* Security group creation -* Check networks parameters -* Launch instance -* Assign floating IP -* Check that VM is accessible via floating IP address -* Check network connectivity from instance via floating IP -* Check network connectivity from instance without floating IP -* Launch instance with file injection -* Launch instance and perform live migration -* User creation and authentication in Horizon diff --git a/pages/operations/health-checks/0411-ha-test-about.rst b/pages/operations/health-checks/0411-ha-test-about.rst deleted file mode 100644 index a083cf2fe..000000000 --- a/pages/operations/health-checks/0411-ha-test-about.rst +++ /dev/null @@ -1,12 +0,0 @@ -HA tests description --------------------- - -HA tests verify the High Availability (HA) architecture. -The following is a description of each HA test available: - -* Check data replication over MySQL -* Check if the amount of tables in OS databases is the same on each node -* Check Galera environment state -* RabbitMQ availability -* RabbitMQ replication -* Check Pacemaker status diff --git a/pages/operations/health-checks/0412-configuration-tests-about.rst b/pages/operations/health-checks/0412-configuration-tests-about.rst deleted file mode 100644 index 28d7c6daa..000000000 --- a/pages/operations/health-checks/0412-configuration-tests-about.rst +++ /dev/null @@ -1,16 +0,0 @@ -Configuration tests description -------------------------------- - -Configuration tests verify if the default user data -(e.g. username, password for OpenStack cluster) were changed. -The following is a description of each test available: - -* Check usage of the default credentials (password) - for root user to SSH on the Fuel Master node. - If the default password was not changed, the - test will fail with a recommendation to change it. -* Check usage of the default credentials for OpenStack cluster. - If the default values are used for the admin user, the - test will fail with a recommendation to - change the password/username for the OpenStack user with the admin role. - diff --git a/pages/operations/health-checks/0413-cloud-validation-about.rst b/pages/operations/health-checks/0413-cloud-validation-about.rst deleted file mode 100644 index b49d00d7b..000000000 --- a/pages/operations/health-checks/0413-cloud-validation-about.rst +++ /dev/null @@ -1,7 +0,0 @@ -Cloud validation tests description ----------------------------------- - -The following tests for cloud validation are implemented: - -* Check disk space outage on the Controller and Compute nodes -* Check log rotation configuration on all nodes diff --git a/pages/operations/health-checks/0500-test-network.rst b/pages/operations/health-checks/0500-test-network.rst deleted file mode 100644 index 46e62d9af..000000000 --- a/pages/operations/health-checks/0500-test-network.rst +++ /dev/null @@ -1,19 +0,0 @@ -.. raw:: pdf - - PageBreak - -.. index:: Fuel UI: Network Issues - -Network Issues -============== - -Fuel has the built-in capability to run a network check before or after -OpenStack deployment. The network check includes tests for connectivity between -nodes via configured VLANs on configured host interfaces. Additionally, checks -for an unexpected DHCP server are done to ensure outside DHCP servers will not -interfere with deployment. The image below shows a sample result of the check. -If there are errors, it is either in your configuration of interfaces or -possibly the VLAN tagging feature is disabled on your switch port. - -.. image:: /_images/user_screen_shots/net_verify_failure.png - diff --git a/pages/operations/health-checks/0650-heat-test-details.rst b/pages/operations/health-checks/0650-heat-test-details.rst deleted file mode 100644 index 8318fe7e5..000000000 --- a/pages/operations/health-checks/0650-heat-test-details.rst +++ /dev/null @@ -1,89 +0,0 @@ - -.. _heat-test-details: - -Details of Heat platform tests ------------------------------- - -.. topic:: Typical stack actions: create, update, delete, show details, etc - - The test verifies that the Heat service can create, update and delete a stack - and shows details of the stack and its resources, events and template. - - Target component: Heat - - Scenario: - - 1. Create a stack. - 2. Wait for the stack status to change to 'CREATE_COMPLETE'. - 3. Get the details of the created stack by its name. - 4. Get the resources list of the created stack. - 5. Get the details of the stack resource. - 6. Get the events list of the created stack. - 7. Get the details of the stack event. - 8. Update the stack. - 9. Wait for the stack to update. - 10. Get the stack template details. - 11. Get the resources list of the updated stack. - 12. Delete the stack. - 13. Wait for the stack to be deleted. - -.. topic:: Check stack autoscaling - - The test verifies that the Heat service can scale the stack capacity - up and down automatically according to the current conditions. - - Target component: Heat - - Scenario: - - 1. Image with cfntools package should be imported. - 2. Create a flavor. - 3. Create a keypair. - 4. Save the generated private key to a file on Controller node. - 5. Create a security group. - 6. Create a stack. - 7. Wait for the stack status to change to 'CREATE_COMPLETE'. - 8. Create a floating IP. - 9. Assign the floating IP to the instance of the stack. - 10. Wait for the cloud_init procedure to be completed on the instance. - 11. Load the instance CPU to initiate the stack scaling up. - 12. Wait for the second instance to be launched. - 13. Release the instance CPU to initiate the stack scaling down. - 14. Wait for the second instance to be terminated. - 15. Delete the file with the private key. - 16. Delete the stack. - 17. Wait for the stack to be deleted. - -.. topic:: Check stack rollback - - The test verifies that the Heat service can rollback the stack - if its creation failed. - - Target component: Heat - - Scenario: - - 1. Start stack creation with rollback enabled. - 2. Verify the stack appears with status 'CREATE_IN_PROGRESS'. - 3. Wait for the stack to be deleted as a result of the rollback after the - expiration of the timeout defined in the WaitHandle resource - of the stack. - 4. Verify if the instance of the stack has been deleted. - -.. topic:: Check advanced stack actions: suspend, resume - - The test verifies that the Heat service can suspend and resume the stack. - - Target component: Heat - - Scenario: - - 1. Create a stack. - 2. Wait until the stack status changes to 'CREATE_COMPLETE'. - 3. Call stack suspend action. - 4. Wait until the stack status changes to 'SUSPEND_COMPLETE'. - 5. Call stack resume action. - 6. Wail until the stack status changes to 'RESUME_COMPLETE'. - 7. Call stack check action. - 8. Wail until the stack status changes to 'CHECK_COMPLETE'. - 9. Delete the stack and wait for the stack to be deleted. diff --git a/pages/operations/how-to-shutdown-cluster-ops.rst b/pages/operations/how-to-shutdown-cluster-ops.rst deleted file mode 100644 index a06e26dff..000000000 --- a/pages/operations/how-to-shutdown-cluster-ops.rst +++ /dev/null @@ -1,56 +0,0 @@ -.. _how-to-shutdown-cluster-ops: - -HowTo: Shut down the whole cluster -================================== - -To shut down the whole cluster, follow these steps: - -#. Stop all virtual machines. - -#. Either power off all the nodes (with clicking *poweroff* button or running - `poweroff` command) at once or shut them down in the following order: - - * Computes - - * Controllers (one by one or all in one) - - * Cinder/Ceph/Swift - - * Other/Neutron (if separate Neutron node exists) - -Starting up cluster -------------------- - -To start up cluster, power on all the nodes. - -If you have a cluster with Neutron, take the instructions below -into consideration. - -Cinder or Ceph require Neutron, Neutron node requires database and Controllers, -so the following sequence is possible: - -#. Power on Ceph/Cinder/Swift/MongoDB/Zabbix nodes. - -#. Start all controllers and Neutron (if separate Neutron node exists) and - wait until RabbitMQ, Neutron - agents and Galera get synced by Pacemaker. - It should take no more than 5 minutes. - -#. Ensure that HAProxy is OK. Note, that HAProxy is under Pacemaker so you - should use *pcs resource clone_p_haproxy* to manage it. - -#. Ensure that RabbitMQ cluster is OK and fix it if there are failed nodes. - -#. Ensure that Galera cluster is OK and fix it if necessary. - Note, that Galera is under Pacemaker, so you should use *pcs resource* to manage it. - -#. Run *pcs resource restart clone_p_neutron-metadata-agent* command. - -#. Run *pcs resource restart clone_p_neutron-plugin-openvswitch-agent* - -#. Wait several minutes and check the cluster state with *crm status* command. - All Neutron agents including L3 and DHCP should be started. - -#. Restart all Openstack services. - -#. Power on compute nodes. diff --git a/pages/operations/isoUSB-ops.rst b/pages/operations/isoUSB-ops.rst deleted file mode 100644 index ca402ed65..000000000 --- a/pages/operations/isoUSB-ops.rst +++ /dev/null @@ -1,26 +0,0 @@ -.. _isoUSB-ops: - -Writing a bootable Fuel ISO to a USB drive -========================================== - -Having downloaded a Fuel ISO, and having -plugged in your USB drive, issue the following command: - - :: - - # dd if=/way/to/your/ISO of=/way/to/your/USB/stick - -where */way/to/your/ISO* is the path to your Fuel ISO, -and */way/to/your/USB/stick* is the path to your USB drive. - -For example, if your Fuel ISO is in the */home/user/fuel-isos/* -folder and your USB drive is at */dev/sdc*, issue the following: - - :: - - # dd if=/home/user/fuel-isos/fuel-7.0.iso of=/dev/sdc - -.. note:: This operation will wipe all the data you have on - on the USB drive and will place a bootable Fuel ISO - on it. You also have to write the ISO to the USB - drive itself, not to a partition on it. diff --git a/pages/operations/murano/7410-components.rst b/pages/operations/murano/7410-components.rst deleted file mode 100644 index 70c30717e..000000000 --- a/pages/operations/murano/7410-components.rst +++ /dev/null @@ -1,29 +0,0 @@ - -.. _Murano_Components: - -Murano Components ------------------ - -Dashboard -+++++++++ - -The Murano Dashboard is available after Murano is installed. -Use the same credentials to log into Murano -as you use for Horizon (via Keystone). -From the Murano Dashboard, you can manage the application catalog. - -Murano API -++++++++++ - -The Murano API provides the ability to manage applications in the OpenStack clouds. -For further reading, refer to `Murano API Specification -`_ - -Engine -++++++ - -The Murano orchestration engine transforms objects -into a series of Heat and Murano API commands. -The Murano dashboard sends requests to the Murano API, -which sends these requests to the engine. - diff --git a/pages/operations/murano/7482-test-prepare.rst b/pages/operations/murano/7482-test-prepare.rst deleted file mode 100644 index 4253a6856..000000000 --- a/pages/operations/murano/7482-test-prepare.rst +++ /dev/null @@ -1,54 +0,0 @@ - -.. _murano-test-prepare: - -Preparing Murano for Testing ----------------------------- - -The platform tests are run in the tenant you've specified in -the 'OpenStack Settings' tab during OpenStack installation. -The 'admin' tenant is selected by default. - -To prepare Murano for linux-based services deployment testing, -add a Linux based image to Murano: - -#. Download the following image: - - http://murano-files.mirantis.com/ubuntu_14_04-murano-agent_stable_juno.qcow2 - - .. note:: - The base operating system of the Murano image is not related - to the base operating system of the OpenStack environment. - - If you want to build your own Linux image, - you can use the Murano agent. - For instructions, see the `Murano documentation (Linux Image Builder) - `_. - - .. note:: - The instructions in the official Murano documentation - may be outdated; - following these instructions cannot guarantee success - with image creation. - - -#. Upload the image to the `admin` tenant - in the OpenStack Image Service (Glance). - -#. Open the 'Murano' tab. - -#. Navigate to the 'Manage' submenu - -#. Click the 'Images' menu. - -#. Click 'Mark Image'. The Image registration window displays. - -#. Select the Linux image with the Murano Agent. - -#. In the 'Title' field, set the title for this image. - -#. Select the 'Generic Linux' type. - -#. Click 'Mark'. - -Murano is ready for testing. - diff --git a/pages/operations/murano/7485-test-details.rst b/pages/operations/murano/7485-test-details.rst deleted file mode 100644 index 3b17aea2d..000000000 --- a/pages/operations/murano/7485-test-details.rst +++ /dev/null @@ -1,56 +0,0 @@ - -.. _murano-test-details: - -Murano platform test details ----------------------------- - -The Platform Tests run as part of the Fuel Health Test suite and -test Murano functionality -when Murano is installed in the OpenStack environment. -This document describes the actual tests that are run. - -.. topic:: Murano environment with WordPress application deployment - - The test verifies that the user can deploy the WordPress application - in the Murano environment. - - Target component: Murano - - Scenario: - - 1. Send request to create environment. - 2. Send request to create session for environment. - 3. Send request to create MySQL. - 4. Send request to create Linux-based service Apache. - 5. Send request to create WordPress. - 6. Request to deploy session. - 7. Checking environment status. - 8. Checking deployments status. - 9. Checking ports availability. - 10. Checking WordPress path. - 11. Send request to delete environment. - - For more information, see: - `Murano documentation `_ - -.. topic:: Murano environment with Linux Apache service deployment - - The test verifies that the Murano service can create and deploy the Linux Apache service. - - Target component: Murano - - Scenario: - - 1. Check linux image with Murano agent installed in Glance. - 2. Send request to create environment. - 3. Send request to create session for environment. - 4. Send request to create service Linux Apache. - 5. Request to deploy session. - 6. Checking environment status. - 7. Checking deployments status. - 8. Send request to delete environment. - - - For more information, see: - `Murano documentation `_ - diff --git a/pages/operations/murano/7490-troubleshoot.rst b/pages/operations/murano/7490-troubleshoot.rst deleted file mode 100644 index 299e2d4ff..000000000 --- a/pages/operations/murano/7490-troubleshoot.rst +++ /dev/null @@ -1,8 +0,0 @@ - -.. index:: Murano: Troubleshooting - -Troubleshooting Murano ----------------------- - -There are no known issues with deploying Murano in Mirantis OpenStack -at the time of this writing. diff --git a/pages/operations/patching-ops.rst b/pages/operations/patching-ops.rst deleted file mode 100644 index b2466a0d6..000000000 --- a/pages/operations/patching-ops.rst +++ /dev/null @@ -1,279 +0,0 @@ - -.. _patching-ops: - -Applying patches -================ - -This section describes how to apply, rollback, and verify the patches applied -to the Fuel Master node and the Fuel Slave nodes. - -Introduction ------------- - -Patching in brief: - -* The patching feature was introduced in Mirantis OpenStack 6.1 - and will not work in older releases. -* There are two types of patches: bugfixes and security updates. -* Patches are downloaded from the Mirantis public repositories. -* You can always check what patches are available and get instructions - on how to apply them at the - `Maintenance Update section of the Release Notes `_. -* The changes that the patches introduce will be applied to the new OpenStack - environments. - -Usage scenarios ---------------- - -Default scenario -++++++++++++++++ - -In the default scenario you download patches from the default Mirantis -mirrors. - -* Make sure you are registered at at the `official Mirantis website `__. -* Once you are registered, you will receive regular email notifications - on the available patches with a link to the documentation on how - to apply the patches. The documentation is always available in the - `Maintenance Update section of the Release Notes `_. -* Your repos by default are configured to download the patches from - Mirantis. The patching repos are: - - .. image:: /_images/patchingReposOps.png - -* Check each patching item and proceed with the instructions (plan - accordingly: for example, schedule a maintenance slot to run the - update). - - * Patching Fuel Master node: - - * Run the command specified in the documentation to install the - patch. - * After the patch is installed, restart the affected service as - specified in the documentation. - - * Patching a slave node: - - * Run the command specified in the documentation to download the patch. - * Run the command specified in the documentation to install the patch. - -Custom scenario: deploying from local mirrors; patching from local mirrors -++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ - -In this custom scenario you deploy from your local mirrors and download -patches from your local mirrors. - -For information on how to create and update local mirrors of Mirantis -OpenStack see :ref:`Configuring repositories`. - -* Make sure you are registered at at the `official Mirantis website `__. -* Once you are registered, you will receive regular email notifications - on the available patches with a link to the documentation on how - to apply the patches. The documentation is always available in the - `Maintenance Update section of the Release Notes `_. -* Check each patching item and proceed with the instructions (plan - accordingly). - - * Patching Fuel Master node: - - * Make sure your local mirror is up to date: run ``fuel-createmirror -M`` - * Run the command specified in the documentation to download the patch. - * Run the command specified in the documentation to install the patch. - * After the patch is installed, restart the affected service as - specified in the documentation. - - * Patching a slave node: - - * Run the command specified in the documentation to download the patch. - * Run the command specified in the documentation to install the patch. - -Custom scenario: deploying from Mirantis mirrors; patching from local mirrors -+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ - -In this custom scenario you deploy from Mirantis mirrors and download -patches from your local mirrors. - -* Make sure you are registered at at the `official Mirantis website `__. -* Configure your local mirrors to download patches from Mirantis - mirrors as described in :ref:`Configuring repositories`. -* Once you are registered, you will receive regular email notifications - on the available patches with a link to the documentation on how - to apply the patches. The documentation is always available in the - `Maintenance Update section of the Release Notes `_. -* Check each patching item and proceed with the instructions (plan - accordingly). - - * Patching Fuel Master node: - - * Make sure your local mirror is up to date: run ``fuel-createmirror -M`` - * Run the command specified in the documentation to download the patch. - * Run the command specified in the documentation to install the patch. - * After the patch is installed, restart the affected service as - specified in the documentation. - - * Patching a slave node: - - * Run the command specified in the documentation to download the patch. - -Additional information -++++++++++++++++++++++ - -**Rolling back patches** - -.. note:: - Use the instructions listed here only for Mirantis OpenStack 6.1 and 7.0. - -.. note:: - The rollback instructions listed here are for advanced administrators. - If you are not sure how to plan and execute the rollbacks, - your best option is to contact `Mirantis support `__. - -Rolling back Fuel Master node -^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -* Roll back the packages on the Fuel Master node. - `Refer to this article `__ as an example. -* Roll back all the changes to the configuration you made when applying - the patching instructions. -* Run ``dockerctl destroy all``. -* Run ``dockerctl start all``. -* Wait for bootstrap to complete. - -Rolling back an Ubuntu slave node -^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -* Evacuate all the running resources from the node. -* Make sure new workloads are not scheduled to the node: Put nova - services in maintenance, turn on Pacemaker into maintenance mode etc. -* Look up the packages you want to roll back in ``/var/log/apt/history.log`` - and ``/var/log/dpkg.log``. -* Figure out where to get the old package version. Run ``apt-cache policy``. -* Figure out if the old package version is available locally. -* If it is, install these versions using dpkg. Otherwise, check the - snapshots of previous repositories on - `http://mirror.fuel-infra.org/mos/snapshots` and pick the - repository that contains the packages you need. -* Add this repository to the environment configuration. -* On the Fuel Master node run: - - :: - - fuel node --node-id \ - --tasks upload_core_repos - - This will propagate the new repos configuration. - -* Install the packages with specific versions: - - ``apt-get install = =`` -* Roll back all the changes to the configuration you made when applying - the patching instructions. -* Reboot the node. - - -**Applying all accumulated changes in one go** - -.. note:: - This set of actions should be applied carefully and with - consideration. It is strongly recommended that you do this on your - test staging environment before applying the updates to production. - -It is a good practice to apply the updates node by node so that you can -stop the update procedure whenever an issue occurs. It is also -strongly recommended to back up all sensitive data that can be altered -continuously during the whole lifetime of your environment and -the Fuel Master node. - -These instructions assume that if you add any custom repositories to -your environment configuration, these commands will update your -environment taking packages from these repositories. - -Patching Fuel Master node -^^^^^^^^^^^^^^^^^^^^^^^^^ - -* Back up your data with dockerctl backup. This will save the data - to ``/var/backup/fuel/``. -* Run ``yum update``. -* Run ``dockerctl destroy all``. -* Run ``dockerctl start all``. -* Wait for the new containers deployment to finish. - -Patching an Ubuntu slave node -^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -* Run ``apt-get update``. -* Run ``apt-get upgrade``. -* Apply all the additional configuration options as described in the - supporting documentation. -* Reboot the node. - -Applying Puppet changes on a slave node -^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -You may want to apply all changes on a slave node or run a single -granular task so that Fuel Puppet changes take effect. - -To run a complete Puppet cycle on a slave node, run: - -* Update fuel-libraryX.X on Fuel Master ``yum update`` -* Run ``fuel node --node NODE_ID --deploy`` - -If you want to just update Puppet manifests and apply a single task, then run: - -* Update fuel-libraryX.X on Fuel Master ``yum update`` -* Run ``fuel node --node node-XX --task rsync_core_puppet hiera globals TASK`` - -.. note:: - The tasks rsync_core_puppet, hiera, and globals are required for - processing any Puppet changes. - -Verifying the installed packages on the Fuel Master node --------------------------------------------------------- - -After you apply a patch to the Fuel Master node, you can verify that the Fuel -Master node is using the latest packages. - -To verify the packages on the Fuel Master node: - -#. Log in to the Fuel Master node CLI. -#. Type: - -:: - - yum clean expire-cache - yum -y update - -Verifying the installed packages on the Fuel Slave nodes --------------------------------------------------------- - -When you apply a patch to the Fuel Slave nodes, ensure that the versions of packages -on all Fuel Slave nodes are identical. Therefore, verify that the Fuel Slave -nodes within one OpenStack environment have the same repository configuration, -as well as the same versions of packages are installed on all nodes. - -To verify the packages are up-to-date on the Fuel Slave nodes: - -#. Log in to the Fuel Master node CLI. -#. Update the list of available packages: - -:: - - apt-get update - -3. Update all packages: - -:: - - apt-get upgrade - -4. Log in to the Fuel Master node GUI: -5. Click **Support**. -6. Generate and download a diagnostic snapshot by clicking - **Generate Diagnostic Snapshot**. - - The Fuel Master node generates ``ubuntu_installed_debs.txt``. - -7. Analyze ``ubuntu_installed_debs.txt`` to verify the versions of the packages. - - Additionally, you can analyze the ``ubuntu_repo_list.txt`` file to verify - the repositories. diff --git a/pages/operations/perform/8200-keystone-tokens.rst b/pages/operations/perform/8200-keystone-tokens.rst deleted file mode 100644 index 2645dcdf0..000000000 --- a/pages/operations/perform/8200-keystone-tokens.rst +++ /dev/null @@ -1,40 +0,0 @@ - -.. _keystone-tokens-perform: - -Keystone Token Cleanup ----------------------- - -The :ref:`keystone-term` service creates new tokens in the Keystone database -each time an external query is run against OpenStack -but it does not automatically clean up expired tokens -because they may be required for forensics work -such as that required after a security breach. -However, the accumulation of the expired tokens in the database -can seriously degrade the performance of the entire OpenStack. - -Beginning with version 5.0, -Mirantis OpenStack includes the -`pt-archiver `_ -command from the -`Percona Toolkit `_. -We recommend using pt-archiver to set up a cleanup job -that runs periodically; -the `cleanup-keystone-tokens.sh `_ -script from TripleO is a good example: - -:: - - pt-archiver --source h=$DB_HOST,u=$DB_USER,p=$DB_PASS,D=$DB_NAME,t=token \ - --charset utf8 \ - --where "expires < UTC_TIMESTAMP()" \ - --purge \ - --txn-size 500 \ - --run-time 59m \ - --statistics \ - --primary-key-only - -It is better to use pt-archiver instead of deleting the expired tokens -using standard database manipulation commands -because it prevents the Keystone database -from being blocked for significant time periods -while the rows with expired tokens are deleted. diff --git a/pages/operations/redeploy/1000-redeploy.rst b/pages/operations/redeploy/1000-redeploy.rst deleted file mode 100644 index e89ce1fe1..000000000 --- a/pages/operations/redeploy/1000-redeploy.rst +++ /dev/null @@ -1,49 +0,0 @@ - -.. _redeploy-compute-storage-ops: - -Redeploy a Non-Controller Node ------------------------------- - -Redeploying a :ref:`node` refers to the process -of changing the roles that are assigned to it. -For example, you may have several nodes that run -both Compute and Storage roles -and you want to redeploy some of those nodes to be only Storage nodes -while others become only Compute nodes. -Or you might want to redeploy some Compute and Storage nodes -to be MongoDB nodes. - -.. note: The Zabbix node must be deployed before any other nodes, - so you cannot add a Zabbix node to an existing environment. - -To redeploy a non-controller node, -follow these steps: - -#. Use `live migration `_ - to move instances from the Compute nodes - you are going to redeploy. - -#. If appropriate, back up or copy information - from the Operating System nodes being redeployed. - -#. Use the procedure described in :ref:`assign-roles-ug` - to remove the node from your environment. - Select the node(s) to be deleted then click on the "Delete Nodes" button. - -#. Click on the "Deploy Changes" button on that screen. - -#. Wait for the node to become available as an unallocated node. - -#. Use the same Fuel screen - to assign an appropriate role to each node being redeployed. - -#. Click on the "Deploy Changes" button. - -#. Wait for the environment to be deployed. - - -After redeploying an Operating System node, -you will have to manually apply any configuration changes you made -and reinstall the software that was running on the node -or restore the system from the backup you made -before redeploying the node. diff --git a/pages/operations/redeploy/2000-add-compute-storage.rst b/pages/operations/redeploy/2000-add-compute-storage.rst deleted file mode 100644 index 573cc29b6..000000000 --- a/pages/operations/redeploy/2000-add-compute-storage.rst +++ /dev/null @@ -1,29 +0,0 @@ - -.. _add-compute-storage-ops: - -Add a Non-Controller Node -------------------------- - -Non-controller nodes can be added to your OpenStack environment. - -To add a non-controller node to your environment, -follow these steps: - -#. Physically configure the node into your hardware environment. - -#. Wait for the new node to show up as an "Unallocated Node" - on your Fuel dashboard. - -#. Click the "Add Node" button; - on the screen described in :ref:`assign-roles-ug`; - the unallocated node will be displayed. - Assign the role or roles to the node that you want. - -#. Click the "Deploy Changes" button - and wait for the node to be deployed. - - The cluster must be redeployed to update the configuration files. - Most of the services that are running are not affected - but the redeployment process restarts HAProxy and a few other services. - - diff --git a/pages/operations/redeploy/2500-add-mongodb.rst b/pages/operations/redeploy/2500-add-mongodb.rst deleted file mode 100644 index c9863b68b..000000000 --- a/pages/operations/redeploy/2500-add-mongodb.rst +++ /dev/null @@ -1,55 +0,0 @@ - -.. _add-mongodb-ops: - -Add a MongoDB node ------------------- - -Additional :ref:`MongoDB` roles can be added -to an existing deployment by using shell commands. -Any number of MongoDB roles (or standalone nodes) -can be deployed into an OpenStack environment -using the Fuel Web UI during the initial deployment -but you cannot use the Fuel Web UI to add MongoDB nodes -to an existing environment. - -Fuel installs MongoDB -as a backend for :ref:`ceilometer-term`. -Ideally, you should configure one MongoDB node -for each Controller node in the environment so, -if you add Controller nodes, -you should also add MongoDB nodes. - -To add one or more MongoDB nodes to the environment: - -#. Add an entry for each new MongoDB node - to the `connection` parameter - in the *ceilometer.conf* file on each Controller node. - This entry needs to specify the new node's IP address - for the Management :ref:`logical network`. - -#. Open the :ref:`astute.yaml` file on any deployed MongoDB node - and determine which node has the `primary-mongo` role; - see :ref:`astute-mongodb-nodes-ref`. - Write down the value of the **fqdn** parameter; - you will use this to **ssh** to this node. - -#. Retrieve the `db_password` value from the - :ref:`astute-ceilometer-config-ref` section of same file. - You will use this password to access the primary MongoDB node. - -#. Connect to the MongoDB node that has the `primary-mongo` role - and log into Mongo: - - :: - - ssh ... - mongo -u admin -p admin - -#. Configure each MongoDB node to be added to the environment: - - :: - - ceilometer:PRIMARY> rs.add ("") - -#. Restart the ceilometer services. - diff --git a/pages/operations/redeploy/3000-add-controller.rst b/pages/operations/redeploy/3000-add-controller.rst deleted file mode 100644 index 8961e7b42..000000000 --- a/pages/operations/redeploy/3000-add-controller.rst +++ /dev/null @@ -1,48 +0,0 @@ - -.. _add-controller-ops: - -Add a Controller node ---------------------- - -Mirantis OpenStack 5.1 and later -allows you to add Controller nodes to your environment -without redeploying the entire environment. - -You may want to add a Controller node to your environment -for any of the following reasons: - -- You deployed a single-Controller, HA-ready environment; - it is not actually highly-available - until at least three Controller nodes are configured - but it is run using :ref:`Pacemaker`, - :ref:`Corosync`, - and the other utilities used to manage an HA environment. - To make it highly available, - add two or more Controller nodes. - -- The resources of your existing Controller nodes - are being exhausted and you want to supplement them. - -- You are replacing a Controller node that failed; - you will first need to remove the failed Controller - as discussed in :ref:`remove-controller-ops`. - -Each Controller cluster should include an odd number of nodes -- -1 node, 3 nodes, 5 nodes, et cetera. - -To add Controllers to your environment: - -#. Physically configure the servers in your hardware environment - and wait for them to be discovered - and reflected in the "Unallocated Node" count on your Fuel dashboard. - -#. Use the :ref:`assign-roles-ug` screen to assign - the Controller role to each node. - -#. Check the connectivity between the nodes - by running :ref:`verify-networks-ug`. - -#. Click "Deploy changes" and wait for Fuel to redeploy the environment. - -#. Run the :ref:`post-deployment checks``. - diff --git a/pages/operations/redeploy/4000-remove-controller.rst b/pages/operations/redeploy/4000-remove-controller.rst deleted file mode 100644 index 5026d31c2..000000000 --- a/pages/operations/redeploy/4000-remove-controller.rst +++ /dev/null @@ -1,38 +0,0 @@ - -.. _remove-controller-ops: - -Remove a Controller node ------------------------- - -You may need to remove a Controller node from your environment, -usually because you want to replace it with a different server. -This may be because of a catastrophic hardware failure -on the node's server -or because you want to replace the server -with a more powerful system. - -.. note: When running a multi-node HA cluster, - all controllers contain the same data - so it is not necessary to preserve data before removing - one of the Controller nodes. - - If you have only one Controller running - and it fails or needs to be replaced with a more powerful system, - you need a good backup from which to restore the data. - Often, if you must replace the Controller node - in a single-Controller node environment, - you are better off redeploying the environment from scratch. - -To remove a Controller node: - -#. Remove Controller(s) from environment - by going to the Nodes tab in the Fuel desktop, - selecting the node(s) to be deleted, - and click on the "Delete Nodes" button. - - Puppet removes the controller(s) from the configuration files - and retriggers services. - -#. Physically remove the controller from the configuration. - - diff --git a/pages/operations/reduced-footprint-ops.rst b/pages/operations/reduced-footprint-ops.rst deleted file mode 100644 index 591143a95..000000000 --- a/pages/operations/reduced-footprint-ops.rst +++ /dev/null @@ -1,246 +0,0 @@ - -.. _reduced-footprint-ops: - -Using the reduced footprint feature -=================================== - -With the reduced footprint feature you can spawn virtual machines -on nodes. - -This can be useful in the following scenarios (but not limited to them): - -* Run a minimal two node cluster on a single physical machine. -* Put external services on the spawned virtual machines (e.g. - a monitoring service). -* Run three controllers on virtual machines on three different physical - machines. - -Reduced footprint flow in brief -------------------------------- - -Minimal requirements: - -* Two bare metal nodes. Alternatively, you can have one virtual - machine (with Fuel installed on it) and one bare metal. -* Fuel 7.0 ISO. - -Deployment flow: - -#. Install Fuel on a bare metal or virtual machine. -#. Boot another bare metal machine via Fuel PXE. -#. Enable the **Advanced** feature group in Fuel. -#. Create a new environment in Fuel. -#. Optionally, modify the libvirt VM template on the Fuel Master node: - ``/etc/puppet/modules/osnailyfacter/templates/vm_libvirt.erb`` - The default template supports tunneling segmentation. - If you use VLAN segmentation, change the bridge name 'br-mesh' - to 'br-prv' and set type to 'openvswitch'. - For example:: - - - - - - - -#. If you use tagged VLANs (VLAN segmentation or 'Use VLAN tagging' in - the "Networks" tab), you should upload a network template. For details - see :ref:`templates-networking-ops`. - See also network template samples for reduced footprint: - - * `VLAN segmentation `_ - * `VLAN tagging `_ - -#. Assign the "virt" role to the discovered node. -#. Upload the virtual machine configuration to Fuel. -#. Provision the bare metal node with the "virt" role. This - will also spawn the virtual machines. -#. Assign roles to the spawned and discovered virtual machines. -#. Deploy the environment. -#. Migrate the Fuel server as an additional virtual machine located on - the physical server. - -Reduced footprint flow detailed -------------------------------- - -#. Install Fuel on a bare metal or virtual machine. For details see :ref:`download-install-ug`. -#. Boot another bare metal machine via Fuel PXE. For details see :ref:`boot-nodes-ug`. -#. Enable the **Advanced** feature group in Fuel. On the Fuel Master - node edit the ``/etc/fuel/version.yaml`` file and add ``advanced`` - under ``feature groups`` there. Here is a sample:: - - VERSION: - feature_groups: - - mirantis - - advanced - - Having added "advanced" to the yaml file, issue the following commands:: - - dockerctl shell nailgun - supervisorctl restart nailgun - -#. Create a new environment in Fuel. For details see :ref:`create-env-ug`. -#. Assign the "virt" role to the discovered node. On the - Fuel Master node, issue the following command:: - - fuel --env-id= node set --node-id= --role=virt - - where points to a specific node identified by its ID - (a number) that you can get by issuing the ``fuel nodes`` command; - points to the environment ID respectively; you can get the - environment ID by issues the ``fuel environment`` command. - - For example:: - - fuel --env-id=1 node set --node-id=1 --role=virt - -#. Upload the virtual machine configuration to Fuel. On the - Fuel Master node, issue the following command:: - - fuel2 node create-vms-conf --conf '{"id":, \ - "mem":,"cpu":}' - - For example:: - - fuel2 node create-vms-conf 2 --conf '{"id":1,"mem":2,"cpu":4}' - - where is "virt" node ID, is VM ID that should - be unique on that "virt" node, is the memory amount - in gigabytes, and is the number of CPUs. - -#. Provision the bare metal node with the virtual role and spawn - virtual machines. - At this point you can go back to the Fuel UI. On the Dashboard there - you will see the **Provision VMs** button that you need to click. - Alternatively, you can do this through Fuel CLI on the Fuel Master - node by issuing the following command:: - - fuel2 env spawn-vms - - For example:: - - fuel2 env spawn-vms 1 - -#. Assign controller roles to the spawned virtual machines. For details - see :ref:`assign-roles-ug`. Alternatively, you can do this through - Fuel CLI by issuing the following command:: - - fuel --env-id= node set --node-id= --role=controller - - You can specify several nodes with the ``--node-id`` parameter. - For example:: - - fuel --env-id=1 node set --node-id=2,3,4 --role=controller - -#. Deploy the environment. For details see :ref:`deploy-changes`. - Alternatively, you can do this through Fuel CLI by issuing the - following command:: - - fuel --env node --deploy --node-id= - - You can specify several nodes with the ``--node-id`` parameter. - For example:: - - fuel --env 1 node --deploy --node-id=1,2,3,4 - -#. Use the fuel-migrate scrpt to migrate the Fuel Master node into - into a virtual machine on a compute node. This allows for reduced - resource use in small environments and lets the Fuel Master node - run on physical or virtual machines by essentially making it - host agnostic. - - To run the script issue the following command:: - - fuel-migrate - - .. note:: This will give you all the available parameters to - properly do the migration with the ``fuel-migrate`` - script. - - Simple usage scenario: - - #. Identify the node with the compute role by issuing the following - command on the Fuel Master node (and checking its output):: - - fuel node - - #. Run the migration script:: - - fuel-migrate - - where is the name or IP address of the - destination compute node where the virtual machine will be - created. - - For example:: - - fuel-migrate node-1 - - Or:: - - fuel-migrate 192.168.116.1 - - .. note:: You can get the node name or the IP address by - issuing the ``fuel node`` command. - - Once you start the script, it will do the following: - - #. Create a blank disk image on the destination node, define the - virtual machine, start the virtual machine, and boot with Fuel - PXE server. - #. Partition the disk on the destination node. - #. Reboot the Fuel Master node into maintenance mode and - synchronize the data. - #. Swap the IP address on the source and destination Fuel Master - nodes. It will then reboot the destination virtual machine. - - An indication of that the script has run successfully will be the - following message (with additional details on how to proceed) - after you log in to the Fuel Master node via SSH:: - - Congratulation! You are on cloned Fuel now! - The migration tasks have completed. The clone should be up and - functioning correctly. - - Additional notes: - - * You can define the destination disk size in gigabytes with - the ``--fvm_disk_size`` parameter. - - For example:: - - fuel-migrate node-1 --fvm_disk_size=50g - - * By default, the destination node will use the admin network - interface. If you need to create additional interfaces, you - can do so with the ``--other_net_bridges`` parameter. - - For example:: - - fuel-migrate node-1 --other_net_bridges=eth1,,virbr13 - - .. note:: Pay attention that ``--other_net_bridges`` - uses three parameters, and if you skip one of these - as in this example, you still need to separate it - with commas ``,,``. - - * By default, the migration log file is /var/log/fuel-migrate.log. - If the migration fails, check the log for errors. - - Custom usage example:: - - fuel-migrate 192.168.116.1 --admin_net_br=virbr12 --del_vm \ - --other_net_bridges=eth1,,virbr13 --fvm_disk_size=100g \ - --dkvm_folder=/var/lib/libvirt/images/ - - This example will do the following: - - #. Set the destination compute node with the IP address 192.168.116.1 - #. Use virbr12 on the host to connect to the admin interface (which - is public network connected to the current Fuel Master node in - this case). - #. Remove the destination virtual machine if it exists. - #. Use virbr13 for Ethernet 1. - #. Set the destination disk size to 100 GB. - #. Set the path to the folder on KVM hist where disk will - be created to ``/var/lib/libvirt/images/`` diff --git a/pages/operations/sahara/7600-security-groups.rst b/pages/operations/sahara/7600-security-groups.rst deleted file mode 100644 index 762d56f20..000000000 --- a/pages/operations/sahara/7600-security-groups.rst +++ /dev/null @@ -1,18 +0,0 @@ - -.. _sahara-security-groups: - -Sahara Security Groups ----------------------- - -Sahara uses auto-security groups for opening required ports for each plugin. - -To learn about the open ports for each plugin, please refer to the official -documentation: - -* `Apache Hadoop `_ -* Hortonworks Hadoop - `Version 2.2 `_ - and `Version 2.3 `_ -* `Apach Spark `_ -* `Cloudera `_ -* `MapR `_ diff --git a/pages/operations/sahara/7700-prepare-to-test.rst b/pages/operations/sahara/7700-prepare-to-test.rst deleted file mode 100644 index 0538a927e..000000000 --- a/pages/operations/sahara/7700-prepare-to-test.rst +++ /dev/null @@ -1,47 +0,0 @@ - -.. _sahara_test_prepare: - -Preparing Sahara for Testing ----------------------------- - -You can run Platform Tests to verify whether Sahara is functioning correctly. -To run the tests, Sahara must be deployed and configured. - -You run the tests in the tenant you specified in the `OpenStack Settings` tab -during the OpenStack installation. By default, the `admin` tenant is used for -the tests. - -You must have at least 4096 MB of available RAM in the tenant you are using -for Sahara Platform Tests otherwise some tests may fail. - -To prepare Sahara for testing, you should get an image and register it -with Sahara image registry: - -#. Download the `image with Hadoop for Sahara - `_ - -#. Register it with Sahara: - - a. Upload the image into Glance into the `admin` tenant. Name it `sahara`. - - b. In Horizon, access the `Data Processing` panel under the `Project` menu. - - c. Switch to the `admin` tenant. - - d. Go to the `Image Registry` menu. - - e. Click the `Register Image` button. The `Image registration` dialog - appears. - - f. Select the image you have just uploaded. - - g. Set username to ``ubuntu``. - - h. Select the tags: ``plugin=vanilla`` and ``version=2.4.1``. - - i. Click ``Add plugin tags``. - - j. Click ``Done``. - -Now you can test Sahara. - diff --git a/pages/operations/sahara/7740-sahara-vmware.rst b/pages/operations/sahara/7740-sahara-vmware.rst deleted file mode 100644 index 27c2f9c4a..000000000 --- a/pages/operations/sahara/7740-sahara-vmware.rst +++ /dev/null @@ -1,13 +0,0 @@ - - -.. _sahara-vmware: - -Image Requirements ------------------- - -Vmware Nova backend requires VMDK image format. You may use qemu-img -utility to convert a QCOW2 image to VMDK. - -.. sourcecode:: console - - qemu-img convert -O vmdk .qcow2 .vmdk \ No newline at end of file diff --git a/pages/operations/sahara/7750-test-details.rst b/pages/operations/sahara/7750-test-details.rst deleted file mode 100644 index f75eb1588..000000000 --- a/pages/operations/sahara/7750-test-details.rst +++ /dev/null @@ -1,121 +0,0 @@ - -.. _sahara-test-details: - -Sahara Test Details -------------------- - -Hadoop cluster operations test - checks whether Sahara can launch a Hadoop cluster using the Vanilla plugin - -Target component - Sahara - -**Scenario** - -#. Login to the OpenStack dashboard. - -#. Register an image: - - * Navigate to `Project > Data Processing > Image Registry`. - - * Click on `Register Image`. - - * Select an image for registering from the drop-down list - in the `Image` field. - - * Specify the ``User Name`` value for this OS. - - * Set the following values: ``Plugin=vanilla``, ``Version=2.6.0``. - - * Click `Add plugin tags` and `Done`. - -#. Create a master node group template: - - * Navigate to `Project > Data Processing > Node Group Templates`. - - * Click `Create Template`. - - * In the `Create Node Group template` dialog, set the following values: - ``Plugin name=Vanilla Apache Hadoop``, ``Hadoop version=2.6.0``. - Click `Create` to proceed. - - * In the second `Create Node Group template` dialog, set the following values: - ``Template Name=vanilla2-master``, ``OpenStack Flavor=m1.small``, - ``Floating IP pool=(external network)``, check ``namenode``, - ``secondarynamenode``, ``resourcemanager``, ``historyserver``, and ``oozie`` - in the `Process` section. - - * Click `Create`. - -#. Create a worker node group template: - - * Navigate to `Project > Data Processing > Node Group Templates`. - - * Click `Create Template`. - - * In the `Create Node Group template` dialog, set the following values: - ``Plugin name=Vanilla Apache Hadoop`` and ``Hadoop version=2.6.0``. - Click `Create` to proceed. - - * In the second `Create Node Group template` dialog, set the following values: - ``Template Name=vanilla2-worker``, ``OpenStack Flavor=m1.small``, - ``Floating IP pool=(external network)``; check ``datanode`` and ``nodemanager`` - in the `Process` section. - - * Click `Create`. - -#. Create a cluster template: - - * Navigate to `Project > Data Processing > Cluster Templates`. - - * Click `Create Template`. - - * In the `Create Cluster Template` dialog, set the following values: - ``Plugin name=Vanilla Apache Hadoop``, ``Hadoop version=2.6.0``. - Click `Create` to proceed. - - * In the second `Create Cluster Template` dialog, set the following values: - - - the `Details` tab: specify ``Template Name=vanilla2-template``; - - - the `Node Groups` tab: add ``vanilla2-master`` and ``vanilla2-worker``; - - - the `HDFS Parameters` tab: set ``dfs.replication=1``. - - * Click `Create`. - -#. Launch the cluster: - - * Navigate to `Project > Data Processing > Clusters`. - - * Click `Launch Cluster`. - - * In the `Launch Cluster` dialog, set the following values: - ``Plugin name=Vanilla Apache Hadoop``, ``Hadoop version=2.6.0``. - Click `Create` to proceed. - - * In the second `Launch Cluster` dialog, set ``Cluster Name=vanilla2-cluster``. - - * Click `Create` and wait until the cluster gets the ``Active`` status. - - -#. Delete the cluster: - - * On the `Clusters` page, select the ``vanilla2-cluster`` cluster from the table - and click `Delete Cluster`. - -#. Delete the templates: - - * Navigate to `Project > Data Processing > Cluster Templates`. - - * Select the `vanilla2-template` templates and click `Delete Templates`. - - * Navigate to `Project > Data Processing > Node Group Templates`. - - * Select `vanilla2-master` and `vanilla2-worker` templates, - and click `Delete Templates`. - - - -For more information, see -`Sahara documentation `_. diff --git a/pages/operations/sahara/7760-sahara-images.rst b/pages/operations/sahara/7760-sahara-images.rst deleted file mode 100644 index 8e47a6414..000000000 --- a/pages/operations/sahara/7760-sahara-images.rst +++ /dev/null @@ -1,47 +0,0 @@ - -.. _sahara-images-ops: - -Sahara Images -------------- - -Prepared images can be downloaded from the following locations: - -* `Ubuntu 12.04 for CDH 5.4.0 `_ -* `Ubuntu 14.04 for Vanilla Hadoop 2.6.0 `_ -* `Ubuntu 14.04 for Spark 1.3.1 `_ -* `Ubuntu 14.04 for MapR 4.0.2 `_ -* `CentOS 6.6 for Vanilla Hadoop 2.6.0 `_ -* `CentOS 6.6 for HDP 2.2 `_ -* `CentOS 6.6 for HDP 2.3 `_ -* `CentOS 6.6 for CDH 5.4.0 `_ -* `CentOS 6.6 for MapR 4.0.2 `_ - -.. note:: - - For the HDP 2.2 and the HDP 2.3 installations, you use the same image. - -The default username for these images depends on the distribution: - -+------------------+-----------+ -| Operating System | Username | -+==================+===========+ -| Ubuntu 12.04 | ubuntu | -+------------------+-----------+ -| Ubuntu 14.04 | ubuntu | -+------------------+-----------+ -| CentOS 6.6 | cloud-user| -+------------------+-----------+ - -You can find MD5 checksum of an image by adding the ``.md5`` suffix -to the image URL. - -For example: - -http://sahara-files.mirantis.com/mos70/sahara-kilo-vanilla-2.6.0-ubuntu-14.04.qcow2.md5. - -To check an ``.iso`` file with an MD5 hash, run: - -.. code-block:: console - - $ md5sum -c sahara-kilo-vanilla-2.6.0-ubuntu-14.04.qcow2.md5 - .. diff --git a/pages/operations/shell/0100-public-keys.rst b/pages/operations/shell/0100-public-keys.rst deleted file mode 100644 index 50c01a928..000000000 --- a/pages/operations/shell/0100-public-keys.rst +++ /dev/null @@ -1,41 +0,0 @@ - -.. _public-keys-ops: - -Uploading Public Keys ---------------------- - -You access the shell on the Fuel Master node -and the target nodes using SSH, -and you must define a Public Key to use SSH. - -#. Generate a Public Key with the following command on your client: - - :: - - ssh-keygen -t rsa - -#. Populate the :ref:`Public Key` field - in the Fuel UI with this key. - Fuel will upload this Public Key to each target node it deploys, - but it does not upload it to nodes that are already deployed. - -#. To upload the SSH key to the Fuel Master node or any deployed node, - use the following command sequence: - :: - - ssh-agent - ssh-copy-id -i .ssh/id_rsa.pub root@ - - <*ip-addr*> is the IP address for the Fuel Master node, - which is the same IP address you use to access the Fuel console. - - You can use this same command to add a public key - to a deployed target node. - See :ref:`ssh-to-target-nodes-ops` for information - about getting the <*ip-addr*> values for the target nodes. - - You can instead add the content of your key - (stored in the ``.ssh/id_rsa.pub`` file) - to the node's ``/root/.ssh/authorized_keys`` file. - - diff --git a/pages/operations/shell/0200-ssh-fuel-master.rst b/pages/operations/shell/0200-ssh-fuel-master.rst deleted file mode 100644 index 5400e1487..000000000 --- a/pages/operations/shell/0200-ssh-fuel-master.rst +++ /dev/null @@ -1,12 +0,0 @@ - -.. _ssh-to-fuel-master-ops: - -SSH to the Fuel Master Node ---------------------------- - -You can now use **ssh** to access the console -of the Fuel Master Node -or **scp** to securely copy a file to the Fuel Master node. - - - diff --git a/pages/operations/shell/0300-ssh-target-nodes.rst b/pages/operations/shell/0300-ssh-target-nodes.rst deleted file mode 100644 index a2babd9f5..000000000 --- a/pages/operations/shell/0300-ssh-target-nodes.rst +++ /dev/null @@ -1,32 +0,0 @@ - -.. _ssh-to-target-nodes-ops: - -SSH to target nodes -------------------- - -You can SSH to any of the target nodes in your environment -from the Fuel Master node. - -Use the **fuel node list** command to get a list -like the following: -:: - - - id | status | name | cluster | ip | mac | roles | pending_roles | online - ---|--------|------------------|---------|------------|-------------------|------------|---------------|------- - 5 | ready | Untitled (4d:4d) | 2 | 10.110.0.3 | b2:8b:55:17:ae:40 | controller | | True - 8 | ready | Untitled (3a:7f) | 2 | 10.110.0.6 | 92:93:99:70:14:4c | compute | | True - 6 | ready | Untitled (34:84) | 2 | 10.110.0.4 | f2:b3:1a:74:da:41 | cinder | | True - 7 | ready | Untitled (f0:9b) | 2 | 10.110.0.5 | 56:09:fe:c6:06:40 | compute | | True - -You can ssh to any of the nodes using the IP address. -For example, to ssh to the Cinder node: -:: - - ssh 10.110.0.4 - -You can also use the "id" shown in the first column, -for example: -:: - - ssh node-6 diff --git a/pages/operations/templates-networking-examples.rst b/pages/operations/templates-networking-examples.rst deleted file mode 100644 index 8f050123e..000000000 --- a/pages/operations/templates-networking-examples.rst +++ /dev/null @@ -1,113 +0,0 @@ -.. _templates-networking-examples: - -Network Template Examples -========================= - -You can use network templates to configure Fuel to use -one or two networks for all OpenStack network traffic. - -Configuring Two Networks ------------------------- - -Fuel supports the two-network configuration where one network interface is -dedicated for PXE traffic and another network interface, or bonding, for -all other traffic. - -**To configure two networks:** - -1. Create a new network for all non-PXE traffic: - - :: - - # fuel network-group --create --name everything --cidr - --gateway --nodegroup - -2. Set the ``render_addr_mask`` parameter to `internal` for this network by - typing: - - :: - - # fuel network-group --set --network 39 --meta '{"name": - "everything", "notation": "cidr", "render_type": null, "map_priority": 2, - "configurable": true, "use_gateway": true, "render_addr_mask": - "internal", "vlan_start": null, "cidr": "10.108.31.0/24"}' - - This parameter is required by the Fuel library. The Fuel library requires - a value called ``internal_address`` for each node. - This value is set to the node's IP address from a network group which has - ``render_addr_mask`` set to `internal` in its metadata. Therefore, update - ``render_addr_mask`` for this network. - -3. Save `network template for two networks - `_ - as ``network_template_.yaml``. - - .. note:: - Verify that ``nic_mapping`` matches your configuration. - -4. Upload the network template by typing: - - :: - - # fuel network-template --upload --env - -5. Deploy the environment. - -6. After Fuel completes the deployment, verify that only one bridge is - configured by typing: - - :: - - # ip -4 a - - 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default - inet 127.0.0.1/8 scope host lo - valid_lft forever preferred_lft forever - 8: br-fw-admin: mtu 1500 qdisc noqueue state UP group default - inet 10.108.5.3/24 brd 10.108.5.255 scope global br-fw-admin - valid_lft forever preferred_lft forever - 16: vr-host-base: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 - inet 240.0.0.5/30 scope global vr-host-base - valid_lft forever preferred_lft forever - 30: hapr-host: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 - inet 240.0.0.1/30 scope global hapr-host - valid_lft forever preferred_lft forever - -Configuring a Single Network ----------------------------- - -Fuel supports a single network configuration where one network interface is -responsible for all OpenStack traffic. This configuration is common in the -proof of concept deployments where no additional network interfaces are -available. - -**To configure a single network:** - -1. Save `network template for one network - `_ - as ``network_template_.yaml``. - -2. Upload the network template by typing: - - :: - - # fuel network-template --upload --env - -3. Deploy the environment. - -4. Proceed to :ref:`neutron_config`. - -.. _neutron_config: - -Configure Neutron -+++++++++++++++++ - -After you deploy your environment, allocate the correct floating IP pool -to the network. - -**To allocate the correct floating IP pool:** - -#. Clear the gateway from `router04`. -#. Delete the `net04_ext__subnet` subnet. -#. Create a new subnet with the floating IP pool from the single network. -#. Set gateway on `router04`. diff --git a/pages/operations/templates-networking-ops.rst b/pages/operations/templates-networking-ops.rst deleted file mode 100644 index 37dd45ec7..000000000 --- a/pages/operations/templates-networking-ops.rst +++ /dev/null @@ -1,306 +0,0 @@ -.. _templates-networking-ops: - -Using Networking Templates -========================== - -Starting with Fuel 7.0 you can use networking templates. -Templates allow for more flexible network configurations and provide -you with the following abilities: - -* Ability to create additional networks (e.g. an extra network for Swift) - and delete networks. -* Have a specific set of network roles. -* Ability to create a network only if a relevant node role is present - on the node. -* Ability to provide custom networking topologies (e.g. subinterface bonding). - -Networking Templates Limitations --------------------------------- - -* Interdependencies between templates for different node roles cannot - be set. -* Network roles to networks mapping and network topology cannot be set - for nodes individually. They can only be set for node role or/and node - group. -* There is no UI support for networking templates. You can only operate - via CLI or API. The "Configure Interfaces" tab of Fuel Web UI will - become inactive after you upload a networking template. - -.. note:: If you delete the template, Fuel's default network - solution will automatically become live and all - network related sections in Fuel Web UI will become - available again. - -Working with Networking Templates ---------------------------------- - -A networking template is a YAML file in the following format:: - - network_template_.yaml - -where is the ID of your OpenStack environment that you can -get by issuing the ``fuel environment`` command. - -For example, if the ID of your environment is ``1``, the name of the -template must be ``network_template_1.yaml`` to operate with the -template via Fuel CLI. - -Networking Templates Samples -++++++++++++++++++++++++++++ - -You can download samples from the `network_templates repository -folder `_. - -.. note:: There is no default or generated template in your Fuel - installation provided by default. - -Networking Templates Structure -++++++++++++++++++++++++++++++ - -Each template consists of five major sections. - -* ``adv_net_template`` -- This is the network configuration template - for the environment. The template operates with :ref:`node groups`. - Sample:: - - adv_net_template: - default: # name of the node group - nic_mapping: - ... - templates_for_node_role: - ... - network_assignments: - ... - network_scheme: - ... - group_11: # name of the node group - nic_mapping: - templates_for_node_role: - network_assignments: - network_scheme: - - The following four sections are defined for each node group - in the environment. Definitions from the ``default`` node group - will be used for the node groups not listed in the template. - -* ``nic_mapping`` -- Aliases to NIC names mapping are set here. - -* ``templates_for_node_role`` -- List of template names for every - node role used in the environment. - -* ``network_assignments`` -- Endpoints used in the template body. This - is where the mapping is set between endpoints and network names to - set the L3 configuration for the endpoints. - -* ``network_scheme`` -- Template bodies for every template listed under - ``templates_for_node_role`` - -nic_mapping section detailed -^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -Sample:: - - nic_mapping: - default: - if1: eth0 - if2: eth1 - if3: eth2 - if4: eth3 - node-33: - if1: eth1 - if2: eth3 - if3: eth2 - if4: eth0 - -NIC aliases (e.g. "if1") are used in templates in the topology -description in the ``transformations`` section. With ``nic_mapping`` -you can set mapping of aliases to NIC names for different nodes. - -The ``default`` mapping is set for all nodes that do not have name -aliases. Custom mapping can be set for any particular node (by node -name). - -The number of NICs for any node may vary. It depends on the topologies -defined for the nodes in templates in the ``transformations`` section. - -Use of aliases in templates is optional. You can use NIC names if all -nodes have the same set of NICs and they are connected in the same way. - -templates_for_node_role section detailed -^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -Sample:: - - templates_for_node_role: - controller: - - public - - private - - storage - - common - compute: - - common - - private - - storage - ceph-osd: - - common - - storage - -This is where you provide the list of template names for every node -role used in the environment. - -The order of templates matters. The description of the topology -that is in the ``transformations`` section of the template is executed -by Puppet in the order provided on its input. Also, the order of -creating the networking objects cannot be arbitrary. For example, -a bridge should be created first, and the subinterface that will carry -its traffic should be created after that. - -While templates can be reused for different node roles, each template -is executed once for every node. - -When several roles are mixed on one node, an alphabetical order of node -roles is used to determine the final order of the templates. - -network_assignments section detailed -^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -Sample:: - - network_assignments: - storage: - ep: br-storage - private: - ep: br-prv - public: - ep: br-ex - management: - ep: br-mgmt - fuelweb_admin: - ep: br-fw-admin - -Endpoints are used in the template body. The mapping is set here -between endpoints and network names to get the networks' L3 -configuration to be set for endpoints. - -The sample above shows the default mapping which is set without a -template. The set of networks can be changed using API: networks -can be created or deleted via API. - -network_scheme section detailed -^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -Sample:: - - network_scheme: - storage: # template name - transformations: - ... - endpoints: - ... - roles: - ... - private: - transformations: - ... - endpoints: - ... - roles: - ... - ... - -Each template has a name which is referenced in the sections above -and consists of the three following sections: - -* ``transformations`` -- A sequence of actions to build proper network - topology is defined here. The "transformation" from physical - interface to endpoint is described here. The transformations - are applied by the `Puppet l23network module `_ - and must be compatible with it. - -* ``endpoints`` -- All endpoints introduced by the template. - -* ``roles`` -- The mapping of network roles to endpoints. When several - templates are used for one node there should be no contradictions - in this mapping. - -Operating with Networking Templates -+++++++++++++++++++++++++++++++++++ - -.. note:: The order in which you add or remove networks and load the - the template does not matter. However, adding or removing - networks will not make sense if a template is not uploaded - for the environment at all, because the default network - solution takes into account only the networks created - by default. - -To upload a networking template, on the Fuel Master node issue the -following command:: - - fuel --env network-template --upload --dir - -where where is the ID of your OpenStack environment that you -can get by issuing the ``fuel environment`` command; is the path -to where your template is. - -For example:: - - fuel --env 1 network-template --upload --dir /home/stack/ - -To download a networking template to the current directory, -on the Fuel Master node issue the following command:: - - fuel --env network-template --download - -For example:: - - fuel --env 1 network-template --download - -To delete an existing networking template, on the Fuel Master node -issue the following command:: - - fuel --env network-template --delete - -For example:: - - fuel --env 1 network-template --delete - -To create a network group, issue the following command:: - - fuel network-group --create --node-group --name \ - "" --release --vlan \ - --cidr - -where is the ID of your :ref:`node-group-term` that you can -get by issuing the ``fuel nodegroup`` command; is the name that -you would like to assign to your group; is the ID of your -release; is the VLAN ID; is an IP address -with an associated routing prefix. - -For example:: - - fuel network-group --create --node-group 1 --name \ - "new network" --release 2 --vlan 100 --cidr 10.0.0.0/24 - -To list all available network groups issue the following command:: - - fuel network-group list - -To filter network groups by node group:: - - fuel network-group --node-group - -For example:: - - fuel network-group --node-group 1 - -To delete network groups:: - - fuel network-group --delete --network - -For example:: - - fuel network-group --delete --network 1 - -You can also specify multiple groups to delete:: - - fuel network-group --delete --network 2,3,4 diff --git a/pages/operations/tls-ssl-ops.rst b/pages/operations/tls-ssl-ops.rst deleted file mode 100644 index d6d6aa461..000000000 --- a/pages/operations/tls-ssl-ops.rst +++ /dev/null @@ -1,87 +0,0 @@ -.. _tls-ssl-ops: - -Switching on SSL and Secure Access -================================== - -Starting with Fuel 7.0 there are two secure access options that -you can enable on the :ref:`settings-ug` of Fuel Web UI: - -* You can switch on SSL for the Horizon dashboard and the OpenStack - publicURL endpoints. - -* HTTPS access to the Fuel Master node. - -Horizon dashboard and the OpenStack publicURL endpoints -------------------------------------------------------- - -Secure access is enabled by default: - -.. image:: /_images/user_screen_shots/horizon-openstack-ops.png - -The "HTTPS for Horizon" checkbox enables SSL access to the Horizon -dashboard. - -.. note:: With the HTTPS enabled, you will not be able to access - the Horizon dashboard through plain HTTP. You will - automatically be redirected to HTTPS port 443. - -The "TLS for OpenStack public endpoints" checkbox enables access -to publicURL enpoints through HTTPS. - - -.. note:: With the "TLS for OpenStack..." enabled, you will not be - able to access the public endpoints through plain HTTP. - -After enabling one or both of the secure access options, you will -need to generate or upload a certificate and update your DNS entries: - -#. Select the certificate source: - - * Self-signed -- The certificate will be generated before - the environment deployment. - - * I have my own keypair with certificate -- You will need to upload - a file with the certificate information and a private key that - can be consumed by HAProxy. For detailed information read - `HOWTO SSL NATIVE IN HAPROXY `_. - -#. Update your DNS entries -- Set the DNS hostname for public TLS - endpoints. This hostname will be used in the two following cases: - - * When setting up DNS in the cluster. - - * As a name for OpenStack services when adding them to Identity. - For example, you will see this name when you issue the - ``keystone --endpoint-list`` command on one of the Controllers - in a deployed cluster. - -HTTPS access to the Fuel Master node ------------------------------------- - -You can now access the Fuel Master node through HTTPS. -To do this, you will need to use port 8443: `https://10.20.0.2:8443 `_ - -Additional information ----------------------- - -* Changing keypairs for a cluster -- There is currently no automated - way to do this. You can manually change the keypairs in - ``/var/lib/astute/haproxy/public_haproxy.pem`` on Controller - and Compute nodes. Make sure you restart the HAProxy service - after you edit the file. - -* Changing keypairs for the Fuel Master node -- You need to write the - key to ``/etc/pki/tls/nginx.key`` and the certificate to - ``/etc/pki/tls/nginx.crt``. Make sure you restart nginx after - that. - -* Making access to the Fuel Master node HTTPS only -- Edit the - ``/etc/fuel/astute.yaml`` file so that it contains the following:: - - SSL: - force_https: true - - .. note:: Currently Fuel CLI does not support HTTPS. - You will also need to update ``fuel-nailgun-agent`` - on all nodes deployed with older than 7.0, otherwise - they will be reported as inactive. diff --git a/pages/operations/troubleshoot/1000-logs.rst b/pages/operations/troubleshoot/1000-logs.rst deleted file mode 100644 index bace1d3b2..000000000 --- a/pages/operations/troubleshoot/1000-logs.rst +++ /dev/null @@ -1,351 +0,0 @@ - - -.. _logs-top-tshoot: - -Logs and messages ------------------ - -A number of logs are available -to help you understand and troubleshoot -what is going on in your environment. - -.. _screen-messages-tshoot: - -Screen messages -+++++++++++++++ - -Clicking on the icon in the upper right corner -of the Fuel UI displays a drop-down menu -of notifications posted as the environment was deployed. -If notifications have been posted -that you have not yet viewed, -this icon is an orange square with a number -that indicates the number of unread notifications. -If there are no unread notifications, -the icon looks as it does here: - -.. image:: /_images/user_screen_shots/messages.png - :width: 80% - -These notifications tell you about the nodes that were deployed -and when nodes go on and offline. -Click on any notification -to get a summary configuration view of the node. - -.. _view-logs-fuel: - -Viewing Logs through Fuel -+++++++++++++++++++++++++ - -The Logs tab on the Fuel UI allows you to view -key logs for any node in the environment. -Use the drop-down list on the left to select -whether to view Fuel Master logs -or the logs of other servers in the environment. - -When you choose the "Fuel Master" logs, -you get this display: - -.. image:: /_images/user_screen_shots/master-logs.png - :width: 80% - -Select the log to view by setting the fields: - -:Logs: Choose between the Fuel Master or "Other servers". - When you choose "Other servers", the display changes - to provide a drop-down list of all nodes in the environment. - -:Source: Log you want to view. See the lists below. - -:Min Level: By default, this shows "INFO" messages only. - If you are running your environment in debug mode, - you can use this field to filter out some of the messages. - -When you have set all the fields, click on "SHOW" at the right -to display the requested log for the specified server. - -Viewing Fuel Master logs -++++++++++++++++++++++++ - -The following logs can be chosen from the "Source" list -for the "Fuel Master" node: - -:puppet: Logs activity of the :ref:`puppet-term` - configuration management system. - -:anaconda: Logs activities of the Anaconda installation agent - used for provisioning. - -:syslog: Shows the **syslog** entries - that will be sent to the **rsyslog** server - (Fuel Master by default). - - - -**Other install logs** - -:storage: Log entries for disk partitioning. - -:kickstart-pre: Shows activities before the :ref:`Cobbler` - kickstart mechanism runs. - -:kickstart-post: Shows activities after the Cobbler kickstart mechanism runs. - - -**Bootstrap logs** - -:Web backend: Logs each connection from the Master Node - to the Internet. - -:REST API: :ref:`Nailgun` API activities. - -:RPC consumer: Logs messaging between :ref:`Nailgun` - and the :ref:`orchestration service` - -:Astute: Records the activity of the :ref:`astute-term` agents - that implements the :ref:`nailgun-term` configuration tasks. - -:Health Check: Displays the results of the most recent run - of the tests run from the "Health Check" tab. - -Viewing logs for target nodes ("Other servers") -+++++++++++++++++++++++++++++++++++++++++++++++ - -When you choose "Other Servers", -the display includes an extra field -that you use to choose the node whose logs you want to view: - -.. image:: /_images/user_screen_shots/other-nodes-logs.png - :width: 80% - -Many of the same logs shown for the Fuel Master node -are also shown for the target nodes. -The difference is in the nodes given for "Bootstrap logs", -plus the controller node includes a set of OpenStack logs -that shows logs for services that run on the Controller node. - -The "Bootstrap logs" for "Other servers" are: - -**Bootstrap logs** - -:dmesg: Standard Linux dmesg log that displays log messages - from the most recent system startup. - -:messages: Logs all kernel messages for the node. - -:mcollective: Logs activities of Mcollective - -:agent: Logs activities of the - :ref:`Nailgun` agent. - -syslog -++++++ - -OpenStack uses the standard Linux **syslog**/**rsyslog** facilities -to manage logging in the environment. -Fuel puts the appropriate templates -into the */etc/rsyslog.d* directory -on each target node. - -By default, Fuel sets up the Fuel Master node -to be the remote syslog server. -See :ref:`syslog-ug` for instructions about -how to configure the environment -to use a different server as the **rsyslog** server. -Note that Fuel configures all the files required for **rsyslog** -when you use the Fuel Master node as the remote server; -if you specify another server, -you must configure that server to handle messages -from the OpenStack environment. - -/var/logs -+++++++++ - -Logs for each node are written to the node's */var/logs* directory -and can be viewed there. -Under this directory, you will find subdirectories -for the major services that run on that node -such as nova, cinder, glance, and heat. - -On the Fuel Master node, -*/var/log/remote* is a symbolic link to the -*/var/log/docker-logs/remote* directory. - -Logging events from Fuel OCF agents are collected both locally -in */var/log/daemon.log* and remotely. The naming convention for -a remote log file is the following:: - - ocf-.log - -For example:: - - ocf-foo-agent.log - -.. note:: RabbitMQ logs its OCF events to the *lrmd.log* file - to keep it backwards compatible. - -.. _atop-ops: - -atop logs -+++++++++ - -Fuel installs and runs -`atop `_ -on all deployed nodes in the environment. -The **atop** service uses -`screen `_ -to display -detailed information -about resource usage on each node. -The data shows usage of the hardware resources -that are most important from a performance standpoint: -CPU, memory, disk, and network interfaces -and can be used to troubleshoot performance and scalability issues. - -The implementation is: - -* By default, **atop** takes a snapshot of system status - every 20 seconds and stores this information in binary form. - -* The binary data is stored locally on each node - in the */var/log/atop* directory. - -* Data is kept for seven days; - a logrotate job deletes logs older than seven days. - -* Data is stored locally on each target node; - it is not aggregated for the whole environment. - -* The data consumes no more than 2GB of disk space on each node - with the default configuration settings. - -* The **atop** service can be disabled from the Linux shell. - A Puppet run - (either done manually or when patching OpenStack) - re-enables **atop**. - -* The Diagnostic Logs snapshot includes - the *atop* data for the current day only. - -To view the **atop** data, -run the `atop(1) `_ -command on the shell of the node you are analyzing: - -:: - - atop -r /var/log/atop/ - - -Use **t** and **T** to navigate through the state snapshots. - -You can also search the **atop** data. -For example, the following command reports on -all **sh** processes in the **atop** binary file -that ran between 10:00 and 12:00 (searching the *atop_current* binary file). -For each process, the **PPRG** flag causes it to report when it started, -when it ended, and the exit code provided: - -.. code-block :: sh - - atop -PPRG -r /var/log/atop/atop_current -b "10:00" -e "12:00" | grep 'sh' - -See the atop(1) man page for a description of -the **atop** options and commands. - -Each target node has a configuration file -that controls the behavior of **atop** on that node. -On Ubuntu nodes, this is the */etc/default/atop* file. -The contents of the file are: - -.. code-block :: sh - - - INTERVAL=20 - LOGPATH="/var/log/atop" - OUTFILE="$LOGPATH/daily.log"` - -Modifying the value of the `INTERVAL` parameter -or the **logrotate** settings affects the size of the logs maintained. -For the most efficient log size, -use a larger interval setting and a smaller rotate setting. -To modify the rotate setting, -edit the */etc/logrotate.d/atop* file -and make both of the following modifications; -the value of `X` should be the same in both cases: - -- Modify the value of the **rotate X** setting. -- Modify the value of the **mtime +X** argument - to the **lastaction** setting. - -Fuel Master node log rotation -+++++++++++++++++++++++++++++ - -The Fuel Master node provides an ability to configure log rotation -using the template file. - -* By default, the logrotate script calls `/etc/logrotate.d/fuel.nodaily` - file every 15 minutes to verify whether one of the following conditions is met: - - * age - if the log has not been rotated in more than the specified period of - time (weekly by default), and the file is larger than 10MB on the Fuel - Master node or 5MB on slave nodes; - - * size - if a log file exceeds 100MB on the Fuel Master node or 20MB on slave nodes. - - .. warning:: - Fuel enforces the following global changes to the `logrotate` configuration: - ``delaycompress`` and ``copytruncate``. - -* You can run a quick test to check if the logrotate script works. - - Find the biggest file in ``/var/log/``, and check date time stamps in the first - and the last line: - - .. code-block :: sh - - biggest_file=$(find /var/log/ -type f | xargs du -h | sort -h | tail -n 1 | cut -f2); - ls -lah $biggest_file; - head -n1 $biggest_file | head -c35; echo ""; - tail -n1 $biggest_file | head -c35; echo ""; - - If it is older than your rotation schedule and bigger than maxsize, - then logrotate is not working correctly. - - To debug, type: - - .. code-block :: sh - - logrotate -v -d /etc/logrotate.d/fuel.nodaily - - The output of this command is a list of files examined by `logrotate`, - including whether they should be rotated or not. - -* You can find an example of a writing rate evaluation for the ``neutron-server`` log file: - `LP1382515 `_. - -* When backporting the reworked logrotate configuration - to the older Fuel releases, purge old template files: - - .. code-block :: sh - - rm /etc/logrotate.d/{1,2}0-fuel* - - The `/usr/bin/fuel-logrotate` script is needed as well as a new cron job to perform the - rotation with it. - - -Enabling debug logging for OpenStack services -+++++++++++++++++++++++++++++++++++++++++++++ - -Most OpenStack services use the same configuration options to control log level -and logging method. If you need to troubleshoot a specific service, locate its -config file under */etc* (e.g. */etc/nova/nova.conf*) and revert the values of -**debug** and **use_syslog** flags like this: - - debug=True - use_syslog=False - -Disabling syslog will protect the Fuel master node from being overloaded from a -flood of debug messages sent from that node to the rsyslog server. Do not -forget to revert both flags back to original values when done with -troubleshooting. diff --git a/pages/operations/troubleshoot/2000-docker-disk-full.rst b/pages/operations/troubleshoot/2000-docker-disk-full.rst deleted file mode 100644 index 9684827d6..000000000 --- a/pages/operations/troubleshoot/2000-docker-disk-full.rst +++ /dev/null @@ -1,310 +0,0 @@ - - -.. _docker-disk-full-top-tshoot: - -Fuel Master and Docker disk space troubleshooting -------------------------------------------------- - -Overview -++++++++ - -One major consideration in maintaining a Fuel Master node is managing disk -space. While there is currently no monitoring for Fuel Master, it is important -to budget enough disk space. Failure to do so may lead to logs overwhelming the -/var partition. For example, enabling Ceilometer and debug logging will quickly -fill up disk space. -The following sections describe failures that may occur -if the disk fills up -and gives solutions for resolving them. - -If the solution to your issue requires rebuilding Docker containers, take note -that data recovery is not necessary for the following containers: mcollective, -nginx, ostf, nailgun, rsyslog, keystone, rabbitmq. This is because the data on -these containers is stateless. For astute, cobbler, and postgres containers it -is necessary to recover stateful data from the affected container. Instructions -below will guide you through the processes. - -PostgreSQL database inconsistency -+++++++++++++++++++++++++++++++++ - -**Diagnosis** - -The following symptoms will be present: - -* Fuel Web UI fails to work -* The ``dockerctl list -l`` output - reports that the nailgun, ostf, and/or keystone container is down -* The output of the ``fuel task`` command reports an error - similar to the following:: - - HTTP Error 400: Bad Request (This Session's transaction has been rolled back - due to a previous exception during flush. To begin a new transaction with - this Session, first issue Session.rollback(). Original exception was: - (InternalError) index "notifications_pkey" contains unexpected zero page at - block 26 - HINT: Please REINDEX it. - - -**Solution** - -The postgres container should still be running, -so you simply need to run an SQL command to correct the fault. -Before attempting to fix the -database, make a quick backup of it: - -.. code-block:: bash - - date=$(date --rfc-3339=date) - dockerctl shell postgres su - postgres -c 'pg_dumpall --clean' \ - > /root/postgres_backup_$(date +"%F-%T").sql - - -Now try to reindex nailgun database: - -.. code-block:: bash - - dockerctl shell postgres su - postgres -c \ - "psql nailgun -S -c \"select pg_terminate_backend(pid) from pg_stat_activity \ - where datname='nailgun';\"" - - dockerctl shell postgres su - postgres -c "psql nailgun -c 'reindex database nailgun;'" - -Lastly, check proper function: - -.. code-block:: bash - - dockerctl check all - -.. note:: You may need to restart the postgres, keystone, nailgun, nginx - or ostf Docker container - using the **dockerctl restart CONTAINERNAME** command. - -Docker metadata corruption loses containers -+++++++++++++++++++++++++++++++++++++++++++ - -**Diagnosis** - -The following symptoms will be present: - -* Deployment fails for some reason -* One or more Docker containers is missing from docker ps -a -* /var/log/docker contains the following message:: - - Cannot start container fuel-core-6.1-postgres: Error getting container - 273c9b19ea61414d8838772aa3aeb0f6f1b982a74555fb6631adb6232459fe80 from driver - devicemapper: Error writing metadata to - /var/lib/docker/devicemapper/devicemapper/.json325916422: write - /var/lib/docker/devicemapper/devicemapper/.json325916422: no space left on device - -**Solution** - -This solution requires data recovery, described in the Summary above. -It is necessary to recover data manually -using the **dmsetup** and **mount** commands. - -First, you need the full UID of the docker container that was lost. In the log -message above, we can see the ID is -273c9b19ea61414d8838772aa3aeb0f6f1b982a74555fb6631adb6232459fe80. If you are -missing such a message, it can be found this way: - -.. code-block:: bash - - container=postgres - container_id=$(sqlite3 /var/lib/docker/linkgraph.db \ - "select entity_id from edge where name like '%$container%'") - echo $container_id - #should look like: - 273c9b19ea61414d8838772aa3aeb0f6f1b982a74555fb6631adb6232459fe80 - -Once you have the container ID, you need to get the devicemapper block device -ID for the container: - -.. code-block:: bash - - device_id=$(python -c 'import sys; import json; input = json.load(sys.stdin);\ - [sys.stdout.write(str(v["device_id"])) for k, v in input["Devices"].items() if \ - k == sys.argv[1]]' "$container_id" < /var/lib/docker/devicemapper/devicemapper/json) - echo $device_id - -Now activate the volume and mount it: - -.. code-block:: bash - - # Verify the your device_id and container variables are defined - echo $device_id - echo $container - pool=$(echo /dev/mapper/docker*pool) - dmsetup create "${container}_recovery" --table "0 20971520 thin $pool $device_id" - mkdir -p "/mnt/${container}_recovery" - mkdir -p "/root/${container}_recovery" - mount -t ext4 -o rw,relatime,barrier=1,stripe=16,data=ordered,discard \ - "/dev/mapper/${container}_recovery" "/mnt/${container}_recovery" - - -Verify that data is present in the mounted directory: - -* for PostgreSQL: - - .. code-block:: bash - - ls -la /mnt/${container}_recovery/rootfs/var/lib/pgsql/9.3/data/ - -* for Astute: - - .. code-block:: bash - - ls -la /mnt/${container}_recovery/rootfs/var/lib/astute - -* for Cobbler: - - .. code-block:: bash - - ls -la /mnt/${container}_recovery/rootfs/var/lib/cobbler - - -Next, it is necessary to purge the container record from the Docker sqlite -database. You may see an issue when running **dockerctl start CONTAINER**:: - - Abort due to constraint violation: constraint failed - -Run this command before trying to restore the container data -or if you are simply destroying and recreating it: - -.. code-block:: bash - - #Make a backup dump of docker sqlite DB - cp /var/lib/docker/linkgraph.db /root/linkgraph_$(date +"%F-%T").db - container_id=$(sqlite3 /var/lib/docker/linkgraph.db \ - "select entity_id from edge where name like '%$container%'") - echo "Deleting container ID ${container_id}..." - sqlite3 /var/lib/docker/linkgraph.db "delete from entity where\ - id='${container_id}';delete from edge where entity_id='${container_id}';" - -Now perform the following recovery actions, -which vary depending on whether you need to recover data -from Cobbler, Astute, or PostgreSQL: - -For Cobbler: - -.. code-block:: bash - - cp -Rp /mnt/cobbler_recovery/rootfs/var/lib/cobbler /root/cobbler_recovery - dockerctl destroy cobbler - dockerctl start cobbler - dockerctl copy "/root/cobbler_recovery/*" cobbler:/var/lib/cobbler/ - dockerctl restart cobbler - -For PostgreSQL: - -.. code-block:: bash - - cp -Rp /mnt/postgres_recovery/rootfs/var/lib/pgsql /root/postgres_recovery - dockerctl destroy postgres - dockerctl start postgres - dockerctl shell postgres mv /var/lib/pgsql /root/pgsql_old - dockerctl copy /root/postgres_recovery/pgsql postgres:/var/lib/ - dockerctl shell postgres chown -R postgres:postgres /var/lib/pgsql - dockerctl restart postgres keystone nailgun nginx ostf - -You may want to make a PostgreSQL backup at this point: - -.. code-block:: bash - - dockerctl shell postgres su - postgres -c 'pg_dumpall --clean' \ - > /root/postgres_backup_$(date +"%F-%T").sql - -To recover a corrupted PostgreSQL database, -you can import the dump to another PostgreSQL installation with the same version, -as on fuel master(in 6.0 it is 9.3.5) -There you can get a clean dump -that you then import to your PostgreSQL container: - -.. code-block:: bash - - yum install postgresql-server - cp -rf data/ /var/lib/pgsql/ - service postgresql start - su - postgres -c 'pg_dumpall --clean' > dump.sql - service postgresql stop - -Now import the *dump.sql* file to the postgres container's database: - -.. code-block:: bash - - dockerctl shell postgres su - postgres -c "psql nailgun" < dump.sql - -For Astute: - -.. code-block:: bash - - cp -Rp /mnt/astute_recovery/var/lib/astute /root/astute_recovery - dockerctl destroy astute - dockerctl start astute - dockerctl copy "/var/lib/astute/*" astute:/var/lib/astute/ - dockerctl restart astute - -Finally, clean up the recovery mount point: - -.. code-block:: bash - - umount "/mnt/${container}_recovery" - dmsetup clear $device_id - - -Read-only containers -++++++++++++++++++++ - -**Symptoms** - -* Fuel Web UI does not work -* Fuel CLI fails to report any commands -* Some containers may be failing and stopped -* Trying to run **dockerctl shell CONTAINER touch /root/test** results in - "Read-only filesystem" error - -**Solution** - -Because of bugs in docker-io 0.10, -the only way to correct this issue is to restart the Fuel Master node. -If it still fails with the same issue, -you may have a corrupt filesystem. -See the next section for more details. - -Corrupt ext4 filesystem on Docker container -+++++++++++++++++++++++++++++++++++++++++++ - -**Symptoms** - -Error:: - - Cannot start container fuel-core-6.1-rsync: Error getting container - df5f1adfe6858a13b0a9fe81217bf7db33d41a3d4ab8088d12d4301023d4cca3 from driver - devicemapper: Error mounting - '/dev/mapper/docker-253:2-341202-df5f1adfe6858a...d41a3d4ab8088d12d4301023d4cca3' - on - '/var/lib/docker/devicemapper/mnt/df5f1adfe6858a...d41a3d4ab8088d12d4301023d4cca3': - invalid argument - -**Solution** - -If the container affected is stateful, it is necessary to recover the data. -Otherwise, you can simply destroy and recreate stateless containers. - -For stateless containers: - -.. code-block:: bash - - container="rsync" # Change container name - dockerctl destroy $container - dockerctl start $container - -For stateful containers: - -.. code-block:: bash - - container_id=$(sqlite3 /var/lib/docker/linkgraph.db \ - "select entity_id from edge where name like '%$container%'") - echo $container_id - umount -l /dev/mapper/docker-*$container_id - fsck -y /dev/mapper/docker-*$container_id - dockerctl start $container diff --git a/pages/operations/troubleshoot/9100-tshoot-corosync-pacemaker.rst b/pages/operations/troubleshoot/9100-tshoot-corosync-pacemaker.rst deleted file mode 100644 index bd78ef41b..000000000 --- a/pages/operations/troubleshoot/9100-tshoot-corosync-pacemaker.rst +++ /dev/null @@ -1,21 +0,0 @@ -.. index:: HowTo: Troubleshoot Corosync/Pacemaker - -.. _tshoot-corosync-ops: - -How To Troubleshoot Corosync/Pacemaker --------------------------------------- - -Pacemaker and Corosync come with several CLI utilities that can help you -troubleshoot and understand what is going on. - -.. note:: In Mirantis OpenStack 6.0 and later, - multiple :ref:`L3 agents` are configured as clones, - one on each Controller. - When troubleshooting Corosync and Pacemaker, - the **clone_p_neutron-l3-agent** resource - (new in 6.0) is used to act on all L3 agent clones in the environment. - The **p_neutron-l3-agent** resource is still provided, - to act on a specific resource on a specific Controller node; - -.. include:: /pages/operations/troubleshoot/9105-crm-resources.rst - diff --git a/pages/operations/troubleshoot/9105-crm-resources.rst b/pages/operations/troubleshoot/9105-crm-resources.rst deleted file mode 100644 index a0749aaca..000000000 --- a/pages/operations/troubleshoot/9105-crm-resources.rst +++ /dev/null @@ -1,315 +0,0 @@ - -.. _crm-ops: - -crm - Cluster Resource Manager -++++++++++++++++++++++++++++++ - -The **crm** utility shows you the state of the :ref:`Pacemaker` -cluster and can be used for maintenance and to analyze whether the cluster is -consistent. This section discusses some frequently-used commands. - -**crm status** - -This command shows you the main information about the Pacemaker cluster and -the state of the resources being managed. - -On the conrtoller node run:: - - root@node-1:~# crm - -Then run the :command:`status` command:: - - crm(live)# - crm(live)# status - -Example of the output for the above command:: - - ============ - Last updated: Tue Jun 23 08:47:23 2015 - Last change: Mon Jun 22 17:24:32 2015 - Stack: corosync - Current DC: node-1.domain.tld (1) - partition with quorum - Version: 1.1.12-561c4cf - 3 Nodes configured - 43 Resources configured - ============ - - Online: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - - Clone Set: clone_p_vrouter [p_vrouter] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - vip__management (ocf::fuel:ns_IPaddr2): Started node-1.domain.tld - vip__public_vrouter (ocf::fuel:ns_IPaddr2): Started node-1.domain.tld - vip__management_vrouter (ocf::fuel:ns_IPaddr2): Started node-1.domain.tld - vip__public (ocf::fuel:ns_IPaddr2): Started node-2.domain.tld - Master/Slave Set: master_p_conntrackd [p_conntrackd] - Masters: [ node-1.domain.tld ] - Slaves: [ node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_haproxy [p_haproxy] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_dns [p_dns] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_mysql [p_mysql] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Master/Slave Set: master_p_rabbitmq-server [p_rabbitmq-server] - Masters: [ node-1.domain.tld ] - Slaves: [ node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_heat-engine [p_heat-engine] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-plugin-openvswitch-agent [p_neutron-plugin-openvswitch-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-dhcp-agent [p_neutron-dhcp-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-metadata-agent [p_neutron-metadata-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-l3-agent [p_neutron-l3-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_ntp [p_ntp] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_ping_vip__public [ping_vip__public] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - -Or run the :command:`crm status` command on the controller node:: - - root@node-1:~# crm status - -Example of the output for the above command:: - - ============ - Last updated: Tue Jun 23 08:47:52 2015 - Last change: Mon Jun 22 17:24:32 2015 - Stack: corosync - Current DC: node-1.domain.tld (1) - partition with quorum - Version: 1.1.12-561c4cf - 3 Nodes configured - 43 Resources configured - ============ - - Online: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - - Clone Set: clone_p_vrouter [p_vrouter] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - vip__management (ocf::fuel:ns_IPaddr2): Started node-1.domain.tld - vip__public_vrouter (ocf::fuel:ns_IPaddr2): Started node-1.domain.tld - vip__management_vrouter (ocf::fuel:ns_IPaddr2): Started node-1.domain.tld - vip__public (ocf::fuel:ns_IPaddr2): Started node-2.domain.tld - Master/Slave Set: master_p_conntrackd [p_conntrackd] - Masters: [ node-1.domain.tld ] - Slaves: [ node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_haproxy [p_haproxy] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_dns [p_dns] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_mysql [p_mysql] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Master/Slave Set: master_p_rabbitmq-server [p_rabbitmq-server] - Masters: [ node-1.domain.tld ] - Slaves: [ node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_heat-engine [p_heat-engine] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-plugin-openvswitch-agent [p_neutron-plugin-openvswitch-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-dhcp-agent [p_neutron-dhcp-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-metadata-agent [p_neutron-metadata-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-l3-agent [p_neutron-l3-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_ntp [p_ntp] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_ping_vip__public [ping_vip__public] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - - -**crm(live)# resource** - -Here you can enter resource-specific commands:: - - root@node-1:~# crm - crm(live)# resource - crm(live)resource# status - -Example of the output for the above command:: - - Clone Set: clone_p_vrouter [p_vrouter] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - vip__management (ocf::fuel:ns_IPaddr2): Started - vip__public_vrouter (ocf::fuel:ns_IPaddr2): Started - vip__management_vrouter (ocf::fuel:ns_IPaddr2): Started - vip__public (ocf::fuel:ns_IPaddr2): Started - Master/Slave Set: master_p_conntrackd [p_conntrackd] - Masters: [ node-1.domain.tld ] - Slaves: [ node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_haproxy [p_haproxy] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_dns [p_dns] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_mysql [p_mysql] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Master/Slave Set: master_p_rabbitmq-server [p_rabbitmq-server] - Masters: [ node-1.domain.tld ] - Slaves: [ node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_heat-engine [p_heat-engine] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-plugin-openvswitch-agent [p_neutron-plugin-openvswitch-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-dhcp-agent [p_neutron-dhcp-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-metadata-agent [p_neutron-metadata-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_neutron-l3-agent [p_neutron-l3-agent] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_p_ntp [p_ntp] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - Clone Set: clone_ping_vip__public [ping_vip__public] - Started: [ node-1.domain.tld node-2.domain.tld node-3.domain.tld ] - -**crm(live)resource# start|restart|stop|cleanup ** - -These commands, in order, allow you to start, stop, and restart resources. - -**crm(live)resource#cleanup** - -The cleanup command resets a resource's state on the node if it is currently -in a failed state because of some unexpected operation, such as some side -effects of a System V **init** operation on the resource. If this happens, -Pacemaker can do the clean-up, deciding which node will run the resource. - -Example:: - - 3 Nodes configured, 3 expected votes - 3 Resources configured. - ============ - - 3 Nodes configured, 3 expected votes - 16 Resources configured. - - - Online: [ controller-01 controller-02 controller-03 ] - - vip__management (ocf::heartbeat:IPaddr2): Started controller-01 - vip__public (ocf::heartbeat:IPaddr2): Started controller-02 - Clone Set: clone_p_haproxy [p_haproxy] - Started: [ controller-01 controller-02 controller-03 ] - Clone Set: clone_p_mysql [p_mysql] - Started: [ controller-01 controller-02 controller-03 ] - Clone Set: clone_p_neutron-openvswitch-agent [p_neutron-openvswitch-agent] - Started: [ controller-01 controller-02 controller-03 ] - Clone Set: clone_p_neutron-metadata-agent [p_neutron-metadata-agent] - Started: [ controller-01 controller-02 controller-03 ] - Clone Set: clone_p_neutron-metadata-agent [p_neutron-dhcp-agent] - Started: [ controller-01 controller-02 controller-03 ] - p_neutron-dhcp-agent (ocf::mirantis:neutron-agent-dhcp): Started controller-01 - Clone Set: clone_p_neutron-l3-agent [p_neutron-l3-agent] - Started: [ controller-01 controller-02 controller-03 ] - -In this case, **crm** found residual OpenStack agent processes that had been -started by Pacemaker because of network failure and cluster partitioning. -After the restoration of connectivity, Pacemaker saw these duplicate resources -running on different nodes. You can let it clean up this situation -automatically or, if you do not want to wait, cleanup them manually. - -For more information, see `crm interactive help and documentation -`_. - -Sometimes a cluster gets split into several parts. In this case, ``crm status`` -shows something like this:: - - On ctrl1 - ============ - …. - Online: [ ctrl1 ] - - On ctrl2 - ============ - …. - Online: [ ctrl2 ] - - On ctrl3 - ============ - …. - Online: [ ctrl3 ] - - -You can troubleshoot this by checking connectivity between nodes. -Look for the following: - -#. By default Fuel configures corosync over UDP. Security Appliances shouldn't - block UDP traffic for 5404, 5405 ports. Deep traffic inspection should be - turned off for these ports. These ports should be accepted on the management - network between all controllers. - -#. Corosync should start after the network interfaces are activated. - -#. `bindnetaddr` should be located in the management network - or at least in the same reachable segment. - -**corosync-cfgtool -s** - -This command displays the cluster connectivity status.:: - - Printing ring status. - Local node ID 50490378 - RING ID 0 - id = 10.107.0.8 - status = ring 0 active with no faults - -FAULTY status indicates connectivity problems. - -**corosync-objctl** - -This command can get/set runtime Corosync configuration values including the -status of Corosync redundant ring members:: - - runtime.totem.pg.mrp.srp.members.134245130.ip=r(0) ip(10.107.0.8) - runtime.totem.pg.mrp.srp.members.134245130.join_count=1 - ... - runtime.totem.pg.mrp.srp.members.201353994.ip=r(0) ip(10.107.0.12) - runtime.totem.pg.mrp.srp.members.201353994.join_count=1 - runtime.totem.pg.mrp.srp.members.201353994.status=joined - -If the IP of the node is 127.0.0.1, it means that Corosync started when only -the loopback interface was available and bound to it. - -If the members list contains only one IP address or is incomplete, it indicates -that there is a Corosync connectivity issue because this node does not see the -other ones. - -As **no-quorum-policy** is set to **stop** on fully functioning cluster, -Pacemaker will stop all resources on quorumless partition. If quorum is present, -the cluster will function normally, allowing to drop minor set of controllers. -This eliminates split-brain scenarios where nodes doesn't have quorum or -can't see each other. - -In some scenarios, such as manual cluster recovery, **no-quorum-policy** can be -set to **ignore**. This setting allows operator to start operations on single -controller rather than waiting for for quorum. - -.. code-block :: bash - - pcs property set no-quorum-policy=ignore - -Once quorum or cluster is restored, **no-quorum-policy** should be set back to -its previous value. - -Also, Fuel temporarily sets **no-quorum-policy** to **ignore** when -Cloud Operator adds/removes a controller node to the cluster. -This is required for scenarios when Cloud Operator adds more controller nodes -than the cluster currently consist of. Once addition/removal of new controller -node is done, Fuel sets **no-quorum-policy** to **stop** value. - -It's also recommended to configure fencing (STONITH) for Pacemaker cluster. -That could be done manually or with help of Fencing plugin[1]_ for Fuel. -When STONITH enabled, **no-quorum-policy** could be set to **suicide** as well. -When set to **suicide**, the node will shoot itself and any other nodes in the -partition without quorum - but it won't try to shoot the nodes it can't see. -When set to **ignore** (or when it has quorum), it will shoot anyone it can't see. -For any other value, it won't shoot anyone when it doesn't have quorum. - -Furthermore, Corosync will always try to automatically restore the cluster back -into single partition and start all of the resources, if any were stopped, unless -some controller nodes are damaged (cannot run the Corosync service for example). -Such nodes cannot join back the cluster and must be fenced by the STONITH daemon. -That is why production cluster should always have a fencing enabled. - -.. [1] `Fencing plugin `_ diff --git a/pages/operations/troubleshoot/9110-verify-neutron-ha-crm.rst b/pages/operations/troubleshoot/9110-verify-neutron-ha-crm.rst deleted file mode 100644 index 626817c65..000000000 --- a/pages/operations/troubleshoot/9110-verify-neutron-ha-crm.rst +++ /dev/null @@ -1,110 +0,0 @@ -.. index:: HowTo: Functional tests for HA - -.. _crm-verify-neutron: - -How to verify that Neutron HA is working -++++++++++++++++++++++++++++++++++++++++ - -To verify that Neutron HA is working, -simply shut down the node hosting the Neutron agents -(either gracefully or with a hard shutdown). -You should see agents start on the other node: - -.. code-block: sh - - # crm status - - Online: [ node-2.test.domain.local node-3.test.domain.local ] OFFLINE: [ node-1.test.domain.local ] - - vip__public (ocf::mirantis:ns_IPaddr2): Started node-2.test.domain.local - Clone Set: clone_ping_vip__public [ping_vip__public] - Started: [ node-2.test.domain.local node-3.test.domain.local ] - vip__management (ocf::mirantis:ns_IPaddr2): Started node-3.test.domain.local - Clone Set: clone_p_heat-engine [p_heat-engine] - Started: [ node-2.test.domain.local node-3.test.domain.local ] - Master/Slave Set: master_p_rabbitmq-server [p_rabbitmq-server] - Masters: [ node-2.test.domain.local ] - Slaves: [ node-3.test.domain.local ] - Clone Set: clone_p_neutron-plugin-openvswitch-agent [p_neutron-plugin-openvswitch-agent] - Started: [ node-2.test.domain.local node-3.test.domain.local ] - Clone Set: clone_p_neutron-dhcp-agent [p_neutron-dhcp-agent] - Started: [ node-2.test.domain.local node-3.test.domain.local ] - Clone Set: clone_p_neutron-metadata-agent [p_neutron-metadata-agent] - Started: [ node-2.test.domain.local node-3.test.domain.local ] - Clone Set: clone_p_neutron-l3-agent [p_neutron-l3-agent] - Started: [ node-2.test.domain.local node-3.test.domain.local ] - Clone Set: clone_p_mysql [p_mysql] - Started: [ node-2.test.domain.local node-3.test.domain.local ] - Clone Set: clone_p_haproxy [p_haproxy] - Started: [ node-2.test.domain.local node-3.test.domain.local ] - -and see corresponding Neutron interfaces on the new Neutron node:: - - # ip link show - - 11: tap7b4ded0e-cb: mtu 1500 qdisc - 12: qr-829736b7-34: mtu 1500 qdisc - 13: qg-814b8c84-8f: mtu 1500 qdisc - -You can also check ``ovs-vsctl show output`` -to see that all corresponding tunnels/bridges/interfaces -are created and connected properly:: - - ce754a73-a1c4-4099-b51b-8b839f10291c - Bridge br-mgmt - Port br-mgmt - Interface br-mgmt - type: internal - Port "eth1" - Interface "eth1" - Bridge br-ex - Port br-ex - Interface br-ex - type: internal - Port "eth0" - Interface "eth0" - Port "qg-814b8c84-8f" - Interface "qg-814b8c84-8f" - type: internal - Bridge br-int - Port patch-tun - Interface patch-tun - type: patch - options: {peer=patch-int} - Port br-int - Interface br-int - type: internal - Port "tap7b4ded0e-cb" - tag: 1 - Interface "tap7b4ded0e-cb" - type: internal - Port "qr-829736b7-34" - tag: 1 - Interface "qr-829736b7-34" - type: internal - Bridge br-tun - Port "gre-1" - Interface "gre-1" - type: gre - options: {in_key=flow, out_key=flow, remote_ip="10.107.0.8"} - Port "gre-2" - Interface "gre-2" - type: gre - options: {in_key=flow, out_key=flow, remote_ip="10.107.0.5"} - Port patch-int - Interface patch-int - type: patch - options: {peer=patch-tun} - Port "gre-3" - Interface "gre-3" - type: gre - options: {in_key=flow, out_key=flow, remote_ip="10.107.0.6"} - Port "gre-4" - Interface "gre-4" - type: gre - options: {in_key=flow, out_key=flow, remote_ip="10.107.0.7"} - Port br-tun - Interface br-tun - type: internal - ovs_version: "1.4.0+build0" - diff --git a/pages/operations/troubleshoot/9120-corosync-crashes.rst b/pages/operations/troubleshoot/9120-corosync-crashes.rst deleted file mode 100644 index b38e6eaee..000000000 --- a/pages/operations/troubleshoot/9120-corosync-crashes.rst +++ /dev/null @@ -1,61 +0,0 @@ -Corosync crashes without network connectivity -+++++++++++++++++++++++++++++++++++++++++++++ - -Depending on a wide range of systems and configurations in the network, -it is possible for Corosync's networking protocol, Totem, to time out. -If this happens for an extended period of time, Corosync may crash. -In addition, MySQL may have stopped. -This guide illustrates the process of working through -issues with Corosync and MySQL. - -**Workaround:** - -#. Verify that Corosync is really broken: - - .. code-block:: console - - service corosync status - - * You should see this error: - - .. code-block:: console - - corosync dead but pid file exists - -#. Start Corosync manually: - - .. code-block:: console - - service corosync start - -#. Run the following command: - - .. code-block:: console - - ps -ef | grep mysql - - - and kill ALL(!) **mysqld** and **mysqld_safe** processes. - -#. Wait for Pacemaker to completely start MySQL processes. - - * Check it with the following command: - - .. code-block:: console - - ps -ef | grep mysql - - * If it doesn't start, run: - - .. code-block:: console - - crm resource p_mysql - -#. To verify that this host is a member - of the cluster and that **p_mysql** - does not contain any "Failed actions", - run the following command: - - .. code-block:: console - - crm status diff --git a/pages/operations/troubleshoot/9140-amqp.rst b/pages/operations/troubleshoot/9140-amqp.rst deleted file mode 100644 index 10ea0545e..000000000 --- a/pages/operations/troubleshoot/9140-amqp.rst +++ /dev/null @@ -1,167 +0,0 @@ -.. index:: HowTo: Troubleshoot AMQP issues - -.. _tshoot-amqp-ops: - -How To Troubleshoot AMQP issues -=============================== - -AMQP is the heart of OpenStack. If something gets wrong with -the messaging layer, normally an OpenStack application can tolerate -this by issuing reconnects, reporting some requests as failed or -retrying them. While this depends on the particular application -and the underlying Oslo messaging library design, there are also some -generic health checks and troubleshooting steps for operators to -know and to do. - -Check if there is a problem in the Corosync/Pacemaker layer ------------------------------------------------------------ - -Normally, failures of the RabbitMQ multistate resource are automatically -fixed by Corosync and Pacemaker. But if a failure cannot be automatically fixed -for some reason, the master_p_rabbitmq-server resource status will be considered "bad". -The status is considered "good" when there exists a single master for the -master_p_rabbitmq-server and the rest of the resource instances are reported -as slaves. Note, that the command ``pcs status`` issued on all controllers -should be enough to gather all the required information, see :ref:`crm-ops`. -You can also try issuing an extended output with the crm tool alternative: - -:: - - crm_mon -fotAW -1 - -If there are some RabbitMQ resource failures, they will -be shown in the command output with the time stamps, so you can -search for the events in the logs around that moment. - -.. note:: If there are split clusters of Corosync running, you should - first fix your Corosync cluster, because you cannot resolve issues with the - Pacemaker resources, including RabbitMQ cluster, when there is a - split brain in the Corosync cluster. - -How to recover -++++++++++++++ - -It is recommended to clean up and restart the master_p_rabbitmq-server -Pacemaker resource, see :ref:`crm-ops`. - -.. note:: Restarting the RabbitMQ Pacemaker resource will introduce - a full downtime for the AMQP cluster and OpenStack applications. - The downtime may take from a few to up to 20 minutes. - -Check if there is a problem in the RabbitMQ layer -------------------------------------------------- - -Normally, failures of the RabbitMQ cluster are automatically healed -by OCF resource agents in Pacemaker. But if this fails for some -reason, there may be unsynchronized queues, wrong cluster membership -reported, or partitions detected by the rabbitmqctl tool, or even -some list channels/queues requests may hang. Note, that the -command ``rabbitmqctl report`` issued on all controllers should be enough -to gather all the required information, but there is also a special group -of Fuel OSTF HA health checks available in the Fuel UI and CLI. See also -`RabbitMQ OSTF replication tests `. - -How to recover -++++++++++++++ - -It is recommended to clean up and restart the master_p_rabbitmq-server -Pacemaker resource, see :ref:`crm-ops`. - -Check if there is a problem in the Oslo messaging layer -------------------------------------------------------- - -Note, that normally an OpenStack application should be able to -reconnect the AMQP host and restore its operations, eventually. -But if it cannot for some reason, there may be "down" status reports -or failures of CLI commands and messaging related or -publish/consume message related records in the log files of the OpenStack -services relying on the Oslo messaging library. -For example, there may be records in the log files -similar to the following ones: - -:: - - Timed out waiting for a reply to message... - -How to recover -++++++++++++++ - -It is recommended to restart the affected OpenStack service or -services, see :ref:`manage-openstack-services-op`. - -.. note:: Restarting the OpenStack service will introduce - a short (near to zero) downtime for the related OpenStack application. - -Check if there are AMQP problems with any of the OpenStack components ---------------------------------------------------------------------- - -Note, that normally an OpenStack application should be able to -reconnect the AMQP host and restore its operations, eventually. -But if it cannot for some reason, there may be "down" status reports -or failures of CLI commands and AMQP/messaging related records in the log -files of the services belonging to the affected OpenStack component -under verification. -For Nova, for example, there may be records in the log files in -the /var/log/nova/ directory similar to the following ones: - -:: - - AMQP server on ... is unreachable: [Errno 113] EHOSTUNREACH... - -How to recover -++++++++++++++ - -It is recommended to restart all instances of the OpenStack services -related to the affected OpenStack component, -see :ref:`manage-openstack-services-op`. -For example, for Nova Compute component, you may want to restart all -instances of the Nova services on the Controllers and Compute nodes affected -by the AMQP issue. - - -How to make RabbitMQ OCF script tolerate rabbitmqctl timeouts -------------------------------------------------------------- - -If on a node where RabbitMQ is deployed other processes consume -a significant part of CPU, RabbitMQ starts responding -slow to queries from ``rabbitmqctl`` utility. The utility is -used by the OCF script to monitor the state of the RabbitMQ. -When the utility fails to complete in a pre-defined period of time, -the OCF script considers the RabbitMQ being down and restarts it, -which might lead to a several minutes cloud downtime. Such restarts -are undesirable, as they cause a downtime without any benefit. -To mitigate the issue, you can configure the OCF script to tolerate -certain amount of ``rabbitmqctl`` timeouts in a row using the -following command: - -.. code-block:: console - - crm_resource --resource p_rabbitmq-server --set-parameter \ - max_rabbitmqctl_timeouts --parameter-value N - -Replace N with the number of timeouts. For instance, -if it is set to `3`, the OCF script will tolerate two rabbitmqctl -timeouts in a row, but fail if the third one occurs. - -By default, the parameter is set to `1`, which means ``rabbitmqctl`` -timeout is not tolerated at all. The downside of increasing the -parameter is a delay in restarting RabbitMQ when it is down. -For example, if a real issue occurs and causes a ``rabbitmqctl`` -timeout, the OCF script will detect that only after N monitor runs -and then restart RabbitMQ, which might fix the issue. - -To understand that RabbitMQ's restart was caused by a ``rabbitmqctl`` -timeout, you should examine `lrmd.log` of the corresponding Controller -on the Fuel Master node in `/var/log/docker-logs/remote/ directory` -for the presence of the following lines: - -:: - - "the invoked command exited 137: /usr/sbin/rabbitmqctl list_channels ..." - -This indicates a rabbitmqctl timeout. The next line will explain if it -caused restart or not. For example: - -:: - - "rabbitmqctl timed out 2 of max. 3 time(s) in a row. Doing nothing for now." diff --git a/pages/operations/troubleshoot/9200-openstack-api-timeout.rst b/pages/operations/troubleshoot/9200-openstack-api-timeout.rst deleted file mode 100644 index 692f1df95..000000000 --- a/pages/operations/troubleshoot/9200-openstack-api-timeout.rst +++ /dev/null @@ -1,66 +0,0 @@ -Timeout In Connection to OpenStack API From Client Applications ---------------------------------------------------------------- - -If you use Java, Python or any other code to work with OpenStack API, all -connections should be done over OpenStack Public network. To explain why we -can not use Fuel network, let's try to run nova client with debug -option enabled:: - - [root@controller-6 ~]# nova --debug list - - REQ: curl -i http://192.168.0.2:5000/v2.0/tokens -X POST -H "Content-Type: appli - cation/json" -H "Accept: application/json" -H "User-Agent: python-novaclient" -d - '{"auth": {"tenantName": "admin", "passwordCredentials": {"username": "admin", - "password": "admin"}}}' - - INFO (connectionpool:191) Starting new HTTP connection (1): 192.168.0.2 - DEBUG (connectionpool:283) "POST /v2.0/tokens HTTP/1.1" 200 2702 - RESP: [200] {'date': 'Tue, 06 Aug 2013 13:01:05 GMT', 'content-type': 'applicati - on/json', 'content-length': '2702', 'vary': 'X-Auth-Token'} - RESP BODY: {"access": {"token": {"issued_at": "2013-08-06T13:01:05.616481", "exp - ires": "2013-08-07T13:01:05Z", "id": "c321cd823c8a4852aea4b870a03c8f72", "tenant - ": {"description": "admin tenant", "enabled": true, "id": "8eee400f7a8a4f35b7a92 - bc6cb54de42", "name": "admin"}}, "serviceCatalog": [{"endpoints": [{"adminURL": - "http://192.168.0.2:8774/v2/8eee400f7a8a4f35b7a92bc6cb54de42", "region": "Region - One", "internalURL": "http://192.168.0.2:8774/v2/8eee400f7a8a4f35b7a92bc6cb54de4 - 2", "id": "6b9563c1e37542519e4fc601b994f980", "publicURL": "http://172.16.1.2:87 - 74/v2/8eee400f7a8a4f35b7a92bc6cb54de42"}], "endpoints_links": [], "type": "compu - te", "name": "nova"}, {"endpoints": [{"adminURL": "http://192.168.0.2:8080", "re - gion": "RegionOne", "internalURL": "http://192.168.0.2:8080", "id": "4db0e11de35 - 74c889179f499f1e53c7e", "publicURL": "http://172.16.1.2:8080"}], "endpoints_link - s": [], "type": "s3", "name": "swift_s3"}, {"endpoints": [{"adminURL": "http://1 - 92.168.0.2:9292", "region": "RegionOne", "internalURL": "http://192.168.0.2:9292 - ", "id": "960a3ad83e4043bbbc708733571d433b", "publicURL": "http://172.16.1.2:929 - 2"}], "endpoints_links": [], "type": "image", "name": "glance"}, {"endpoints": [ - {"adminURL": "http://192.168.0.2:8776/v1/8eee400f7a8a4f35b7a92bc6cb54de42", "reg - ion": "RegionOne", "internalURL": "http://192.168.0.2:8776/v1/8eee400f7a8a4f35b7 - a92bc6cb54de42", "id": "055edb2aface49c28576347a8c2a5e35", "publicURL": "http:// - 172.16.1.2:8776/v1/8eee400f7a8a4f35b7a92bc6cb54de42"}], "endpoints_links": [], " - type": "volume", "name": "cinder"}, {"endpoints": [{"adminURL": "http://192.168. - 0.2:8773/services/Admin", "region": "RegionOne", "internalURL": "http://192.168. - 0.2:8773/services/Cloud", "id": "1e5e51a640f94e60aed0a5296eebdb51", "publicURL": - "http://172.16.1.2:8773/services/Cloud"}], "endpoints_links": [], "type": "ec2" - , "name": "nova_ec2"}, {"endpoints": [{"adminURL": "http://192.168.0.2:8080/", - "region": "RegionOne", "internalURL": "http://192.168.0.2:8080/v1/AUTH_8eee400f - 7a8a4f35b7a92bc6cb54de42", "id": "081a50a3c9fa49719673a52420a87557", "publicURL - ": "http://172.16.1.2:8080/v1/AUTH_8eee400f7a8a4f35b7a92bc6cb54de42"}], "endpoi - nts_links": [], "type": "object-store", "name": "swift"}, {"endpoints": [{"admi - nURL": "http://192.168.0.2:35357/v2.0", "region": "RegionOne", "internalURL": " - http://192.168.0.2:5000/v2.0", "id": "057a7f8e9a9f4defb1966825de957f5b", "publi - cURL": "http://172.16.1.2:5000/v2.0"}], "endpoints_links": [], "type": "identit - y", "name": "keystone"}], "user": {"username": "admin", "roles_links": [], "id" - : "717701504566411794a9cfcea1a85c1f", "roles": [{"name": "admin"}], "name": "ad - min"}, "metadata": {"is_admin": 0, "roles": ["90a1f4f29aef48d7bce3ada631a54261" - ]}}} - - REQ: curl -i http://172.16.1.2:8774/v2/8eee400f7a8a4f35b7a92bc6cb54de42/servers/ - detail -X GET -H "X-Auth-Project-Id: admin" -H "User-Agent: python-novaclient" - - H "Accept: application/json" -H "X-Auth-Token: c321cd823c8a4852aea4b870a03c8f72" - - INFO (connectionpool:191) Starting new HTTP connection (1): 172.16.1.2 - -Even though initial connection was in 192.168.0.2, the client tries to -access the Public network for Nova API. The reason is because Keystone returns -the list of OpenStack services URLs, and for production-grade deployments it -is required to access services over public network. - diff --git a/pages/operations/upgrade/1000-overview.rst b/pages/operations/upgrade/1000-overview.rst deleted file mode 100644 index b92dc8811..000000000 --- a/pages/operations/upgrade/1000-overview.rst +++ /dev/null @@ -1,138 +0,0 @@ -.. index:: Upgrade Overview - -.. _Upg_Over: - -Overview --------- - -Upgrading Mirantis OpenStack from version 6.1 to version 7.0 involves -building new environment, installing an HA Controller node in that environment, -alongside with the old Controller nodes, switching all compute nodes to the new -controller nodes, and then upgrading the Compute nodes. - -You do not need any new hardware for the upgrade. - -.. warning:: - - During the upgrade, virtual machines and other resources might experience - temporary network disconnects. Schedule the upgrade during a maintenance - window. - -Upgrade Scenario -++++++++++++++++ - -The proposed solution includes the following general steps described -below in more details: - -* OpenStack environment of version 7.0 is created using Fuel API with - the settings and network configurations matching the configuration of - the original 6.1 environment. -* One of the :ref:`Cloud Infrastructure Controllers ` (CICs) - in the original 6.1 environment is deleted and moved to the - 6.1 environment. It is then installed in that environment as - a primary controller side-by-side with the original 6.1 environment. -* All OpenStack platform services are put into :ref:`Maintenance Mode - ` for the whole duration of the upgrade procedure to - prevent user data loss and/or corruption. -* Copy the state databases of all the upgradeable OpenStack components - to the new Controller and upgrade these with the standard - ‘database migration’ feature of OpenStack. -* Reconfigure the Ceph cluster in such a way that the Monitors on the - new 7.0 CICs replace the Monitors of the 6.1 environment, retaining - the original IP addresses and configuration parameters. -* The 7.0 CIC is connected to the Management and External networks, - while the original 6.1 ones are disconnected. The 7.0 CIC takes - over Virtual IPs in the Management and Public :ref:`networks `. -* Control plane services on the Compute nodes in the 6.1 environment - are upgraded to 7.0 without affecting the virtual server instances - and workloads. After the upgrade, the Compute service reconnects to - 7.0 CICs. -* Compute nodes from the 6.1 environment work with the CICs from the - 7.0 environment, forming a temporary hybrid OpenStack environment - that is only used to upgrade the Compute nodes one by one by - re-assigning them to the 7.0 environment and re-installing with - the new version. -* Ceph OSD nodes from the 6.1 environment transparently switch to - the new Monitors without the actual data moving in the Ceph cluster. -* User data stored on OSD nodes must be preserved through - re-installation of the nodes into a new release of the operating - system and OpenStack services, and OSD nodes must connect to the - Monitors without changing their original IDs and data set. - -Every step requires certain actions. All of these actions are scripted -as subcommands to the upgrade script called 'octane'. - -Prerequisites and dependencies -++++++++++++++++++++++++++++++ - -The procedure of upgrading Mirantis OpenStack from 6.1 to 7.0 version -has certain prerequisites and dependencies. You need to verify if your -installation of Mirantis OpenStack meets these requirements. - -Fuel installer -^^^^^^^^^^^^^^ - -Mirantis OpenStack 6.1 environment must be deployed and managed by -Fuel installer to be upgradeable. If you installed your environment -without leveraging Fuel, or removed the :ref:`Fuel Master node ` -from the installation after a successful deployment, you will not be -able to upgrade your environments using these instructions. - -The upgrade scenario deviates from the standard sequence used in Fuel -installer to deploy Mirantis OpenStack environment. These modifications -to the behavior of the installer are implemented as modifications to the -:ref:`deployment tasks <0010-tasks-schema>` and extensions to certain -components of Fuel. Patches are applied to the Fuel Master node as part -of 'preparation' phase of the Upgrade scenario. See the sections below -for the detailed description of which components are modified and why. - -.. _architecture-constraints: - -Architecture constraints -^^^^^^^^^^^^^^^^^^^^^^^^ - -Make sure that your Mirantis OpenStack 6.1 environment meets -the following architecture constraints. Otherwise, these instructions -will not work for you: - -+----------------------------------------------------+------------------+ -| Constraint | Check if comply | -+====================================================+==================+ -| High Availability architecture | | -+----------------------------------------------------+------------------+ -| Ubuntu 14.04 as an operating system | | -+----------------------------------------------------+------------------+ -| Neutron networking manager with OVS+VLAN plugin | | -+----------------------------------------------------+------------------+ -| Cinder virtual block storage volumes | | -+----------------------------------------------------+------------------+ -| Ceph shared storage for volumes and ephemeral data | | -+----------------------------------------------------+------------------+ -| Ceph shared storage for images and objeсt store | | -+----------------------------------------------------+------------------+ - -Fuel upgrade to 7.0 -^^^^^^^^^^^^^^^^^^^ - -In this guide we assume that the user upgrades Fuel installer from -version 6.1 to 7.0. The upgrade of Fuel installer is a standard -feature of the system. Upgraded Fuel retains the ability to manage -6.1 environments, which is leveraged by the environment upgrade solution. - -Additional hardware -^^^^^^^^^^^^^^^^^^^ - -The upgrade strategy requires installing 7.0 environment that will -result in an OpenStack cluster along with the original environment. -One of the Controller nodes from the original 6.1 environment will -be deleted, added to the new 7.0 environment, and reinstalled. This -allows performing an upgrade with no additional hardware. - -.. note:: - - The trade-off for using one of the existing controllers as a - primary upgraded controller is that the 7.0 environment will - not be highly available for some time during the maintenance - window dedicated to the upgrade. Once the remaining controllers - are moved from the 6.1 environment and reinstalled into the 7.0 - environment, its High Availability is restored. diff --git a/pages/operations/upgrade/1010-quick-start.rst b/pages/operations/upgrade/1010-quick-start.rst deleted file mode 100644 index 4d273cb43..000000000 --- a/pages/operations/upgrade/1010-quick-start.rst +++ /dev/null @@ -1,147 +0,0 @@ -.. index:: Upgrade Environment Quick Start - -.. _Upg_QuickStart: - -Upgrade Environment Quick Start -------------------------------- - -.. CAUTION:: - - Only use this section as a reference. Read the detailed sections - below to understand the upgrade scenario before running any of - the listed commands. - -This section lists commands required to upgrade a 6.1 environment to -version 7.0 with brief comments. For the detailed description of what -each command does and why, see the following sections: - -* :ref:`Detailed upgrade procedure` -* :ref:`Detailed description of commands` - -.. CAUTION:: - - Do not run the following commands unless you understand exactly - what you are doing. It can completely destroy your OpenStack - environment. Please, read the detailed sections below carefully - before you proceed with these commands. - -*1. Install the Upgrade Script* - -Run the following command on the Fuel Master node to download and -install the Upgrade Script in the system: - -:: - - yum install -y fuel-octane - octane prepare - -*2. Pick environment to upgrade* - -Run the following command and pick an environment to upgrade from the -list: - -:: - - fuel2 env list - -Note the ID of the environment and store it in a variable: - -:: - - export ORIG_ID= - -*3. Create an Upgrade Seed environment* - -Run the following command to create a new environment of version 7.0 -and store its ID to a variable: - -:: - - SEED_ID=$(./octane upgrade-env $ORIG_ID) - -*4. Upgrade the first Controller* - -Pick one of the Controllers in your environment by ID and remember -that ID: - -:: - - fuel node list --env ${ORIG_ID} | awk -F\| '$7~/controller/{print($0)}' - -Use the ID of the Controller to upgrade it with the following command: - -:: - - octane upgrade-node --isolated $SEED_ID - -*5. Upgrade State Database* - -After the first Controller in the 7.0 environment is deployed and -ready, run the following command to upgrade the state databases -of the OpenStack services: - -:: - - octane upgrade-db $ORIG_ID $SEED_ID - -*6. Upgrade Ceph cluster* - -Run the following command to upgrade the Monitor node on the new -Controller with the state and configuration of the original Ceph -cluster: - -:: - - octane upgrade-ceph $ORIG_ID $SEED_ID - -*7. Switch control plane to 7.0* - -Run the following command to switch the OpenStack environment to the -7.0 control plane: - -:: - - octane upgrade-controlplane $ORIG_ID $SEED_ID - -*8. Upgrade all Controllers* - -Identify the remaining Controllers in the 6.1 environment by IDs -(ID1, ID2, etc): - -:: - - fuel node list --env ${ORIG_ID} | awk -F\| '$7~/controller/{print($0)}' - -Run the following command to upgrade the remaining 6.1 Controllers -to version 7.0: - -:: - - octane upgrade-node $SEED_ID - -*9. Upgrade Compute and Ceph OSD nodes* - -Repeat the following command for every node in the 6.1 environment -identified by ID: - -:: - - octane upgrade-node $SEED_ID - -*10. Clean up the Fuel Master node* - -When no nodes remain in the 6.1 environment, run the following -command to restore the original state of the 7.0 Fuel Master node: - -:: - - octane cleanup-fuel - -*11. Delete the original 6.1 environment* - -After verification of the upgraded 7.0 environment, delete the -original 6.1 environment with the following command: - -:: - - fuel env --env $ORIG_ID --delete diff --git a/pages/operations/upgrade/2000-solution-overview.rst b/pages/operations/upgrade/2000-solution-overview.rst deleted file mode 100644 index 13d03a15b..000000000 --- a/pages/operations/upgrade/2000-solution-overview.rst +++ /dev/null @@ -1,345 +0,0 @@ -.. index:: Upgrade Solution - -.. _Upg_Sol: - -Solution Overview ------------------ - -This section describes a solution that implements the upgrade strategy -outlined in the previous section. It gives a step by step script of the -procedure and explains every step of it. In the chapters that follow we -will give detailed scripts with exact commands to upgrade your cluster. - -Hardware considerations -+++++++++++++++++++++++ - -For Mirantis OpenStack with :ref:`High Availability Reference Architecture -` using at least 3 CICs is recommended. When you -install a 7.0 Seed environment in HA mode, you can start with only 1 -Controller. This procedure assumes that the node for this Controller is -borrowed from the set of the Controllers in the original 6.1 -environment. - -Preparations and prerequisites -++++++++++++++++++++++++++++++ - -Before starting the upgrade itself, make sure that your system complies -to the :ref:`architecture constraints ` -listed above. You will also need to make some preparations to provide -prerequisites for the upgrade procedure. These preparations are -automated using the Upgrade Script named ``octane``. - -Install the upgrade script on the Fuel Master node using ``yum``: - -:: - - yum install fuel-octane - -Create 7.0 Seed environment -++++++++++++++++++++++++++++ - -Our concept of the upgrade involves installing a CIC of version 7.0 -side-by-side with the cloud being upgraded. We leverage Fuel installer -for the task of deployment of nodes with 7.0 versions. - -The way we create the upgraded environment is different from the way -the ordinary OpenStack cluster is installed by Fuel 7.0. This section -explains the specifics of the deployment of such a 'shadow' environment, -also referred to as Upgrade Seed environment in this section. - -Clone configuration of 6.1 environment -^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -The first step in the upgrade procedure is to install a new 7.0 Upgrade -Seed environment. The settings and attributes of the Seed environment -must match the settings of the original environment, with the changes -corresponding to the changes in the data model of Nailgun between -releases. - -As part of the upgrade procedure automation, an extension to Nailgun -API was developed. This extension implements a resource -``/api/v1/cluster/<:id>/upgrade/clone`` which creates an Upgrade Seed -environment based on the settings of the original one -(identified by the ``id`` parameter). - -A ``POST`` request to that resource must be sent to initiate the -upgrade procedure. - -An extension to the Fuel client was developed that allows sending -the request from the CLI of the Fuel Master node. - -Fuel client extension is installed in the -:ref:`preparation phase ` of the upgrade procedure. - -Install 7.0 CIC -+++++++++++++++ - -When the Fuel Master node and Upgrade Seed environment are prepared, -you can start upgrading your 6.1 environment. First you need to pick -a Controller node in the original environment. Upgrade script will -move that node into the Upgrade Seed environment and reinstall it as -a primary controller in that environment. - -The Fuel installer deploys the Cloud Controller in a Seed environment -with the following changes: - -* 7.0 Controller will be isolated from the Management and Public - networks on the data link layer (L2) to avoid conflicts with the - Virtual IPs in the original 6.1 Controllers. - -The nature of network isolation defines many aspects of the deployment -process. To understand how it could be implemented, we need to analyze -the configuration of the internal networking of Cloud Infrastructure -Controller. - -Fuel creates virtual bridges that connect the host to networks with -different roles. Physical interfaces (e.g. ``eth1``) are added to those -bridges creating L2 connections to the corresponding networks. - -On the other hand, L3 IP address is assigned to virtual bridge -to the network of a given type. A virtual bridge to connect to -Management network is called ``br-mgmt``, to Public network - -``br-ex``, and so on. - -To install 7.0 Controller in isolation from these networks, the script -configures the deployment information for the node in a way that -physical interfaces are not added to certain virtual bridges when -OpenStack is being deployed. - -This ensures that the Controller has no physical connection to Management -and Public network. - -Using Fuel for isolated deployment -^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -Fuel is responsible for the assignment of IP addresses to logical -interfaces in the Management, Public and other types of networks. -The environment cloning function in Nailgun API does copy the IP -ranges and Virtual IP addressses of the original cluster. - -Fuel configures Linux bridges and interfaces during the deployment of an -environment. This configuration is managed by Puppet and is defined in -the deployment settings. You can modify these settings to disable -adding of certain physical interface to the bridge. - -For deployment to succeed with the described schema, you need to ensure -that no network checks break the installation by disabling a check for -connectivity to the default gateway. Fuel installer expects the gateway -to be in the Public network, which is not directly accessible from our -isolated Controller. - -The exact commands to create an isolated Upgrade Seed environment are -listed in the :ref:`Upgrade Script ` chapter. - -Initial state of Ceph cluster -^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -According to the upgrade scenario, Ceph cluster must be installed in -a way that allows for replacing the original Monitors of the 6.1 -environment with the new Monitors when 7.0 CICs take over. There is -a way to install a cluster without OSD nodes and thus rule out the -rebalance and data movement once the original OSD nodes start joining -the cluster. However, it requires that the upload of the test VM image -by Fuel is disabled before the deployment. We achieve this by -disabling the corresponding tasks in the deployment graph: -``upload_cirros`` and ``check_ceph_ready``. - -Maintenance Mode -++++++++++++++++ - -During the installation of 7.0 Seed cloud the original 6.1 environment -continues to operate normally. Seed CIC do not interfere with the -original CICs and the latter could continue the operation through -the initial stages of the upgrade. - -However, when it comes to the upgrade of state databases of -OpenStack services, you need to make sure that no changes are made -to the state data. Maintenance mode must be started before you download -data from the state database of 6.1 OpenStack environment. -Maintenance mode should last at least until the database upgrade is -finished and 7.0 CICs take over the environment. - -Note that Maintenance mode implemented according to these instructions -does not impact operations of existing virtual server instances and -other resources. It only affects OpenStack API endpoints which are the -only way for the end user to change the state data of the cluster. - -High Availability architecture of Mirantis OpenStack provides access to -all OpenStack APIs at a single VIP address via HAProxy load balancer. -You need to configure HAProxy server to return code ``HTTP 503`` on -all requests to the services listening on the Public VIP in 6.1 -environment. This will not allow users to change the state of the -virtual resources in the original cloud which can be lost after the -data is downloaded from DB. - -On 7.0 CIC, you must disable all OpenStack component services to make -sure that they do not write to the state database while it is being -upgraded. Otherwise, this might lead to data corruption and loss. - -All the detailed commands used to put environments into Maintenance -mode are listed in the Upgrade Script chapter below. - -Upgrade databases -+++++++++++++++++ - -Database upgrade is a standard procedure provided by OpenStack upstream -as a main upgrade feature. It allows converting data from state -databases of all OpenStack component services from a previous to a new -release version schema. It is necessary to fully preserve the status of -the virtual resources provided by the cloud through the upgrade -procedure. - -The data is dumped from MySQL database on one of the CIC nodes in 6.1 -environment. A text dump of the database is compressed and sent over -to CIC node in 7.0 environment. - -After uploading the data to MySQL on 7.0 CIC, use standard OpenStack -methods to upgrade the database schema to the new release. Specific -commands that upgrade the schema for particular components of the -platform are listed in the Upgrade Script chapter below. - -Configure Ceph Monitors -+++++++++++++++++++++++ - -Architecture constraints for the upgrade procedure define that in the -upgradeable configuration Ceph is used for all types of storage in the -OpenStack platform: ephemeral storage, permanent storage, object -storage and Glance image store. Ceph Monitors are essential for the -Ceph cluster and must be upgraded seamlessly and transparently. - -By default, Fuel installer creates a new Ceph cluster in the 7.0 Seed -environment. You need to copy the configuration of the cluster from -6.1 environment to override the default configuration. This will -allow OSD nodes from 6.1 environment to switch to the new Monitors -when 7.0 CICs take over the control plane of the upgraded environment. - -The Upgrade Script synchronizes the configuration of Ceph Monitors in -the 6.1 and 7.0 clusters during the upgrade procedure. - -Upgrade Control Plane -+++++++++++++++++++++ - -This step is called 'Upgrade', as it concludes with a new CIC of -version 7.0 listening on the same set of IP addresses as the original -6.1 CICs. However, from the technical standpoint it is more of a -switch to a new version of control plane. 7.0 Controller takes over the -Virtual IP addresses of 6.1 environment, while the original CICs are -disconnected from all networks except Admin. The sections that follow -explain what happens and why at every stage of the upgrade process. - -Start OpenStack services on 7.0 Controller -^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -As part of Maintenance mode, OpenStack component services were shut -down on 7.0 CIC before upgrading the database. These services include -Nova, Glance, Keystone, Neutron and Cinder. Now it is time to restore -them with a new data set created by the database migration procedure. -This operation basically reverts the shutdown operation described above. -It is automated in the Upgrade Script. - -Note that Neutron restart involves creation of tenant networking -resources on CIC nodes where Neutron agents run. This process can -take longer than starting all other services, so check it carefully -before you proceed with the upgrade. - -Delete ports on 6.1 Controllers -^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -Before 7.0 CIC can take over the virtual network addresses in the -upgraded environment, you need to disconnect 6.1 CICs to release -those addresses. Based on the CICs networking schema described above, -to do that you need to delete patch ports from certain OVS bridges. - -This procedure is automated by the upgrade script and executed as part -of the ``upgrade-cics`` subcommand. - -Connect 7.0 Controller -^^^^^^^^^^^^^^^^^^^^^^ - -After 6.1 CICs are disconnected from all networks in the environment, -7.0 CIC can take over their former VIP addresses. The take-over -procedure adds physical ports to the appropriate bridges and brings -the ports up. - -Upgrade hypervisor host -+++++++++++++++++++++++ - -Hypervisor hosts provide their physical resources to run virtual -machines. Physical resources are managed by hypervisor software, -usually 'libvirt' and 'qemu-kvm' packages. With KVM hypervisor, -all virtualization tasks are handled by the Linux kernel. Open vSwitch -provides L2 network connectivity to virtual machines. All together, -kernel, hypervisor and OVS constitute a data plane of Compute service. - -You can upgrade data-plane software on a hypervisor host (or Compute -node) by re-installing the operating system to a new version with Fuel -installer. However, the deployment process takes time and impacts the -virtual machines. To minimize the impact, leverage live migration to -move all virtual machines from the Compute node before you start -upgrading it. You can do that since Compute node's control plane is -upgraded to 7.0. - -Nailgun API extension installed by the Upgrade Script allows to move -a node to the Upgrade Seed environment in runtime. It preserves the ID -of the node, its hostname and configurations of its disks and -interfaces. - -When a node is added to the upgraded environment, the script provisions -the node. When the provisioning is finished, the script runs the -deployment of the node. As a result of the deployment, the node will -be added to the environment as a fully capable Mirantis -OpenStack 7.0 Compute node. - -Upgrade of a single Compute node must be repeated for all the nodes -of 6.1 environment in a rolling fashion. VMs must be gradually moved -from the remaining 6.1 Compute nodes to the 7.0 ones with live -migration. - -Upgrade Ceph OSD node -+++++++++++++++++++++ - -In a Ceph cluster all data is stored on OSD nodes. These nodes have one -or more storage devices (or disk partitions) dedicated to Ceph data and -run ceph-osd daemon that is responsible for I/O operations on Ceph data. - -Upgrading OSD node via Fuel means that the node must be redeployed. Per -the requirement to minimize end-user impact and the move of data across -the OpenStack cluster being upgraded, we developed a procedure to -redeploy Ceph OSD nodes with the original data set. Although Fuel -by default erases all data from disks of the node it deploys, you can -patch and configure the installer to keep Ceph data on the devices -intact. - -There are several stages of the deployment when the data is erased from -all disks in the Ceph OSD node. First, when you delete a Ceph node, -Nailgun agent on that node does the erasing on all non-removable disks -by writing 0s to the first 10MB of every disk. Then, at the provisioning -stage, Ubuntu installer creates partitions on disks and formats them -according to the disks configuration provided by Fuel orchestration -components. - -As part of the upgrade procedure, we provide patches for the components -involved in volumes management that allow to keep data on certain -partitions or disks. These patches are applied automatically by the -Upgrade Script. - -Disable rebalance -^^^^^^^^^^^^^^^^^ - -By default, Ceph initiates rebalance of data when OSD node goes down. -Rebalancing means that the data of replicas is moved between the -remaining nodes, which takes significant time and impacts end user's -virtual machines and workloads. We disable the rebalance and -recalculation of CRUSH maps when OSD node goes down. When a node is -reinstalled, OSD connects to Ceph cluster with the original data set. - -Finalizing the upgrade -++++++++++++++++++++++ - -When all nodes are reassigned to the 7.0 environment and upgraded, -it is time to finalize the upgrade procedure with a few steps that allow -Fuel installer to manage with the upgraded environment just as with -vanilla 7.0 environment, installed from scratch: - -* revert all patches applied to Fuel components; -* delete the original environment. diff --git a/pages/operations/upgrade/3000-upgrade-script.rst b/pages/operations/upgrade/3000-upgrade-script.rst deleted file mode 100644 index 7a5d13e51..000000000 --- a/pages/operations/upgrade/3000-upgrade-script.rst +++ /dev/null @@ -1,25 +0,0 @@ -.. index:: Upgrade Script - -.. _Upg_Script: - -Upgrade Script Explained ------------------------- - -In this chapter we explain how exactly we implement the steps described -in :ref:`Solution Overview`. Sections of this chapter contain -appendices with listings of commands and scripts that implement each -particular action. - -.. IMPORTANT:: - - * All commands in this section must be executed on the Fuel Master - node, unless specified otherwise. - - * You must use Bourne shell (``bash``) to execute commands. - -.. include:: /pages/operations/upgrade/3010-upgrade-prerequisites.rst -.. include:: /pages/operations/upgrade/3020-prepare-fuel-master.rst -.. include:: /pages/operations/upgrade/3030-clone-env-settings.rst -.. include:: /pages/operations/upgrade/3040-install-seed.rst -.. include:: /pages/operations/upgrade/3050-upgrade-cics.rst -.. include:: /pages/operations/upgrade/3060-upgrade-node.rst diff --git a/pages/operations/upgrade/3010-upgrade-prerequisites.rst b/pages/operations/upgrade/3010-upgrade-prerequisites.rst deleted file mode 100644 index 00206ad65..000000000 --- a/pages/operations/upgrade/3010-upgrade-prerequisites.rst +++ /dev/null @@ -1,103 +0,0 @@ -.. index:: Upgrade Prereq - -.. _Upg_Prereq: - -Upgrade Prerequisites -+++++++++++++++++++++ - -There are certain prerequisites for upgrading Mirantis OpenStack -environment managed by Fuel installer. You need to make sure that -all the requirements are met before proceeding with the procedure. -This section describes prerequisites and gives a list of commands used -to check if the requirements are met. - -Versions of Fuel installer and environment -^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -First, you need to check the versions of Fuel installer and the -environment you've picked for the upgrade. Version of Fuel must be -equal to 7.0. Version of environment must be equal to 6.1. You -can check versions using the Fuel Web UI or CLI client to Fuel API. - -Configuration of environment -^^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -The configuration of the environment picked for the upgrade must -comply to the architecture constraints for the upgrade procedure. -You can check the applicability of the procedure to your configuration -via Fuel Web UI. - -Check Upgrade Prerequisites -^^^^^^^^^^^^^^^^^^^^^^^^^^^ - -*Pick environment to upgrade* - -Select an environment to upgrade from the list of environments in -Fuel CLI and assign its ID to the ``ORIG_ID`` variable. - -:: - - fuel env -