95 lines
5.3 KiB
HTML
95 lines
5.3 KiB
HTML
|
|
<!DOCTYPE html>
|
|
<html lang="en">
|
|
<head>
|
|
<meta charset="utf-8">
|
|
<meta http-equiv="X-UA-Compatible" content="IE=edge">
|
|
<meta name="viewport" content="width=device-width, initial-scale=1">
|
|
<meta name="description" content="StackTach.v3">
|
|
<meta name="author" content="Sandy Walsh">
|
|
<link rel="icon" href="../../favicon.ico">
|
|
|
|
<title>StackTach.v3</title>
|
|
|
|
<!-- Latest compiled and minified CSS -->
|
|
<link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.2/css/bootstrap.min.css">
|
|
|
|
<link href="stv3-narrow.css" rel="stylesheet">
|
|
|
|
<!-- Optional theme -->
|
|
<link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.2/css/bootstrap-theme.min.css">
|
|
|
|
<!-- Latest compiled and minified JavaScript -->
|
|
<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.2/js/bootstrap.min.js"></script>
|
|
|
|
<style>
|
|
.bottom_padding {
|
|
padding-bottom: 20px;
|
|
}
|
|
</style>
|
|
|
|
<!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
|
|
<!--[if lt IE 9]>
|
|
<script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
|
|
<script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
|
|
<![endif]-->
|
|
|
|
|
|
</head>
|
|
|
|
<body>
|
|
|
|
<div class="container">
|
|
<div class="header bottom_padding">
|
|
<nav>
|
|
<ul class="nav nav-pills pull-right">
|
|
<li role="presentation"><a href="index.html">Home</a></li>
|
|
<li role="presentation"><a href="about.html">Docs</a></li>
|
|
<li role="presentation" class="active"><a href="install.html">Getting Started</a></li>
|
|
<li role="presentation"><a href="#">API</a></li>
|
|
<li role="presentation"><a href="screencasts.html">Screencasts</a></li>
|
|
<li role="presentation"><a href="contribute.html">Contribute</a></li>
|
|
</ul>
|
|
</nav>
|
|
<img src="StackTach_160x70.png"/>
|
|
</div>
|
|
|
|
<div class="row marketing">
|
|
<div class="col-lg-12">
|
|
<h3>How StackTach.v3 is deployed at Rackspace</h3>
|
|
<p>For Rackspace Public Cloud, OpenStack is deployed in many different regions and each region is comprised of many cells.</p>
|
|
|
|
<img src='deploy_diagram.gif' class="img-rounded"/>
|
|
|
|
<p>In this deployment scenario, we have a set of "worker" boxes that run the <code>yagi-event</code> workers (to consume notifications from RabbitMQ). We run one yagi-event worker per OpenStack cell. We also run the Winchester pipeline-workers on this box. The pipeline-worker manages pipeline processing for ready streams. We run as many pipeline-workers as needed to keep each core busy. Both the yagi-event and pipeline-worker processes are single threaded so we spawn more to keep the host busy. We add more servers like these to handle the load in the pipeline processing and/or the source queues.</p>
|
|
<p>Additionally, we have servers for the API nodes and the MySQL database. Load balancing the API servers and making MySQL highly available is left to the deployer.</p>
|
|
<h3>The Ansible deployment scripts</h3>
|
|
<p>In the <a href='https://github.com/stackforge/stacktach-sandbox/tree/master/ansible'>StackTach Sandbox</a> repo, there is an ansible directory that contains roles for the workers, the API nodes and the database. There is a fourth "common" role that is used by the other roles.</p>
|
|
<p>These scripts assume a multi-cell deployment where there is one StackTach.v3 deployment per region (each with it's own API servers and database). If you are not running with cells, pretend it's a single cell.</p>
|
|
<h3>The Build script</h3>
|
|
<p>The <a href='https://github.com/stackforge/stacktach-sandbox'>StackTach Sandbox</a> repo is the umbrella repo for all the other StackTach modules. It:</p>
|
|
<ul>
|
|
<li>can create a local dev environment for anyone wanting to contribute to StackTach or just play around with it
|
|
<li>can package StackTach into a python virtual environment and tarball it up for larger scale deployment. The ansible scripts use this tarball approach.
|
|
<li>git clones all the dependent python modules so you can develop locally and see your changes immediately and easily.
|
|
</ul>
|
|
<p>The sandbox readme will get you started, but the gory details are in the <code>build.sh</code> script. There are essentially three options:</p>
|
|
<ul>
|
|
<li><code>./build.sh</code> - run the local StackTach.v3 dev environment in a screen session.
|
|
<li><code>./build.sh -t</code> - run the tests on all the StackTach.v3 repos.
|
|
<li><code>./build.sh -p</code> - install StackTach.v3 into the virtual env and package it up into a tarball for deployment.
|
|
<li><code>./build.sh -p -d</code> - package and deploy the tarball. Currently this just lists the ansible incantation required to do the deployment.
|
|
</ul>
|
|
<p>The <a href='screencasts.html'>screencasts</a> cover using the sandbox for local dev in more detail.</p>
|
|
<footer class="footer">
|
|
<p>© Dark Secret Software Inc. 2014</p>
|
|
</footer>
|
|
|
|
</div> <!-- /container -->
|
|
|
|
<!-- IE10 viewport hack for Surface/desktop Windows 8 bug -->
|
|
<script src="../../assets/js/ie10-viewport-bug-workaround.js"></script>
|
|
</body>
|
|
</html>
|
|
|