Commit Graph

28 Commits

Author SHA1 Message Date
Monty Taylor a7839ba1c2 Retire stackforge/MRaaS 2015-10-17 15:59:47 -04:00
denizdemir da37ddb022 swift examples
Change-Id: Ifbc7da968b46ffd6459af1784d29429edc9c887c
2013-01-26 23:45:24 -08:00
denizdemir 53182ee041 brief build instruction for swift native driver
Change-Id: Iba42207fa44d4f774baf893d438760385e814ad5
2013-01-26 23:36:19 -08:00
denizdemir dfbfa77399 hadoop swift native driver
Change-Id: I3f20f7b648b0b3e589d62cb291d95ed353a9f7ae
2013-01-26 23:22:54 -08:00
denizdemir ba1ecf0195 project parts
Change-Id: I66bd04c856e037fb9ab75bdae8994e79c106fab2
2013-01-23 03:38:50 -08:00
Andrew Hutchings 5a2f0249f1 Modify .gitreview to point to Openstack code review 2012-08-22 14:40:47 +01:00
Andrew Hutchings 733ed45f4f Clean out branch to start from zero
Change-Id: I9786c2599b0af2708bf34db96cd39477554789dc
2012-05-17 19:01:46 +01:00
Tim Miller 3052b2759b create hadoop image, configure hadoop.
install hadoop, create hadoop base image.

Change-Id: Idb719e663764f45a7386c69b94246e412c73692f

configure and start Hadoop.

Change-Id: Ie76b25ec1fb6ad8ff531310b7fc4a17de95c3ed7
2012-04-06 09:58:03 -07:00
Deniz Demir a2d43dca7e Initial commit for integration of mr job exec
Change-Id: If0f4a80121d3cfd90bc7dc1ba20564145253a119
2012-04-02 08:11:53 -07:00
Tim Miller 7f9510b22d rearrange repo, jclouds.
add features, move to jclouds.

re-arrange directories, create vm with jclouds.

Change-Id: I3f5350f30343b404ca3dbd946ac69f118d945024

checking in test updates.

Change-Id: Ieb25640919cb6389270f6c0563227ae9e671f233

update server and db launcher commands.

- move utilities to mraas/bin
- replace shell scripts with ruby

Change-Id: Iff59c470b54eaf4707315107854327d786eb5daa

move config files to config directory.

Change-Id: I4ccf834dd859ede559acc9ff603502313f4f8f68

add cluster delete rest endpoint, cli tool

- add cluster delete endpoint, with tests and destroyer stub.
- add ruby cli tool to create, show, destroy clusters.
- add script to setup h2 database.

Change-Id: Ib7322161610ab770379acea7c37cb5d1e5129233

create and tear down VMs.

Change-Id: I544ed1b2fcbfeb8db300becb4ec0640ca9f1eac6

move mraas service to root of repo.

Change-Id: Ia0a0cf0a178cb8912a184f81018d398fb58b6513
2012-03-28 19:04:24 -07:00
Tim Miller 37ff8c8857 mostly functional REST service with h2 db.
hook mraas up to db. get and post clusters.

- Hook up to h2 database.
- add rest endpoints for get and post of clusters.
- add script to start h2 db browser-ui
- tests.

Change-Id: I8d290f23f8be3a790fa43fd82b03558495576412

add cluster serialization / deserialization test.

Change-Id: Iaf40458b61f893ac7fde8ed4a13296b7e94a1536

add openstack-java-sdk for nova operations.

Change-Id: Icdfeeeaf5cb1aff5eb9532cd0eab5944dab432b4

stub out provisioner, add properties to Cluster.

Change-Id: I52f2eb455e6642f5b1626a57c82a8b9b742ad1b3

update service bootstrap to use new constructor.

Change-Id: I37bfb0b03f81e4ed02abfa4f2185442d5acfb152
2012-03-27 22:08:18 -07:00
Tim Miller 1074e64c67 skeletal dropwizard service for MRaaS.
Change-Id: Ieae554909a1231f1198ca31a71332c2835853a17
2012-03-26 09:37:04 -07:00
Tim Miller 6c4ae1b056 set log level to info instead of debug.
Change-Id: I37a1ebb7c14216615ab43bc94cd686a47b629957
2012-03-20 22:57:44 +00:00
Tim Miller 9ff069aed2 update map reduce job running code, add --demo.
Change-Id: I6e994144daf311ad7f1677dc5c90e871b8896806
2012-03-16 20:35:24 +00:00
Deniz Demir dca1d2b7ea submitting map-reduce job
Change-Id: Iedb4e20686894b2ad87b6b159a713561ee2146ca
2012-03-16 10:01:52 -07:00
Deniz Demir aa7d4ce922 adding map-reduce job submission...
Change-Id: I9322f6e136140c5a122c867e52d004f4560a3762
2012-03-16 10:01:51 -07:00
Tim Miller 088bba9e90 add cli script.
Change-Id: I9db6d56a6da2a16bb6db204e9681c8da25923f82
2012-03-16 16:52:54 +00:00
Tim Miller 8b30e41c82 add a command line wrapper, allow many clusters.
- Persist cluster information to disk so that clusters
may be kept around, and destroyed later.
- Add a command line tool to create, list, and destroy clusters.

Change-Id: Ie437a5d03e51704ade54f7c2697fd7d95b140b7d
2012-03-15 22:05:13 +00:00
Tim Miller 9e345a8c6d Speed up provisioning of hadoop cluster.
- Disable 'UseDNS' in sshd_config when creating the hadoop
  image.  This reduces ssh login time from 5 seconds to
  less than one second.
- Run some ssh commands in parallel across hosts, instead
  of serially.

Change-Id: Ib7e6ea01c3bc4131784d39f8caf61d3651b84cb9
2012-03-15 16:50:49 +00:00
Tim Miller 0d203fd6e1 build private image with jdk and hadoop
If the image named by config option 'hadoop_image_name'
does not exist, build a vm, install jdk, install hadoop,
and save an image with that name. If the image already
exists, use it as is.

Change-Id: I4231e96565901b432ff2c4baa525e8859aca3915
2012-03-14 21:18:40 +00:00
Tim Miller 304ae33ffa use paramiko instead of ssh, error on failed cmds.
- Use paramiko instead of shelling out to ssh.
- Raise an exception when an ssh command results
  in an unexpected exit status.

Change-Id: I8db6bced55daf9b4945972cac738e77767be7485
2012-03-14 18:40:49 +00:00
Tim Miller cb85c52f4a hadoop prototype starts hadoop once cluster is up.
Change-Id: I13b6b9b2ca7b5f1990527762b879fddc482611c4
2012-03-13 22:15:29 +00:00
Tim Miller 74fa7756a1 a python prototype which sets up a hadoop cluster
Change-Id: I2a0d0682131c7f12e1fc2bb7712a0b5ce68f7fb1
2012-03-13 18:42:52 +00:00
Tim Miller 6b59712085 add a gitignore / test commit.
Change-Id: I11bf847d0ca7718abacb38fd0ef49bcc26133cc1
2012-03-10 00:17:56 +00:00
Deniz Demir c2d97cef49 dummy commit...
Change-Id: I602b1baf10c320a8d617e2b8a061b203606e05b0
2012-03-09 15:18:32 -08:00
Andrew Hutchings 86ea1ad673 Gerrit test
Test Jenkins too (attempt 8)

Change-Id: Ib5326e507edad3af7f663c4729b5602cb0ceef40
2012-03-07 15:30:03 +00:00
Andrew Hutchings 68dbdb533f Gerrit test 2012-03-07 10:15:56 +00:00
Andrew Hutchings 1094756426 first commit 2012-03-07 10:05:30 +00:00