Hadoop orchestration with OpenStack

We need a python script that orchestrates Hadoop instances in OpenStack. The script shall be integrated into OpenStack Dashboard.

It works as follow:

1. In the existing OpenStack dashboard the user can submit his MapReduce Algorithm (jar file), specify a link to it's data, and chose the number of worker nodes.

2. After the users hits the start button, a prepared Hadoop master image will be launched by OpenStack.

3. After the master node is up, the specified number of hadoop worker nodes will be fired up.

4. Once the worker nodes are up and connected to the master the specified jar. file and data to process will be loaded to the master.

5. Hadoop will be executed.

6. The output file(s) can be downloaded for the OpenStack Dashboard.


OpenStack Version: Folsom

Hadoop (Cloudera): Latest

OS Instances: Ubuntu 12.04

Taidot: Django, Hadoop, Python

Näytä lisää: orchestration, hadoop orchestration, python button, mapreduce image, hadoop image, python hadoop, hadoop and python, python algorithm, openstack, mapreduce, hadoop, hadoop algorithm, Cloudera, algorithm python, python openstack, python ubuntu, openstack image, node dashboard, ubuntu openstack, node openstack, openstack node, python data dashboard, hadoop mapreduce, dashboard python, dashboard django

Tietoa työnantajasta:
( 4 arvostelua ) Zürich, Switzerland

Projektin tunnus: #4278714

1 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_23% %project_currencyDetails_sign_sub_24% tähän työhön


check pm also portfolio to check skills.

$250 USD 4 päivässä
(9 arvostelua)