Käynnissä

Write some Software

Write a AWS cloudformation script to create a working Hadoop / Spark environment with yarn Zeplin and Sqoop

Basically take 1 2, or 3 [url removed, login to view] and setup so it distributes data and work across the machines.

I do not want an EMR solution or a solution that has licensing costs. I just want to pay for the EC2 and S3 costs. Also only use Community AMI's

NB an [url removed, login to view] has 4*800G SSD

On each machine use N-1 SSDs (3 in this case) and split each disk roughly between HDFS and Spark. You can use the the final disk for OS and installed software

cloudformation Inputs would be number of machines : 1 2 or 3

cloudformation output section will have 4 URLs / port number for: yarn zepplin, ganglia and spark master

You can assume I am using my root account, it is a clean environment and I have foxyproxy like tool running on my desktop. You can hard code region and AMI.

I will own the copyright of the script. You cannot share it or blog about it or utube it …

The requirement is single yaml or json such that I load it to S3 and I simply run cloudformation. Payment if meets all the stated requirements

Taidot: Amazon Web Services, Pilvitietotekniikka , Hadoop, Spark

Näytä lisää: software write mq4, software write chip epson, useful software write book, software write web specs, software write edid, software write websites idea, software write book images, software write books, software write protection, free software write book, software write book, software write technical manual

About the Employer:
( 3 reviews ) United Kingdom

Projektin tunnus: #13141301

Myönnetty käyttäjälle:

akshaynaidu9

Hello, I am applying for this job because I've a keen interest in BigData technology and I’m considering your job post for me with the required capabilities. I have learned R programming, Hadoop and its components Lisää

100 £ GBP 8 päivässä
(2 arvostelua)
2.8

9 freelanceria on tarjonnut keskimäärin 260 £ tähän työhön

joystick220

Hi There I understand you need a Cloudformation Script(YAML/JSON) to orchestrate the mentioned resource with an Open Source EMR Solution. I'm pretty sure I can do it coz I've been regularly using CFN to orchestrate L Lisää

333 £ GBP 3 päivässä
(49 arvostelua)
5.9
Shopify

Hello, I want to show you all relevant Demo and Designs which is similar to your project completed previously. To make sure about the requirement set and customizations, I want to discuss this project with you further Lisää

515 £ GBP 10 päivässä
(1 arvostelu)
4.4
dirisalagopal

Amazon Web Services: Lambda, API Gateway, EC2, Load Balancers, RDS, Elastic Beanstalk, Elastic File System, IAM, VPC, Security Groups, Cloud Formation,, S3, CLoudFront, Redshift, Route 53, Cloud Watch, Kinesis, SNS, SQ Lisää

399 £ GBP 0 päivässä
(10 arvostelua)
4.1
prashushinde9

Hello, We have accomplished 90% of the project which is similar of your requirement. All we need 10% customization as per your requirement set and specifications. I want to discuss in personal chat in order to explore Lisää

257 £ GBP 10 päivässä
(1 arvostelu)
4.1
CsGeek2

I am a data science engineer with 3+ years experience in designing, developing and implementing machine learning solutions to complex data problems. My expertise includes apache-spark, apache Hadoop, AWS, Cloudera, Sca Lisää

166 £ GBP 3 päivässä
(4 arvostelua)
3.0
giridharanu9

· Setup/Managing Linux Servers on Amazon ( EC2, EBS, ELB, SSL, Security Groups, RDS and IAM). · Setup/Managing VPC, Subnets; make connection between different zones; Blocking suspicious ip/subnet via ACL. · Set Lisää

150 £ GBP 3 päivässä
(1 arvostelu)
2.0
250 £ GBP 3 päivässä
(0 arvostelua)
0.0
subinmat

Hello I have 7+ years experience in Linux and a very good expertise in AWS and docker containers. I can be able to do this project with great expertise. Regards Subin

166 £ GBP 3 päivässä
(0 arvostelua)
0.0