Write some Software

Write a AWS cloudformation script to create a working Hadoop / Spark environment with yarn Zeplin and Sqoop

Basically take 1 2, or 3 [url removed, login to view] and setup so it distributes data and work across the machines.

I do not want an EMR solution or a solution that has licensing costs. I just want to pay for the EC2 and S3 costs. Also only use Community AMI's

NB an [url removed, login to view] has 4*800G SSD

On each machine use N-1 SSDs (3 in this case) and split each disk roughly between HDFS and Spark. You can use the the final disk for OS and installed software

cloudformation Inputs would be number of machines : 1 2 or 3

cloudformation output section will have 4 URLs / port number for: yarn zepplin, ganglia and spark master

You can assume I am using my root account, it is a clean environment and I have foxyproxy like tool running on my desktop. You can hard code region and AMI.

I will own the copyright of the script. You cannot share it or blog about it or utube it …

The requirement is single yaml or json such that I load it to S3 and I simply run cloudformation. Payment if meets all the stated requirements

Taidot: Amazon Web Services, Pilvitietotekniikka , Hadoop, Spark

Näytä lisää: software write mq4, software write chip epson, useful software write book, software write web specs, free software write user guide, software write edid, free software write company profile, software write websites idea, write program adds large integers using linked lists, software write book images, software write books, software write protection, free software write book, write html files wikimedia markup using php, software write book, write program student information system using database, write code intrusion detection prevention using windows, bypass web master craiglist usa using, software write protect software, software write technical manual

Tietoa työnantajasta:
( 3 arvostelua ) United Kingdom

Projektin tunnus: #13141301

Myönnetty käyttäjälle:


Hello, I am applying for this job because I've a keen interest in BigData technology and I’m considering your job post for me with the required capabilities. I have learned R programming, Hadoop and its components Lisää

£100 GBP 8 päivässä
(2 Arvostelua)

9 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön


Hi There I understand you need a Cloudformation Script(YAML/JSON) to orchestrate the mentioned resource with an Open Source EMR Solution. I'm pretty sure I can do it coz I've been regularly using CFN to orchestrate L Lisää

£333 GBP 3 päivässä
(49 arvostelua)

Hello, I want to show you all relevant Demo and Designs which is similar to your project completed previously. To make sure about the requirement set and customizations, I want to discuss this project with you further Lisää

£515 GBP 10 päivässä
(1 arvostelu)

Amazon Web Services: Lambda, API Gateway, EC2, Load Balancers, RDS, Elastic Beanstalk, Elastic File System, IAM, VPC, Security Groups, Cloud Formation,, S3, CLoudFront, Redshift, Route 53, Cloud Watch, Kinesis, SNS, SQ Lisää

£399 GBP 0 päivässä
(10 arvostelua)

Hello, We have accomplished 90% of the project which is similar of your requirement. All we need 10% customization as per your requirement set and specifications. I want to discuss in personal chat in order to explore Lisää

£257 GBP 10 päivässä
(1 arvostelu)

I am a data science engineer with 3+ years experience in designing, developing and implementing machine learning solutions to complex data problems. My expertise includes apache-spark, apache Hadoop, AWS, Cloudera, Sca Lisää

£166 GBP 3 päivässä
(4 arvostelua)

· Setup/Managing Linux Servers on Amazon ( EC2, EBS, ELB, SSL, Security Groups, RDS and IAM). · Setup/Managing VPC, Subnets; make connection between different zones; Blocking suspicious ip/subnet via ACL. · Set Lisää

£150 GBP 3 päivässä
(1 arvostelu)
£250 GBP 3 päivässä
(0 arvostelua)

Hello I have 7+ years experience in Linux and a very good expertise in AWS and docker containers. I can be able to do this project with great expertise. Regards Subin

£166 GBP 3 päivässä
(0 arvostelua)