Write a AWS cloudformation script to create a working Hadoop / Spark environment with yarn Zeplin and Sqoop
Basically take 1 2, or 3 [url removed, login to view] and setup so it distributes data and work across the machines.
I do not want an EMR solution or a solution that has licensing costs. I just want to pay for the EC2 and S3 costs. Also only use Community AMI's
NB an [url removed, login to view] has 4*800G SSD
On each machine use N-1 SSDs (3 in this case) and split each disk roughly between HDFS and Spark. You can use the the final disk for OS and installed software
cloudformation Inputs would be number of machines : 1 2 or 3
cloudformation output section will have 4 URLs / port number for: yarn zepplin, ganglia and spark master
You can assume I am using my root account, it is a clean environment and I have foxyproxy like tool running on my desktop. You can hard code region and AMI.
I will own the copyright of the script. You cannot share it or blog about it or utube it …
The requirement is single yaml or json such that I load it to S3 and I simply run cloudformation. Payment if meets all the stated requirements
9 freelanceria on tarjonnut keskimäärin 260 £ tähän työhön
Hello I have 7+ years experience in Linux and a very good expertise in AWS and docker containers. I can be able to do this project with great expertise. Regards Subin