Hi, I want you to create a log analytics platform in AWS, I will provide you the architecture and you need to build a sample project utilizing every service mentioned in the architecture. The goal is to collect logs from SQL server and ingest them to AWS using AWS kinesis agent and kinesis data streams. Analyze the logs using Kinesis data analytics and then building spark ml models in Databricks. This is just a demo where you can work using sample data, I don't mind if you don't build ML models or not , my main goal is to establish the connection between the services. In the final demo, You should be able to show me how you build and connected each service in AWS with an SQL server and you should also send me a video regarding the same. You should also send me a document summarizing the challenges you faced and is it possible to scale this project for a multinational company and if scaled what kind of challenges will developers face. As you are just dealing with your own sample data, the cost incurred in AWS is your responsibility, You are responsible for any cost in AWS . I am attaching the architecture as png file. Only people who had good knowledge on AWS apply as this project is not just about doing stuff but identifying future challenges developers in multi national companies face when scaled to huge SQL servers
9 freelanceria on tarjonnut keskimäärin $209 tähän työhön
Cloudera certified Hadoop professional with 17+ years of experience in AWS , Bigdata , Kafka , spark and related technologies. Worked on given technologies for multiple clients.