Build an EL pipeline in Azure
Budjetti €18-36 EUR / tunti
Job Description:
We need a freelance Azure data engineer to develop a data pipeline for a large hotel chain.
The project would start with a proof-of-concept where the freelancer will develop the first few steps of the pipeline. If we evaluate that the collaboration worked well, we would then continue the partnership to develop the rest of the pipeline.
The full project scope is visualised in the picture attached
The first steps to be developed in this first iteration are:
- With a user and environment provided by us, deploy Azure Data Factory and Azure Blob Storage resources, requesting any necessary permissions for your user so we can provide them
- Using Azure Data Factory, deploy a process that runs on a daily basis to extract CSV files from an SFTP and load them into Azure Blob Storage as parquet files (SFTP credentials and data will be provided by us)
- Make sure to detail a naming convention for the parquet files and a folder structure for Azure Blob Storage
- All deployments must be done via infrastructure-as-code, so they can be redeployed in Production later
- All script code must be in Python whenever it is available
Your response to this proposal should include:
- The description of any additional steps you see as necessary to complete the goal of this iteration
- Any questions you may have
- A quote, ideally in terms of hours plus hourly rate
We’d like to initiate the project as soon as possible.
Thank you!
25 freelanceria on tarjonnut keskimäärin €29/tunti tähän työhön
Dear Employer, Many Thanks for giving us a chance to submit a proposal on your project. As mentioned in the project scope you can hire our experience Azure data engineer for developing the data pipeline for large hotel Lisää
Hi there,I'm biddin on your project "Build an EL pipeline in Azure" I have read your project description and i'm an expert in Python and machine learning therefore i can do this project for you perfectly.I still have a Lisää
Hello, How are you? I am a senior data engineer with extensive experience in Azure development, Python and data integration. I have developed multiple EL pipelines on Azure and have good understanding of Blob Storage Lisää
Hello, Warm Greetings! I am pretty sure I can produce high-quality and perfect results for your project. By using Python, I used to make AI engines, BOT, Web Scraping Tools, and so on. PHP and Python are my majors, so Lisää
Experienced data Engineer in azure with expertise in azure data factory, adls and certified databricks Spark Developer
Hello greetings, After going through your project description, I feel confident and excited to work on this project for you. But I have some important things and queries to clear out. Can you please leave a message on Lisää
Hi, I am excited to apply for the Azure Data Engineer position for the hotel chain data pipeline project. As an experienced Azure data engineer, I am confident in my ability to develop a data pipeline and deploy it us Lisää
=======Python Expert=========== Hi there, Here you can get a good partner. I always activate. I can show you demo. I have read your project description and it seems I can complete this project satisfying your requirem Lisää
Oh, My best brand Tech. It's like shoes that match my skill area. could you help me. I hope to 'buy' it. Pls contact me.
Hi I am a Machine Learning Engineer. I am expert in python. I have worked in Microsoft Azure and confident that I can do this project for you. Your project requirements are clear at this stage. I need to do some resea Lisää
11 years of IT experience- Python, Java, C++, Go, RestAPI, NodeJS, Golang, SQL, OpenSQL NoSQL, SD-WAN, Web Application Firewall, JavaScript, AWS, Azure, DevOps, Continuous Integration, Machine Learning, Artificial Inte Lisää
I am the best candidate for this project as I am having 5 years of IT Experience in Azure Data Engineering and have undertaken many project where i worked on Azure Data Factory and Azure Blob Storage resources to extra Lisää
Hi, I have extensive experience in developing ETL pipelines using azure tech. My specialty is that I will build dynamic pipelines which can be used for multiple purposes. I will provide you with detailed documentat Lisää
Hi there,I'm biddin on your project "Build an EL pipeline in Azure" I have gone though your project description and mysel an expert in Design and Develop end to end solution with azure data and integration space, A Lisää
