Find Jobs
Hire Freelancers

High-Performance Data Pipeline Creation

₹12500-37500 INR

Suljettu
Julkaistu noin kuukausi sitten

₹12500-37500 INR

Maksettu toimituksen yhteydessä
The Data Engineer contractor role will be a project based role focused on migrating data pipelines from legacy infrastructure and frameworks such as Scalding to more modern infrastructure we support such as Spark Scala. This role will be responsible for: Analyzing existing data pipelines to understand their architecture, dependencies, and functionality. Working closely with data engineers to develop a migration strategy for converting pipelines from the current framework to the target framework. Designing, building, and testing new data pipelines in the target framework, ensuring they meet or exceed existing performance and reliability standards. Debugging and troubleshooting issues that arise during the migration process, working collaboratively with cross-functional teams to resolve them quickly. Communicating progress, challenges, and timelines to stakeholders on a regula Requirements The ideal candidate is a Data Engineer with considerable experience in migrations and Big Data frameworks. Must-Haves Scala programming language expertise Spark framework expertise Experience working with BigQuery Familiarity scheduling jobs in Airflow Fluency with Google Cloud Platform, in particular GCS and Dataproc Python programming language fluency Scalding framework fluency Pyspark framework fluency Dataflow(Apache Beam) framework fluency
Projektin tunnus (ID): 37979495

Tietoa projektista

8 ehdotukset
Etäprojekti
Aktiivinen 6 päivää sitten

Haluatko ansaita rahaa?

Freelancerin tarjouskilpailun edut

Aseta budjettisi ja aikataulu
Saa maksu työstäsi
Kuvaile ehdotustasi
Rekisteröinti ja töihin tarjoaminen on ilmaista
8 freelancerit tarjoavat keskimäärin ₹25 344 INR tätä projektia
Käyttäjän avatar
Top 1% in Freelancer.com Hi, Greetings! ✅checked your project details: ✅Completed Time: In project deadline We have worked on 900 + Projects. I have 6 + years of the experience in same kind of projects. If you are looking for a true Freelancer, I am the Right person for you. I am available almost 24-7 and am very responsive. I feel proud that I am a trusted Freelancer who pleases almost every single client. You can rest assure, your work will be delivered well in advance of others, with passion and accuracy. I guarantee you instant communication & responses when you need me. Why choose me? I think every client is the reason for my success. I only take projects which I am sure I can do quickly. My Portfolio Items: https://www.freelancer.com/u/schoudhary1553 I would really like to work with you on this project. If interested, Kindly contact me via chat for further details and discussion. Thank you Sandeep
₹25 000 INR 7 päivässä
5,0 (403 arvostelua)
8,3
8,3
Käyttäjän avatar
With my robust knowledge in Scala, Spark, and Airflow—in addition to my familiarization with BigQuery and Google Cloud Platform—your data migration project seems tailor-made for me. My competence in scheduling jobs in Airflow will come in handy for ensuring a seamless transition, while my comprehensive understanding of the GCP ecosystem will enable me to utilize its tools, such as GCS and Dataproc, optimally. And if any Python or Pyspark elements are needed within the migration process, I am more than qualified to incorporate them effectively.
₹37 500 INR 28 päivässä
5,0 (1 arvostelu)
0,8
0,8
Käyttäjän avatar
Hello, I UNDERSTAND YOUR REQUIREMENTS 100% I'm very interested in High-Performance Data Pipeline Creation Very happy to your project. Reading your project, I notice that you are looking for a normal programming language developer. I am very familiar with PHP, JavaScript, CSS, HTML, Laravel, Codeigniter, React.js, Vue.js, Angular.js, MySQL, PostgreSQL, Node.js, Python, Django, Flask..... I have 7+ years experience in Website development and Mobile application development(flutter, flutterflow, android studio). So I am pretty sure I can build whatever that you want. Looking forward to work with you. Sincerely.
₹27 750 INR 2 päivässä
0,0 (0 arvostelua)
0,0
0,0
Käyttäjän avatar
Hi, I’m very glad to see this project and very interested to work with, it matches to my skills and experiences, I’ve worked on many similar projects previously and have good working experience in this field, I’m sure, I can provide you best outcome according to your requirement, Please let me know about it briefly and let’s discuss something more about it, Call or WhatsApp me here (+91) 8175810850 Thanking you.
₹15 000 INR 8 päivässä
0,0 (0 arvostelua)
0,0
0,0
Käyttäjän avatar
I am a senior full stack developer. I read your requirements carefully and understood very well about the project scope and I am ready to start. I am having more than 3+ years of experienced in developing and I believe that I can start working step by step and achieve the project goal with high quality in short time frame. I'd like to discuss your project requirements further, so please message me through the freelancer chat room.
₹15 000 INR 2 päivässä
0,0 (0 arvostelua)
0,0
0,0

Tietoja asiakkaasta

Maan INDIA lippu
Delhi, India
0,0
0
Liittynyt tammik. 11, 2024

Asiakkaan vahvistus

Kiitos! Olemme lähettäneet sinulle sähköpostitse linkin, jolla voit lunastaa ilmaisen krediittisi.
Jotain meni pieleen lähetettäessä sähköpostiasi. Yritä uudelleen.
Rekisteröitynyttä käyttäjää Ilmoitettua työtä yhteensä
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Ladataan esikatselua
Lupa myönnetty Geolocation.
Kirjautumisistuntosi on vanhentunut ja sinut on kirjattu ulos. Kirjaudu uudelleen sisään.