Find Jobs
Hire Freelancers

Data Engineering Projects needed - with Databricks and dbt - Need Pyspark/Spark Scala, SQL and python

₹12500-37500 INR

Suljettu
Julkaistu 2 kuukautta sitten

₹12500-37500 INR

Maksettu toimituksen yhteydessä
I need complete 2 small projects done. The data needs to be pulled from API using python. The pulled data needs to be unnested, then transformed to answer some insights with medallion architecture. Here, you need to showcase SCD-type 2 ingestions, incremental joins, managing PII information, aggregation. Final deliverable needed for 1st project (databricks): Data model designed and architecture overview Notebooks of transformations in Python and PySpark/Spark Scala Final deliverable needed for 2nd project (dbt): Data model designed and architecture overview dbt sql and yaml files
Projektin tunnus (ID): 37847697

Tietoa projektista

16 ehdotukset
Etäprojekti
Aktiivinen kuukausi sitten

Haluatko ansaita rahaa?

Freelancerin tarjouskilpailun edut

Aseta budjettisi ja aikataulu
Saa maksu työstäsi
Kuvaile ehdotustasi
Rekisteröinti ja töihin tarjoaminen on ilmaista
16 freelancerit tarjoavat keskimäärin ₹23 113 INR tätä projektia
Käyttäjän avatar
Hello, I read through, and I can help out. I am a seasoned Python developer, and with my skill set, you can entrust me with 100% project delivery. I have a deep understanding of Python and libraries like Pandas, Numpy, Scipy, Plotly, scikit, re, poetry, etc. Kindly text me over the chats so we can discuss further. Thank you Note: Bid Amount and timeline is just a placeholder; actual value would be provided after 1 on 1 discussion over chat.
₹25 000 INR 7 päivässä
5,0 (8 arvostelua)
4,2
4,2
Käyttäjän avatar
Hi, i'm data engineer with more 6 years in the area of big data. I have experience working with scala and python. I can help you with this project. Write me and talk me about the detail of project.
₹16 800 INR 7 päivässä
4,8 (13 arvostelua)
3,2
3,2
Käyttäjän avatar
Utilizing my current skills in web development, I have been exploring the Kaggle dataset primarily with SQL. My affinity for learning new things and adapting to the latest trends aligned serendipitously with your project's requirements of Databricks, dbt, PySpark, Spark Scala, and Python. Therefore I am confident in my ability to complete both projects competently and punctually. Beyond this alignment of skills, my experience in designing and developing databases gives me an insightful perspective on data engineering projects such as yours. Within this domain, I have proven abilities in unnesting data, incorporating SCD-type 2 ingestions, implementing incremental joins, managing PII information efficiently and handling complex aggregations. In conclusion, though my background may differ somewhat from a typical data engineer's profile, I can offer you a fresh perspective that combines creativity with technical expertise. I am ready to dive into your projects headfirst, guaranteeing meticulous attention to details alongside superb final deliverables including a comprehensive data model design and architecture overview plus well-structured and efficient notebooks or sql/yaml files. With me as part of your team on this project, you can rest assured that your data will be managed accurately and transformed effectively to reveal valuable insights.
₹25 000 INR 1 päivässä
0,0 (0 arvostelua)
0,0
0,0
Käyttäjän avatar
Hello ChirpyGreetings, I am Sadat Saeed, with 8 years of experience in Python and SQL. I have carefully read your project requirements for data engineering using Databricks and dbt. I will pull data from APIs using Python, unnest and transform it to showcase SCD-type 2 ingestions, incremental joins, managing PII information, and aggregation. The final deliverables will include data models, architecture overview, and transformation notebooks in Python and PySpark/Spark Scala for the first project, and dbt SQL and yaml files for the second project. Please review my portfolio https://www.freelancer.ca/u/DGM999 and let's discuss further. Best regards, Sadat Saeed
₹35 000 INR 8 päivässä
0,0 (0 arvostelua)
0,0
0,0
Käyttäjän avatar
I have total 8 years of experience in oracle sql and plsql Creating procedure, cursor ,functions, Views, index , complex views, trigger , Analytical function, aggregate function.
₹25 000 INR 7 päivässä
0,0 (0 arvostelua)
0,0
0,0
Käyttäjän avatar
my name is Azam im student now i live in China as possible i will help u if it possible send me details . its my first work in this web site in past i have a lot of projekts with it , also i had programmers team
₹25 000 INR 7 päivässä
0,0 (0 arvostelua)
0,0
0,0
Käyttäjän avatar
I am particularly excited about the opportunity to work on projects involving medallion architecture, slowly changing dimension (SCD) type 2 ingestions, incremental joins, managing personally identifiable information (PII), and aggregation. I believe my experience in these areas, combined with my passion for data engineering and problem-solving, make me a strong candidate for this role. Thank you.
₹12 500 INR 15 päivässä
0,0 (0 arvostelua)
0,0
0,0
Käyttäjän avatar
Data engineer with 7 years of experience using Python and spark, I already define data pipelines architecture one of that was able to process more than 500gb
₹37 500 INR 7 päivässä
0,0 (0 arvostelua)
0,0
0,0
Käyttäjän avatar
Hello, I hope you are doing well, I'm available to work on this project, please contact me so we can discuss the specifications. Regards
₹20 000 INR 7 päivässä
0,0 (0 arvostelua)
0,0
0,0
Käyttäjän avatar
Hi I have experience working with python , Databricks would accomplish your both the projects . hoping to start working soon with u
₹12 500 INR 7 päivässä
0,0 (0 arvostelua)
0,0
0,0
Käyttäjän avatar
I have working experience of 2 years in Big Data field, i have worked on Spark/SparkSql, python, Hadoop, Hive.
₹13 000 INR 8 päivässä
0,0 (0 arvostelua)
0,0
0,0
Käyttäjän avatar
Hi Greetings! We are a team of software developers. We have developers working on almost all the technologies. We will assign you a project manager who will assist you during the entire process of project completion. We will provide you with fast, timely, and on-time delivery at reasonable and minimum cost. We are a registered company located in Indore, India. We are available right now for the project discussion and can start the project on an immediate basis. We understand your project requirement We have 12 ++ years of experience in design and development. We can handle projects from small styling to full development from scratch. We will provide a good result in a short time and satisfy you fully. We have experienced developers in Python SQL Spark Data Modeling WHY-Us: » Ready to Start on an Immediate basis &provide proper Testing. » Keep your Data & Website Secure: Daily Progress Updates. » You will get 30 days FREE BUG-SUPPORT even after Project-Completion Please come in touch and let's discuss more detail about your task via chat. Project milestones will be decided during the chat. Thanks and Regards Tech India
₹37 500 INR 5 päivässä
0,0 (0 arvostelua)
0,0
0,0

Tietoja asiakkaasta

Maan INDIA lippu
Tiruchi, India
0,0
0
Maksutapa vahvistettu
Liittynyt maalisk. 26, 2020

Asiakkaan vahvistus

Kiitos! Olemme lähettäneet sinulle sähköpostitse linkin, jolla voit lunastaa ilmaisen krediittisi.
Jotain meni pieleen lähetettäessä sähköpostiasi. Yritä uudelleen.
Rekisteröitynyttä käyttäjää Ilmoitettua työtä yhteensä
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Ladataan esikatselua
Lupa myönnetty Geolocation.
Kirjautumisistuntosi on vanhentunut ja sinut on kirjattu ulos. Kirjaudu uudelleen sisään.