Apache Spark development to sync data into elastic search from multiple table from postgreSql

$30-250 USD

Suljettu

Julkaistu

noin 2 vuotta sitten

$30-250 USD

Maksettu toimituksen yhteydessä

Virtual Dataset syncing through Spark. Spark job to written in Scala/Java which will retrieve the data from multiple tables with complex join conditions. There will be multiple stages before the final outcome and each stage can transformed and will be input to next stage for joining with other table/previous output. Request will have all the metadata in JSON format for the stages involved in the virtual dataset and there detailed joins as well as transformation conditions. Screenshots attached for more understanding.

Projektin tunnus (ID): 33641081

Tietoa projektista

6 ehdotukset

Etäprojekti

Aktiivinen 2 vuotta sitten

Haluatko ansaita rahaa?

Sähköpostiosoite

Freelancerin tarjouskilpailun edut

Aseta budjettisi ja aikataulu

Saa maksu työstäsi

Kuvaile ehdotustasi

Rekisteröinti ja töihin tarjoaminen on ilmaista

6 freelancerit tarjoavat keskimäärin $231 USD tätä projektia

@Ghazik

Am ready to retrieve the data from multiple tables with complex join conditions. please send me a message to discuss further details about this project in chat. thanks

$166,67 USD 5 päivässä

5,0

(4 arvostelua)

2,7

@h87md3h

Hello I am a big data engineer with experience of 5 years. I have worked with postgres elastic and spark to create etl pipeline before too. Thanks

$300 USD 7 päivässä

0,0

(0 arvostelua)

0,0

@sarvan92

I am Bigdata engineer and I am having rich experience in data pipelines and data processing on Hadoop,Azure and AWS using pyspark and java I can build a simple script for your requirements and we can make a great pipeline on that.

$140 USD 7 päivässä