Käynnissä

Talend (java ETL) job creator needed to complete dev. of job for automated push from PostgreSQL to SQL Server in Ubuntu environment

I have a Talend Open Studio for Data Integration job setup that needs to be completed and deloyed. The architecture of the job can be changed based on your skill-level of improving the process.

The goal is to migrate data via the Talend ETL job from PostgreSQL to SQL Server every 10-15 minutes. Talend can develop the shell script or batch file automatically after exporting the completed project, so the user will need to either have an alternate route to doing this or have Talend Open Studio installed already and be knowledgeable on the application.

We have around 80 tables that need to be initially pulled over (in full) and then a WHERE condition or filter added to just pull changes to the data (based on created_date or updated_date within last 24 hours, as an example).

The table updates all need to start at the same time and be optimized for speed and efficiency. I want this parallel style of processing through the table updates, as opposed to sequential, ordered updates, because we need this job to go as quick as possible and a small quick job not have to wait on a predecessor long-running job (could be 4-5 minutes long).

I can export and send the project we have now which has the PostgreSQL and JDBC(SQL Server) connections already setup, and a set of some of the tables already.

I require the job to be updated via a properties file to control the connection details so that we can replicate this job over and over for multiple databases just be changing the connection (not duplicating the jobs over and over again every time we create a new database).

I need this done in about 4-5 days if possible and can start ASAP.

Taidot: Tietokannan hallinto, Java, Linux, Shell Script, SQL

Näytä lisää: predecessor talend etl, etl talend java, ubuntu skill, ubuntu jobs, talend architecture, shell jobs, jobs java, java develop 7, java batch job, in need of a job asap, export job, etl jobs, etl job, develop databases, data control jobs, create shell script, changing jobs, postgresql java etl, talend studio, talend jobs, studio jobs, sql server job, server studio, process server jobs, knowledgeable of

About the Employer:
( 16 reviews ) Bellevue, United States

Projektin tunnus: #1745371

6 freelanceria on tarjonnut keskimäärin 242 $ tähän työhön

JDKochan

..........

250 $ USD 5 päivässä
(3 arvostelua)
4.3
hardcorefs

I work in Talend (java ETL) Please see my private message

260 $ USD 4 päivässä
(1 arvostelu)
3.6
P8Ohz2I5U

Custom software development - The Administrator removed this message due to advertising which breaches our Terms and Conditions.

250 $ USD 1 päivässä
(0 arvostelua)
0.0
MrImperium

Hi Sir I have plenty of Talend and "Big Data" experience, will be able to complete this project for you. Mr Imp

160 $ USD 2 päivässä
(0 arvostelua)
0.0
rungtajyoti123

Hi we have experience developer working under us and we can easily manage your work. Please fine the attached resume of our developer for your reference Let us know if you would like to proceed with more details

300 $ USD 15 päivässä
(0 arvostelua)
0.0
nikhileshtiwari

Dear Hiring Manager, I would like to thank you for posting the job and looking at my proposition. Mentioned below is a brief profile information, my work record & a few projects on which i have worked. I am havin Lisää

230 $ USD 4 päivässä
(0 arvostelua)
0.0