I need to help me with a Python code to get the data from Postgres SQL server(It needs to run SQL queries on the server which has filters) and dump it into Databricks table. This has to be done in small intervals as the table is very very huge. Need to get data from 2018 to till date with probably intervals of 3months and append to same table. Once we get the data till date, from next time it has to be just incremental load from that last processed date.
13 freelanceria on tarjonnut keskimäärin $28 tähän työhön
Hi, I can help you to move data from postgre sql to data bricks azure. If you are interested we can further talk about this. I am sure you have azure access. Regards, Ali