Need Data Engineer who knows Python, PySpark, Azure DevOps, ETL to give support for few months. We will pay Rs. 20-22k per month. We are looking for immediately.
1. Data Engineering/Data Warehousing development/operations experience of at least 7 years
2. Azure cloud experience of at least 3 years with ADF V2, ADF Data flows, Azure Databricks, SQLDB/Hyperscale, SQLDW, ADLS Gen 2 and other Azure services
3. Python & PySpark development
4. SQL development including PL/SQL, preferably SQL Server but another RDBMS may be fine
5. Managing an offshore team
6. Good communication (verbal & written) & documentation skills
1. Development using ETL tools like DataStage or Informatica
2. ADF source code version control using Azure DevOps or Git
3. Experience with Snowflake
4. Collaboration with business teams
Experience in fast-paced & complex environments, including large enterprise settings
Tools: Azure Data lake, Databricks
7 freelancers are bidding on average ₹23333 for this job
I have been working as a developer and a production support on Hadoop jobs running on Edge nodes and Azure Databricks for last two years. Been using Automic and Airflow Scheduler for job handling and monitoring.