Experienced Azure Data Engineer Required.

@Web1devloper

With over 8 years of experience under my belt, I have seasoned proficiency in the wide array of technologies and tools your project requires, Harsh. I bring an end-to-end understanding of data analytics that will be invaluable to your personal project. Familiarity with Apache Databricks and Delta Lake combined with my strong knowledge of PySpark, SQL, JSON parsing, data deduplication and validation will enable me to transform your structured and semi-structured healthcare/insurance-related datasets into actionable insights. I'm not new to working with complex healthcare data and have successfully engineered pipelines on multiple occasions involving member/customer data, claims, policy/benefits data and even FHIR/HL7 standards. I understand the urgency involved in processing historical and incremental data in real-time which makes me the ideal fit for creating efficient ingestion pipelines using Azure Data Factory (ADF) and other Azure services while maintaining optimal performance without sacrificing quality. Moreover, as a seasoned data engineer, I've developed an obsession with optimizing Spark jobs and SQL queries and possess basic CI-CD skills which ensures code stability as well as facilitates easy debugging.I look forward to supporting your project efforts using Git while

@indreshpnk

Hello, I understand you need an Azure Data Engineer to build and maintain data pipelines involving ingestion, transformation, validation, incremental processing, and structured/semi-structured data using Azure Databricks, PySpark, SQL, ADF, ADLS Gen2, and Delta Lake. The goal is to deliver reliable and scalable ETL/ELT workflows. Here’s what I can provide: • Python-based data processing, JSON parsing, cleansing, deduplication, and validation • Strong SQL, backend/API development, database handling, and ETL workflow understanding • AWS cloud, Docker, Git, and scalable application experience transferable to Azure environments I bring over 4+ years of experience in Python, SQL, Django, AWS, Docker, REST APIs, and backend development, with a strong focus on reliable and scalable systems. I’m comfortable learning and implementing new cloud technologies and can work with your existing architecture and requirements. Just to clarify a few things: • Is the project primarily focused on existing Databricks pipelines or building them from scratch? • What is the expected weekly availability and on-site schedule in Pune? Please come to the chat box to discuss more about your project. Best regards Indresh Kushwaha

@abhilashr53

You need a battle-tested Azure Data Engineer who can build reliable, scalable pipelines handling structured and semi-structured healthcare and insurance data across the full Azure modern data stack, from ingestion through validated Delta Lake output. My approach: I would architect ADF pipelines for both historical loads and incremental ingestion into ADLS Gen2, implement Bronze-Silver-Gold medallion layers in Delta Lake, handle nested JSON parsing and FHIR-adjacent structures in PySpark notebooks, and enforce data quality through source-to-target reconciliation checks before any downstream consumption. Delta MERGE operations for upserts and deduplication would be standard practice, not afterthoughts. My stack proficiency covers everything listed: Databricks, PySpark, ADF, ADLS Gen2, Delta Lake, Databricks SQL, SQL Server, and Git-based version control with basic CI-CD pipeline awareness. Key risks I proactively handle include schema drift in semi-structured sources, partition strategy for query performance, and data sensitivity governance given the healthcare domain. I can commit part-time with consistent availability and can typically be productive from day one without hand-holding. What does your current pipeline architecture look like, and where is the biggest pain point right now?

@GenomyR

Hi, Your pipeline needs efficient handling of nested healthcare JSON and incremental updates in Delta Lake without performance degradation during upsert operations. I will build the ADF ingestion layer to land semi-structured data into ADLS Gen2, followed by PySpark transformations in Azure Databricks using Delta MERGE patterns for source-to-target reconciliation. This pipeline can be fully deployed and tested within three business days. Are the incoming healthcare payloads streaming via Event Hubs or landing as batch files in Blob storage? Best regards, Tumisang

@kimiatech

Hi there, I am ready to help you build and optimize your Azure data pipeline using Python and SQL. What I will deliver: • Python Data Pipelines: Efficient data extraction, transformation, and automated ETL workflows using pandas and custom scripts. • SQL Optimization: Database design, query optimization, and structured data handling. • Azure Cloud Integration: Reliable connection to Azure services for seamless data operations. I focus on writing clean, well-tested code that runs error-free. I can start immediately and adapt to your specific data architecture. Looking forward to hearing about your current setup! Best regards, Kimia

@nabeeli18

Greetings I have extensive experience as an Azure Data Engineer, having completed similar projects in the healthcare domain. I understand your need for a skilled engineer to manage data ingestion, transformation, and validation using Azure services. My expertise in building robust data pipelines and optimizing performance will ensure your project runs smoothly and efficiently. I bring over five years of hands-on experience with Azure Databricks, PySpark, SQL Server, and Azure Data Factory. My background includes working on healthcare and insurance data projects, making me well-suited for your requirements. I’d love to chat about your project and suggest a follow-up discussion to explore how I can contribute to your success. Regards, Nabeel Ismail

@abdullahrafiq0x

I am a seasoned Azure Data Engineer with 3+ years of hands-on experience working on diverse data engineering projects. My skills align perfectly with the requirements of your project. Throughout my career, I have employed Azure Databricks, PySpark, SQL/SQL Server and other tools mentioned extensively in my projects. Importantly, I have a deep understanding of healthcare and insurance-related data systems including FHIR/HL7 standards. What sets me apart is my practical experience implementing end-to-end data processing flow using technologies mentioned starting from source through event-based processing in Azure Data Factory and ultimately delivering transformed data in unified targets. My familiarity with Delta Lake will ensure efficient utilization of the system for data ingestion and ETL purposes. Additionally, my expertise extends to areas such as performance optimization and Git-based CI-CD which are critical for successful project delivery. By choosing me, you can expect a dedicated professional committed to creating optimal solutions customized to your needs. I can offer flexible working hours ensuring high availability to meet tight deadlines. My payment options can also be tailored to suit your preferences be it hourly or milestone based.

@nidheshruhela194

As an experienced Azure Data Engineer, I bring to the table a solid 4 years of experience working with Azure Databricks, PySpark, and SQL/SQL Server, which are all key components of your project. My expertise also extends to Azure Data Factory (ADF), ADLS Gen2, Delta Lake, Databricks SQL, Git, and CI/CD - all essential for efficient data handling and processing. Having worked on projects dealing with structured and semi-structured data including healthcare and insurance-related data, I've developed the skills to effectively handle FHIR/HL7 standards alongside crucial tasks such as data deduplication/validation. One of my stand-out qualities is my detailed comprehension of end-to-end data flow processes. I am able to fully grasp complex project requirements such as merging/upserting operations for incremental data through JSON parsing/nesting techniques. I excel at not just creating ETL pipelines but also optimizing them for maximum performance in Databricks- a skill that will benefit your project on many fronts. Furthermore, I understand how important well-documented solutions are. I assure you clear documentation and seamless knowledge transfer at every stage.

@zaryabk83

Hi, I'm Zaryab. I can support your Azure data engineering project end to end — ADF ingestion, Databricks PySpark notebooks, ADLS Gen2 and Delta Lake, incremental processing with MERGE/upsert, nested JSON parsing, deduplication, and source-to-target reconciliation. I'm comfortable building the full flow: SQL Server source → ADF/Databricks → ADLS Gen2 → Delta Lake → transformation and validation → unified target, with performance tuning and documentation. Quick questions before I confirm: is the Pune on-site requirement firm, or can this be remote? And roughly how many hours per week do you need? Happy to share similar project details on request. Best, Zaryab

@hanst12

Hello, I am a dedicated web developer with experience in HTML, CSS, JavaScript, PHP and SQL. I have carefully reviewed your project requirements and can deliver a clean, responsive and professional solution. I pay attention to details, communicate clearly, and will keep you updated throughout the project. I am ready to start immediately and can deliver within the proposed 7-day deadline. Thank you for considering my proposal.