
Closed
Posted
We are looking for a highly skilled Senior Data Engineer with 8+ years of experience in designing, developing, and modernizing enterprise-scale data platforms. The ideal candidate should have strong expertise in Google Cloud Platform (GCP) and hands-on experience building scalable data pipelines, data migration, and modernization initiatives. Key Responsibilities Design, develop, and optimize end-to-end data pipelines on Google Cloud Platform (GCP). Build and maintain scalable ETL/ELT solutions using GCP services such as BigQuery, Dataflow, Dataproc, Cloud Storage, Pub/Sub, and Composer. Lead data modernization and migration projects from legacy/on-premise systems to GCP. Implement data integration, transformation, and orchestration processes for large-scale datasets. Ensure data quality, governance, security, and performance best practices. Collaborate with business stakeholders, architects, and cross-functional teams to deliver data-driven solutions. Required Skills 8+ years of experience in Data Engineering and Data Warehousing. Strong hands-on experience with GCP Data Engineering services. Expertise in building batch and real-time data pipelines. Proficiency in SQL, Python, and ETL/ELT frameworks. Experience with BigQuery, Dataflow (Apache Beam), Dataproc, Cloud Composer (Airflow), and Pub/Sub. Knowledge of data modeling, performance tuning, and cloud-native architectures. Experience in data migration and modernization programs. Preferred Qualifications GCP Professional Data Engineer Certification. Experience with CI/CD, DevOps, and Infrastructure as Code (Terraform). Exposure to modern data lake/lakehouse architectures.
Project ID: 40491600
23 proposals
Remote project
Active 2 days ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
23 freelancers are bidding on average ₹594 INR/hour for this job

Hi there, With 8+ years of experience as a data engineer, I have honed my skills in designing, developing, and modernizing enterprise-scale data platforms. My proficiency lies in Google Cloud Platform (GCP), having spent considerable time building and optimizing data pipelines using BigQuery, Dataflow, Dataproc, Cloud Storage, Pub/Sub, and Composer. My knowledge is not only limited to building batch and real-time data pipelines but also extends to ensuring data quality, governance, security, and performance - essential qualities for success as a Senior Data Engineer. Moreover, I have a solid grasp of ETL/ELT frameworks that are key players in any data migration project - an important responsibility listed in the job description. My extensive know-how on GCP is supplemented with hands-on experience working with SQL and Python, as well as my ability to apply data modeling and performance tuning strategies. Wielding Terraform for Infrastructure-as-Code (IaC) and having exposure to cloud-native architectures further qualifies me for this assignment.
₹575 INR in 40 days
4.6
4.6

As a Senior Data Engineer with 8+ years of experience and vast knowledge of GCP, I'm more than equipped to handle your project's requirements. My repertoire includes developing and optimizing data pipelines using GCP services such as BigQuery, Dataflow, and Composer. I am also adept in SQL and Python, which are key proficiencies you desire. My team and I at Krishna Kant boast a proven track record in delivering advanced data engineering solutions; from data migration and modernization programs to ensuring end-to-end data quality, governance, and performance. With hands-on experience in building both batch and real-time data pipelines, we can cater to all your project's needs. Moreover, our proficiency extends beyond just the technical aspect as we are well-versed in collaborating efficiently with stakeholders from various departments. We are excited about the opportunity to work on this project and promise you a tailored-fit solution that aligns closely with your goals for a well-optimized, secure and scalable data platform on GCP. Partnering with us will ensure that you have a Senior Data Engineer who isn't just technically sound but also understands the importance of building data-driven solutions that truly revamp your business processes.
₹750 INR in 40 days
3.8
3.8

Hi, I’m a Senior Data Developer with over 15 years of experience designing, building, and modernizing large-scale data platforms. I have strong hands-on expertise with Google Cloud Platform and have successfully delivered multiple data migration and modernization initiatives from legacy environments to cloud-native architectures. I am highly proficient in Python and SQL and have worked extensively on ETL/ELT frameworks, data modeling, performance optimization, and data quality implementation. Additionally, I have experience with CI/CD pipelines, Terraform-based infrastructure provisioning, and cloud best practices for governance, security, and scalability. I look forward to hearing from you.
₹575 INR in 40 days
3.2
3.2

Hi, I can easily DO your work IN 24 HOURS, DM me now to get started, PRICE NEGOTIABLE 100% Work satisfaction is provided
₹500 INR in 40 days
2.6
2.6

Hello, I understand that you are seeking a highly skilled Senior Data Engineer to design and develop scalable data platforms on Google Cloud Platform (GCP). With over 12 years of experience in Data Engineering, I have successfully led data modernization and migration projects, transforming legacy systems into efficient cloud-based solutions. My hands-on expertise with GCP services such as BigQuery, Dataflow, and Pub/Sub allows me to build robust ETL/ELT pipelines that ensure data quality and governance. I am proficient in SQL and Python, enabling me to optimize performance for large-scale datasets effectively. I collaborate seamlessly with cross-functional teams to deliver impactful data-driven solutions tailored to business needs. My knowledge of cloud-native architectures positions me well for this role. Could you please share more about the specific challenges you're facing in your current data platform that you'd like to address? Looking forward to the possibility of working together! Best regards, [Your Name]
₹750 INR in 7 days
0.0
0.0

The Senior Data Engineer for GCP Development project requires expertise in Python, SQL, and Google Cloud Platform, which aligns with my experience in building scalable backend systems using Python and managing databases. With a strong foundation in Python and SQL, I can effectively design and implement data warehousing solutions on Google Cloud Platform, leveraging BigQuery for data analysis. My experience with database administration and data integration will enable me to deliver a robust and efficient data pipeline. I am ready to discuss how my skills can support this project and propose a tailored approach to meet the client's needs, with a detailed estimate within the $400-$750 budget range, and I will send over a contract to get started immediately upon acceptance.
₹575 INR in 7 days
2.7
2.7

Hi, there! I recently led a project focused on modernizing an enterprise-scale data platform using Google Cloud Platform (GCP), emphasizing scalable data pipelines and migration strategies. In this role, I designed and optimized end-to-end ETL solutions utilizing GCP services such as BigQuery, Dataflow, and Cloud Composer. The challenge was to ensure seamless data migration from legacy systems while maintaining data quality and governance. I addressed this by implementing robust data validation checks and leveraging cloud-native architectures for performance optimization. I offer to bring my extensive experience in GCP and data engineering to your project, focusing on developing scalable and efficient data pipelines tailored to your specific needs. My approach includes collaboration with stakeholders to ensure that the solutions align with business objectives while adhering to best practices in data governance and security. If I use my previous experience, your project will likely be completed successfully. Hope to discuss this in detail. Through detailed discussion, I think I can find a better solution to finish your project successfully. Thank you.
₹575 INR in 40 days
0.0
0.0

I understand that you are looking for a highly experienced Senior Data Engineer with strong expertise in Google Cloud Platform to design, develop, and modernise large scale data systems. The role involves building and managing scalable data pipelines, handling data migration from legacy systems to cloud platforms, and ensuring strong data quality, security, and performance. You also need someone who can work with business and technical teams to deliver reliable data driven solutions. At 4U Consultancy Services, we specialise in building scalable and efficient cloud based data engineering solutions. I will start by understanding your current data architecture and migration requirements. Then I will design and develop end to end data pipelines using Google Cloud Platform services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, and Cloud Composer. I will focus on building both batch and real time processing systems using SQL and Python while ensuring proper data modelling, optimisation, and governance. I will also apply best practices for CI/CD and infrastructure as code to ensure a stable and maintainable system. I would be happy to discuss your project in more detail and understand your environment and goals so we can build a strong and reliable data platform for your business. Please feel free to connect with me over a chat so we can get started.
₹575 INR in 40 days
0.0
0.0

I bring 10+ years of experience in designing and modernizing large-scale data platforms, with strong hands-on expertise in Google Cloud Platform (GCP) data engineering services. I can design and optimize end-to-end batch and real-time pipelines using BigQuery, Dataflow (Apache Beam), Pub/Sub, Dataproc, Cloud Storage, and Cloud Composer (Airflow). I’ve led multiple migration and modernization projects from legacy/on-prem systems to cloud-native architectures, focusing on scalability, cost optimization, and performance tuning. My approach emphasizes clean data modeling, robust ETL/ELT design, data governance, and production-grade CI/CD using Terraform and DevOps best practices. I also ensure strong monitoring, logging, and failure recovery for enterprise reliability. I collaborate closely with stakeholders and architects to translate business needs into scalable data solutions. I’m comfortable owning architecture decisions end-to-end and delivering production-ready systems in fast-paced environments.
₹400 INR in 40 days
0.0
0.0

Hi, I have carefully reviewed your project requirements and understand what you are looking for. I can help you with: • Build AI-powered ai/ml development with Python, SQL, Database Administration • Implement machine learning models with clean architecture • Deliver production-ready AI solution with monitoring I will build a ai/ml development that is reliable, scalable, and easy to use. What you will get: 1. Fully functional solution 2. Clean and well-structured code 3. Setup instructions and documentation 4. Ongoing support (if needed) I have experience in Python, SQL, Database Administration, and I have worked on similar projects involving ai/ml development. I am confident I can deliver this project within your expected timeline and quality. Let's connect and discuss your requirements in detail. Best regards, Chintan
₹750 INR in 21 days
0.0
0.0

WE'VE JUST COMPLETED A SIMILAR PROJECT. Our recent project began with outdated data systems hindering growth. After implementation, the client saw a 30% increase in data processing efficiency and a 20% rise in actionable insights. This success aligns perfectly with your goal to modernize data platforms and enhance scalability. I'd love to chat about your vision and bring it to life! The worst that can happen is you walk away with a free consultation. Regards, Laurence.
₹400 INR in 7 days
0.0
0.0

Scope Understanding: Migrating legacy data to scalable GCP pipelines while ensuring speed, accuracy, and zero downtime is tough. Who we are: SCAIMLON LABS PVT. LTD. is a Bengaluru & Chennai-based Cloud MSP and certified Microsoft Azure, AWS, and Google Partner. Your Ask: Build and optimize enterprise-scale data pipelines on GCP, migrate legacy datasets, and ensure reliable, secure, and high-performance data flows for analysis and reporting. Our Solution Approach: We will design end-to-end GCP data pipelines using BigQuery, Dataflow, Dataproc, Composer, and Pub/Sub, automate ETL/ELT processes, migrate legacy datasets, and deliver optimized, secure pipelines with full operational documentation Deliverables: End to end GCP pipelines, legacy data migration, ETL automation, performance testing, runbook documentation Relevant Experience: Firepack faced unreliable cloud deployments that delayed releases. Platform: AWS. Problem solved: configured secure pipelines and automated data flows. Outcome: stable, high-performance cloud setup with full handover documentation. Call to Action: If you want scalable, secure GCP data pipelines delivered with full documentation and zero downtime, we are ready to implement it flawlessly. Happy to jump on a quick call to walk you through our approach before you decide.
₹450 INR in 136 days
0.0
0.0

Hi there, What is the biggest challenge your team is currently facing with data modernization or cloud migration initiatives? I've reviewed your requirements and can help design, build, and optimize enterprise-scale data platforms on GCP with a focus on scalability, reliability, and performance. My approach is to assess the current data landscape, architect cloud-native solutions, develop robust batch and real-time pipelines, implement modernization and migration strategies, and establish governance, monitoring, and performance optimization best practices. A little about me: I work with large-scale data engineering solutions involving GCP, ETL/ELT frameworks, data warehousing, orchestration platforms, and cloud migration projects, helping organizations transform raw data into reliable business assets. A few questions: 1. What are the primary source systems involved in the migration (on-prem databases, Hadoop, cloud platforms, etc.)? 2. Is the immediate need project-based support or a long-term engagement? 3. Are there existing GCP environments and data pipelines that require optimization, or is this a greenfield implementation? I'd be happy to discuss your data platform goals, modernization roadmap, and technical requirements in more detail. Feel free to send me a message via Freelancer.com chat so we can review the project and determine the best approach. With regards, Rajat Tiwedi
₹575 INR in 40 days
0.0
0.0

Hello, I am interested in this opportunity and have experience working with Python, SQL, data processing, and cloud-based applications. I have a strong background in software development and data-driven solutions, with hands-on experience in building scalable applications and integrating modern technologies. My key strengths include: • Python and SQL development • Data analysis and ETL workflows • Database design and optimization • Cloud technologies and API integrations • Problem-solving and performance optimization I am eager to contribute to data engineering projects involving GCP, BigQuery, and large-scale data processing. I am a quick learner, highly adaptable, and committed to delivering quality solutions. I would be happy to discuss how my skills can support your project requirements. Best regards, Pratik Kamble
₹400 INR in 40 days
0.0
0.0

Having invested over a decade in software engineering and data domains, I embody a formidable blend of experience and technical expertise that sets me apart from the crowd. Specializing in Python, I have successfully designed and scaled high-performance AI driven systems alongside scalable APIs and distributed architectures. Equipped with strong problem-solving skills, I have consistently developed clean, efficient codes and delivered reliable solutions securing better ROI for my clients. My ultimate goal is to help organizations like yours manage large-scale datasets proficiently while delivering immaculate technology-based services. By hiring me, not only do you get access to extensive industry experience but also the resourcefulness and determination which have marked every project I undertook. Choose me as your Senior Data Engineer for this transformational endeavor; rest assured, you have a proactive partner who will fiercely ensure your success.
₹575 INR in 40 days
0.0
0.0

Dear Sir/Madam, I am an experienced Python Developer with strong expertise in building scalable backend systems, APIs, automation tools, and full-stack applications. I specialize in delivering clean, efficient, and production-ready solutions. I have successfully developed and deployed multiple live applications including healthcare platforms, legal service apps, school management systems, fintech apps, and real-time communication systems. My Core Python Expertise ✔ Django & Django REST Framework ✔ FastAPI (High-performance APIs) ✔ Flask ✔ SQLModel / SQLAlchemy ✔ PostgreSQL / MySQL / MongoDB ✔ Supabase Integration ✔ Authentication (JWT, OAuth) ✔ Payment Gateway Integration (PhonePe, Razorpay, Stripe) ✔ Web Scraping (BeautifulSoup, Selenium) ✔ Automation Scripts ✔ WebSocket & Real-time Systems ✔ Docker Deployment ✔ AWS / VPS Deployment ✔ REST API Design & Optimization What I Can Build For You Secure REST APIs SaaS backend architecture Admin dashboards Real-time chat systems Payment systems Data processing systems Microservices architecture AI/ML API integration Custom business logic systems Recent Project Experience Healthcare booking & wallet system Legal consultation backend platform School ERP & management API Fintech wallet & transaction management Real-time chat application (WebSocket + MQTT) Location-based services & geo APIs
₹400 INR in 40 days
0.0
0.0

I am Sourabh Joshi, a Senior Data & AI Engineer with 8+ years of experience in designing, building, optimising, and modernising enterprise-scale data platforms across cloud, big data, and data warehousing environments. My relevant expertise includes: Building batch and real-time data pipelines using Python, SQL, Spark, Airflow, Pub/Sub, and cloud storage Designing scalable data platforms on GCP using BigQuery, Dataflow, Dataproc, Cloud Composer, Cloud Storage, and Pub/Sub Migrating legacy/on-premise data systems to modern cloud-native platforms Data warehousing, data modeling, ETL/ELT design, performance tuning, and cost optimization Implementing data quality, reconciliation, governance, monitoring, and secure access patterns Working with CI/CD, DevOps practices, and infrastructure automation concepts For your requirement, I can help with: Current-state assessment of your legacy/on-premise data systems Target GCP architecture design using BigQuery, Dataflow, Dataproc, Composer, Pub/Sub, and Cloud Storage Pipeline development for batch and real-time ingestion Migration strategy and execution with validation and reconciliation Performance optimisation for BigQuery, Spark/Dataflow, and orchestration workflows Data quality and governance setup Production deployment support, documentation, and handover
₹400 INR in 40 days
0.0
0.0

I understand you are looking to build a scalable, automated data architecture to state the primary goal. With my background in data engineering, I can help you design a reliable solution.
₹750 INR in 20 days
0.0
0.0

Ahmedabad, India
Payment method verified
Member since Dec 24, 2019
₹37500-75000 INR
₹5000-7000 INR
₹600-1500 INR
₹1000-5000 INR
₹1500-12500 INR
$8-15 USD / hour
₹750-1250 INR / hour
$25-50 USD / hour
$50-100 USD
₹50000-100000 INR
$30-250 USD
₹600-1500 INR
₹150000-250000 INR
₹12500-37500 INR
$250-750 USD
₹400-750 INR / hour
$15-60 USD / hour
₹12500-37500 INR
$250-750 USD
$2-8 USD / hour
₹100-400 INR / hour
€250-750 EUR
$10-30 USD
$10-30 USD
£18-36 GBP / hour