Data Engineer - Google Cloud Platform

Data Engineer (Google Cloud Platform - GCP) Job Overview : We are seeking a skilled Data Engineer with expertise in Google Cloud Platform (GCP) to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have hands-on experience with GCP services such as BigQuery, Dataflow, Pub/Sub, Cloud Composer, Cloud Storage, and Dataproc, and strong programming skills in Python, SQL, or Java. Key Responsibilities : - Design, develop, and maintain scalable data pipelines and ETL processes using GCP services. - Build and optimize data warehouse solutions using BigQuery. - Develop real-time and batch data processing workflows using Apache Beam, Dataflow, and Pub/Sub. - Automate workflows and orchestrate pipelines with Cloud Composer (Apache Airflow). - Work with structured and unstructured data to support business analytics and machine learning initiatives. - Implement data governance, security, and compliance best practices. - Collaborate with data analysts, data scientists, and business stakeholders to define data requirements. - Monitor and optimize data processing performance, scalability, and cost efficiency. - Develop CI/CD pipelines for data engineering solutions using Terraform, Cloud Build, or similar tools. Required Skills & Qualifications : - 3 years of experience in data engineering. - Hands-on experience with Google Cloud Platform (GCP) services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer. - Strong programming skills in Python, SQL, or Java. - Expertise in ETL development, data modeling, and data warehousing. - Experience with Apache Beam, Apache Airflow, or Spark. - Proficiency in writing complex SQL queries and optimizing database performance. - Familiarity with Terraform, Kubernetes, or Docker is a plus. - Understanding of data security, compliance, and governance best practices. - Experience with streaming data architectures is a plus. - Strong problem-solving and communication skills. Preferred Qualifications : - Google Cloud Professional Data Engineer certification is a plus. - Experience in machine learning pipelines and MLOps. - Knowledge of NoSQL databases (Firestore, Bigtable, or MongoDB). - Experience with BI tools like Looker, Tableau, or Power BI. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 3/26/2025