Data Engineer - Google Cloud Platform

Location : Chennai Experience : 4 to 9 yrs Work Mode : Hybrid Company type : Product based Based MNC Job Description : We are seeking a highly skilled GCP Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, a deep understanding of Google Cloud Platform (GCP) services, and hands-on experience with SQL, Python, BigQuery, Dataflow/Airflow, and Dataproc. As a GCP Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and ensuring the efficient processing and storage of large datasets. Roles and Responsibilities : - Design, develop, and maintain scalable and robust data pipelines using GCP services. - Work with BigQuery to design and optimize data warehouses and analytical solutions. - Develop data processing workflows using Dataflow and/or Apache Beam. - Implement and manage ETL processes and data orchestration with Airflow. - Leverage Dataproc for big data processing tasks using Hadoop, Spark, and other technologies. - Write efficient SQL queries for data extraction, transformation, and loading (ETL). - Utilize Python for data manipulation, automation, and integration tasks. - Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. - Ensure data quality, integrity, and security across all data platforms. - Monitor, troubleshoot, and optimize data processing workflows for performance and reliability. - Stay up-to-date with the latest trends and best practices in data engineering and GCP services (ref:hirist.tech)

Location: chennai, IN

Posted Date: 10/10/2024