Senior Data Engineer - ETL

Senior Data Engineer. Location : Hyderabad, Bangalore, Pune (Hybrid). Experience : 6 years overall, 4 years relevant. Job Description : We are looking for a Senior Data Engineer with expertise in Azure Data Factory, Azure Databricks, Python/PySpark, and SQL to join our team. The ideal candidate will play a key role in designing, building, and optimizing scalable data pipelines for advanced analytics and reporting. Key Responsibilities : - Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Databricks. - Implement data transformation and processing using Python/PySpark. - Optimize and fine-tune SQL queries for efficient data retrieval and storage. - Build and maintain data models, data lakes, and data warehouses in the Azure ecosystem. - Ensure data quality, governance, and security across all pipelines. - Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and provide solutions. - Monitor, troubleshoot, and improve performance of data pipelines. Required Skills & Experience : - Azure Data Factory (ADF) : Hands-on experience in creating and managing data pipelines. - Azure Databricks : Strong experience in big data processing and analytics. - Python/PySpark : Expertise in writing efficient and scalable data processing scripts. - SQL : Advanced skills in writing complex queries, performance tuning, and working with large datasets. - Data Modeling : Experience with dimensional modeling and schema design. - Cloud & Big Data Technologies : Experience in handling large-scale data processing in Azure. - Version Control & CI/CD : Experience with Git, DevOps, or similar tools for deployment automation. Good to Have : - Experience with Azure Synapse Analytics or other cloud data warehousing solutions. - Knowledge of Kafka, Event Hubs, or other real-time streaming technologies. - Familiarity with Data Governance, Security, and Compliance Best Practices. Work Setup : - Hybrid working model with flexibility to collaborate from Hyderabad, Bangalore, or Pune. How to Apply : Interested candidates can share their resumes with the following details:. Total Experience:. Relevant Experience:. Notice Period:. Current Pay:. Expected Pay:. Preferred Location: (Hyderabad / Pune / Bengaluru). If you are passionate about data engineering and eager to work in a fast-paced, cloud-driven environment, apply now . (ref:hirist.tech)

Location: pune, IN

Posted Date: 3/29/2025