Lead Data Engineer

Job Description : Key Responsibilities : - Lead and manage the entire offshore data engineering team, providing guidance, mentorship, and performance management. - Foster a collaborative and high-performing team environment. - Oversee resource allocation, project planning, and task prioritization. - Conduct regular team meetings and provide progress updates to stakeholders. - Design and implement effective database solutions and data models to store and retrieve company data. - Examine and identify database structural necessities by evaluating client operations, applications, and programming requirements. - Assess database implementation procedures to ensure compliance with internal and external regulations. - Install and organize information systems to guarantee company functionality. - Prepare accurate database design and architecture reports for management and executive teams. - Oversee the migration of data from legacy systems to new solutions. - Monitor system performance by performing regular tests, troubleshooting, and integrating new features. - Recommend solutions to improve new and existing database systems. - Design and implement scalable and efficient ETL/ELT processes using Azure Data Factory, Databricks, and other relevant tools. - Build and maintain data warehouses and data lakes using Azure Synapse, Snowflake, BigQuery, and Azure Data Lake. - Develop and optimize data pipelines for data ingestion, transformation, and loading. - Implement data quality checks and validation processes. - Support data analytics initiatives by providing access to reliable and accurate data. - Develop data visualizations and dashboards using Power BI and Tableau. - Collaborate with data scientists and business analysts to translate business requirements into technical solutions. - Educate staff members through training and individual support. - Work within an Agile Scrum framework. - Utilize IT Service Management best practices. - Provide Techno-Functional Management. Mandatory Skills and Expertise : - Azure SQL - Azure Data Factory - Azure Data Lake - Azure Databricks - Azure Synapse - Snowflake - BigQuery - T-SQL - DBT - ETL/ELT - PySpark - Data Warehousing - Data Analytics - Data Visualization Qualifications : - Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field. - Proven experience leading and managing data engineering teams. - Extensive experience in designing and implementing data solutions on Azure and other cloud platforms. - Strong understanding of data warehousing, data modeling, and ETL/ELT concepts. - Proficiency in SQL and scripting languages (Python, PySpark). - Excellent communication, leadership, and problem-solving skills. - Proven experience in client facing roles. (ref:hirist.tech)

Location: coimbatore, IN

Posted Date: 3/26/2025