Azure Data Engineer - Teradata

Job Title : Azure Data Engineer (Teradata ). Location : Bangalore, Hyderabad, Chennai. Experience : 5-7 Years. Required skills : Teradata , Azure, Databricks, Python , Pyspark. Job Description : We are seeking a highly skilled Azure Data Engineer with extensive experience in Teradata to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining data pipelines and solutions on the Azure cloud platform while leveraging Teradata for data warehousing and analytics Responsibilities : - Design, develop, and maintain efficient and reliable data pipelines for ingesting, processing, and transforming large datasets from various sources, including Teradata, into Azure data services. - Implement data integration and ETL/ELT processes using Azure Data Factory, Databricks, and other relevant Azure services. - Optimize data pipelines for performance, scalability, and reliability. - Monitor and troubleshoot data pipeline issues, ensuring data quality and availability. - Develop and maintain efficient data extraction and loading processes between Teradata and Azure data services. - Optimize Teradata queries and data models for performance and efficiency. - Troubleshoot and resolve issues related to Teradata integration. - Understand and implement best practices for data migration from Teradata to Azure. - Design and implement data solutions using Azure data services, including Azure Data Lake Storage (ADLS), Azure SQL Database, Azure Synapse Analytics, and Azure Databricks. - Develop and deploy data processing applications using Python and PySpark on Azure Databricks. - Implement data security and governance best practices on the Azure platform. - Utilize Azure DevOps for CI/CD pipelines. - Design and implement data models for analytical and reporting purposes. - Develop and maintain data warehouses and data marts on Azure Synapse Analytics and Teradata. - Ensure data quality and consistency across all data platforms. - Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective solutions. - Communicate technical concepts and solutions effectively to both technical and non-technical audiences. - - Participate in code reviews and contribute to team knowledge sharing. - Document all processes and procedures. Required Skills : - Strong experience in Teradata database administration, development, and optimization. - Proficiency in writing complex SQL queries and stored procedures. - Experience with Teradata utilities and tools (e.g., BTEQ, FastLoad, MultiLoad). - Understanding of Teradata architecture. - Extensive experience with Azure data services, including Azure Data Factory, Azure Databricks, Azure Data Lake Storage (ADLS), Azure SQL Database, and Azure Synapse Analytics. - Experience with Azure DevOps for CI/CD pipelines. - Understanding of Azure security and networking concepts. - Strong proficiency in Python. - Extensive experience with PySpark for data processing and transformation. - Experience with SQL. - Solid understanding of data warehousing, ETL/ELT, and data modeling principles. - Experience with data quality and data governance best practices. - Experience with large scale data processing. - Excellent problem-solving and analytical skills. - Strong communication and collaboration skills. - Ability to work independently and as part of a team. - Ability to learn new technologies quickly. - Preferred Skills : - Experience with other cloud platforms (AWS, GCP). - Experience with data visualization tools (Power BI, Tableau). - Experience with data streaming technologies (Kafka, Azure Event Hubs). - Experience with data governance tools. - Knowledge of Data science/Machine learning concepts. Education : - Bachelor's or Master's degree in Computer Science, Engineering, or a related field. (ref:hirist.tech)

Location: in, IN

Posted Date: 3/26/2025