Azure Data Engineer - ETL Tools

Job Title: Azure Data Engineer Location: [NOIDA] Job Type: [Full-time] Job Description: We are seeking a skilled and motivated Azure Data Engineer with expertise in Azure Data Services, Data Bricks, SQL, Python, PySpark, and Azure Data Factory to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and managing data pipelines, ensuring the smooth flow of data between various systems and applications, and optimizing data storage and processing. The ideal candidate will have a strong background in cloud data engineering, with hands-on experience in Azure technologies, data orchestration, and data processing frameworks like PySpark. Responsibilities : Data Engineering & Architecture: Design, develop, and maintain scalable and efficient data pipelines and data models using Azure services like Azure Data Factory, Azure Data Lake, and Azure Synapse Analytics. Data Processing: Leverage Azure Databricks, PySpark, and Python to perform ETL tasks, process large data sets, and implement complex transformations. SQL & Data Modeling: Utilize SQL to write complex queries and manage relational and non-relational data sources. Build efficient and reusable SQL scripts for data extraction, transformation, and loading. Data Integration & Automation: Create automated data workflows using Azure Data Factory to integrate disparate data sources and build continuous data integration pipelines. Performance Optimization: Monitor and optimize the performance of data pipelines and data processing workflows to ensure low-latency and high-throughput data processing. Collaboration & Reporting: Work closely with data scientists, analysts, and other stakeholders to ensure that data systems meet organizational requirements and deliver timely, accurate insights. Troubleshooting & Support: Provide troubleshooting and support for any data pipeline or system issues, ensuring that data solutions are robust, scalable, and maintainable. Documentation & Best Practices: Maintain comprehensive documentation of all data engineering solutions, and adhere to best practices and data governance standards. Skills & Qualifications : - Proven experience as an Azure Data Engineer or similar role with a strong understanding of cloud-based data solutions. - Strong proficiency in Azure Data Factory, Azure Databricks, and other Azure data services. - Proficient in SQL, with experience writing complex queries for data manipulation, aggregation, and transformation. - Hands-on experience with Python and PySpark for data processing and ETL tasks. - Familiarity with data storage technologies like Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics. - Experience in building and automating data pipelines using Azure Data Factory and other ETL tools. - Knowledge of data warehousing concepts and designing data models for analytical workloads. - Ability to optimize data workflows for performance, scalability, and cost-efficiency. - Excellent problem-solving skills and ability to troubleshoot and debug complex data systems. - Strong communication and collaboration skills with the ability to work in a team-oriented environment. Preferred Qualifications : - Microsoft Azure certifications (e.g., Azure Data Engineer Associate). - Experience with Azure Synapse Analytics, Azure SQL Data Warehouse, or similar data warehousing solutions. - Familiarity with Data Lake and Data Mesh architectures. - Experience with data governance, data security, and compliance in the Azure cloud environment. - Knowledge of machine learning or data science concepts is a plus. (ref:hirist.tech)

Location: noida, IN

Posted Date: 3/26/2025