Azure Data Engineer - Python/SQL

Primary Skills : ADF,Databricks Secondary Skills : DBT, Python, Databricks, Airflow, Fivetran, Glue, Snowflake Role Responsibility : - Translate functional specifications and change requests into technical specifications - Translate business requirement document, functional specification, and technical specification to related coding - Develop efficient code with unit testing and code documentation - Ensuring accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem solving - Setting up the development environment and configuration of the development tools - Communicate with all the project stakeholders on the project status - Manage, monitor, and ensure the security and privacy of data to satisfy business needs - Contribute to the automation of modules, wherever required To be proficient in written, verbal and presentation communication (English) - Co-ordinating with the UAT team Role Requirement : - Proficient in basic and advanced SQL programming concepts (Procedures, Analytical functions etc.) - Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing dimensions etc.) - Knowledgeable in Shell / PowerShell scripting - Knowledgeable in relational databases, nonrelational databases, data streams, and file stores - Knowledgeable in performance tuning and optimization - Experience in Data Profiling and Data validation - Experience in requirements gathering and documentation processes and performing unit testing - Understanding and Implementing QA and various testing process in the project - Knowledge in any BI tools will be an added advantage - Sound aptitude, outstanding logical reasoning, and analytical Skills : - Willingness to learn and take initiatives - Ability to adapt to fast-paced Agile environment Additional Requirement : - Demonstrated expertise as a Data Engineer, specializing in Azure cloud services. - Highly skilled in Azure Data Factory, Azure Data Lake, Azure Databricks, and Azure Synapse Analytics. - Create and execute efficient, scalable, and dependable data pipelines utilizing Azure Data Factory. - Utilize Azure Databricks for data transformation and processing. - Effectively oversee and enhance data storage solutions, emphasizing Azure Data Lake and other - Azure storage services. - Construct and uphold workflows for data orchestration and scheduling using Azure Data Factory or equivalent tools. - Proficient in programming languages like Python, SQL, and conversant with pertinent scripting languages. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/19/2024