Data Engineer - Azure Databricks

We are looking for Azure Data Engineers. Exp : 4 -7 Years. Location : Hyderabad/Bangalore. Mode : Hybrid. Notice : 10 days. Skills : Mandatory : Pyspark,SQL,DAX,Cube,. Preferred : ADF,ADB,SSIS/SSAS, Fabric. Responsibilities : Data Curation and Transformation : - Translate business requirements into technical solutions for data curation and transformation, specifically using Databricks Lakehouse from a modeling and ELT perspective. - Azure Data Engineering : Develop data pipelines and orchestration using Azure Data Factory and other Azure Modern Data Warehouse platform components. - SQL and Pyspark : Utilize SQL programming and Pyspark for data manipulation and processing tasks. - Azure Services : Work with Azure services such as ADLS (Azure Data Lake Storage), ADX (Azure Data Explorer), and Databricks. - Data Migration : Experience in SQL Server migration to the cloud and handling structured and unstructured datasets. - DevOps and CI/CD : Good knowledge of DevOps tools and processes, and experience in automating data pipelines through a CI/CD delivery methodology. - Databricks Expertise : In-depth hands-on implementation knowledge on Azure Databricks, Databricks Delta Lake, and managing Delta Tables. - Data Modeling : Understand and implement data modeling for the data lake. - Data Transfer and Oracle PL/SQL : Hands-on experience in using secure file transfer tools like Kiteworks, and Oracle PL/SQL knowledge will be a plus. - Effort Estimation : Provide effort estimation for new projects related to data engineering. - Complex Design and Agile Environment : Drive complex design and development efforts in an agile : - Minimum of 5-7 years of experience working on Azure and Databricks "Lakehouse" implementation. - Strong experience in ADF (Azure Data Factory) and SQL as primary skills. - Familiarity with Informatica PWC and Oracle PL/SQL. - Experience in SQL programming and Pyspark. - 2 or more years of experience as a Data Engineer, specifically in the Azure Modern Data Warehouse platform. - Good understanding of data modeling and data lake concepts. - Expertise in Databricks, ADLS, ADX, and other Azure services. - Prior experience in SQL Server migration to the cloud. - Knowledge of DevOps tools and processes (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/8/2024