Data Engineer - SQL/Python

We have urgent job opening for Data Engineer with Top MNC in Bangalore Experience : 4-9 years Shift : 12pm to 9pm Must Have : - Strong SQL & Python - AWS - S3 Lambda, Glue, step functions, Redshift Good to have : Build data warehouse, solutions on cloud, DW concepts, CI/CD, Terraform, GitLab Culture : Should be a good team player, highly contribution motivated, small portion of support & enhancements Responsibilities : - Collaborate with the data team to design and develop BI and analytics solutions. - Implement batch and near real-time data movement patterns, establishing best practices in data engineering. - Design and build cloud-based data solutions (data lakes, warehouses, marts, and analytics) by working closely with business analysts, project managers, architects, and developers. - Lead efforts to blend, analyse, and harmonize data, ensuring it is well-modelled for effective analytics in a dynamic data environment. - Develop and maintain data pipelines from multiple data sources. - Exhibit strong problem-solving and analytical skills, effectively communicating technical solutions to both internal and external stakeholders. - Collaborate with cross-functional teams, including onshore/offshore development, QA teams, and vendors, to ensure timely data delivery. - Troubleshoot, backtrack, and resolve issues as necessary. - Update and maintain key cloud data solution deliverables and diagrams. - Ensure adherence to Georgia-Pacific's data architecture guidelines and enterprise data strategies. Basic Qualifications : - Bachelor's degree in Computer Science, Engineering, or a related field with 5-8 years of experience in software development. - Expertise in S3, AWS Glue, Spark, AWS Lambda, Python, Columnar Databases (Redshift or Snowflake), and SQL. - Working knowledge of AWS IAM, Step Functions, Git, Terraform, and CI/CD pipelines. - 5 years of hands-on experience designing, implementing, and managing large-scale ETL solutions. - 3 years of experience in business intelligence, data modelling, data engineering, and ETL, with proficiency in SQL, Python, and related frameworks. - Experience in designing and optimizing queries for Columnar Databases (Redshift or Snowflake). - Strong understanding of Data Engineering, Data Warehousing, OLAP, and database concepts. - Familiarity with DevSecOps/DataOps processes, CI/CD tools, and methodologies (e.g., GitLab, Terraform). - Ability to analyze large datasets to resolve data quality issues. What Puts You Ahead : - AWS certifications such as Solutions Architect (SAA/SAP) or Data Engineering Associate (DEA). - Hands-on experience with AWS data technologies and at least one full lifecycle project involving AWS data solutions. - Experience with visualization tools like Tableau or PowerBI. - Knowledge of OLAP technologies and Data Virtualization tools (e.g., Denodo). - Familiarity with the manufacturing and finance domains. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 10/9/2024