Data Engineer - AWS & Snowflake DB

Job Overview : - Experienced Data engineer(6) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems. - Responsible for Cloud migrations for data pipelines using AWS and Snowflake - Participate in all aspects of the software development lifecycle for AWS and Snowflake solutions, including planning, requirements, development, testing, and quality assurance - Work in tandem with our engineering team to identify and implement the most optimal cloud-based solutions. - Troubleshoot incidents, identify root causes, fix and document problems, and implement preventive measures. - Working experience on Snowflake Platform - Working Cloud knowledge on AWS (Certification preferred) - Working Snowflake knowledge with Designing data warehouses - Strong hands-on experience in Python with ETL concepts - Good understanding on Metadata and data lineage - Able to demonstrate experience with software engineering practices including CI/CD, Automated testing and Performance Engineering. - Good understanding and exposure on any Git, Bamboo, Confluence and Jira. - Good problem solving and troubleshooting skills. Soft skills : - Team player, collaborative approach and excellent communication skills - Candidate should be good in communication and articulation Note : Qualification : BE/Btech , MCA , Msc it /cs Full Time 1. Needs to be a permanent employee throughout professional tenure. 2. Educational Qualification has to be full time 3. Gap if any (mention reason and duration if more than 6 months) Key Responsibilities : Data Pipeline Development : Design, develop, and maintain end-to-end ETL/ELT pipelines in Snowflake, from raw data ingestion to transformation and loading into the data warehouse. Automate data integration workflows, ensuring seamless data flow from various source systems (databases, APIs, files, etc.) into Snowflake. Optimize data pipeline performance and ensure scalability for large datasets and high throughput. Data Modeling and Architecture : Design and implement data models in Snowflake that align with business requirements and analytical needs. Work with business intelligence and analytics teams to create data schemas that support reporting, dashboarding, and ad-hoc querying. Build and maintain efficient and normalized data models (star/snowflake schema, fact/dimension tables, etc.). Snowflake Data Warehouse Management : Manage Snowflake's data storage, performance tuning, and cost optimization. Implement Snowflake features such as streams, tasks, and zero-copy cloning to improve data management and processing efficiency. Perform data migrations, backups, and replication to ensure data integrity and availability. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/20/2024