Senior Data Engineer - AWS Platform

Job Title : Senior AWS Data Engineer Company : AstroSoft Technologies About the Job : Astrosoft Technologies, a leading provider of innovative Data, Analytics, Cloud, AI/ML, and Digital solutions, is seeking a highly experienced and driven Senior AWS Data Engineer to join our expanding team in Hyderabad. We are looking for a seasoned professional with 8-12 years of experience in building and managing complex data engineering solutions on the AWS platform. This role offers a unique opportunity to work on cutting-edge projects and contribute to the success of our clients. Location : Hyderabad, India (Hybrid) Job Type : Full-Time Experience : 8-12 Years Key Responsibilities : - Advanced Data Pipeline Development : Design, develop, and implement highly scalable and performant data pipelines using advanced AWS services like AWS Glue, Lambda, EMR, and MWAA (Airflow). - Real-Time Data Streaming : Architect and implement complex real-time data streaming solutions using Kafka, Spark Streaming, and Flink. - Data Warehousing & Optimization : Design and optimize data warehouses using Amazon Redshift, focusing on performance tuning, scalability, and cost-effectiveness. - Infrastructure as Code (IaC) : Develop and maintain robust and reusable infrastructure as code using Terraform, ensuring consistent and automated deployments. - ETL/ELT Architecture : Design and implement sophisticated ETL/ELT architectures, including data quality checks and data governance processes. - Database Management & Optimization : Manage and optimize database platforms like Oracle and AWS Redshift, including advanced SQL tuning, physical optimization, and performance monitoring. - SRE & Observability : Implement and maintain robust SRE practices, including monitoring, alerting, and logging using tools like CloudWatch, Splunk, and DataDog. - Cloud Architecture & Design : Design and implement scalable and secure cloud architectures, adhering to AWS best practices. - Collaboration & Communication : Collaborate with business partners, data scientists, and other engineers to understand complex requirements and deliver effective solutions. - Mentorship & Leadership : Mentor junior engineers and contribute to the development of best practices and standards. - Problem Solving & Innovation : Identify and solve complex technical challenges, driving innovation and continuous improvement. Required Skills and Qualifications : - Experience : 8-12 years of experience in data engineering and analytics on the AWS platform. - AWS Expertise : Deep understanding and extensive experience with AWS services, including S3, SNS, SQS, MWAA (Airflow), Glue, DMS, EMR, and Redshift. - Stream Processing : Expert-level knowledge of streaming architectures and technologies like Kafka, Spark Streaming, and Flink. - Programming Skills : Strong proficiency in Python (preferred), Java, or Scala. - Infrastructure as Code : Extensive experience with Terraform for building and managing AWS infrastructure. - ETL/ELT Expertise : Advanced experience with ETL/ELT tools and techniques on AWS. - Database Proficiency : Strong expertise in database platforms like Oracle and AWS Redshift, including advanced SQL tuning and optimization. - SRE & Observability : Deep understanding and experience with SRE principles and tools like CloudWatch, Splunk, and DataDog. - Communication & Collaboration : Excellent communication, collaboration, and interpersonal skills. - Problem Solving & Critical Thinking : Strong analytical and problem-solving skills, with the ability to think critically and creatively. - Self-Motivation & Leadership : Self-motivated, able to work independently, and demonstrate strong leadership skills. Desired Skills and Experience : - AWS Certified Data Analytics - Specialty or other relevant AWS certifications. - Experience with advanced data governance and data quality tools. - Experience with machine learning and AI on AWS. - Experience with containerization and orchestration technologies like Docker and Kubernetes. - Experience with complex data modeling and data architecture design. Benefits Program : H1B Sponsorship (Depends on Project & Performance) Lunch & Dinner (Every day) Health Insurance Coverage- Group Industry Standards Leave Policy Skill Enhancement Certification Hybrid Mode Interview Process : 2 Technical Rounds Early Joiners Preferred - - (ref:hirist.tech)

Location: hyderabad, IN

Posted Date: 3/26/2025