Data Engineer - AWS/Redshift

Job Title : Data Engineer Experience : 5 years Budget : 30 LPA Location : Gurgaon Industry : Tech Product Overview : We are looking for a skilled Data Engineer with a strong background in AWS and Redshift skills. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines, ensuring data quality and availability, and enabling business teams to make data-driven decisions. You will work closely with data scientists, analysts, and other stakeholders to optimize our data infrastructure. Key Responsibilities : - Design, develop, and maintain data pipelines for extracting, transforming, and loading (ETL) data into data warehouses using AWS services such as Redshift, S3, Lambda, Glue, and EMR. - Implement data models in Redshift to optimize query performance and storage efficiency. - Develop and automate data quality checks to ensure the reliability and accuracy of the data. - Collaborate with data scientists and analysts to build scalable and efficient data solutions that support their requirements. - Optimize existing data processes for better performance and cost efficiency. - Monitor data pipeline performance and troubleshoot any issues to ensure smooth data flow. - Ensure data security and compliance standards are met, following best practices in AWS. - Document data architecture, models, and procedures for future reference. Required Skills and Qualifications : - Bachelor's degree in Computer Science, Engineering, or a related field. - 5 years of experience in data engineering, with a focus on AWS and Redshift. - Strong knowledge of AWS services such as Redshift, S3, Glue, Lambda, EMR, and IAM. - Proficiency in SQL and experience with data modeling for data warehouses. - Experience with ETL tools and frameworks. - Knowledge of data warehousing concepts, data lake architectures, and big data technologies. - Familiarity with programming languages such as Python, Java, or Scala. - Understanding of data security best practices and compliance in the cloud. - Strong problem-solving skills and ability to work in a fast-paced environment. Preferred Qualifications : - AWS Certified Data Analytics or AWS Certified Big Data certification. - Experience with Redshift Spectrum, Athena, or other data querying tools. - Familiarity with DevOps practices, including CI/CD pipelines, infrastructure as code (e.g., Terraform), and monitoring tools. - Knowledge of machine learning frameworks and data science workflows. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/10/2024