Data Engineer - ETL/Java/Python

What You'll Be Doing : - Collaborate with teams across the organization, including product managers, data engineers and business leaders to translate requirements into software solutions to process large amounts of data. - Develop new ways to ensure ETL and data processes are running efficiently. - Write clean, maintainable, and reusable code that adheres to best practices and coding standards. - Conduct thorough code reviews and provide constructive feedback to ensure high-quality codebase. - Optimize software performance and ensure scalability and reliability. - Stay up-to-date with the latest trends and advancements in data processing and ETL development and apply them to enhance our products. - Meet with product owners and other stakeholders weekly to discuss priorities and project requirements. - Ensure deployment of new code is tested thoroughly and has business sign off from stakeholders as well as senior leadership. - Handle all incoming support requests and errors in a timely manner and within the necessary time frame and timezone commitments to the business. Skills you need in order to succeed in this role : What you will bring : - 7 years of experience with Java 11(required), managing and working in Maven projects - 2 years of experience with Python (required) - Knowledge and understanding of complex data pipelines utilizing ETL processes (required) - 4 years of experience using relational databases and deep knowledge of SQL with the ability to understand complex data relationships and transformations (required) - Knowledge and understanding of Git (required) - 3 year of experience with various GCP technologies - Google Dataflow (Apache Beam SDK) (equivalent Hadoop technologies) - BigQuery (equivalent of any data warehouse technologies: Snowflake, Azure DW, Redshift) - Cloud Storage Buckets (equivalent to S3) - GCloud CLI - Experience with Apache Airflow / Google Composer - Knowledge and understanding of Docker, Linux, Shell/Bash and virtualization technologies - Knowledge and understanding of CI/CD methodologies - Ability to understand and build UML diagrams to showcase complex logic - Experience with various organization/code tools such as Jira, Confluence and GitHub Bonus Points for Tech Enthusiasts : - Infrastructure as Code technologies (Pulumi, Terraform, CloudFormation) - Experience with observability and logging platforms (DataDog) - Experience with DBT or similar technologies (ref:hirist.tech)

Location: in, IN

Posted Date: 10/30/2024