Data Engineer - Python Programming

Job Description : We are seeking a skilled and motivated Data Engineer with a strong background in data integration, ETL processes, and data warehousing. The ideal candidate will have over 3 years of experience in data engineering, with a good understanding of data architecture, pipeline creation, and big data technologies. This role requires a proactive individual who can design, build, and maintain data systems, collaborate with cross-functional teams, and ensure the highest standards of data quality and performance. Job Responsibilities : - Design, develop, and maintain scalable data pipelines for data ingestion, processing, and storage. - Build and optimize data architectures and data models for efficient data storage and retrieval. - Develop ETL processes to transform and load data from various sources into data warehouses and data lakes. - Ensure data integrity, quality, and security across all data systems. - Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. - Monitor and troubleshoot data pipelines and workflows to ensure high availability and performance. - Document data processes, architectures, and data flow diagrams. Requirements : Candidate Required Skills : - Bachelor's degree in Computer Science, Engineering, or a related field. - 3 years of experience in data engineering and data architecture. - Proficiency in SQL and at least one programming language (e. Python, Java, Scala). - Experience with cloud data platforms (e. AWS, Azure, GCP) and their data services. - Knowledge of ETL tools and frameworks (e. , Apache NiFi, Talend, Informatica). - Understanding of data modeling, data structures, and database design. - Strong analytical and problem-solving skills. - Strong communication and collaboration skills. - Ability to work independently and as part of a team. - Experience with data warehousing solutions (e., Redshift, BigQuery, Snowflake). - Implement and maintain data integration solutions using industry-standard tools and technologies (e., Apache Spark, Kafka, Airflow, etc. - Hands-on experience with big data technologies (e., Hadoop, Spark, Kafka). - Knowledge of data governance and best practices in data management. - Familiarity with containerization and orchestration tools (e., Docker, Kubernetes). - Experience with data visualization tools (e., Tableau, Power BI) (ref:hirist.tech)

Location: in, IN

Posted Date: 11/21/2024