Data Engineer - Machine Learning

Job Description : Responsibilities : - Design, develop and maintain a data platform that is accurate, secure, available, and fast. - Engineer efficient, adaptable, and scalable data pipelines to process data. - Integrate and maintain a variety of data sources: different databases, APIs, SAASs, files, logs, events, etc. - Create standardized datasets to service a wide variety of use cases. - Develop subject-matter expertise in tables, systems, and processes. - Partner with product and engineering to ensure product changes integrate well with the data platform. - Partner with diverse stakeholder teams, understand their challenges and empower them with data solutions to meet their goals. - Perform data quality on data sources and automate and maintain a quality control capability. Qualification : - 6 years in MLOps, ML engineering, MLOps, and data science with 2 years leading and mentoring agile teams. - At least 5 years of experience as a Data Engineer - Hands-on and deep experience with Star/Snowflake schema design, data modeling, data pipelining and MLOps. - Experience in Data Warehouse technologies (e.g. Snowflake, AWS Redshift, etc) - Experience in AWS data pipelines (Lambda, AWS glue, Step functions, etc) - Fintech or Financial services industry experience - Proficient in SQL and at least one major programming language like Python, Java - Experience with Data Analysis Tools such as Looker or Tableau - Experience with Pandas, Numpy, Scikit-learn, and Jupyter notebooks preferred, familiarity with Git, GitHub, and JIRA. (ref:hirist.tech)

Location: pune, IN

Posted Date: 10/9/2024