Solytics Partners - Senior Data Engineer

Company Profile : Solytics Partners provides Consulting and Solutions to Banking, Capital Markets, Asset Management, and Insurance firms. We leverage a combination of deep domain knowledge, advanced analytics and technology to provide accelerated and efficient services and next generation solutions. Our team of senior consultants comes with significant global experience in key markets and advanced degrees in STEM. Our regulatory compliant solutions and services enable leading financial institutions and corporations to create and sustain a competitive advantage. Job Title : Data Engineer Experience : 8 Years Location : Pune, MH (Hybrid) Education Qualification : Masters or bachelor's in computer science/IT from a reputed institute Job Description : This is a critical hands-on engineer position in a growing independent risk organization focused on applying data processing/reporting and practical artificial intelligence techniques to solve real world problems. This role will be instrumental for data sourcing and data integration, and will play a key role in conceptualizing, prototyping and implementing best-in-class analytics/reporting AI solutions to meet risk management requirements. This hands-on role will focus on developing data, reporting, and infrastructure solutions supporting the risk function and enabling innovation via cutting-edge data engineering and AI techniques. Strong communications (verbal/written) and collaboration are essential for this role. Preference is for candidates who have experience working in US : - Data Sourcing, Preprocessing & Storage : Must have solid expertise in Python to work with large structured/unstructured data sets, performing data sourcing, preprocessing, staging, data modeling, persistence, scheduling data pipelines, ensuring data integrity and quality - Full-stack programming : Proven experience building data integration solutions leveraging Git workflows, modularized coding practices, API calls, and web-based solutions. - Deep hands-on experience with core technologies such as Snowflake, Airflow, dbt, git, docker, Tableau, Streamlit, AWS, sklearn, TensorFlow, stat models, SQL etc. - AI Solution Development : Design and develop AI-based solutions leveraging available Generative AI (Gen AI) LLMs and/or natural language processing as applicable, to enable enhanced risk reporting, conversational risk analysis/commentary, and automated risk management processes. - Model Adoption : Design, develop, and optimize RAG (Retrieval Augmented Generation) on available LLMs integrated with vector databases to develop solutions for specific use cases to optimize output accuracy and effectiveness, ensuring enhanced user experiences. - Solution Performance Monitoring : Periodically assess solution performance ensuring they meet applicable performance, compliance, and security standards. Implement retraining and continuous improvement strategies. Technical Skills : - Bachelor's or master's degree in computer science, Data Science, AI, Machine Learning, or a related field. - 8 years solid software development experience in data integration, ETL, data warehousing/data lakes, data modeling in the banking or financial services domain. - Hands-on experience in developing and deploying production-grade GenAI and NLP solutions for risk management, document understanding, fraud detection, or compliance. - Programming Languages : Proficiency in Python is required, with knowledge of Java, Scala, or C++ as a plus. - Data Storage : Experience with relational and NoSQL databases (e.g. , PostgreSQL, MongoDB) and data lakes for handling large amounts of text data. - Data Engineering : Hands on experience with Snowflake on AWS. Experience with large-scale data handling, including unstructured text processing, tokenization, embeddings (e.g. , Word2Vec, BERT, or Transformer-based models), and data pipelines. - Cloud Platforms : Experience with cloud-based machine learning and AI platforms such as AWS (SageMaker, Lambda) and Snowflake with a focus on GenAI model training, deployment, and monitoring. - MLOps and Deployment : Hands-on experience in deploying machine learning models using CI/CD pipelines, containers (Docker, Kubernetes), and APIs for serving LLM/NLP models at scale. - APIs & Microservices : Experience developing and integrating AI powered APIs and microservices architecture into banking applications. - Search and Retrieval : Experience with vector databases and retrieval-augmented generation (RAG) techniques using systems like Elasticsearch, Pinecone, or FAISS for enhancing LLM performance. - Strong analytical and problem-solving skills with attention to detail and an ability to work with complex, large-scale systems. - Ability to communicate complex data concepts and solutions clearly to non-technical stakeholders. - Strong collaboration skills, with experience working in agile, cross functional teams. - Experience in banking or financial services use cases such as conversational AI for customer service, intelligent document processing for loan applications, fraud detection, or risk analysis (ref:hirist.tech)

Location: pune, IN

Posted Date: 11/7/2024