Big Data Architect/Engineer - Python Programming

In this critical role, you will : - Platform Architecture : Design the overall architecture of our big data platform, ensuring scalability, performance, and reliability. - Data Acquisition & Processing : Perform and oversee tasks involved in data acquisition, including writing scripts, calling APIs, web scraping, and writing SQL queries. - Scalable Data Storage : Design and implement data stores that can handle the scalable processing and storage of our high-frequency data. - Data Pipeline Management : Maintain and optimize our existing data pipeline to ensure efficient data flow and processing. - Integration & Customization : Customize and oversee the integration of various tools, data warehouses, databases, and analytical systems. - Data Accessibility : Configure and ensure the availability of data-access tools for our data science team. What you'll bring : - Proven experience in designing and implementing big data platforms. - Strong proficiency in Python for data manipulation, scripting, and automation. - Expertise in writing SQL queries and working with various database systems. - Experience with data warehousing concepts and technologies. - Familiarity with data integration tools and techniques. - Understanding of scalable data storage solutions and technologies. - Ability to design and maintain robust data pipelines. - Excellent problem-solving and analytical skills. - Strong communication and collaboration abilities (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 4/11/2025