Data Architect - ETL/Data Warehousing

Exp : 10 to 20 yrs. Location : Bangalore / Kochi / Thiruvananthapuram. Role : Data Architect. Job Description : You will be responsible to define and lead the Data Architecture, Data Quality, Data Governance, ingesting, processing, and storing millions of rows of data per day. This hands-on role helps solve real big data problems. You will be working with our product, business, engineering stakeholders, understanding our current eco-systems, and then building consensus to designing solutions, writing codes and automation, defining standards, establishing best practices across the company and building world-class data solutions and applications that power crucial business decisions throughout the organization. We are looking for an open-minded, structured thinker passionate about building systems at scale. Responsibilities : - Design, implement and lead Data Architecture, Data Quality, Data Governance across. - Defining data modeling standards and foundational best practices. - Develop and evangelize data quality standards and practices. - Establish data governance processes, procedures, policies, and guidelines to maintain the integrity and security of the data. - Drive the successful adoption of organizational data utilization and self-serviced data platforms. - Create and maintain critical data standards and metadata that allows data to be understood and leveraged as a shared asset. - Develop standards and write template codes for sourcing, collecting, and transforming data for streaming or batch processing data. - Design data schemes, object models, and flow diagrams to structure, store, process, and integrate data. - Provide architectural assessments, strategies, and roadmaps for data management. - Apply hands-on subject matter expertise in the Architecture and administration of Big Data platforms, Data Lake Technologies (AWS S3/Hive), and experience with ML and Data Science platforms. - Implement and manage industry best practice tools and processes such as Data Lake, Databricks, Delta Lake, S3, Spark ETL, Airflow, Hive Catalog, Redshift, Kafka, Kubernetes, Docker, CI/CD. - Translate big data and analytics requirements into data models that will operate at a large scale and high performance and guide the data analytics engineers on these data models. - Define templates and processes for the design and analysis of data models, data flows, and integration. - Lead and mentor Data Analytics team members in best practices, processes, and technologies in Data platforms. Mandatory Qualifications : Qualifications : -10 years of hands-on experience in Data Warehouse, ETL, Data Modeling & Reporting. - 7 years of hands-on experience in productionizing and deploying Big Data platforms and applications - Hands-on experience working with: Relational/SQL, distributed columnar data stores/NoSQL databases, time-series databases, Spark streaming, Kafka, Hive,Delta Parquet, Avro, and more extensive experience in understanding a variety of complex business use cases and modeling the data in the data warehouse. - Highly skilled in SQL, Python, Spark, AWS S3, Hive Data Catalog, Parquet, Redshift, Airflow, and Tableau or similar tools. - Proven experience in building a Custom Enterprise Data Warehouse or implementing tools like Data Catalogs, Spark, Tableau, Kubernetes, and Docker. - Knowledge of infrastructure requirements such as Networking, Storage, and Hardware Optimization with Hands-on experience with Amazon Web Services (AWS). - Strong verbal and written communications skills are a must and work effectively across internal and external organizations and virtual teams. - Demonstrated industry leadership in the fields of Data Warehousing, Data Science, and Big Data related technologies. - Strong understanding of distributed systems and container-based development using Docker and Kubernetes ecosystem. - Deep knowledge of data structures and algorithms. - Experience in working in large teams using CI/CD and agile methodologies. - EST Time zone preferred. (ref:hirist.tech)

Location: in, IN

Posted Date: 10/10/2024