Falabella India - Data Engineer - Distributed Computing

Skills : - Experience in one of the following languages is a must - Python, Java - Experience in GCP is most preferred Data Engineering : We are Falabella. We deliver seamless customer experiences across seven countries in Latin America, with our niche technology center based in Bangalore, India. We enable business strategy in a multi-format, integrated retail business through the effective use of technology and innovation. Our people are at the heart of what we do and play a pivotal role in coding the future of the Falabella Group. At Falabella India, we are looking for passionate Data Engineers who are proficient in Big Data- technologies, have a strong cloud background and excellent analytical and communication skills. We are looking for minds to work on Nextgen frameworks and platforms, to develop features in the eCommerce and Retail domains. We welcome people who are creative-thinkers, self-driven and passionate. Data Engineer : - Should have total 3-5 Yrs of experience in Data Engineering. - Should have hands-on experience on Distributed computing - Should have working experience on Data Architecture design - Strong on programming languages like Python, Java. - Should be aware of storage and compute options and when to choose what - Must have one cloud hands-on experience - Proficient in either Apache Spark or Apache Beam or Apache Flink - Advance SQL knowledge is mandatory - Must be aware of Streaming concepts like Windowing , Late arrival , Triggers etc - Should have exposure on GCP tools to develop end to end data pipeline for various scenarios (including ingesting data from traditional data bases as well as integration of API based data sources). - Should have Business mindset to understand data and how it will be used for BI and Analytics purposes. - Should have working experience on CI/CD pipelines, Deployment methodologies, Infrastructure as a code - Should have advance understanding of different file formats e.g. AVRO, Parquet, ORC , CSV and when to choose what Good to have : - Hands-on experience on Kubernetes - Vector based Database like Qdrant - Should have good understanding on Cluster Optimisation/ Pipeline Optimisation strategies . - Experience in Working with GCP tools like Storage :- CloudSQL , Cloud Storage, Cloud Bigtable,- Bigquery, Cloud Spanner, Cloud DataStore Ingest :- Pub/Sub, Cloud Functions, AppEngine, Kubernete Engine, Kafka, Micro services Schedule : Cloud Composer, Airflow Processing: Cloud Dataproc, Cloud Dataflow, Apache Spark, Apache Flink CI/CD : BitbucketJenkinjs / Gitlab Infrastructre as a tool : Terraform (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/1/2024