Data Engineer - Hive/Hadoop

Job Description : - 5 years of hands-on experience of Scala SDK 2.11.12 or higher, Apache Spark, Hadoop, Hive, and related ecosystem. - Excellent knowledge of Scala EE, Web Services (REST/SOAP), Spring framework, MQ, Kafka, Databases (Db2/SQL), Webserver (Apache Tomcat preferred). - Working Experience on Autosys for scheduling jobs or any other similar scheduling platform. - Experience and very good understanding of Design Patterns. - Good understanding of DevOps practices and tooling. - Experience in understanding of requirements of large enterprise applications (security, entitlements etc.). - Experience working in Agile development methodologies. Skills Desired: - Working Knowledge of building applications in the Cloud. - Working Knowledge of Unix/Linux and/or any scripting language. - Working knowledge of financial market, document platform-based products and Wealth Management. Education : - Minimum BS degree Job Functions/Duties and Responsibilities : - Design & Development Enterprise scale ETL process for doing Data Ingestion, Transformation and Distribution integrating with multiple systems in Morgan Stanley. - Perform Business analysis along with BA/QA's to ensure requirements documented, and implemented in Scala language. - Collaborating with multiple technology teams that are upstream and downstream to the application such as Books & Records System, Pricing System, Data Warehouse - Working in the Agile development methodologies, collaborating with business and technology teams located globally. (ref:hirist.tech)

Location: in, IN

Posted Date: 10/24/2024