Aiprus Software - Data Engineer - Big Data/Hadoop

Company Description : Aiprus Software Private Limited is an onshore-offshore based IT outsourcing company formed in March 2021, specializing in providing professional, cost-effective offshore outsourcing services globally. The company offers a full range of IT services, including Application Development, Testing, Production Support, and Product & Solution Implementation. Aiprus is committed to delivering high-quality, cost-effective software development and product implementation services to help clients achieve their strategic business goals. Role Description : This is a full-time on-site Data Engineer role located in Bengaluru at Aiprus Software Private Limited. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics on a day-to-day basis. Key Responsibilities : - Design, develop, and implement data pipelines to efficiently collect and process large datasets from diverse sources. - Establish scalable, secure, and efficient data storage solutions, including data warehouses and databases. - Create and execute data validation and testing procedures to ensure accurate and efficient data processing. - Automate data collection, processing, and reporting tasks to reduce manual effort and enhance efficiency. - Produce high-quality documentation that captures problem statements, requirements, solutions, and design specifications. - Contribute to the creation of reusable and repeatable resources for broader use within the organization. - Implement data quality checks and validation processes to maintain the accuracy, consistency, and security of data. - Monitor data pipelines and processes, troubleshoot issues, and develop solutions to prevent future occurrences. - Maintain thorough documentation of data architectures, processes, and workflows to promote knowledge sharing and collaboration. Qualifications : - Data Engineering and Data Modeling skills - Experience with ETL (Extract Transform Load) processes - Data Warehousing and Data Analytics skills - Strong analytical and problem-solving abilities - Proficiency in programming languages such as SQL, Python, or Java - Experience with Big Data technologies like Hadoop, Spark, or Kafka - Bachelor's or Master's degree in Computer Science, Information Technology, or related field Experience : 7 years (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 10/17/2024