Aeris - Data Engineer - Python/ETL

About Aeris Communication : The Internet of Things (IoT) will unlock trillions of dollars in value over the next 10 years as 50 billion devices are brought online. Aeris is at the forefront of this industry, building networks and applications to enable Fortune 500 clients like Chrysler, Honda and Bosch fundamentally improve their businesses. Headquartered in Chicago with offices in Bucharest, San Jose, London, Delhi, Bangalore, Helsinki, and Tokyo as well as other markets. We rank among the top ten cellular providers for the IoT globally, powering critical projects across energy, transportation, retail, healthcare and more. Built from the ground up for IoT and road-tested at scale, Aeris IoT Services are based on the broadest technology stack in the industry, spanning connectivity up to vertical solutions. As veterans of the industry, we know that implementing an IoT solution can be complex, and we pride ourselves on making it simpler. We believe in doing things well - and doing them right. Integrity is a core value here: you'll see it embodied in our staff, our management approach and growing social impact work (we have a VP devoted to it). You'll also see it embodied in the way we manage people and our HR issues: we expect employees and managers to deal with issues directly, immediately and with the utmost respect for each other and for the Company. Designation : Data Engineer. Location : Noida. Experience : 5-10 yrs. Required Skills : - Cloud Run, Cloud Scheduler, Workflow, BigQuery, Cloud Storage, Cloud Pub/Sub, Datastream. - Proficiency in SQL, Python, and/or Java for data staging and transformation. - Experience with Cloud Workflow / Apache Airflow, and Cloud Composer. - Knowledge of IAM, RBAC, ACLs, OAuth authentication, and API security best practices. - Experience with multi-cloud data management and monitoring tools like Prometheus and Grafana. - Working knowledge of OpenTelemetry for distributed tracing. - Past experience in data-exchange platforms and event-driven architectures. - Specification design using AsyncAPI. Key Responsibilities : Data Pipeline Development & Optimization : - Design, develop, and optimize CDC ETL/ELT data pipelines using Cloud Datastream, Cloud Run, and BigQuery, orchestrated by Cloud Workflow. - Build and maintain data warehouses and data lakes using BigQuery, CloudSQL, Cloud Storage, and Spanner. - Develop batch and streaming data processing solutions using Pub/Sub, Kafka, and Dataflow. - Optimize SQL queries and performance tuning in BigQuery. - Monitor data pipeline performance and troubleshoot issues using Cloud Logging and Cloud Monitoring. Security, Compliance & Governance : - Implement RBAC, IAM, and ACL-based access control for multi-tenant architectures. - Apply data governance, encryption, and compliance best practices to protect sensitive data. - Ensure API security through signed URLs, OAuth-based authentication, rate limiting, and secure access controls. CI/CD & Infrastructure Automation : - Deploy and manage data pipelines using Terraform and Kubernetes. - Automate pipeline orchestration with Cloud Workflow, Composer, and Apache Airflow. - Work with multi-cloud data management strategies and optimize cross-cloud data access. Observability & Monitoring : - Implement end-to-end observability using Prometheus and Grafana. - Leverage OpenTelemetry framework for distributed tracing and performance insights. API & Specification Design : - Define API specifications using AsyncAPI for event-driven data exchange platforms. - Work with data-sharing APIs, ensuring secure and efficient integrations. (ref:hirist.tech)

Location: noida, IN

Posted Date: 3/26/2025