Data Engineer [Freelance] M/F/Mx

Trustpair is reinventing B2B payment security. We are building the leading anti-fraud solution for large corporations to help them avoid $20 billion in fraud every year. With Trustpair, finance teams work with accurate data to avoid the risk of fraud and proceed to payments with peace of mind.

Trustpair at a glance:

• 200+ companies preventing B2B payment fraud with Trustpair (Airliquide, Generali, Kering)
• A financial technology acclaimed by major banking actors (Société Générale, Natixis, CACIB)
• Enterprise-ready platform connected to market-leading financial softwares (SAP, Kyriba and more)
• €25M raised in Series B to become #1 SaaS platform for third-party risk management
• A team of 100+ people, based in Europe and NYC

About the role:

As the referent Data Engineer at Trustpair, reporting to Cyrille, our VP Operations and working closely with our SRE, VP Engineering and CTO, you will be responsible for leading a significant improvement project (reliability, automation, infra, security). Working on on our existing AWS Data lake, you'llhelp our stack scale and answer our current and future Data Analytics needs, as well asevolving product-related Data needs.

This is a freelance contract, working five days per week. The improvement project will last at least 2 months, and may be extended. Upon completion there is the possibilityto adopt a 2 days per week contract to maintain the stack.

This position is open to full remote, but candidates must be based in France.

What you'll do:

Stack improvement & simplification project

• Our current stack on AWS is: S3 (Lake), DMS (data change capture), Airflow (Orchestrator), DBT, Athena (query engine), Glue, EMR
• Initial audit:
  • Assess our technical stack with thecurrent use cases in mindand challenge our patterns
  • Document the processes, the guidelines and when to use Airflow / DMS / DBT

Reliability

• Address the monitoring and observability of the stack: monitoring / alerting
• Deploy some data drift control mechanisms and realignment processes
• Challenge the staging environment to make it more meaningful before going to prod

Automation / Ingestion

• For now we have one Data Ingestion pattern by assessing the postgresql wal file and reconstructing images
• Deploy a new Ingestion pattern that could easily integrate within the data lake

Infra / Tech

• Migrate Airflow to Kubernetes with our SRE
• Adapt Airflow configuration to support Google Authenticator
• Challenge our EMR setup

Security

• Challenge Data security (RBAC) within the data lake

Other

• Stack day to day maintenance
• Ingestion of new sources when required, to support our analytics projects

What's in it for you

• A collaborative environment with a flat structure, where everyone's voice is heard
• Work with innovative and modern technology related to your role which evolves to provide value
• Trustpair is in scaling phase with career opportunities in France and internationally
• Flexible remote policy
• A talented team with senior colleagues you can learn and work with
• Inclusive environment with cultural diversity and parity

Why join Trustpair? A list of our perks here !

Must Haves:

• 3-5 years of experience as a Data Engineer
• Ability to maintain and improve a whole Data Lake and/or Data Warehouse
• Good knowledge on data lake architectures and ingestion patterns
• Understanding on building a production system with performance and reliability drivers
• Professional experience with Python
• Good knowledge of Cloud environments(ideally AWS)
• Experience in Spark, Airflowor equivalents
• Good understanding of SQL
• Fluent in English
• Strong problem solving skills
• Ability to work autonomously

Nice to Have:

• Experience in an AWS environment with some of the following technology: EMR, Glue, S3, Athena
• Experience working with Terraform and Github CI
• Experience working with Apache Hudi or equivalent
• Software Engineering background
• Basic knowledge of dbt

Recruitment Process

• First call with Aicha , Talent Acquisition (30 min)
• Experience interviewwith Cyrille , VP Operations (30 min)
• Technical test (at home)& interview with our SRE and VP Engineering (1h)
• Coffee fit with two members of Trustpair & one of our Co-founders (1h)

Equal Opportunity Statement
Trustpair's policy is to provide equal employment opportunity in all of our employment practices without regard to race, color, religion, sex, national origin, ancestry, marital status, protected veteran status, age, individuals with disabilities, sexual orientation or gender identity or expression or any other legally protected category.
Applicants for all positions in Trustpair must be legally authorized to work in the country which they are applying for or be a citizen from Schengen / EU zone. The verification of employment eligibility will be required as a condition of hire.

Department Data Locations Paris | Headquarters

Location: Paris, FR

Posted Date: 7/1/2024