Research Engineer, Data Infrastructure
Paris • Full-time
Posted 3mo ago
Job Location
Paris
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Infrastructure Engineer
About the job
Mistral AI is seeking a Research Engineer focused on Data Infrastructure to architect and build the backbone of our frontier model training and fine-tuning ecosystem. This role involves designing and scaling massive compute fleets and storage systems for high performance and scalability, with a vision towards exabyte-scale architecture. You will contribute to a strategic transition from legacy scheduling to modern orchestration, implementing sophisticated multi-cluster orchestration and cloud-bursting capabilities. The position requires full lifecycle ownership, from architecting migrations away from legacy orchestrators to implementing production-grade pipelines and participating in on-call rotations for critical training jobs.
Responsibilities
- Build and scale massive distributed compute and storage systems.
- Architect and maintain multi-cluster orchestration layers for optimized workload placement.
- Design and architect transitions to modern storage formats for exabyte-scale fine-tuning datasets.
- Contribute to the development of the internal training platform across Kubernetes and SLURM environments.
- Implement and manage metadata and lineage systems for data and model pipelines.
- Manage cloud-native deployments using modern workflows to ensure scalability, reliability, and efficiency.
Requirements
- 4+ years of experience in Data Infrastructure, MLOps, or Infrastructure Engineering.
- Experience or strong interest in supporting foundational compute and storage platforms.
- Proficiency in Python and experience with modern, columnar storage standards.
- Well-versed in Kubernetes-native tooling and debugging large-scale distributed systems.
- Experience building and operating scalable, reliable, and secure systems.
- Comfort with ambiguity and challenges of building high-scale infrastructure in a rapid-growth AI environment.
Benefits
- Competitive cash salary and equity
- Daily lunch vouchers (France)
- Monthly contribution to a Gympass subscription (France)
- Monthly contribution to a mobility pass (France)
- Full health insurance for you and your family (France)
- Generous parental leave policy (France)
- Visa sponsorship
- Insurance (UK)
- Reimbursement for office parking charges or monthly public transport allowance (UK)
- Monthly reimbursement for gym membership (UK)
- Monthly meal allowance (UK)
- Pension plan (UK)