Research Engineer, Data Infrastructure
Remote • Palo Alto • Full-time
Posted 3mo ago
Job Location
Palo Alto
Tech Stack
Remote Work Policy
Fully remote
Employment Type
Full-time
Categories
AI Infrastructure Engineer
About the job
Mistral AI is seeking a Research Engineer focused on Data Infrastructure to build and operate the next generation of our data systems. This role involves designing and scaling massive compute fleets and storage systems for high performance and scalability. You will contribute to a future of decoupled control and data planes, scaling big data compute and storage platforms while ensuring secure and governed data access for MLOps and research. The position requires full lifecycle ownership, from architecting migrations away from legacy orchestrators to implementing production-grade pipelines and participating in on-call rotations for critical training jobs.
Responsibilities
- Build and scale massive distributed compute and storage systems.
- Architect and maintain multi-cluster orchestration layers for optimized workload placement.
- Design and implement transitions to modern storage formats for large-scale fine-tuning datasets.
- Contribute to the development of an internal training platform using Kubernetes and SLURM.
- Implement and manage systems for data and model pipeline visibility and lineage.
- Manage cloud-native deployments using modern workflows to ensure platform scalability and reliability.
Requirements
- 4+ years of experience in Data Infrastructure, MLOps, or Infrastructure Engineering.
- Experience or strong interest in supporting foundational compute and storage platforms.
- Proficiency in Python and experience with modern, columnar storage standards.
- Well-versed in Kubernetes-native tooling and debugging large-scale distributed systems.
- Experience building and operating scalable, reliable, and secure systems.
- Comfort with ambiguity and challenges in a rapid-growth AI environment.
Benefits
- Competitive salary and equity
- Medical, Dental, and Vision healthcare coverage for employee and family
- 401K with 6% matching
- 18 days of Paid Time Off (PTO)
- Transportation reimbursement ($120/month for public transport or office parking charges)
- $120/month reimbursement for gym membership
- $400 monthly allowance for meals
- Visa sponsorship
- Voluntary BetterUp coaching