Research Engineer/Scientist - Speech/Audio Machine Learning
Paris • Full-time
Posted 9mo ago
Job Location
Paris
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
Machine Learning Engineer
About the job
The Institute of Foundation Models is a research lab focused on building, understanding, using, and managing foundation models. We aim to advance research, cultivate future AI builders, and contribute to a knowledge-driven economy. As part of our team, you will work on cutting-edge foundation model training alongside world-class researchers and engineers, addressing fundamental challenges in AI development and creating groundbreaking solutions. Your strategic problem-solving skills will be key to establishing MBZUAI as a global hub for high-performance computing in deep learning and driving impactful discoveries.
Responsibilities
- Design and train state-of-the-art end-to-end neural speech models.
- Develop novel neural architectures for low-latency speech-to-speech translation and generation, including Diffusion, Flow-matching, and Transformer-based audio LLMs.
- Design and implement custom objective functions to optimize prosody, including emotions, intelligibility, and naturalness.
- Conduct large-scale training runs and perform ablation studies on model architecture and tokenization strategies.
- Establish rigorous internal benchmarks using objective metrics (WER, MCD) and subjective human-in-the-loop (MOS) testing.
Requirements
- PhD or MSc in Computer Science with a focus on Deep Learning, Signal Processing, or Computational Linguistics.
- Record of research with published work in top-tier venues such as NeurIPS, ICLR, ICASSP, or Interspeech.