Machine Learning Engineer, Multimodal Perception and Authentication
$342k - $399k • San Francisco • FullTime
Posted 1mo ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
On-site
Employment Type
FullTime
Categories
Machine Learning Engineer
About the job
The Future of Computing Research team is seeking a Machine Learning Engineer to focus on multimodal perception and authentication. This role involves shaping how future AI systems understand the physical world and the people within it by integrating signals from various sensors like cameras and microphones. You will collaborate with specialized perception models, larger multimodal models, and partner with hardware, firmware, software, and product teams to translate research into real-world systems. This position is based in San Francisco and requires a hybrid work arrangement.
Responsibilities
- Research and develop multimodal perception and authentication methods using visual, audio, and other sensing signals.
- Explore the synergy between specialized perception models and larger multimodal models.
- Design data, training, and evaluation strategies to enhance performance in real-world conditions.
- Analyze model behavior, robustness, and failure modes across different sensing, data, and deployment environments.
- Integrate and validate new capabilities within real-time or resource-constrained systems.
- Collaborate with hardware, firmware, software, and product teams to implement research findings into functional systems.
Requirements
- Strong background in computer vision, audio or speech machine learning, multimodal learning, or sensing.
- Experience developing specialized machine learning models, larger multimodal models, or both.
- Proven ability to translate research ideas into practical systems, prototypes, or products.
- Proficiency in designing experiments, building evaluations, and investigating model behavior.
- Experience with sensing hardware, real-time systems, or other deployment constraints.
- Proficiency in Python and PyTorch.
- Comfort with C++ or systems integration.
- Experience with authentication, biometrics, or other privacy-sensitive applications.
- Enjoy working across disciplines on evolving research problems.