Senior Staff Machine Learning Engineer, Agentic Systems - Moveworks
Remote • Mountain View, CALIFORNIA, United States • Full-time
Posted 1mo ago
Job Location
Mountain View, CALIFORNIA, United States
Tech Stack
Remote Work Policy
Fully remote
Employment Type
Full-time
Categories
Machine Learning Engineer
About the job
Moveworks is seeking a Machine Learning Engineer to develop cutting-edge ML infrastructure for building and serving LLMs. This role is pivotal in constructing, optimizing, and scaling end-to-end machine learning systems, encompassing distributed training and inference pipelines for large language models, model evaluation and monitoring frameworks, and LLM latency optimization. The frameworks developed will serve as a robust foundation for hundreds of ML and NLP models in production, impacting millions of enterprise employees. You will address challenges in service scalability and core algorithm optimization, working closely with machine learning, data infrastructure, and core skill teams. Your contributions will significantly influence customer AI experiences and the long-term scalability of our core AI product.
Responsibilities
- Design, build, and optimize scalable machine learning infrastructure for training, evaluation, and deployment of large language models.
- Create abstractions to automate various steps within different ML workflows.
- Collaborate with cross-functional teams including engineers, data analytics, machine learning experts, and product managers to develop new features.
- Drive best practices in ML and data engineering through your experience.
Requirements
- 12+ years of industry experience in Machine Learning, Infrastructure, or related fields.
- Experience with deep learning frameworks like PyTorch or Hugging Face.
- Experience with LLM serving frameworks such as vLLM or TensorRT-LLM.
- Experience building and scaling end-to-end machine learning systems.
- Experience building scalable microservices and ETL pipelines.
- Expertise in Python and experience with performant languages like C++ or GoLang.
- Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or an equivalent field.
- A strong interest in research publications within the machine learning and software engineering communities.
- Effective communication skills with experience in cross-functional collaboration.