Staff Machine Learning Engineer
$230k - $300k • United States (Remote)
Posted 2mo ago
Job Location
United States (Remote)
Tech Stack
Remote Work Policy
On-site
Categories
Machine Learning Engineer
About the job
Cresta is seeking a Staff Machine Learning Engineer to work on high-impact AI initiatives, focusing on next-generation agentic AI systems that augment contact center agents in real-time. This role involves leading and building these systems, requiring strong ML foundations, deep expertise in LLMs and prompting techniques, and a rapid prototyping mindset to translate research into scalable, production-grade systems. The engineer will also focus on improving the reliability, robustness, and performance of LLM-powered agents by designing evaluation frameworks, diagnosing failure modes, and defining measurable quality metrics. Additionally, the role includes architecting and scaling LLM and retrieval-augmented generation pipelines to process complex data and deliver real-time intelligence.
Responsibilities
- Define and lead the technical vision for next-generation Agentic AI systems.
- Architect scalable, production-grade LLM systems integrating reasoning, retrieval, planning, tool use, and real-time decision-making.
- Design and evolve multi-agent orchestration frameworks combining RAG, structured knowledge, and automated actions.
- Establish best practices for building robust, reliable, and cost-efficient LLM-powered systems.
- Own evaluation strategy for complex AI systems, including benchmarking, experimentation, and failure analysis.
- Proactively identify and mitigate agent failure modes like hallucinations and tool misuse.
- Define measurable quality standards and drive continuous system improvement.
- Influence cross-team architecture decisions for seamless AI integration.
- Mentor senior engineers and contribute to long-term AI strategy.
- Translate cutting-edge research into practical, high-impact production systems.
Requirements
- Bachelor's degree in Computer Science, Mathematics, or related field; Master's or Ph.D. strongly preferred.
- 7+ years of experience building and deploying production ML systems, with deep hands-on experience with LLMs at scale.
- Demonstrated leadership in architecting complex AI systems, particularly agentic or multi-step LLM workflows.
- Deep expertise in transformer-based models, embeddings, retrieval systems, and RAG pipelines.
- Experience designing evaluation frameworks for LLM systems beyond single-turn prompts.
- Strong systems thinking for scalability, latency, cost efficiency, security, and maintainability.
- Extensive experience with modern ML frameworks (e.g., PyTorch, TensorFlow, Hugging Face) and cloud infrastructure.
- Proven ability to influence technical direction across teams as a senior individual contributor.
- Strong bias toward action with ability to prototype rapidly while maintaining production rigor.
Benefits
- Comprehensive medical, dental, and vision coverage