Senior Production Engineer, Managed AI

About the job

Responsibilities

• Design and operate reliable managed AI services, focusing on serving and scaling LLM workloads.
• Build automation and reliability tooling for distributed AI pipelines and inference services.
• Define, measure, and improve SLIs/SLOs for AI workloads to meet performance and reliability targets.
• Collaborate with AI, platform, and infrastructure teams to optimize large-scale training and inference clusters.
• Automate observability by building telemetry and performance tuning strategies for AI services.
• Investigate and resolve reliability issues in distributed AI systems using telemetry, logs, and profiling.
• Contribute to the architecture of next-generation distributed systems for AI-first environments.

Requirements

• Strong software engineering background, with experience building production-grade systems.
• Demonstrated experience in distributed systems design and implementation.
• Hands-on work with large language models (LLMs) or AI/ML infrastructure.
• SRE mindset and experience, including defining/measuring SLIs/SLOs, building monitoring/observability, driving performance/reliability improvements, and designing fault-tolerant systems with automated testing.
• Proficiency in at least one modern programming language (Python, Go, Java, C++).
• Familiarity with Kubernetes or container orchestration platforms.
• Strong collaboration and communication skills.
• Ability to thrive in a fast-paced, mission-driven environment.

Benefits

• Industry competitive pay
• Restricted Stock Units
• Health insurance package options (HDHP and PPO, vision, and dental)
• Employer contributions to HSA accounts
• Paid Parental Leave
• Paid life insurance, short-term and long-term disability
• Teladoc
• 401(k) with a 100% match up to 4% of salary
• Generous paid time off and holiday schedule
• Cell phone reimbursement
• Tuition reimbursement
• Subscription to the Calm app
• MetLife Legal
• Company paid commuter benefit ($300 per month)