Senior Production Engineer, Managed AI
$170k - $205k • Remote • San Francisco, CA - US • FullTime
Posted 3h ago
Job Location
San Francisco, CA - US
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Infrastructure Engineer
About the job
Crusoe is seeking a Senior Production Engineer to join their team and ensure the reliability and scalability of their AI-optimized cloud platform. This role is crucial for building and operating managed AI services at scale, focusing on delivering highly available, performant, and cost-efficient AI infrastructure for compute-intensive, latency-sensitive workloads. The ideal candidate will have a strong background in distributed systems and hands-on experience with large language models, contributing to the future of AI infrastructure.
Responsibilities
- Design and operate reliable managed AI services, focusing on serving and scaling LLM workloads.
- Build automation and reliability tooling for distributed AI pipelines and inference services.
- Define, measure, and improve SLIs/SLOs for AI workloads to meet performance and reliability targets.
- Collaborate with AI, platform, and infrastructure teams to optimize large-scale training and inference clusters.
- Automate observability by building telemetry and performance tuning strategies for latency-sensitive AI services.
- Investigate and resolve reliability issues in distributed AI systems using telemetry, logs, and profiling.
- Contribute to the architecture of next-generation distributed systems for AI-first environments.
Requirements
- Strong software engineering background with experience building production-grade systems.
- Demonstrated experience in distributed systems design and implementation.
- Hands-on work with large language models (LLMs) or AI/ML infrastructure.
- SRE mindset and experience, including defining/measuring SLIs/SLOs, building monitoring/observability, driving performance/reliability improvements, and designing fault-tolerant systems.
- Proficiency in at least one modern programming language (Python, Go, Java, C++).
- Familiarity with Kubernetes or container orchestration platforms.
- Strong collaboration and communication skills.
- Ability to thrive in a fast-paced, mission-driven environment.
Benefits
- Industry competitive pay
- Restricted Stock Units
- Health insurance package options (HDHP, PPO, vision, dental)
- Employer contributions to HSA accounts
- Paid Parental Leave
- Paid life insurance, short-term and long-term disability
- Teladoc
- 401(k) with a 100% match up to 4% of salary
- Generous paid time off and holiday schedule
- Cell phone reimbursement
- Tuition reimbursement
- Subscription to the Calm app
- MetLife Legal
- Company paid commuter benefit ($300/month)