Senior Software Engineer, AI Platform
$170k - $205k • San Francisco, CA - US • FullTime
Posted 3h ago
Job Location
San Francisco, CA - US
Tech Stack
Remote Work Policy
On-site
Employment Type
FullTime
Categories
AI Infrastructure Engineer
About the job
Crusoe is seeking a Senior Software Engineer to join their AI Platform team. This role is pivotal in shaping the architecture and scalability of next-generation managed AI services. You will lead the design and implementation of core systems for AI offerings, including resilient fault-tolerant queues, model catalogs, and scheduling mechanisms optimized for cost and performance. This position offers the opportunity to build and scale critical infrastructure capable of handling millions of API requests per second across thousands of customers, contributing to the acceleration of AI development and deployment.
Responsibilities
- Lead the design and implementation of core AI services, including resilient fault-tolerant queues, model catalogs, and scheduling mechanisms.
- Architect and scale infrastructure to handle millions of API requests per second.
- Implement robust monitoring and alerting to ensure system health and 24/7 availability.
- Collaborate with product management, business strategy, and other engineering teams to define the AI platform roadmap.
- Influence the long-term vision and architectural decisions of the platform.
- Contribute to open-source AI frameworks and actively participate in the AI community.
- Prototype and rapidly iterate on emerging technologies and new features.
Requirements
- 4-5+ years of industry experience with a demonstrated history of consistent success leading initiatives.
- Experience with distributed systems, cloud services (compute, storage, networking, database), and delivering early-stage projects.
- Experience with Generative AI (LLMs, Multimodal) and AI infrastructure (training, inference, ETL pipelines).
- Proficiency with container runtimes (e.g., Kubernetes), microservices, REST APIs, gRPC, and the full software development lifecycle including CI/CD.
- Proficiency in Golang, Python or Rust for production services.
- Contributions to open-source AI projects (e.g., VLLM).
- Experience with performance optimizations on GPU systems and inference frameworks.
- Proactive, collaborative, and capable of working autonomously.
- Excellent communication and interpersonal skills.
- Passion for building cutting-edge AI products and solving complex technical problems.
Benefits
- Competitive compensation and equity packages
- Restricted Stock Units
- Paid time off, paid holidays & leave of absence programs
- Comprehensive health, dental & vision insurance
- Employer contributions to HSA account
- Paid parental leave
- Paid life insurance, short-term and long-term disability
- Professional development & tuition reimbursement
- Mental health & wellness support
- Commuter benefits (parking & transit)
- Cell phone stipend
- 401(k) Retirement plan with company match up to 4% of salary
- Volunteer time off
- Global travel insurance & emergency assistance
- Daily meals allowance
- Additional perks & programs specific to location