Senior Software Engineer - Together Cloud Platform
$160k - $230k • Remote • San Francisco
Posted 1mo ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
Fully remote
Categories
Machine Learning Engineer
About the job
Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI model lifecycle, combining a fast LLM inference engine with state-of-the-art AI cloud infrastructure. As a Senior Backend Engineer, you will play a key role in building the next generation AI cloud platform. This platform is designed to be highly available, global, and extremely fast, virtualizing cutting-edge ML hardware and enabling practitioners with self-serve AI cloud services. It serves both internal StaaS products and external cloud customers across numerous data centers worldwide.
Responsibilities
- Identify, design, and develop foundational backend services for the cloud platform.
- Analyze and improve the robustness and scalability of distributed systems, APIs, databases, and infrastructure.
- Partner with product teams to understand requirements and deliver solutions.
- Write clear, well-tested, and maintainable software and IaC.
- Conduct design and code reviews, create developer documentation, and develop testing strategies.
- Participate in an on-call rotation for critical incidents.
Requirements
- 5+ years of experience building large-scale, fault-tolerant, distributed systems and API microservices.
- Experience designing, analyzing, and improving efficiency, scalability, and stability of system resources.
- Excellent communication skills for design docs and cross-functional collaboration.
- Experience building and operating high-performance or globally distributed microservice architectures on cloud providers (AWS, Azure, GCP).
- Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale.
- Experience developing against and managing relational databases (e.g., PostgreSQL).
- Expert-level programming in Golang preferred.
- Proficiency in version control and integrating IaC with CI/CD pipelines.
- Experience with Kubernetes and containers is preferred.
- Experience building and operating data infrastructure (Kinesis, Airflow, Kafka, etc.) is a plus.
- Bachelor's or Master's degree in Computer Science, Computer Engineering, or equivalent practical experience.
Benefits
- Competitive compensation
- Startup equity
- Health insurance
- Other benefits
- Flexibility in terms of remote work