Senior Software Engineer - Together Cloud Platform
$160k - $230k • Remote • San Francisco
Posted 1mo ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Infrastructure Engineer
About the job
Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle. As a Senior Backend Engineer, you will play a key role in building the next generation AI cloud platform – a highly available, global, blazing-fast cloud infrastructure that virtualizes cutting-edge ML hardware and enables state-of-the-art ML practitioners with self-serve AI cloud services. This platform serves both internal StaaS products and external cloud customers across dozens of data centers worldwide.
Responsibilities
- Identify, design, and develop foundational backend services for the cloud platform.
- Analyze and improve the robustness and scalability of distributed systems, APIs, databases, and infrastructure.
- Partner with product teams to understand requirements and deliver solutions.
- Write clear, well-tested, and maintainable software and IaC.
- Conduct design and code reviews, create developer documentation, and develop testing strategies.
- Participate in an on-call rotation to address critical incidents.
Requirements
- 5+ years of experience building large-scale, fault-tolerant, distributed systems and API microservices.
- Experience designing, analyzing, and improving system resource efficiency, scalability, and stability.
- Excellent communication skills for design docs and team collaboration.
- Experience building and operating high-performance and/or globally distributed microservice architectures across cloud providers (AWS, Azure, GCP).
- Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale.
- Experience developing against and managing a relational database, such as PostgreSQL.
- Expert-level programmer in Golang (preferred) or another language.
- Proficiency in version control and integrating IaC with CI/CD pipelines.
- Experience with Kubernetes and containers is preferred.
- Experience building and operating data infrastructure (Kinesis, Airflow, Kafka, etc.) is a plus.
- Bachelor's or Master's degree in Computer Science, Computer Engineering, or equivalent practical experience.
Benefits
- Competitive compensation
- Startup equity
- Health insurance
- Other benefits
- Flexibility in terms of remote work