Software Engineer, Frontier AI Infrastructure
$138k - $259k • San Francisco, CA; St. Louis, MO; New York, NY; Washington, DC
Posted 2mo ago
Job Location
San Francisco, CA; St. Louis, MO; New York, NY; Washington, DC
Tech Stack
Remote Work Policy
On-site
Categories
AI Infrastructure Engineer
About the job
Scale AI is seeking a Software Engineer to join our dynamic Public Sector Engineering team. In this role, you will own the model inference layer, enabling state-of-the-art models, debugging AI tools, managing networking, and tracking AI model metrics. You will lead technical discussions with cloud vendors and customers, debug platform issues, and work with Product to understand features before they break. The position involves designing and implementing secure, scalable backend systems for Public Sector customers, re-architecting the stack for compliant environments, and building integration tests to prevent failures. You will also participate in customer engagements and contribute to the platform roadmap and product strategy.
Responsibilities
- Own the model inference layer, enabling state-of-the-art models.
- Debug the latest AI tools and platform issues.
- Manage networking and debug latency for AI models.
- Track pricing and usage metrics for AI models.
- Lead technical discussions with cloud vendors and customers.
- Design and implement secure, scalable backend systems for Public Sector customers.
- Re-architect the stack to run in compliant or restrictive environments by designing swappable components.
- Build integration tests to catch issues early.
- Participate actively in customer engagements to understand requirements and deliver solutions.
- Contribute to the platform roadmap and product strategy.
Requirements
- Must have an active secret clearance and be able to uplevel to TS/SCI with CI Poly.
- Proficiency in both front-end and back-end development, including modern web development frameworks, programming languages, and databases.
- Experience developing and delivering software to air-gapped and isolated environments is a plus.
- Understanding of containerization (e.g., Docker) and container orchestration (e.g., Kubernetes) is desired.
- Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and experience in cloud-native development and deployment.
- Experience with Federal Compliance frameworks and requirements (e.g., Cloud SRG, FedRAMP, STIG Benchmarks).
- Experience developing software and technical solutions that meet strict security and regulatory compliance requirements.
- Strong analytical and problem-solving skills.
- Excellent interpersonal and communication skills.
- Willingness to embrace new technologies, learn new skills, and adapt to evolving project requirements.
- Ability to support work 3-4 days a week from the DC, SF, NYC, or STL office.
Benefits
- Base salary
- Equity
- Comprehensive health, dental, and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend (potentially)