AI Inference Core - Infrastructure SW Engineer
Remote • Sunnyvale, CA • FullTime
Posted 1mo ago
Job Location
Sunnyvale, CA
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Infrastructure Engineer
About the job
Cerebras Systems is seeking a Software Engineer to design and build the core software powering their engineering infrastructure. This role involves working on Python frameworks, orchestration systems, distributed execution, scheduling, test infrastructure, and developer tooling. The ideal candidate enjoys dissecting unfamiliar code, understanding system interdependencies, tackling complex debugging challenges, and improving underlying designs rather than implementing quick fixes. The team values strong software engineering fundamentals, independent problem-solving, and sound systems thinking.
Responsibilities
- Design, develop, test, and maintain Python frameworks and services for orchestrating engineering workflows across machines and clusters.
- Build reusable abstractions for scheduling, distributed execution, resource management, test execution, workflow planning, and failure recovery.
- Define clear APIs, module boundaries, extension points, and data models for evolving infrastructure systems.
- Reason about concurrency, asynchronous execution, multiprocessing, state management, retries, idempotency, cancellation, and partial failures.
- Debug complex issues spanning Python applications, operating systems, processes, filesystems, networking, remote machines, and distributed services.
- Write high-quality automated tests and documentation for reliable and widely reused infrastructure.
- Partner with platform, CI, release, quality, ML systems, and product engineering teams to translate requirements into scalable software designs.
Requirements
- 3+ years of professional software engineering experience.
- Strong proficiency in Python and understanding of its strengths, limitations, and runtime behavior.
- Experience designing maintainable software systems, libraries, frameworks, backend services, or developer-facing APIs.
- Good judgment around software architecture, abstraction boundaries, design patterns, extensibility, and long-term maintainability.
- Understanding of concurrency concepts (processes, threads, asynchronous execution, synchronization, shared state).
- Foundational understanding of operating systems (processes, signals, filesystems, resource management, program execution).
- Foundational understanding of distributed systems concepts (retries, timeouts, idempotency, partial failure, coordination, eventual consistency).
- Strong debugging and problem-solving skills, including independent work through unfamiliar systems.
- Experience with Python concurrency technologies (asyncio, multiprocessing, concurrent futures, event-driven systems) is preferred.
- Experience building orchestration engines, workflow systems, schedulers, distributed job runners, or control-plane software is preferred.
- Experience developing test infrastructure or extensions for frameworks like pytest is preferred.
- Familiarity with CI systems, build systems, release infrastructure, or developer-productivity tooling is preferred.
- Experience with Kubernetes, containerized environments, cluster schedulers, or remote execution systems is preferred.
- BS/MS in Computer Science or related field, or equivalent practical experience.
Benefits
- Build a breakthrough AI platform beyond the constraints of the GPU.
- Publish and open source cutting-edge AI research.
- Work on one of the fastest AI supercomputers in the world.
- Job stability with startup vitality.
- Simple, non-corporate work culture that respects individual beliefs.