Senior Staff Software Engineer, Agentic Systems - Moveworks
$201k - $352k • Remote • Mountain View, CALIFORNIA, United States • Full-time
Posted 8h ago
Job Location
Mountain View, CALIFORNIA, United States
Tech Stack
Remote Work Policy
Fully remote
Employment Type
Full-time
Categories
AI Agent Engineer
About the job
Moveworks is building the runtime infrastructure that powers its AI agents, which are responsible for orchestrating, executing, and delivering responses to millions of enterprise users in real time. This is a distributed systems engineering role focused on the core systems that enable AI agents to plan, execute multi-step workflows, call tools, and interact with users while maintaining correctness, observability, and low latency. The systems you will build and own are central to this agentic AI wave.
Responsibilities
- Develop and own the agent orchestration engine, a state machine managing long-running agent sessions across multiple LLM calls and tool invocations.
- Implement distributed session management with lease-based ownership, heartbeat protocols, and crash recovery.
- Build an event-driven message pipeline using SQS FIFO queues, Kafka consumers, and real-time streaming via gRPC and Socket.IO.
- Utilize structured concurrency with Python asyncio TaskGroups for concurrent task management within sessions.
- Create observability infrastructure with OpenTelemetry instrumentation and distributed trace context propagation.
- Design and implement caching and state layers using Redis and DynamoDB for per-organization/per-bot scoping.
Requirements
- Deep experience in distributed systems, including consistency models, idempotency, exactly-once delivery, and distributed locking/leasing.
- Proficiency in concurrent/async programming, such as Python asyncio or Go goroutines, with experience in structured concurrency and cancellation handling.
- Experience with event-driven architectures, message queues (SQS, Kafka), pub/sub patterns, backpressure, and delivery guarantees.
- Strong knowledge of database systems for infrastructure, including DynamoDB (conditional writes, transactions) and Redis (connection pooling, pub/sub).
- Experience with observability tools and concepts, such as OpenTelemetry, distributed tracing, span context propagation, and Prometheus metrics.
- Familiarity with gRPC/protobuf, including streaming RPCs, service interface design, and error handling patterns.
- 10+ years of experience building production backend/infrastructure systems.
- Strong proficiency in Python or Go (ideally both).
- Experience designing and operating systems that handle significant real-world traffic at scale.
- Comfort with ambiguity and solving novel problems without established solutions.
Benefits
- Equity (when applicable)
- Variable/incentive compensation
- Health plans, including flexible spending accounts
- 401(k) Plan with company match
- ESPP
- Matching donations
- Flexible time away plan
- Family leave programs