Staff / Principal Software Engineer - USA
$280k - $350k • Remote • Mountain View, California, USA • FullTime
Posted 1y ago
About the job
Inworld is seeking an ambitious and capable Staff/Principal Backend Engineer to join their research lab and contribute to the advancement of their AI platform. This role will focus on developing and scaling core systems for exciting new products, including an intelligent routing layer (Inworld Router) that supports over 200 LLMs, real-time API services, and API-based model services like TTS/STT with voice cloning. The position involves tackling complex infrastructural projects, platformization, and system-wide billing, with a strong emphasis on collaboration with ML teams to drive learning and adaptability. This is an individual contributor role focused on direct technical contribution.
Responsibilities
- Own core systems for multi-provider failover, cost/latency-based routing, live A/B experimentation, and real-time observability at massive scale for the Inworld Router.
- Develop and enhance API-based model services, including custom TTS/STT models and LLM, Knowledge/RAG, and STT functionalities.
- Contribute to new, ambitious, and large-scale product launches.
- Develop services for control and optimization of AI capabilities.
- Engage in complex and exciting infrastructural projects, including platformization of new offerings and system-wide billing.
- Collaborate with PMs, engineers, and leads to define and focus on key product needs.
- Operate with technical autonomy, suggesting and implementing new technical dependencies or standards.
- Collaborate, execute, and deliver on projects, optimizing for both speed and quality.
- Advocate for and realize system improvements, both feature-related and independent.
Requirements
- Excellent programming skills in a statically typed backend language (Go, Python, C++, or Rust preferred).
- Experience developing and deploying cloud-based services handling hundreds of queries per second.
- Hands-on experience with relational databases (PostgreSQL or MySQL).
- Experience with caching (Redis or Memcached), pubsub/queues, data pipelines (Flink, Beam), and cloud storage.
- Excellent verbal and written communication skills, with the ability to collaborate and coordinate effectively.
- Experience building API gateways, routing/proxy layers, or multi-provider orchestration systems (bonus).
- Experience with analytics or timeseries databases (ClickHouse, Timescale, InfluxDB) (bonus).
- Experience with OpenTelemetry (bonus).
- Experience with C++ (bonus).
- Must be based in the SF Bay Area or willing to relocate for hybrid work.
Benefits
- Equity
- Health insurance
- Paid time off