Software Engineer, Conversational Products & Agent Workflows
$116k - $174k • Boston, MA • Full-time
Posted 9d ago
Job Location
Boston, MA
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Agent Engineer
About the job
At Klaviyo, we believe the future of software lies not only in tools that help people work more efficiently, but in intelligent systems that can take action, learn from outcomes, and improve customer experiences over time. Klaviyo serves more than 167,000 customers and processes billions of consumer profiles, messages, interactions, and conversion signals. This creates a unique opportunity to build state-of-the-art AI systems that help businesses create and execute better customer experiences at scale. We’re looking for a Software Engineer, Conversational Products & Agent Workflows to join the Customer Agent team, Klaviyo’s AI-native conversational platform. You’ll help build scalable backend systems and AI-powered product experiences that enable agents to retrieve context, use tools, and take reliable action on behalf of customers. This is a backend-heavy role with opportunities to contribute to user-facing experiences. You’ll independently own meaningful pieces of larger systems, contribute to technical decisions, and continue developing your depth across backend engineering, applied AI, and production reliability.
Responsibilities
- Build and improve reliable backend systems and APIs that power AI-driven customer experiences.
- Develop production agentic features involving tool use, context management, retrieval, structured outputs, orchestration, and multi-step workflows.
- Contribute to solving applied AI problems across retrieval and RAG, grounding, hallucination mitigation, model selection, and choosing between LLM-based, deterministic, or hybrid approaches.
- Build and use evaluation approaches including representative datasets, automated and human evaluation, regression testing, qualitative error analysis, and production signals.
- Improve system reliability through guardrails, retries, fallbacks, observability, monitoring, and thoughtful failure handling.
- Build asynchronous and distributed processing workflows that support AI workloads at scale.
- Participate in an on-call rotation and help diagnose, mitigate, and learn from production incidents.
- Work with external customers and cross-functional partners to understand workflows, identify pain points, and translate feedback into product improvements.
- Monitor shipped experiences and use quality metrics, system performance, and customer feedback to guide iteration.
Requirements
- 3+ years of professional software engineering experience, with experience building backend systems or distributed applications.
- Hands-on experience building or contributing to generative AI or agentic AI applications, ideally used by real users or in production environments.
- Proficient in Python and experience with modern backend frameworks such as FastAPI or Django.
- Experience with asynchronous processing or distributed task/event systems such as Celery, Kafka, SQS, RabbitMQ, or Redis.
- Working knowledge of databases, data modeling, APIs, and persistence patterns used in production systems.
- Comfortable working in cloud environments and experience with technologies such as AWS, containers, Kubernetes, infrastructure automation, or CI/CD systems.
- Ability to reason about tradeoffs among quality, latency, cost, reliability, and implementation complexity.
- Comfortable working through ambiguity, breaking larger problems into smaller pieces, and making progress without every requirement being fully specified.
- Experience with, or strong interest in, working directly with external customers to understand problems and improve products.
- Care about shipping useful, reliable products and motivated to deepen engineering judgment in a rapidly evolving technical space.
Benefits
- Participation in the company’s annual cash bonus plan
- Variable compensation (OTE) for sales and customer success roles
- Equity
- Sign-on payments
- Comprehensive range of health, welfare, and wellbeing benefits