Senior Backend Engineer - AI Framework (Python)
Salary not listed • Tel Aviv • Full-time
Posted 4mo ago
This job has been open for more than 60 days. It may no longer be actively hiring, so check with the company before putting a lot into an application.
About the job
Gong is seeking a Senior Backend Engineer to join their AI Framework team. This role will focus on building the foundational platform that enables the entire organization to design, evaluate, deploy, and operate AI agents at scale. You will be responsible for creating the frameworks, tools, and guardrails that power Gong’s agentic ecosystem, working deeply in areas like orchestration, evaluation, observability, and safety. The platforms you build will have a company-wide impact, empowering other teams to build agent-based solutions faster and with higher quality.
Responsibilities
- Design and build Gong’s internal agentic framework, integrating industry-standard tools.
- Develop evaluation frameworks and workflows for AI agents, including offline and online evaluations and quality metrics.
- Provide robust observability capabilities for AI agents, including tracing, logging, monitoring, cost tracking, and safety guardrails.
- Create APIs, SDKs, and abstractions to enable product teams to easily build, test, and operate agents.
- Design integrations and tooling across Python and Java for seamless adoption within Gong’s backend ecosystem.
- Build the runtime responsible for orchestrating agent execution, managing tool calls, and maintaining state.
- Manage agent execution, tool usage, memory, workflows, and failure modes in production systems.
- Ensure agents remain observable, debuggable, and safe as usage scales.
- Detect quality regressions and unintended agent behaviors through robust evaluation and monitoring systems.
- Balance flexibility with guardrails to enable rapid innovation while maintaining reliability, security, and cost controls.
Requirements
- 7+ years of backend engineering experience with strong system design and platform-building expertise.
- Hands-on experience designing and building agentic systems or agent frameworks in production.
- Experience extending or building frameworks on top of tools like LangChain, LangGraph, or similar agent orchestration frameworks.
- Experience designing, implementing, and operating production-grade AI agents, including handling failure modes and observability.
- Strong understanding of AI evaluation methodologies.
- High proficiency in Python for building production-grade AI frameworks and services.
- Familiarity with Java and experience integrating backend platforms into Java-based systems.
- Experience building observability, monitoring, or platform tooling for distributed systems.
- Strong analytical skills and ability to reason about complex AI-driven systems.
- Experience with cloud platforms and scalable microservices architectures.
- Excellent communication skills and a strong platform mindset.