New: upload your resume and get matched to AI jobs. Free to start →

Software Engineer 3 - GenAI

Remote • India • Full-time

Posted 8d ago

Remote Work Policy

Fully remote

Employment Type

Full-time

Categories

AI Agent Engineer

About the job

We are seeking a Software Engineer 3 with a focus on Generative AI to design, develop, and scale production-ready multi-agent systems. This role involves building robust tool contracts, RAG pipelines for knowledge retrieval, and optimizing application performance. You will implement security guardrails, ensure secure data management, and develop observability and evaluation capabilities. Collaboration with cross-functional teams, including SDETs and product stakeholders, is key to delivering reliable AI solutions. The position offers technical ownership, exposure to cutting-edge AI technologies, and opportunities for professional development and leadership.

Responsibilities

  • Design, develop, and scale production-ready multi-agent systems, including supervisor and router architectures, specialized agents, LangGraph workflows, tool calling, conversation memory, and checkpointing.
  • Build robust and strongly typed tool contracts and data-access layers using internal APIs.
  • Develop and maintain Retrieval-Augmented Generation (RAG) pipelines for knowledge retrieval, implementing tenant-isolated embeddings and retrieval mechanisms.
  • Optimize application performance, latency, reliability, and infrastructure costs through caching, prewarming, retries, circuit breakers, and intelligent model routing.
  • Implement security and AI guardrails to protect applications against prompt injection, unauthorized access, and data leakage.
  • Ensure secure data management and privacy across multi-tenant GenAI applications.
  • Develop observability and evaluation capabilities using tools such as LangSmith to monitor model behavior and application reliability.
  • Collaborate with SDETs to create evaluation datasets, regression testing suites, and quality criteria.
  • Investigate and troubleshoot production issues using traces, logs, and performance metrics.
  • Support real-time streaming capabilities through WebSocket and Server-Sent Events (SSE).
  • Lead technical design discussions, architecture reviews, and code reviews.
  • Mentor and support junior engineers.
  • Communicate technical designs, architectural decisions, and project progress to stakeholders.
  • Work closely with GenAI engineering, platform, QA/SDET, and product teams to deliver AI solutions.

Requirements

  • 6–10 years of professional software engineering experience.
  • 1–2 years of hands-on experience building and deploying production-grade LLM or Generative AI features.
  • Strong programming proficiency in Python and good working knowledge of Java.
  • Practical experience with agent orchestration frameworks such as LangChain or LangGraph.
  • Hands-on experience integrating Large Language Model APIs (e.g., OpenAI, Anthropic, Amazon Bedrock).
  • Strong understanding of prompt engineering, tool/function calling, structured outputs, and LLM application development.
  • Experience designing and implementing Retrieval-Augmented Generation (RAG) systems using embeddings and vector databases.
  • Strong backend engineering and API design capabilities.
  • Practical experience with AWS cloud infrastructure, containers, Kubernetes/EKS, PostgreSQL, Redis, and CI/CD pipelines.
  • Familiarity with LLM evaluation techniques and AI observability platforms like LangSmith.
  • Strong knowledge of system architecture, distributed systems, scalability, and performance optimization.
  • Understanding of production monitoring, debugging, reliability engineering, and automated testing practices.
  • Excellent analytical and problem-solving abilities.
  • Strong communication and collaboration skills.
  • Previous experience leading code reviews, contributing to engineering standards, and mentoring junior developers.

Benefits

  • Fully remote position based in India.
  • Full-time opportunity.
  • Opportunity to take end-to-end responsibility for major GenAI components and influence architectural decisions.
  • Work with cutting-edge technologies, including LLMs, multi-agent systems, LangGraph, RAG, and intelligent AI assistants.
  • Strengthen expertise in production-grade Generative AI, cloud infrastructure, and enterprise-scale software engineering.
  • Lead technical discussions, establish engineering standards, and mentor junior software engineers.
  • Work alongside experienced professionals across GenAI engineering, platform, QA/SDET, and product teams.