Software Engineer, GenAI
Remote • SF Office • FullTime
Posted 2d ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
Applied AI Engineer
About the job
Abridge is seeking GenAI Software Engineers of all levels to join their mission of powering deeper understanding in healthcare. In this role, you will collaborate with researchers, clinicians, and engineers to translate cutting-edge language model capabilities into dependable clinical systems. Your work will focus on designing advanced LLM-driven workflows that can reason through complex clinical contexts, leverage agentic capabilities, and integrate seamlessly with retrieval systems, ensuring outputs meet the highest standards of clinical reliability. You will also develop and apply rigorous evaluation frameworks to assess accuracy, robustness, and multilingual capabilities, and own the end-to-end productionization of LLM workflows, including deployment, monitoring, and versioning.
Responsibilities
- Design and build agentic systems that leverage retrieval, tool use, agentic reasoning, and structured outputs.
- Collaborate to scale and optimize agentic workflows, managing latency, context windows, and model choice.
- Write high-quality, modular, and maintainable code.
- Own major architectural decisions for workflows, data flow, caching, and output structuring.
- Drive rigorous evaluation by building benchmark datasets, developing evaluation frameworks, designing experiments, running A/B tests, and analyzing clinician feedback.
- Rapidly prototype with new models, tools, and prompting techniques.
Requirements
- 3+ years of experience building production-grade systems.
- 1-2+ years focused on LLM-powered or agentic products.
- Deep fluency with LLM APIs, prompting strategies, and orchestration patterns (e.g., LangChain, LlamaIndex).
- Experience with retrieval systems (e.g., semantic and lexical retrieval, vector DBs, efficient kNN), function calling, tool-use, or agentic workflows.
- Working knowledge of model evaluation, dataset building, automated and human-in-the-loop evaluations, A/B testing, and working with subject matter experts.
- Strong Python fundamentals, including clean code, comprehensive test cases, and familiarity with core language features and standard libraries.
- Experience with async programming, performance profiling, packaging, and deployment tooling is strongly preferred.
- Ability to balance moving fast with addressing technical debt.
Benefits
- Relocation assistance is available for candidates willing to move to San Francisco.