Senior AI Engineer
Remote • United States • Full-time
Posted 5d ago
Job Location
United States
Tech Stack
Remote Work Policy
Fully remote
Employment Type
Full-time
Categories
LLM Engineer
About the job
Jeeves is seeking a Senior AI Engineer to own AI workflows end-to-end, from design and implementation to measurement and continuous improvement. This hands-on role requires individuals who are "AI-native" in their approach, leveraging coding agents and AI tools daily to drive efficiency. You will collaborate closely with Product and Backend Engineering teams, taking initiative to define and build solutions rather than waiting for detailed specifications. The position is remote and based in the United States, offering a steep learning curve and the opportunity to rebuild how money moves across borders.
Responsibilities
- Design agentic and LLM-based systems for multi-step tasks, incorporating extraction, retrieval, reasoning, and tool use with human-in-the-loop components.
- Develop production-grade LLM pipelines, including prompt and context design, structured outputs, validation, fallbacks, and confidence scoring.
- Integrate AI services seamlessly with the company's backend, ensuring clear API contracts, retries, graceful degradation, and data isolation.
- Manage AI model costs and latency, selecting appropriate models for each task.
- Build evaluation sets and automated tests to monitor and prevent regressions in AI workflows.
- Instrument AI components with logging, tracing, dashboards, and alerts for proactive quality monitoring.
- Maintain an audit trail of AI decisions compliant with financial product regulations.
- Establish patterns, shared tooling, and best practices for AI engineering within the team.
- Mentor other engineers on the effective use of coding agents and AI tools.
- Review and provide feedback on peers' AI system designs.
Requirements
- 7+ years of professional software engineering experience.
- At least 2 years of experience building and operating LLM or AI-powered systems in production.
- Proven track record of owning large systems or workflows end-to-end with limited direction.
- Hands-on experience shipping LLM-powered applications using APIs like Anthropic or OpenAI, including structured outputs, error handling, and evaluation.
- Experience designing agentic or multi-step AI workflows involving tool use, orchestration, and human review.
- Strong proficiency in Python.
- Solid backend fundamentals including REST APIs, PostgreSQL or similar relational databases, async patterns, and experience with a major cloud provider (AWS, GCP, or Azure).
- Experience with observability for AI systems (logging, tracing, dashboards, quality monitoring).
- Professional fluency in English, both written and spoken.