Staff AI Engineer
$210k - $280k • Remote • US
Posted 5mo ago
About the job
Machinify is a leading healthcare intelligence company that uses an AI-powered platform to deliver value, transparency, and efficiency to health plan clients. We are seeking an AI Engineer to build and ship LLM-powered products, focusing on turning models, prompts, and retrieval into reliable, production-grade systems. This role emphasizes making foundation models perform useful work at scale, cost-effectively, and with minimal hallucination, bridging the gap between research and production.
Responsibilities
- Design and build LLM applications including RAG pipelines, agents, tool-use systems, structured generation, and multi-step workflows.
- Own prompt engineering and evaluation, treating both as code and writing evaluations before prompts.
- Integrate and select appropriate foundation models (e.g., Claude, GPT, Gemini, Llama, Qwen, Mistral).
- Build production-grade LLM infrastructure such as caching, streaming, retries, fallbacks, cost controls, observability, and guardrails.
- Fine-tune or distill models using techniques like LoRA/QLoRA, SFT, or DPO when prompting is insufficient.
- Collaborate with product and design teams on AI-specific UX patterns, including latency masking, streaming UIs, confidence display, and human-in-the-loop systems.
Requirements
- 3+ years of software engineering experience, with at least 1 year shipping LLM-based features in production.
- Proficiency in Python and TypeScript, with experience in production codebases beyond notebooks.
- Deep practical knowledge of the LLM stack, including prompting techniques, function calling, structured outputs, context management, embedding models, and vector search.
- Experience building and maintaining an evaluation suite for LLMs.
- Comfort with at least one orchestration approach (e.g., custom, LangGraph, Inngest, Temporal) and one vector store (e.g., pgvector, Pinecone, Turbopuffer, Weaviate).
- Awareness of cost and latency implications, with the ability to optimize based on usage data.
- Strong communication skills, including the ability to push back on inappropriate AI integration requests.
Benefits
- Work from anywhere in the US
- Top Medical/Dental/Vision offerings