AI Engineer II (AI Platform)
$104k - $178k • Remote • US Remote • FullTime
Posted 2mo ago
Job Location
US Remote
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Infrastructure Engineer
About the job
MeridianLink is seeking a mid-level AI Engineer II to join their AI Platform team. This role is crucial for designing, developing, testing, and maintaining the core AI platform components that power AI features across the company's products. You will be instrumental in implementing services like model integration layers, retrieval-augmented generation infrastructure, prompt management systems, and evaluation pipelines. This position involves close collaboration with senior engineers on architecture, direct engagement with product engineering teams to understand their AI integration needs, and contributing to the establishment of standards and patterns for AI platform adoption.
Responsibilities
- Implement AI platform components including model serving, retrieval infrastructure, prompt management, and evaluation services.
- Develop and maintain APIs for product teams to integrate AI capabilities.
- Build observability and monitoring into platform services for quality, latency, cost, and health.
- Contribute to design discussions, considering trade-offs in simplicity, reliability, and scalability.
- Collaborate with product engineering teams to translate AI integration requirements into platform features.
- Participate in technical design sessions and code reviews with product teams.
- Identify and consolidate common AI integration problems solved by multiple product teams.
- Contribute to documentation, reference implementations, and runbooks for AI platform services.
- Help define and enforce integration standards, including API contracts and error handling.
- Mentor junior engineers on AI systems and platform design.
- Implement evaluation and monitoring pipelines for AI output quality and model behavior.
- Contribute to content safety standards and compliance guardrails for financial services.
- Help design systems for handling PII, maintaining audit trails, and meeting data residency requirements.
Requirements
- 3-5 years of professional software engineering experience.
- Strong proficiency in backend engineering using Python, C#/.NET, Java, or Node.js.
- Solid understanding of algorithms, data structures, and system design principles.
- Hands-on experience integrating large language models or ML models into production applications.
- Working knowledge of retrieval-augmented generation (RAG) concepts, vector databases, and embedding pipelines.
- Experience building or contributing to shared services or platform components.
- Familiarity with cloud-managed AI services (AWS Bedrock, Azure OpenAI, or equivalent).
- Experience with APIs, asynchronous processing, and event-driven architectures.
- Bachelor's degree in Computer Science, Software Engineering, or equivalent professional experience.
- Experience with LLM frameworks (LangChain, LlamaIndex, etc.) or prompt engineering.
- Familiarity with vector databases (Pinecone, Weaviate, Milvus, or similar).
- Knowledge of containerization and orchestration (Docker, Kubernetes).
- Experience with observability tools and designing monitoring for ML/AI systems.
- Prior work in regulated industries with data handling, compliance, or audit requirements.
- Experience with fintech, banking, or other financial services environments.
- Active daily use of AI-assisted development tools and understanding of their benefits and limitations.
Benefits
- AI/ML training
- Job-specific technical development
- Monthly soft-skill sessions
- Mentorship from experienced Senior and Staff engineers