Senior Frontier Agents Engineer

About the job

Responsibilities

• Partner with enterprise customers to understand their technical infrastructure, data pipelines, and business requirements.
• Design and implement custom integrations between Scale AI's platform and customer data environments.
• Build data connectors and ETL pipelines for ingesting, processing, and preparing customer data for AI workflows.
• Deploy and configure AI models and agents within customer security and compliance boundaries.
• Develop production-grade AI agents for use cases such as customer support, data analysis, content generation, and workflow automation.
• Architect multi-agent systems that coordinate different models, tools, and data sources.
• Implement evaluation frameworks to measure agent performance and drive improvements.
• Design human-in-the-loop workflows and feedback mechanisms for continuous agent enhancement.
• Create prompt engineering strategies optimized for customer-specific domains and data.
• Build and maintain prompt libraries, templates, and best practices.
• Conduct systematic prompt experimentation and A/B testing.
• Implement RAG systems and fine-tuning pipelines.
• Serve as the primary technical point of contact for strategic enterprise accounts.
• Collaborate with customer data scientists, ML engineers, and software developers.
• Provide technical training and knowledge transfer to customer teams.
• Work with Scale's product and engineering teams to translate customer needs into product improvements.
• Document technical architectures, integration patterns, and best practices.
• Debug complex technical issues across the entire stack.
• Rapidly prototype solutions to unblock customers and prove new use cases.
• Stay current on the latest AI/ML research and tools.
• Identify opportunities for productization based on common customer patterns.

Requirements

• 5+ years of software engineering experience with strong fundamentals in data structures, algorithms, and system design.
• Production Python expertise with experience in modern ML/AI frameworks (e.g., LangChain, LlamaIndex, HuggingFace, OpenAI API).
• Experience with cloud platforms (AWS, GCP, or Azure) and modern data infrastructure.
• Strong problem-solving skills with the ability to navigate ambiguous requirements and iterate rapidly.
• Excellent communication skills to explain complex technical concepts to diverse audiences.
• Deep understanding of LLMs including prompting techniques, embeddings, and RAG architectures.
• Experience building and deploying AI agents or autonomous systems in production.
• Knowledge of vector databases and semantic search systems.
• Experience with containerization (Docker, Kubernetes) and CI/CD pipelines.
• Experience using Infrastructure as Code (IaC) tools (e.g., Terraform, Bicep).
• Familiarity with enterprise security, compliance, and governance requirements.
• Proven ability to work with customers in a technical consulting, solutions engineering, or product engineering role.
• Domain expertise in verticals like finance, healthcare, government, or manufacturing.
• Experience with technical enablement or teaching programs.