Applied Scientist
$150k - $275k • Remote • San Francisco • FullTime
Posted 2d ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Agent Engineer
About the job
Blee is seeking an Applied Scientist to specialize in agent system design, focusing on architecting and implementing the next generation of intelligent compliance systems. This role involves designing frameworks where multiple agents, powered by custom and foundational models, collaborate to identify, track, and explain compliance flags. You will also be responsible for building and optimizing applied AI/ML pipelines, including model fine-tuning, prompt engineering, evaluation frameworks, and customer-specific AI configurations, and training models based on user feedback to deliver more targeted compliance recommendations.
Responsibilities
- Architect multi-agent systems, designing and implementing frameworks that integrate foundational LLMs and custom-trained models for intelligent compliance workflows.
- Build and optimize AI/ML pipelines, including model fine-tuning, prompt engineering, and evaluation frameworks.
- Ensure explainability and traceability by building mechanisms for transparent flagging, linking compliance flags to prior rules, examples, or data assets.
- Automate compliance rule translation by building systems that convert compliance rules into agent-ready logic paths.
- Design, train, and fine-tune models to enhance compliance accuracy and adaptability using user feedback and outcomes data.
- Design model evaluation and monitoring infrastructure to ensure reliability and auditability across customer deployments.
- Collaborate cross-functionally with Product Engineers, model training engineers, and compliance users to integrate AI features and translate complex rules into agent workflows.
- Stay current on AI/ML advances by prototyping and applying new techniques to the platform.
Requirements
- 5+ years of applied ML/AI engineering experience.
- Strong knowledge of agent-based architectures and orchestration frameworks.
- Proficiency in Python and modern software engineering practices (APIs, microservices, distributed systems).
- Experience with ML frameworks such as PyTorch, TensorFlow, or Hugging Face.
- Experience with LLMs, including fine-tuning, prompt engineering, RAG, and evaluation.
- Background in data preprocessing, feature engineering, and training pipelines.
- Experience with production ML systems, including model serving, monitoring, A/B testing, and data pipelines.
- Strong communication skills and ability to work cross-functionally.
- Based in the Bay Area or NY and willing to come into the office 2-3 days a week.
Benefits
- Competitive salary and equity package
- Bi-annual get-togethers
- Fully paid medical, dental, and vision insurance
- Free access to OneMedical (US Only)
- Company-paid life insurance (US Only)
- Company-sponsored 401k + matching (US Only)
- Flexible time off (with mandatory 15 days off)
- Financial support for work-adjacent learning opportunities