New: upload your resume and get matched to AI jobs. Free to start →

Member of Technical Staff (ML)

$200k - $350k • New York City • Full-time

Posted 1mo ago

Remote Work Policy

On-site

Employment Type

Full-time

Visa Sponsorship

The posting says they sponsor visas

Categories

AI Engineer

About the job

Solstice is seeking a Member of Technical Staff in Machine Learning to enhance the AI software that assists life sciences teams in creating, refining, and reviewing pharmaceutical marketing content. You will focus on improving the models, data representations, and datasets that underpin Solstice's AI agents. Your work will directly contribute to agents' ability to locate supporting evidence, utilize tools effectively, and integrate reviewer feedback to produce superior outputs. You will be responsible for diagnosing issues across agent workflows, formulating hypotheses, implementing changes, and rigorously testing their impact on customer tasks, ultimately deploying improvements into production.

Responsibilities

  • Improve model behavior within AI agents, diagnosing failures in evidence selection, tool usage, and feedback incorporation.
  • Enhance the accuracy of retrieval and grounding mechanisms for scientific documents and approved content.
  • Develop curated datasets from agent runs and reviewer feedback for training and evaluation.
  • Implement and test improvements in model choices, representations, context strategies, and learning methods.
  • Measure complete-task outcomes, evaluating intermediate tool behavior and final artifact quality.
  • Integrate model and data improvements into production Python services and agent workflows, ensuring quality monitoring and rollback capabilities.

Requirements

  • Strong Machine Learning fundamentals, including reasoning about learning objectives, optimization, regularization, data quality, and generalization.
  • Proficiency in Python and hands-on experience building or improving LLM systems, retrieval systems, or AI agents.
  • Demonstrated experience taking data or model improvements into production and analyzing post-deployment performance.
  • Sound experimental judgment, including forming explicit hypotheses, conducting credible comparisons, and managing data leakage.
  • Depth in at least one relevant area such as retrieval and ranking, representation learning, model adaptation, or learning from human feedback.
  • Ability to diagnose failure sources and determine appropriate solutions (data, model, context, or tool interface).
  • Practical software engineering skills for reproducible experiments, tested components, and production integration.
  • Clear communication skills and personal ownership, including explaining tradeoffs and collaborating with partners.

Benefits

  • Health, dental, and vision insurance
  • Ground-floor equity opportunity
  • Visa sponsorship for O-1, H-1B, and TN visas
  • Unlimited PTO
  • 401(k) with a 4% company match
  • In-office lunches five days a week
  • Professional growth stipend
  • Relocation support