New: upload your resume and get matched to AI jobs. Free to start →

Applied Scientist II / Senior Applied Scientist - Responsible AI (CoreAI)

$102k - $202k • United States, Washington, Redmond; United States, New York, Garden City; United States, California, Mountain View; United States, California, San Francisco; United States, Massachusetts, Boston • Full-time

Posted 16d ago

Job Location

United States, Washington, Redmond; United States, New York, Garden City; United States, California, Mountain View; United States, California, San Francisco; United States, Massachusetts, Boston

Tech Stack

Remote Work Policy

On-site

Employment Type

Full-time

Categories

LLM Engineer

About the job

The CoreAI Platform and Tools organization is building transformative experiences that leverage the latest AI technology while upholding Microsoft’s commitment to ethical and responsible standards for Artificial Intelligence. The Responsible AI (RAI) service components you build will be accessed by hundreds of millions of consumers across the globe and will touch all facets of Artificial Intelligence. The Responsible AI team within this division is looking for an experienced Applied Scientist II and a Senior Applied Scientist with a proven track record to help tackle the challenges of enabling customers to leverage the latest advancements in AI responsibly.

Responsibilities

  • Conduct supervised fine-tuning of LLMs, applying Reinforcement Learning from Human Feedback (RLHF) and evaluating the results.
  • Design and implement agent adversarial evaluations and safety mitigations to help agent creators identify risks and apply safeguards.
  • Collaborate with the Responsible AI engineering team to deliver mitigations at scale, refine existing implementations, and troubleshoot end-to-end issues.

Requirements

  • Bachelor's Degree in Computer Science, Computational Linguistics, or related field with 2+ years of related experience, OR Master's Degree with 1+ year of related experience, OR Doctorate, OR equivalent experience.
  • Proficiency in programming languages such as Python, C#.
  • Familiarity with machine learning frameworks including PyTorch and Triton.
  • Experience with data processing and handling large datasets.
  • Experience in engineering methodologies: Unit testing, Test Driven Development, DevOps.
  • Solid platform/API design, debugging, and data analysis skills.
  • Ability to work collaboratively and communicate complex concepts effectively.

Benefits

  • Annual base pay range for Applied Scientist II: USD $102,100 - $202,200 (USD $133,800 - $219,200 in SF Bay/NYC areas).
  • Annual base pay range for Senior Applied Scientist: USD $119,800 - $234,700 (USD $160,200 - $261,000 in SF Bay/NYC areas).
  • Potential eligibility for other benefits and compensation.