RLHF Jobs
84 open roles mentioning RLHF
Senior/Staff Machine Learning Research Engineer, General Agents, Enterprise GenAI
Scale AI
Scale AI is seeking a Senior/Staff Machine Learning Engineer to join the General Agents team, focusing on building robust, production-ready AI agents for enterprise use cases. This role involves working across the entire agent lifecycle, from design and development to evaluation, deployment, and iteration. You will translate cutting-edge agentic techniques into reliable systems that solve high-impact business problems, emphasizing generalization, extensibility, and deployment across multiple customers. The team operates at the intersection of frontier agent development and real-world application, aiming to deliver significant economic value through scalable agent systems.
$290k - $363k
Research Scientist, Safety Post Training
Scale AI
Scale Labs is seeking a Research Scientist focused on Safety Post-Training to develop and apply methods for making frontier AI systems safer and more understandable. This role involves designing and executing post-training pipelines to analyze how training choices impact model safety, robustness, and alignment. You will also develop evaluations informed by interpretability techniques to uncover the reasons behind undesirable model behaviors and use these insights to guide targeted safety mitigations. A key aspect of this position is collaborating with policymakers, engineers, and other researchers to translate findings into actionable safety standards, benchmarks, and best practices.
$216k - $270k
Research Scientist, AI Controls and Monitoring
Scale AI
Scale Labs is launching a new team focused on policy research to bridge the gap between AI research and global policymakers, enabling informed, scientific decisions about AI risks and capabilities. This team tackles complex problems in agent robustness, AI control protocols, and AI risk evaluations to help governments, industry, and the public understand and mitigate AI risk while maximizing AI adoption. The Research Scientist, AI Controls and Monitoring will design methods, systems, and experiments to ensure advanced AI models and agents remain aligned with intended goals, even in high-stakes or adversarial environments.
$216k - $270k
Research Scientist, Agent Robustness
Scale AI
Scale Labs is launching a new team focused on policy research to bridge the gap between AI research and global policymakers, enabling informed, scientific decisions about AI risks and capabilities. This team tackles fundamental challenges in agent robustness, AI control protocols, and AI risk evaluations to help governments, industry, and the public understand and mitigate AI risk while maximizing AI adoption. The role involves collaborating broadly across industry, the public sector, and academia, and regularly publishing findings to shape the future of AI safety and alignment.
$216k - $270k
ML Research Engineer, ML Systems
Scale AI
Scale's ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform powers MLEs, researchers, data scientists, and operators for fast and automatic training and evaluation of LLMs, as well as data quality evaluation. You will work closely across Scale’s ML teams and researchers to build the foundation platform that supports all our ML research and development, enabling the next generation of LLM training, inference, and data curation.
$190k - $237k
Machine Learning Research Scientist, Post-Training
Scale AI
Scale works with leading AI labs to accelerate GenAI research by providing high-quality data. This role focuses on optimizing data curation and evaluation to enhance LLM capabilities in text and multimodal modalities. You will develop novel methods to improve the alignment and generalization of large-scale generative models, collaborate with researchers and engineers on best practices in data-driven AI development, and partner with foundation model labs to provide technical and strategic input on next-generation generative AI models.
$166k - $207k
Machine Learning Research Scientist, Evaluations
Scale AI
Scale works with leading AI labs to accelerate progress in GenAI research, focusing on LLM post-training and evaluation. This role is on the evaluation pod, building benchmarks and diagnosing model failure modes in text and multimodal modalities. You will develop rigorous evaluations to reveal where and why frontier models fail, collaborating with researchers and engineers to define best practices in evaluation-driven AI development. You will also partner with foundation model labs to translate failure analysis into technical and strategic input for next-generation generative AI models.
$166k - $207k
Staff/Senior Machine Learning Research Engineer, Intelligent Systems
Scale AI
Scale is seeking a Staff Machine Learning Research Engineer to join the Applied Intelligence Systems (AIS) team, which is part of the Scale Generative AI Platform. This role focuses on advancing agentic AI applications for enterprise and government use cases. You will work across the full spectrum of technical challenges within AIS, contributing to areas such as model training and fine-tuning, designing evaluation systems, building improvement loops from production data, prototyping novel agent architectures, and developing internal tooling. This is a hands-on research and engineering position where you will write code, ship production systems, and set the AI/ML technical direction for the team, influencing methods, architectures, and standards for others.
$250k - $350k
Staff Software Engineer, Full Stack - Gen AI
Scale AI
Our Generative AI Data Engine powers advanced LLMs and generative models through RLHF, human data generation, model evaluation, safety, and alignment. The data produced is crucial for how humanity will interact with AI. This horizontal, high-impact Staff Fullstack Engineer & Architect position reports directly to the Director of Contributor Engineering. Your scope spans across all Contributor (CB) teams, powering AI data operations from building high-impact datasets to optimizing contributor onboarding and incentives, and safeguarding data integrity. You will act as an organizational architect and tech lead, embedding into high-priority projects to guarantee execution, unblock teams, and ship mission-critical initiatives. Concurrently, you will lead the long-term technical evolution of our stack, transforming the core architecture to ensure it is highly sustainable, scalable, and fundamentally AI-native.
$252k - $315k
Staff Machine Learning Engineer, Public Sector
Scale AI
Scale is seeking a Staff Machine Learning Engineer for its Public Sector team to lead the design and deployment of agentic AI systems in critical government environments. This role involves working at the intersection of agentic ML, systems engineering, and applied research to build foundational infrastructure for AI systems that reason, plan, and act reliably at a national scale. You will partner directly with U.S. defense and intelligence agencies, contributing to flagship programs that advance agentic AI for geospatial reasoning, planning, and decision support. As a Staff ML Engineer, you will set technical direction, own core architectures, and translate ambitious ideas into production systems trusted by government operators.
$274k - $343k
Research Engineer, Chip Design RL
Anthropic
Anthropic is seeking a Research Engineer for its Code RL team, focused on advancing AI models for silicon design. This role involves leveraging chip design expertise to create tasks and signals for AI models, aiming to improve their capabilities in areas like RTL generation, design verification, and physical design optimization. The position sits at the intersection of cutting-edge research and engineering, with a commitment to building high-quality, scalable AI systems.
$500k - $850k
Research Engineer, RL Frontiers
Etched
Etched is building AI systems that accelerate its own development. As a Research Engineer on the RL Frontiers team, you will train proprietary frontier models to automate kernel development, ASIC engineering, production pipelines, and 3-D hardware operating systems. You will use proprietary simulators and environments to create custom data mixes and post-train models to SOTA performance on the company's hardest engineering tasks. The company is focused on inference and bets on transformer architectures, aiming to capture the entire inference market. Etched is a fully in-person team in San Jose, valuing engineering skills and expecting technical staff to contribute to both engineering and research across disciplines.
From $400k
Senior Software Engineer - Model Platform
Abnormal Security
Abnormal AI is seeking a Senior Software Engineer to join the Detection Team, focused on building advanced technology to identify and stop email and cloud-based attacks. In this role, you will enhance the speed, responsiveness, stability, and confidence of feature development for the ML and Data Science teams. The ideal candidate possesses a first-principles approach to scalable, customer-centric solutions, a drive to solve meaningful problems, and an ownership-oriented outlook, with the ability to iterate quickly and autonomously on novel challenges.
$180k - $259k
Research Engineer, Cybersecurity RL (Reinforcement Learning)
Anthropic
The Cybersecurity RL team within Horizons is seeking a Research Engineer to advance the capabilities of AI models in secure coding, vulnerability remediation, and defensive cybersecurity. This role combines research and engineering, involving the design and implementation of RL environments, conducting experiments, delivering work into production training runs, and collaborating with cross-functional teams. The ideal candidate will possess domain expertise in cybersecurity and an interest in training safe AI models, potentially coming from backgrounds such as white hat hacking, security engineering, or detection and response.
$500k - $850k
Summer 2027 Intern - AI Research
Salesforce
Salesforce AI Research is seeking entrepreneurial Research Interns for Summer 2027 to help build the next generation of Enterprise AI. This is a unique opportunity to work like a founder within Salesforce, exploring high-impact research directions, prototyping cutting-edge AI capabilities, and seeing how ideas are validated with customers and turned into production-ready solutions. Interns will have the freedom to propose and explore new ideas alongside mentors and research scientists, with access to Salesforce's global customer and product ecosystem. The role is ideal for individuals comfortable with ambiguity, bringing energy and focus, and who care as much about customer adoption as technical innovation, offering the pace and ownership of a startup with the reach and resources of Salesforce.
Research, Tinker, RL Systems
Thinking Machines Lab
Thinking Machines is building AI that extends human will and judgment. We are developing Tinker, a fine-tuning API that empowers researchers and developers to customize frontier AI models. This role focuses on building and enhancing our training systems for Tinker, specifically involving RL systems, numerics, and kernels, to enable users to train models with their own data and algorithms.
$350k - $475k
Agent Post-Training, Computer Use Research
OpenAI
The Agent Post-Training team at OpenAI is responsible for developing the frontier agents that are shipped to users. This involves training models for products like Codex and ChatGPT, focusing on creating persistent, proactive intelligence that can operate computers, collaborate with humans and other agents, and expand user capabilities. The team defines the next generation of agent abilities, builds the training signals, and runs experiments to realize these advancements. The role specifically focuses on teaching models to operate computers, including navigating browsers and desktops, using tools, reasoning through complex workflows, and completing long-horizon tasks reliably. This position is at the intersection of frontier model training, product behavior, evaluation, and systems engineering, directly influencing the computer-use capabilities of OpenAI's future agents.
$380k - $500k
Research Scientist (post-training)
Genmo
Genmo is a research lab developing sophisticated video world models to understand, simulate, and interact with the physical world, aiming to unlock the right brain of AGI. We are seeking an exceptional Research Scientist to focus on alignment and post-training techniques for large-scale video generation models. This role is at the forefront of ensuring our diffusion-based video models reliably produce high-quality, physically accurate, and safe outputs that align with human preferences and values.
Applied Research - Sovereign AI
Prime Intellect
Prime Intellect is developing an open superintelligence stack, providing infrastructure for AI labs. Their platform, Lab, integrates compute, environments, evaluations, secure sandboxes, and high-performance training for post-training at scale, including SFT, RL, tool use, agent workflows, and continuous model improvement. They are building open-source frontier AI models for long-horizon tasks and the platform their research team uses. The role focuses on building post-training and agent systems for national institutions, public-sector organizations, and regulated industries, addressing needs for models and agents that operate within strict boundaries for data, deployment, access, auditability, and human authority, while enabling self-improvement without external model dependency.
$150k - $300k
Applied Research - Continual Learning
Prime Intellect
Prime Intellect is building an open superintelligence stack, providing infrastructure for AI labs. Their platform, Lab, unifies compute, environments, evaluations, and training for post-training at scale, including SFT, RL, tool use, agent workflows, and continuous model improvement. They are focused on open-source models for long-horizon tasks and the platform their research team uses. The company has raised significant funding from prominent investors and is looking for individuals passionate about building at the intersection of frontier research, infrastructure, and go-to-market strategy for a nascent category.
$150k - $300k
