LLM Engineer Jobs in San Francisco

NVIDIA is seeking software engineers for the CUDA Tile team to work on a new tile-based programming model for their GPUs. This role involves designing and implementing compiler transformations, developing MLIR-based dialects and lowering passes, and optimizing the performance of tile-based kernels across various NVIDIA GPU architectures. The work includes defining public APIs, crafting compiler and optimization techniques, and general software engineering tasks. NVIDIA is a leading technology company transforming computer graphics, PC gaming, and accelerated computing, now focusing on AI to define the next era of computing.

$152k - $242k

We are seeking a motivated engineer to enhance the integration of APIs across our CUDA-X math library software stack into modern LLM and agentic AI workflows. Organizations worldwide leverage GPU-powered data centers for AI, data analytics, and scientific simulations, driving progress in fields like LLMs, computer vision, and autonomous vehicles. Our team develops the essential GPU-accelerated libraries and SDKs for these technologies. In this role, you will ensure that human engineers and AI agents can easily build high-performance applications by effectively utilizing CUDA-X libraries. We are looking for individuals with a unique combination of technical expertise, developer experience, and communication skills.

$152k - $288k

NVIDIA is seeking exceptional engineers to design, implement, and deploy cutting-edge end-to-end autonomous driving systems. This role focuses on AI 2.0, leveraging LLMs, VLMs, and VLAs to enhance reasoning, planning, and interactivity in autonomous vehicles and robotics. You will be instrumental in building the future of autonomy by developing and integrating advanced AI models into mass-production vehicles.

$184k - $357k

NVIDIA is seeking a Senior Deep Learning Software Engineer to join their Algorithmic Model Optimization Team. This role focuses on optimizing generative AI models, including LLMs and diffusion models, for maximum inference efficiency. The team utilizes techniques like neural architecture search, pruning, sparsity, and quantization, and develops an innovative software platform for automated deployment. The engineer will contribute to applied research and the development of this software, which is used both internally at NVIDIA and externally by other AI development teams. This is an opportunity to push the boundaries of inference efficiency and large-scale automated deployment, working with high-level frameworks and improving high-performance kernel implementations.

$184k - $357k

NVIDIA is seeking senior engineers to enhance its AI platform, focusing on performance optimizations within deep learning frameworks like JAX. The goal is to create a robust, efficient, and scalable platform for data handling, training, and analysis across various deep learning solutions. This role requires strong programming and system design skills, along with excellent communication and planning abilities, to contribute to the next generation of numerical computing and machine learning research tools.

$184k - $357k

We are seeking a Senior AI Developer Technology (DevTech) Engineer to accelerate the frontier of generative AI training and inference. Our team bridges the NVIDIA platform with developers worldwide, diving deep into customer projects to eliminate bottlenecks and partnering with the developer community to deliver optimal performance on NVIDIA systems. If you are passionate about accelerating advanced AI models and influencing the future of NVIDIA hardware and software, we want you on our team.

$184k - $357k

NVIDIA is seeking a Senior Engineer to lead the performance modeling, evaluation, and post-training of large language models focused on code generation and agentic coding tasks. This role involves optimizing model capabilities, efficiency, and reliability by working at the intersection of model training, inference, and empirical analysis. You will design experiments to understand model behavior, identify performance bottlenecks, and develop post-training strategies to achieve measurable improvements in coding benchmarks and real-world software engineering tasks. Collaboration with research scientists, infrastructure engineers, and product teams will be key to translating model insights into production-ready features.

$224k - $431k

NVIDIA is seeking a motivated Deep Learning engineer to integrate advanced communication technologies into AI stacks, including PyTorch, TRT-LLM, vLLM, and SGLang. You will work with the team that created communication libraries like NCCL and NVSHMEM, and technology like GPUDirect, to scale Deep Learning and HPC applications. Your work will directly impact AI application performance by improving communication between GPUs, making AI toolkits easier for the community to use. This role offers an outstanding opportunity for someone with an AI background to advance the state of the art in this space.

$184k - $357k

We are seeking a Senior Power Architecture & Optimization Engineer to advance energy efficiency through sophisticated analytics and AI, including specialized LLMs for power analysis. This role is central to NVIDIA's mission of creating the most energy-efficient GPUs and SoCs, leveraging AI and LLMs as a key differentiator for future products. You will combine expertise in power architecture with machine learning, reinforcement learning, data analytics, and large language models to innovate in modeling, analyzing, and optimizing energy consumption across various design levels.

$136k - $265k

Harvey is transforming legal and professional services by combining advanced agentic AI, an enterprise platform, and deep domain expertise. This role offers a unique opportunity to contribute to a rapidly scaling company at a pivotal moment, defining a new category in real-time. The team operates with intensity, ownership, and a commitment to excellence, driven by values of decisiveness, simplicity, and continuous improvement. If you are motivated to do your best work alongside driven individuals, Harvey is the place to build the future of professional services.

$230k - $340k

Snorkel AI

Snorkel AI is seeking Senior and Staff Product Engineers with strong backend experience to help shape and deliver product capabilities that simplify complex workflows for users. This role involves owning backend features from concept to production, collaborating closely with Product, Design, and Engineering teams. You will be instrumental in building and evolving APIs, services, data models, and workflow capabilities that support the product, focusing on areas like data cataloging, agent benchmarking, and workflow automation. The ideal candidate possesses sound technical judgment and a commitment to product quality, usability, and impact.

$208k - $315k

Anthropic

As a Senior Software Engineer on the Life Sciences team, you will build and maintain biology software for use by Anthropic's scientists and the wider research community. This role involves accelerating biological progress with AI, combining frontier models with hands-on research. You will be responsible for the quality and reliability of released tools, pipelines, datasets, and benchmarks in genomics and structural biology, ensuring they are usable, trustworthy, and well-documented for external researchers. You will also represent the team within the computational biology community, contributing to public repositories, answering issues, and speaking at conferences. The role emphasizes using AI coding agents heavily in the software development lifecycle, holding agent-generated code to the same high standards as manually written code.

$300k - $320k

Figure is an AI robotics company developing autonomous general-purpose humanoid robots with the goal of shipping human-level intelligence. The Helix team is seeking an experienced AI Training Performance Engineer to elevate model training. This role focuses on enhancing distributed training frameworks for large-scale model training, optimizing GPU kernels, evaluating different accelerator types, and co-designing models for maximum hardware utilization.

$200k - $400k

Athelas

Commure is building the AI Operating System for healthcare, transforming how care is delivered, documented, and financed. Our platform spans the full care journey with Ambient AI, intelligent Agents, and autonomous RCM processing. We are at the center of transforming healthcare's $1 trillion administrative burden, with over 500,000 clinicians trusting our platform. Our Air AI team specifically is developing the intelligence layer within the clinical workflow, enabling listening, documentation, reasoning, and action to alleviate clinician burden. This involves real-time transcription, a conversational clinical assistant, and an AI Skills Library for automating clinical tasks.

$170k - $230k

You'll join the Grok Voice Model team as a software engineer. You'll design, build, and run the software systems behind Grok Voice, which delivers natural, low-latency, multilingual spoken interactions across devices and in real time. The team owns the full engineering stack behind the model, from large-scale data processing to distributed training to production deployment.

$150k - $450k

Together AI

As a Forward Deployed Engineer (FDE) focused on Post-Training, you will be a hands-on technical partner to strategic customers who are using fine-tuning and reinforcement learning to build differentiated models on open-source foundations. You will work alongside Solutions Architects as the deep-domain specialist in post-training, guiding customers through data strategy, algorithm selection, experiment design, and evaluation, and sizing the compute required. Your role is crucial in ensuring the successful delivery of post-training Proofs of Concept (POCs), driving adoption of the fine-tuning and RL platform, and translating customer goals into measurable improvements in model quality. This position directly impacts customer success, company growth, and the enhancement of our core platform.

$270k - $300k

Together AI

As a Forward Deployed Engineer (FDE) focused on Inference & Post-Training, you will be a hands-on technical partner to strategic customers looking to leverage high-quality models and perform inference at scale. You will act as a deep-domain specialist in inference optimization, fine-tuning pipelines, and production deployment, partnering with Solutions Architects. FDEs add significant value by ensuring complex Proofs of Concept (POCs) are met, facilitating platform adoption, and guiding tailored optimization efforts, directly impacting customer success and company growth.

$270k - $300k

Glean is seeking an AI Engineer focused on Quality and Post-Training to enhance their Work AI platform. This role is crucial for improving the reliability and usefulness of AI agents by focusing on measurement and quality improvements. You will work at the intersection of applied research, quality assurance, and product engineering to refine Glean's AI assistants and autonomous agents, ensuring they can reason, plan, and act effectively across complex workflows. The position involves optimizing the entire AI stack, including agent harnesses, model routing, prompts, and retrieval, while balancing quality with performance and cost.

$200k - $280k

Scale AI

Scale's LLM post-training platform team builds an internal distributed framework for large language model training, powering MLEs, researchers, data scientists, and operators for fast and automatic training and evaluation of LLMs. This platform also serves as the underlying training framework for the data quality evaluation pipeline. You will work closely with Scale’s ML teams and researchers to build the foundation platform which supports all our ML research and development works, enabling next generation LLM training, inference, and data curation.

$290k - $363k

Scale AI

Scale's ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform powers MLEs, researchers, data scientists, and operators for fast and automatic training and evaluation of LLMs, as well as data quality evaluation. You will work closely across Scale’s ML teams and researchers to build the foundation platform that supports all our ML research and development, enabling the next generation of LLM training, inference, and data curation.

$190k - $237k

As a Developer Platform engineer at Notion, you will contribute to the foundational elements that make Notion extensible and connected. You will build tools, APIs, and platform experiences enabling customers to integrate Notion with their external applications, data, and workflows. Your work will empower developers, admins, and builders to create reliable integrations and automations, making it easier to bring their apps and data into the Notion workspace. You will be a key player in establishing the robust technical foundation for Notion's connected workspace vision, contributing to both internal platform improvements and end-user-facing functionality. This role involves tackling complex technical challenges to ensure the long-term quality, reliability, and performance of Notion's platform as it scales.

$179k - $200k

Ironclad is seeking a Technical Lead Manager to lead a team of engineers focused on building production generative AI systems. This role combines hands-on technical leadership with people management, involving setting the technical direction for the team and fostering engineer growth. The team will own the technical roadmap and quality bar for their systems, partnering with product management to translate business needs into technical deliverables. The Tech Lead Manager will also contribute directly through design documents, architectural decisions, and writing production code for critical problems. A key aspect of the role is staying deeply involved in the team's architecture and technical details to effectively review designs, unblock engineers, and make prioritization calls, while also setting and upholding high engineering standards for code quality, testing, and production monitoring.

$188k - $235k

Wayve is building the leading AI platform for autonomous driving, pioneering an end-to-end AI approach that enables vehicles to learn directly from real-world experience. This role is on the AI Libraries team, which builds the foundations that enable Wayve's machine learning engineers and researchers to train, evaluate, and deploy models at scale. You will create high-quality platforms, tools, and reusable abstractions that support thousands of GPUs and accelerate the development of autonomous-driving technology. You will work closely with machine learning teams to understand their workflows and translate complex requirements into stable, scalable, and intuitive software. Your day-to-day will involve designing and writing Python, leading projects from discovery through delivery, improving engineering standards, and supporting users as they push the scale and performance of their models. You will build modular libraries for areas such as multimodal data loading, distributed training and inference, checkpointing, and observability, improving the reliability, performance, and developer experience of systems used across Wayve.

$276k - $311k

Databricks

The Foundation Model Inference team is the backbone of Databricks’ generative AI capabilities. We build the infrastructure that enables our customers to serve, scale, and optimize frontier models with enterprise-grade reliability and performance. Our Foundation Model APIs provide a unified platform that gives customers access to LLMs with the governance, flexibility, and scalability required for enterprise production workloads. We are looking for high-agency engineers who are excited to work on powering model inference at enterprise scale.

$190k - $265k