Senior LLM Engineer Jobs

NVIDIA is seeking experienced engineers specializing in performance analysis and optimization to improve the efficiency of LLM training workloads. This role focuses on optimizing NVIDIA’s high-performance LLM software stack in frameworks like PyTorch and JAX for high-performance training on thousands of GPUs. You will also help shape hardware roadmaps for the next generation of GPUs powering the AI revolution. This is an opportunity to collaborate with forward-thinking individuals and shape the future of AI in a creative and autonomous work environment.

$184k - $357k

NVIDIA is seeking a Senior Compiler Engineer to join our GPU Software organization. In this role, you will be instrumental in delivering features and improvements that maximize the potential of NVIDIA hardware across diverse computational workloads, including deep learning, scientific computing, autonomous vehicles, and gaming. Our compiler organization plays a critical role in every GPU NVIDIA produces. You will focus on the CUDA compiler front end, developing language features, diagnostics, and capabilities that empower both human developers and AI agents to create correct and high-performance GPU code. This position offers the opportunity to expand your expertise into other areas of the compiler stack, such as the LLVM-based optimizer, code generation, and MLIR.

$152k - $242k

We are seeking a Senior Forward Deployed Engineer to lead technical engagements with partners and customers, focusing on NVIDIA's open model portfolio. The primary mission is to transform open models into production-ready AI solutions tailored to specific domains, covering the entire lifecycle from post-training to harness optimization. This role involves collaborating closely with NVIDIA's partner ecosystem, co-leading customer engagements, and developing resources that enable partners to scale their AI initiatives. You will work hands-on to build custom AI solutions, from initial customer conversations through to production deployment, ensuring models are optimized for performance and cost-effectiveness.

$184k - $357k

NVIDIA is seeking a Senior Software Engineer to enhance the Rust experience for CUDA Core Libraries. This role involves designing and implementing safe, idiomatic Rust APIs for GPU computing, while integrating closely with existing C/C++ components. You will be part of the team responsible for building the foundational libraries, algorithms, and infrastructure that power CUDA, ensuring a high-performance experience for developers and AI coding agents.

$184k - $357k

NVIDIA is seeking software engineers for the CUDA Tile team to work on a new tile-based programming model for their GPUs. This role involves designing and implementing compiler transformations, developing MLIR-based dialects and lowering passes, and optimizing the performance of tile-based kernels across various NVIDIA GPU architectures. The work includes defining public APIs, crafting compiler and optimization techniques, and general software engineering tasks. NVIDIA is a leading technology company transforming computer graphics, PC gaming, and accelerated computing, now focusing on AI to define the next era of computing.

$152k - $242k

We are seeking a motivated engineer to enhance the integration of APIs across our CUDA-X math library software stack into modern LLM and agentic AI workflows. Organizations worldwide leverage GPU-powered data centers for AI, data analytics, and scientific simulations, driving progress in fields like LLMs, computer vision, and autonomous vehicles. Our team develops the essential GPU-accelerated libraries and SDKs for these technologies. In this role, you will ensure that human engineers and AI agents can easily build high-performance applications by effectively utilizing CUDA-X libraries. We are looking for individuals with a unique combination of technical expertise, developer experience, and communication skills.

$152k - $288k

NVIDIA is seeking exceptional engineers to design, implement, and deploy cutting-edge end-to-end autonomous driving systems. This role focuses on AI 2.0, leveraging LLMs, VLMs, and VLAs to enhance reasoning, planning, and interactivity in autonomous vehicles and robotics. You will be instrumental in building the future of autonomy by developing and integrating advanced AI models into mass-production vehicles.

$184k - $357k

NVIDIA is seeking a Senior Deep Learning Software Engineer to join their Algorithmic Model Optimization Team. This role focuses on optimizing generative AI models, including LLMs and diffusion models, for maximum inference efficiency. The team utilizes techniques like neural architecture search, pruning, sparsity, and quantization, and develops an innovative software platform for automated deployment. The engineer will contribute to applied research and the development of this software, which is used both internally at NVIDIA and externally by other AI development teams. This is an opportunity to push the boundaries of inference efficiency and large-scale automated deployment, working with high-level frameworks and improving high-performance kernel implementations.

$184k - $357k

NVIDIA is seeking senior engineers to enhance its AI platform, focusing on performance optimizations within deep learning frameworks like JAX. The goal is to create a robust, efficient, and scalable platform for data handling, training, and analysis across various deep learning solutions. This role requires strong programming and system design skills, along with excellent communication and planning abilities, to contribute to the next generation of numerical computing and machine learning research tools.

$184k - $357k

We are seeking a Senior AI Developer Technology (DevTech) Engineer to accelerate the frontier of generative AI training and inference. Our team bridges the NVIDIA platform with developers worldwide, diving deep into customer projects to eliminate bottlenecks and partnering with the developer community to deliver optimal performance on NVIDIA systems. If you are passionate about accelerating advanced AI models and influencing the future of NVIDIA hardware and software, we want you on our team.

$184k - $357k

NVIDIA is seeking a Senior Engineer to lead the performance modeling, evaluation, and post-training of large language models focused on code generation and agentic coding tasks. This role involves optimizing model capabilities, efficiency, and reliability by working at the intersection of model training, inference, and empirical analysis. You will design experiments to understand model behavior, identify performance bottlenecks, and develop post-training strategies to achieve measurable improvements in coding benchmarks and real-world software engineering tasks. Collaboration with research scientists, infrastructure engineers, and product teams will be key to translating model insights into production-ready features.

$224k - $431k

NVIDIA is seeking a motivated Deep Learning engineer to integrate advanced communication technologies into AI stacks, including PyTorch, TRT-LLM, vLLM, and SGLang. You will work with the team that created communication libraries like NCCL and NVSHMEM, and technology like GPUDirect, to scale Deep Learning and HPC applications. Your work will directly impact AI application performance by improving communication between GPUs, making AI toolkits easier for the community to use. This role offers an outstanding opportunity for someone with an AI background to advance the state of the art in this space.

$184k - $357k

We are seeking a Senior Power Architecture & Optimization Engineer to advance energy efficiency through sophisticated analytics and AI, including specialized LLMs for power analysis. This role is central to NVIDIA's mission of creating the most energy-efficient GPUs and SoCs, leveraging AI and LLMs as a key differentiator for future products. You will combine expertise in power architecture with machine learning, reinforcement learning, data analytics, and large language models to innovate in modeling, analyzing, and optimizing energy consumption across various design levels.

$136k - $265k

We are seeking an AI ML Director to lead a team in building next-generation, AI-driven Global Financial Crimes Strategic Monitoring solutions. This role involves detecting AML risk, regulatory violations, transaction risk, misconduct, and behavioral anomalies. You will be responsible for designing, building, and productionizing risk typologies, features, data pipelines, supervised and unsupervised ML models, and LLM risk explainability at scale. This is a hands-on role requiring deep expertise in ML operations, LLM integration, scalable ML systems, and production-grade engineering discipline, with opportunities to collaborate with product managers, architects, data science, and operational teams.

Salary not listed

Toast

Toast is seeking a Software Engineering Manager to lead a team focused on building a demand generation engine for their restaurant customers. This role is a hands-on 'player/coach' position, requiring a balance of team leadership, architectural contributions, and direct coding. The manager will guide a lean, high-impact squad of 5-10 engineers, focusing on delivering high-impact features for one of Toast's fastest-growing products. The emphasis is on driving clarity, improving execution, and maintaining a high standard of quality, with approximately 30-50% of time dedicated to coding, technical design reviews, and pairing with engineers.

Salary not listed

Accenture

As a Large Language Model Architect, you will design and structure advanced language models capable of understanding and generating human-like text. Your primary focus will be on creating neural network configurations that efficiently process vast amounts of unstructured text data. This involves refining model architectures to enhance performance and scalability, collaborating with various teams to integrate these models into broader applications, and continuously exploring innovative approaches to improve natural language processing capabilities. The role demands a thoughtful balance of creativity and technical insight to build systems that can interpret and generate language with high accuracy and relevance.

Salary not listed

Accenture

As a LLM Model Developer, you will engage in the intricate process of fine-tuning Large Language Models, focusing on instruction fine-tuning and domain adaptation. Your typical day will involve collaborating with cross-functional teams to enhance model relevance and performance in specific contexts, ensuring that the models meet the diverse needs of various applications. You will analyze model outputs, iterate on training processes, and implement strategies to optimize performance, all while maintaining a keen awareness of the latest advancements in the field of artificial intelligence and machine learning.

Salary not listed

Accenture

As an AI / ML Engineer, you will design and build advanced applications and systems that leverage artificial intelligence technologies and cloud-based services. This role involves integrating generative AI models into solutions, ensuring applications are production-ready and scalable. You will develop pipelines for deployment on cloud or on-premises environments, collaborate with cross-functional teams, and explore innovative approaches such as deep learning, neural networks, chatbots, and image processing to solve complex challenges.

Salary not listed

Snorkel AI

Snorkel AI is seeking Senior and Staff Product Engineers with strong backend experience to help shape and deliver product capabilities that simplify complex workflows for users. This role involves owning backend features from concept to production, collaborating closely with Product, Design, and Engineering teams. You will be instrumental in building and evolving APIs, services, data models, and workflow capabilities that support the product, focusing on areas like data cataloging, agent benchmarking, and workflow automation. The ideal candidate possesses sound technical judgment and a commitment to product quality, usability, and impact.

$208k - $315k

SambaNova

SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. At the core of SambaNova's technology is the RDU (Reconfigurable Dataflow Unit) — a chip built on a dataflow architecture rather than the traditional GPU model. This role involves bringing frontier open-weight models from Hugging Face to production serving on SambaNova's RDU dataflow accelerators. This includes adapting models, mapping them across chips and hosts, compiling them, and validating them numerically against the reference. You will also build inference features like continuous batching, speculative decoding, and FP8/FP4 as shared modules to reduce the cost of bringing up new models.

$208k - $312k

Anthropic

As a Senior Software Engineer on the Life Sciences team, you will build and maintain biology software for use by Anthropic's scientists and the wider research community. This role involves accelerating biological progress with AI, combining frontier models with hands-on research. You will be responsible for the quality and reliability of released tools, pipelines, datasets, and benchmarks in genomics and structural biology, ensuring they are usable, trustworthy, and well-documented for external researchers. You will also represent the team within the computational biology community, contributing to public repositories, answering issues, and speaking at conferences. The role emphasizes using AI coding agents heavily in the software development lifecycle, holding agent-generated code to the same high standards as manually written code.

$300k - $320k

Join a team where your engineering work accelerates how machine learning is built, governed, and delivered across JPMorgan Chase. You will help create platform capabilities that make it easier for teams to move from ideas to production with confidence. If you enjoy building scalable systems and improving developer experience, this role offers meaningful impact and career growth. As a Lead Software Engineer within the Corporate Artificial Intelligence and Machine Learning Data Platforms team, you will build and enhance products that support the machine learning lifecycle—spanning model operations, data development (such as processing and data annotation), and governance tooling. You will collaborate closely with engineers, system architects, product managers, data scientists, and research partners to deliver reliable, secure, and user-friendly platform services.

Salary not listed

Stripe

The Conversation Platform team is building a comprehensive platform for Stripe merchants, focusing on automating simple tasks and assisting with complex ones. This includes features like customizing landing pages, enabling natural language interaction with the Stripe API, and automating issue resolution. The team is developing Retrieval-Augmented Generation (RAG) systems using the latest Large Language Models (LLMs) and fine-tuning their own models, managing the entire lifecycle from ideation to production deployment.

Salary not listed

Mastercard's Services division is seeking a Lead Data Scientist to join the Business & Market Insights (B&MI) team. This role is central to developing new products and capabilities driven by analytics and AI, leveraging rich data resources and AI platform capabilities. You will work across multiple teams, from concept and technical design to market release and optimization, driving new ideas forward with creative thought leadership and innovation. This is a rewarding opportunity to be part of a transformative strategic initiative, combining technical expertise with a customer-centric approach to solve complex business problems.

Salary not listed