Senior LLM Engineer Jobs

Crusoe

As a Senior Engineering Manager, you will lead an engineering team focused on making large language models run faster, cheaper, and more reliably in production. This role balances team leadership with core systems and performance engineering on demanding models in production, requiring you to stay deeply technical and hands-on with the inference stack end to end. The work is applied, not academic, with optimizations landing in real customer deployments. You will tailor deployments to customer needs, take workloads from proof of concept to production, and ensure performance gains deliver clear business and customer value. This leadership role combines people management, technical direction, and hands-on coding and profiling, with a customer-facing component and elements of product and technical solutions leadership.

$250k - $300k

Cerebras

Cerebras is developing a new generation of disaggregated AI inference systems that combine GPU-accelerated prefill with ultra-fast decode on the Cerebras Wafer-Scale Engine. We are seeking a Software Engineer to build and enhance the ML API layer, making this heterogeneous serving system accessible, reliable, and user-friendly. You will operate across our inference APIs, model integration layer, request-routing services, and the Cerebras inference platform to ensure a consistent experience across various models and accelerator backends. This role is at the intersection of machine learning systems, API design, model serving, and distributed systems, enabling new model architectures and inference capabilities while defining stable user-facing behavior and ensuring features like streaming, sampling, tool use, structured outputs, and multimodal inputs function correctly in production.

Salary not listed

Capital One is building trustworthy and reliable AI systems to transform banking. We leverage machine learning for real-time, intelligent customer experiences and are committed to world-class applied science and engineering. The AI Foundations team is central to this vision, working across the research lifecycle from academia to production systems. You will partner with cross-functional teams to deliver AI-powered products, using technologies like Pytorch, AWS Ultraclusters, Huggingface, and Lightning to analyze vast amounts of data. This role involves building AI foundation models through all development phases, from design to implementation, and engaging in high-impact applied research to drive next-generation customer experiences.

$263k - $300k

Together AI

As a Forward Deployed Engineer (FDE) focused on Inference & Post-Training, you will be a hands-on technical partner to strategic customers looking to leverage high-quality models and perform inference at scale. You will act as a deep-domain specialist in inference optimization, fine-tuning pipelines, and production deployment, partnering with Solutions Architects. FDEs add significant value by ensuring complex Proofs of Concept (POCs) are met, facilitating platform adoption, and guiding tailored optimization efforts, directly impacting customer success and platform hardening.

Salary not listed

JPMorgan Chase & Co. is seeking a hands-on AI Engineering Lead and domain expert to join the growing Asset and Wealth Management AI Engineering team. This role involves building next-generation technology that leverages JPMC's unique data and full-service advantage to develop high-impact AI applications and platforms within the financial services industry. The ideal candidate will be excited about the opportunity to build cutting-edge business solutions powered by AI, combining proven development expertise with a passion for creating innovative technology through solid engineering practices.

Salary not listed

We are seeking an Engineering Manager for AI/ML to lead Rula's AI Engineering team, focusing on both applied product capabilities and foundational ML platforms. This role involves guiding senior and staff engineers to deliver user-facing features like transcript summarization and search relevance, while also architecting core AI/ML infrastructure such as feature stores and AI observability platforms. The ideal candidate will balance execution speed, strong coaching, and a rigorous sense of clinical safety to ensure solutions and models scale effectively and safely. You will be instrumental in shaping Rula's AI engineering culture and driving technological advancements that transform mental healthcare delivery.

$208k - $260k

EnCharge AI is seeking a highly skilled and experienced AI Compiler Engineer to spearhead the development and optimization of graph compilers tailored for cutting-edge AI and ML workloads. This role involves collaborating with hardware architects and AI researchers to enhance performance, optimize computation graphs, and enable efficient model deployment on EnCharge's Inference Accelerators. The ideal candidate will architect, design, and implement optimizations for AI model execution on graph compilers to improve performance, reduce latency, and maximize hardware utilization.

$190k - $255k

Capital One is seeking an Applied Researcher to join the AI Foundations team, focusing on LLM, Optimization, and Finetuning. This role involves partnering with cross-functional teams to deliver AI-powered products that enhance customer interactions with their money. You will leverage a broad stack of technologies, including Pytorch, AWS Ultraclusters, Huggingface, and Lightning, to analyze vast amounts of data and build AI foundation models through all phases of development. The position offers the opportunity to engage in high-impact applied research, pushing the boundaries of AI for next-generation customer experiences and translating complex work into tangible business goals. Collaboration with senior researchers for tech reports and conference submissions is also a key aspect of the role.

$219k - $250k

Databricks

As a staff software engineer for GenAI inference, you will lead the architecture, development, and optimization of the inference engine that powers Databricks Foundation Model API. You’ll bridge research advances and production demands, ensuring high throughput, low latency, and robust scaling. Your work will encompass the full GenAI inference stack: kernels, runtimes, orchestration, memory, and integration with frameworks and orchestration systems.

$191k - $233k

Databricks

Databricks is seeking a Fullstack Software Engineer to join its new R&D center in Vancouver, Canada. This role involves working on the company's mission to simplify and democratize data and AI by building and running the world's best data and AI infrastructure platform. You will collaborate with your team and product management to make data insights simple, taking ownership of the full product and user experience beyond technical implementation. The Vancouver site is envisioned as a key driver of product innovation, with open roles across strategic areas like Log Analytics, AI/BI, Unity Catalog Business Semantics, and Databricks Apps, the latter of which heavily invests in app builder AI agents.

CA$146k - CA$201k

Hugging Face is seeking a Senior Open-Source Python Engineer to join their Applications team, focusing on building tooling for developers to create machine learning applications. This role involves maintaining and growing existing libraries like Trackio and Gradio, as well as developing new tools from scratch. A significant part of the job is taking projects from early stages to widespread adoption by shaping APIs, shipping quickly, and engaging with the developer community. The position is dynamic and requires comfort with evolving challenges in the rapidly changing ML ecosystem.

Salary not listed

Handshake is seeking a Senior Software Engineer to join the Backend Platform team, with a primary focus on supporting Handshake AI (HAI) and internal AI initiatives. This role involves building and maintaining backend services, shared platform capabilities, and developer tooling. The work will center on core backend platform concerns such as service architecture, APIs, data systems, performance, reliability, and developer experience, with an increasing use of LLMs and agents. The ideal candidate will possess strong backend fundamentals combined with practical knowledge of LLM-powered and agentic systems.

$208k - $260k

Capital One is seeking an AI Engineer to join the Intelligent Foundations and Experiences (IFX) team, which is central to bringing the company's AI vision to life. This role involves partnering with cross-functional teams to deliver AI-powered products that transform customer interactions and associate workflows. You will design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, agents, multi-agent workflows, similarity search, guardrails, model evaluation, and governance. The position leverages a broad stack of Open Source and SaaS AI technologies and focuses on inventing and introducing state-of-the-art foundation model optimization techniques to enhance the performance of large-scale production AI systems. You will also contribute to the technical vision and roadmap for foundational AI systems, design and optimize multi-model orchestration pipelines, and establish cost-performance governance for AI systems.

$230k - $262k

Capital One is building responsible and reliable AI systems to transform banking. We are at the forefront of enterprises leveraging AI, using machine learning to create personalized customer experiences and bring humanity and simplicity to banking. You will join a world-class applied science and engineering team to deliver breakthrough product experiences and scalable, high-performance AI infrastructure. The Intelligent Foundations and Experiences (IFX) team is central to this vision, advancing the state of the art in AI science and engineering, and building proprietary solutions that deliver value to millions of customers. Our AI models and platforms empower teams across Capital One to enhance their products with AI in responsible and scalable ways.

$197k - $225k

Anthropic

The Encodings Infra team at Anthropic maintains the libraries that engineers and researchers use to encode text and multimodal data for Claude. This team also defines Claude's prompt structure, including how user turns are represented and how Claude interacts with tools. As a Software Engineer on this team, you will be responsible for the design and upkeep of these libraries, ensuring their APIs are intuitive, performance is optimized, and abstractions are robust. Your work will span across various systems, from pretraining to finetuning and the API, requiring close collaboration with researchers and engineers to facilitate the rapid transition of new encoding ideas from experimentation to production.

$320k - $405k

PALO IT is seeking an AI Native Tech Lead/Architect in CDMX to lead the technical delivery of full-stack solutions. This role involves guiding teams towards scalable, secure, and maintainable implementations, bridging business objectives with software architecture and engineering delivery. You will establish engineering standards, ensure solutions align with client needs, and drive the adoption of PALO IT's AI-first engineering methodology, Gen-e2™, to enhance productivity and quality. The position requires a blend of hands-on technical expertise and leadership, collaborating with clients and engineering teams to integrate AI-assisted development into software delivery.

Salary not listed

Fin, now part of Salesforce, is seeking Staff Product Engineers to join the AI Group and build Fin's AI-powered products. This role involves working closely with ML Scientists and product teams to define new ML features, research algorithms, and rapidly prototype solutions for customers. The team is highly product-focused, partnering with Product and Design to bring AI-powered product experiences to life and ship them to beta within weeks. Engineers will contribute to all phases of software development, from ideation to implementation and testing, while also playing a key role in mentoring other engineers and raising technical standards within the group.

Salary not listed

Fin, now part of Salesforce, is seeking Senior Product Engineers to join their AI Group to build Fin's AI-powered products. Product Engineers in this role will work closely with ML Scientists and product teams, deeply understanding the product, customers, and the ML tech stack. The group is responsible for defining new ML features, researching algorithms and technologies, and rapidly prototyping for customer hands-on experience. This is a product-focused team that partners with Product and Design functions, enabling fast production cycles, often shipping to beta in weeks. They are passionate about applying machine learning, having productized everything from classic supervised models to novel applications of transformer neural networks, measuring real customer impact for each deployed model.

Salary not listed

Fin, now part of Salesforce, is seeking a Senior Product Engineer to join their multidisciplinary product teams. In this role, you will solve real customer problems by applying your technical knowledge to build both back-end and front-end systems. You will work closely with designers, product managers, researchers, and data analysts to address exciting scaling challenges and build a robust platform. This is an opportunity to contribute to the future of customer experience by leveraging AI and driving innovation in a fast-paced environment.

Salary not listed

WorldQuant is seeking an exceptionally talented AI Scientist to join its Artificial Intelligence team. This role involves conducting research in Machine Learning to enhance the investment pipeline, producing trading or predictive signals using innovative algorithms, and applying LLM-based agentic technology to develop and test new trading strategies. The position also includes implementing signal compression and combination techniques, designing deep learning architectures, and developing model frameworks for investment professionals. The successful candidate will collaborate closely with portfolio managers and researchers to optimize machine learning algorithms and communicate complex concepts effectively.

$150k - $200k

Pika

Pika is building the next generation of AI creative tools to make video creation seamless, intuitive, and accessible to everyone. We are seeking a Principal Product Engineer to lead the technical vision, architecture, and roadmap for user-facing systems. In this high-impact role, you will guide the engineering direction for features serving millions of creative users, from intuitive UIs and collaboration tools to real-time interactions and advanced generative AI experiences. You will work closely with product, design, and engineering leadership to deliver robust, scalable, and delightful features, influencing both immediate user experience and long-term product vision from conception to launch and iteration.

Salary not listed

Parallel Wireless is seeking a hands-on technical leader to build and operate a secure local large-language-model (LLM) platform. This platform will enable engineering and business teams to leverage generative AI with proprietary company data, including source code, product documentation, and technical standards, all within a secure, company-controlled environment. This senior individual contributor role involves applied LLM engineering, platform architecture, data pipelines, security, and production operations. You will transform prototypes into a dependable internal capability by selecting and optimizing open-weight models, building permission-aware retrieval systems, creating reusable APIs and tools, integrating with existing workflows, and establishing metrics for quality, safety, latency, capacity, and business value. The role emphasizes building a trustworthy enterprise LLM solution that includes robust source grounding, access controls, repeatable evaluation, observable services, and a sustainable operating model.

Salary not listed

Anthropic

The Safeguards ML Sampling Path team builds and operates the production services that power Claude's safety systems. These services are critical, sitting on the token generation path across every platform Claude runs on. You will be responsible for keeping p99 latency flat as traffic grows, building for robustness against dependency failures, and safely shipping changes to a system that cannot go down. This role requires a strong foundation in distributed systems and a focus on designing systems for graceful degradation.

$320k - $485k

PALO IT is seeking a Software Architect in CDMX to lead the technical delivery of digital products, guiding teams towards scalable, secure, and maintainable solutions with a strong emphasis on AI-first engineering practices. The company is a global technology consultancy with a trademarked, AI-first approach called Gen-e2™, redefining how enterprises build digital products and transform with AI. They are a B Corp-certified company committed to local care and global delivery, operating as an AI-native organization with a collective intelligence approach.

Salary not listed