Rust Jobs

thinkingmachines

Thinking Machines Lab is seeking a full-stack engineer to develop and deploy the products and services that Tinker users engage with daily. This role involves working across frontend, backend, and infrastructure to build the Tinker console, developer tools, and other essential components for the platform. Tinker is a fine-tuning API that enables researchers and developers to customize frontier AI models using their own data and algorithms, managing the underlying infrastructure to provide flexibility and access to advanced capabilities.

$350k - $475k

thinkingmachines

Thinking Machines Lab is seeking a developer productivity engineer to enhance internal software development processes, focusing on safety, speed, and user experience. This role will concentrate on AI tools and coding agents, collaborating with platform, security, and product engineers to build cutting-edge tooling for AI-assisted software development and significantly accelerate the inner development loop. The position involves both establishing company-wide platforms and assisting individual developers in optimizing their workflows.

$350k - $475k

OpenAI

OpenAI is seeking an experienced systems generalist to join the GPT Infrastructure team. This role involves building an automated inference optimization platform that handles workload analysis, target hardware profiling, compiler and runtime context, and trusted verification. You will design and implement both the OpenAI-hosted control plane and the partner-side software responsible for evaluating candidates on real accelerator hardware. The goal is to create a reliable system that ensures reproducible performance results and maintains clear trust boundaries for sensitive information, turning a powerful research workflow into a scalable product.

thinkingmachines

Thinking Machines Lab is seeking an engineer to join a high-impact team focused on data infrastructure. This role is crucial for architecting and scaling the core systems that power distributed training pipelines, multimodal data catalogs, and intelligent processing of petabytes of data. You will work directly with researchers to accelerate experiments, develop new datasets, enhance infrastructure efficiency, and derive key insights from our data assets. If you are passionate about distributed systems, large-scale data mining, and building foundational tools from the ground up, we encourage you to apply.

$350k - $475k

Crusoe is seeking a Senior Software Engineer to build and own customer-facing observability products within Crusoe Cloud's Cloud Monitoring Service. This team delivers managed logs and self-service observability capabilities, enabling customers to collect, search, and act on their telemetry efficiently. You will be responsible for end-to-end ownership of product surfaces, including APIs, backend services, and the user onboarding and configuration experience, with a strong emphasis on reliability and ease of use.

$175k - $210k

thinkingmachines

Thinking Machines Lab is seeking a Software Engineer to own the platform systems that power Tinker, their fine-tuning API. This role involves developing and maintaining critical components such as billing and usage metering, permissions and access control, organization and team management, data export functionalities, and audit logging. You will collaborate closely with product, legal, and other cross-functional teams, ensuring that new features, pricing adjustments, and enterprise deals are seamlessly integrated into the platform. This is an opportunity to grow a rapidly expanding platform and contribute to the Tinker community.

$350k - $475k

thinkingmachines

Thinking Machines Lab is seeking engineers to build the libraries and tools that accelerate research. You will own internal infrastructure, including evaluation libraries, RL training libraries, and experiment tracking platforms, and build systems that compound research velocity over time. This is a collaborative role where you will work directly with researchers to identify bottlenecks and pain points. Success means researchers trust your systems to just work and find them a delight to use.

$350k - $475k

thinkingmachines

Thinking Machines Lab is seeking engineers to build the libraries and tools that accelerate research. You will own internal infrastructure, including evaluation libraries, RL training libraries, and experiment tracking platforms, to build systems that compound research velocity over time. This is a collaborative role where you will work directly with researchers to identify bottlenecks and pain points. Success means researchers trust your systems to just work and find them a delight to use.

$350k - $475k

LangChain is seeking a hands-on Engineering Manager to lead the SmithDB team, responsible for building a storage and query layer purpose-built for AI observability and evaluation. This role is a blend of technical leadership and people management, requiring the individual to write production code, review PRs at the systems level, and make architectural decisions, while also owning team health, hiring, and the technical roadmap. The ideal candidate possesses deep systems or database engineering experience and a passion for staying technical while growing a team, contributing to a greenfield system with significant production load and ambitious engineering goals.

$240k - $300k

OpenAI

OpenAI's API Platform organization is seeking full stack and frontend engineers to help define and build the next generation of OpenAI's developer experience. This role involves working across frontend product surfaces, backend systems, SDK and documentation pipelines, and API workflows that serve millions of developers and companies. You will partner closely with product, design, research, API engineering, and developer-facing teams to make complex AI capabilities simple to understand, easy to test, and safe to launch in real-world applications. This is a highly cross-functional role for someone who cares deeply about craft, developer empathy, reliability, and product velocity.

Nabla is seeking a Staff Front-End Engineer to lead the development of high-impact user experiences across our web, desktop, browser extension, and mobile interfaces. You will be instrumental in setting the standard for UI quality and performance, and will play a central role in evolving our design system, architecture, and tooling. This role offers the opportunity to contribute end-to-end to a specific product area within a cross-functional squad, working closely with Product, ML, and Back-End teams to ship full-stack features. We are a fast-moving, deeply technical engineering team leveraging AI to revolutionize healthcare delivery.

Scale AI

Scale AI is seeking a highly skilled and motivated Software Engineer to join our dynamic Public Sector Engineering team. You will play a critical role in supporting Scale’s government customers by scoping and developing onsite solutions. Your expertise will be instrumental in designing and implementing systems that can handle interactions with existing customer systems to help our products integrate into existing customer workflows. We are looking for an exceptional Senior Software Engineer to architect and build the foundational data infrastructure that will serve as the brain of a project ecosystem. You will be responsible for designing highly novel data models and processing pipelines capable of handling massive quantities of output data from complex simulations. At the core of this role is the challenge of building a foundational data ensemble—a unified architecture that seamlessly aggregates, structures, and stages diverse sources of simulation outputs and user inputs. Your systems will manage enormous batch throughput jobs with strict, minimal latency requirements, ensuring that downstream AI systems and language models have the exact context they need to actionably reason over complex, multi-dimensional scenarios.

$216k - $300k

LiteLLM is seeking a Rust Engineer to lead the critical migration of its AI Gateway from Python to Rust. This high-visibility role involves owning the entire migration process, from planning with the CTO and restructuring the codebase to executing a stability-first, gradual rollout. The primary focus is on significantly improving performance, aiming to make LiteLLM the lowest-latency, highest-throughput AI gateway in the market without compromising reliability for enterprise customers. This is a single-owner mandate where your decisions will directly shape the platform's future performance and efficiency.

Together AI

Together AI is seeking a Staff Platform Engineer to lead the architecture of their Voice AI platform, which powers real-time voice agents at scale. This role involves setting the technical direction for how developers interact with the platform, from API primitives to autoscaling systems and multi-provider abstractions. The focus is on building robust, low-latency infrastructure for voice applications, which presents unique challenges compared to text inference, such as handling bidirectional audio streams and stateful connections. This is a foundational position on a small team, where decisions will shape the platform's architecture for years to come.

$220k - $280k

Together AI

Together AI is building the best inference infrastructure for voice applications, powering production-grade, real-time voice agents and applications with best-in-class latency and reliability. We are seeking a Senior Platform Engineer to take ownership of the API and infrastructure layer for voice workloads. You will develop the real-time WebSocket and HTTP APIs used by developers to deploy voice experiences, design autoscaling for latency-sensitive streaming workloads, and ensure the reliability of our multi-provider voice platform for production voice agents handling millions of calls. This is a critical, foundational role on a small, high-impact team, defining how developers interact with our voice platform as we scale.

$200k - $260k

Together AI

Together AI is building the Inference Platform to bring advanced generative AI models to the world, powering multi-tenant serverless workloads and dedicated endpoints. This role offers a unique opportunity to optimize latency and fully utilize tens of thousands of GPUs, working hands-on with cutting-edge hardware. You will collaborate directly with research teams to productionize frontier models and engage with the open-source community, contributing to projects that push the boundaries of inference performance and efficiency.

$160k - $250k

Together AI

You will join the Data Platform team, responsible for building the backend services and data products that power how data moves through the company. This involves creating core platform primitives like high-quality event streams, reliable access layers, and developer-friendly APIs and tools. The goal is to enable teams across the organization to self-serve their data needs and ship faster. You will contribute to backend services that derive value from company data and enhance the self-serve capabilities of the data platform, allowing product and engineering teams to easily create and operate event-driven architectures, publish/consume streams, define access models, and manage data products end-to-end. Additionally, you will work on LLM-adjacent services, including prompt categorization, enrichment, and metadata systems, transforming raw telemetry into trusted, usable products with guidance from experienced engineers.

$120k - $170k

Together AI

Together AI is seeking an ML Engineer to develop systems and APIs for customer inference and fine-tuning of LLMs. The ideal candidate will have experience implementing runtime systems for large-scale AI/ML model inference, including the largest LLMs. This role involves designing and building production systems for reliability and performance at scale, partnering with cross-functional teams, and improving system efficiency and stability.

$160k - $220k

Together AI

Together AI is a research-driven artificial intelligence company focused on lowering the cost of modern AI systems. This role is part of a team dedicated to enabling custom models and dedicated inference on Together's platform. The team is responsible for building a container platform, optimizing autoscaling, minimizing cold starts, achieving the best end-to-end model performance, and providing a best-in-class developer experience with great tooling. The work often involves video or audio generation across the stack, including CUDA kernels, PyTorch optimization, inference engines, container orchestration, and queueing theory.

$160k - $250k

Together AI

Together AI is seeking a Machine Learning Engineer to join our Inference Engine team, focusing on optimizing and enhancing the performance of our AI inference systems. This role involves working with state-of-the-art large language models and ensuring they run efficiently and effectively at scale. You will collaborate closely with AI researchers and engineers to create cutting-edge AI solutions and shape the future of AI inference.

$160k - $230k