Entry-Level AI Infrastructure Engineer Jobs

CoreWeave

CoreWeave is seeking a Junior Software Engineer to join their Inference team. In this role, you will be responsible for the end-to-end ownership of a production service, including feature development, maintenance of dashboards and alarms, and operational improvements. You will collaborate with cross-functional teams to enhance key service level indicators and contribute to the development of a cutting-edge inference platform that powers generative AI and real-time applications at scale.

$120k - $160k

NVIDIA is seeking New College Graduates to join our GPU compute architecture and performance engineering team. This role focuses on pre-silicon modeling, data-supported architecture exploration, and GPU microarchitecture improvement for generative AI workloads, including LLM inference and agentic AI. You will contribute to improving the efficiency and scalability of these models on NVIDIA platforms, gaining hands-on experience with performance modeling, bottleneck analysis, and system-level analysis. This is an opportunity to shape the performance of next-generation AI models in data center and edge environments by developing system-level modeling and correlation solutions.

$124k - $242k

SambaNova

As a new grad Cloud Platform Engineer, you will write automation and infrastructure code to ensure the SambaNova inference service remains fast and available. This role involves building monitoring and dashboards, managing Kubernetes clusters and Terraform modules, and assisting with the setup of new regions. Upon ramp-up, you will join a shared on-call rotation to support production operations.

$131k - $197k

NVIDIA is seeking an AI Compiler Formal Verification Intern to research and implement innovative formal methods for verifying state-of-the-art AI compilers. This role offers the chance to explore and utilize AI, formal verification, and other semantic verification or static analysis techniques to develop solutions for verifying AI compilers for human and agentic-use cases. This is an opportunity to contribute to the next era of computing driven by AI.

Salary not listed

We are expanding our research and development for deep learning and are seeking excellent Software Engineers to join our team. We specialize in developing GPU-accelerated deep learning software, enabling breakthroughs in numerous areas. Join the team that builds software to enable new solutions. Your ability to work in a fast-paced, customer-oriented team is required, and excellent communication skills are necessary.

Salary not listed

NVIDIA is seeking AI development interns to join our AI Infra team. This team focuses on enabling NVIDIA and its customers to scale deep learning workflows more efficiently. The work involves building infrastructure for data storage, processing, retrieval, and mining, as well as developing tools for workflow orchestration, issue triage, and model KPI evaluation and testing. The team also handles AI data at a massive scale for applications like autonomous driving.

Salary not listed

NVIDIA is seeking passionate Compute/DL Architecture Performance Optimization Interns to explore computer architectures for deep learning and work at the intersection of hardware and software. The role involves mining the ultimate performance of deep learning operators and designing scalable infrastructure to ship highly optimized operators to NVIDIA's software libraries for training and inference.

Salary not listed

Join NVIDIA’s Cosmos Lab Infrastructure team to develop training and post-training systems for advanced Physical AI models, including world foundation models and robot policies. Our infrastructure connects training, inference, and evaluation with simulation and real-world robot interaction. You will work with a mentor on a focused project scoped to your experience and internship duration, implementing and evaluating systems improvements on real AI workloads using NVIDIA’s GPU infrastructure.

Salary not listed

Fireworks is seeking PhD graduates in Computer Science, Computer Engineering, or Electrical Engineering to join their Systems Infrastructure team. This role is for individuals who want to apply their research ideas to real-world, large-scale AI infrastructure. You will be responsible for designing and building the core systems that power Fireworks' AI platform, including schedulers, storage systems, and networks, ensuring efficient utilization of hardware and low inference latency. You will work on challenging problems related to compute placement, efficient data movement, and high-performance networking for AI workloads, with the opportunity to see your work ship in a production environment.

$200k - $230k