Senior Software Engineer, AI Frameworks
$152k - $288k • Remote • US, CA, Santa Clara
Posted 1d ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Infrastructure Engineer
About the job
We are seeking a Senior Software Engineer to drive the integration of the NVIDIA Grove project within Dynamo and across a set of leading open-source AI frameworks. In this role, you will develop production-grade software enabling Grove capabilities to be adopted, scaled, and operated smoothly across environments such as Dynamo, llm-d, Ray, PyTorch, and other emerging frameworks in the AI ecosystem. You will collaborate across engineering teams and the open-source community to deliver robust integrations, reference implementations, and developer-focused tooling.
Responsibilities
- Design and implement end-to-end integrations of Grove with open-source AI frameworks.
- Build and maintain adapters, plugins, operators, and runtime components for Grove features.
- Partner with framework owners to upstream changes and ensure long-term maintainability of integrations.
- Develop reference workflows, sample applications, and best-practice guides.
- Optimize performance, scalability, and reliability for distributed training and inference.
- Improve observability and operational readiness for Kubernetes-based deployments.
- Participate in technical design reviews and define APIs/contracts.
- Diagnose complex issues spanning containers, networking, scheduling, GPU utilization, and framework runtime behavior.
Requirements
- BS/MS/PhD in Computer Science, Electrical Engineering, or related field (or equivalent experience).
- 5+ years of proven experience in a related field.
- Hands-on experience integrating with at least one major AI framework/runtime.
- Solid understanding of AI workloads, including model development, training vs. inference tradeoffs, and performance considerations.
- Experience with distributed systems concepts.
- Practical Kubernetes experience, including deployment, operation, and debugging.
- Familiarity with containers and cloud-native tooling (Docker, CI/CD pipelines).
- Strong software engineering experience in Go, C++, and/or Python.
- Strong interpersonal skills and ability to collaborate across teams and with open-source communities.
- Exceptional collaboration, communication, and documentation habits.
Benefits
- Equity
- Benefits