Senior Software Engineer - Perf and Benchmarking
$182k - $242k • Sunnyvale, CA / Bellevue, WA
Posted 5d ago
Job Location
Sunnyvale, CA / Bellevue, WA
Tech Stack
Remote Work Policy
On-site
Categories
Machine Learning Engineer
About the job
CoreWeave is seeking a Senior Engineer for its Benchmarking & Performance team. This role will be instrumental in managing a planet-scale performance data warehouse, handling the ingestion, storage, transformation, and analysis of performance events across global data centers. The engineer will also contribute to industry-leading performance benchmarking publications like MLPerf. The position involves owning designs, elevating engineering standards, and driving measurable improvements in latency, throughput, and reliability across multiple services. Collaboration with product, orchestration, and hardware teams will be key to evolving the Kubernetes-native platform and meeting stringent P99 SLAs at scale.
Responsibilities
- Develop and enhance Kubernetes-native benchmarking services to measure latency, throughput, jitter, and cost-per-request.
- Implement and maintain benchmarking workflows for MLPerf Training and Inference runs, including workload setup, cluster configuration, and result validation.
- Participate in design discussions and contribute to architecture decisions.
- Break down engineering tasks into milestones and deliver high-quality code.
- Collaborate with teammates to maintain reproducible and well-documented benchmarking processes.
- Provide constructive code reviews and share best practices.
- Mentor junior engineers and review cross-team designs.
- Ensure reproducible and well-documented benchmarking processes.
Requirements
- 3-5 years of experience building distributed systems, high-performance computing components, or cloud services.
- Strong programming skills in Python or Go (C++ is a plus).
- Understanding of networked systems and performance fundamentals.
- Hands-on experience with Kubernetes in production environments.
- Familiarity with CI/CD and observability tools (e.g., Prometheus, Grafana, OpenTelemetry).
- Exposure to performance-critical GPU systems (CUDA, NCCL, NVLink/PCIe, memory bandwidth) or model-serving stacks (llm-d, vLLM, TensorRT-LLM, Megatron-LM).
- Effective communication skills and ability to work cross-functionally.
Benefits
- Medical, dental, and vision insurance (100% paid by CoreWeave)
- Company-paid Life Insurance
- Voluntary supplemental life insurance
- Short and long-term disability insurance
- Flexible Spending Account
- Health Savings Account
- Tuition Reimbursement
- Employee Stock Purchase Program (ESPP)
- Mental Wellness Benefits through Spring Health
- Family-Forming support provided by Carrot
- Paid Parental Leave
- Flexible, full-service childcare support with Kinside
- 401(k) with a generous employer match
- Flexible PTO
- Catered lunch
- Discretionary bonus
- Equity awards