← All roles

Principal Engineer - Perf and Benchmarking

CoreWeave· Technology
Apply on company site
Hybrid (Sunnyvale, CA / Bellevue, WA)$206k - $333kFull-timePosted 7mo ago

About the role

Technical lead for CoreWeave’s Benchmarking & Performance team, responsible for ingesting, storing, transforming, and analyzing planet-scale performance data across global data centers; lead industry benchmarking publications and collaborations with NVIDIA and OSS communities to demonstrate performance leadership.

Responsibilities

  • Strategy & Leadership - Define multi-year benchmarking strategy and roadmap; prioritize models/workloads (LLMs, diffusion, vision, speech) and hardware tiers; build, lead, and mentor a team; establish governance for claims with documented methodologies, versioning, reproducibility, and audit trails.
  • Perf Ownership - Lead end-to-end MLPerf Inference and Training submissions: workload selection, cluster planning, runbooks, audits, result publication; coordinate optimization tracks with NVIDIA to hit competitive results; drive upstream fixes where needed.
  • Internal Latency & Throughput Benchmarks - Design a Kubernetes-native benchmarking service; measure and report latency metrics (p50/p95/p99), jitter, tokens/s, time-to-first-token, cold-start/warm-start, cost-per-token; cover various precisions, batch sizes, and GPU types; maintain representative scenarios and automate comparisons across releases and hardware generations.
  • Tooling & Automation - Build CI/CD pipelines and Kubernetes controllers/operators to schedule benchmarks at scale; integrate with observability stacks and results warehouses; ensure supply-chain integrity for benchmark artifacts (SBOMs, Cosign signatures).
  • Cross-functional & Community - Partner with NVIDIA, ISVs, OSS projects (vLLM, Triton, KServe, PyTorch/DeepSpeed, ONNX Runtime); support Sales/SEs with data for RFPs; brief analysts and press with rigorous data.

Qualifications

  • 10+ years building distributed systems or HPC/cloud services with deep expertise in large-scale ML training or similar high-performance workloads.
  • Proven track record architecting/building planet-scale data systems (telemetry platforms, observability stacks, cloud data warehouses, large-scale OLAP engines).
  • Deep understanding of GPU performance (CUDA, NCCL, RDMA, NVLink/PCIe, memory bandwidth), model-server stacks (Triton, vLLM, TensorRT-LLM, TorchServe), and distributed training frameworks (PyTorch FSDP/DeepSpeed/Megatron-LM).
  • Proficient with Kubernetes and ML control planes; familiarity with SUNK, Kueue, and Kubeflow in production environments.
  • Excellent communicator able to interface with executives, customers, auditors, and OSS communities.

Skills

Required:Distributed systems designGPU performance optimizationKubernetes & ML control planes
Nice to have:MLPerf submissions

Benefits

  • Medical, dental, and vision insurance - 100% paid for by CoreWeave
  • Company-paid Life Insurance
  • Voluntary supplemental life insurance
  • Short and long-term disability insurance
  • Flexible Spending Account
  • Health Savings Account
  • Tuition Reimbursement
  • Ability to Participate in Employee Stock Purchase Program (ESPP)
  • Mental Wellness Benefits through Spring Health
  • Family-Forming support provided by Carrot
  • Paid Parental Leave
  • Flexible, full-service childcare support with Kinside
  • 401(k) with a generous employer match
  • Flexible PTO
  • Catered lunch each day in our office and data center locations
  • A casual work environment
  • A work culture focused on innovative disruption
Last updated Aug 12, 2026. Interested? Apply on the company site.

About CoreWeave

The Essential Cloud for AI

CoreWeave is the force multiplier that empowers pioneers with momentum, magnitude, and mastery—enabling them to innovate with confidence. Explore the #1 AI Cloud.

AI CloudCluster ManagementGPU computeManaged ServicesNetworkingPlatformStorageliquid-ai-recruiting-target
Company profileWebsite

More open roles at CoreWeave