← All roles

Senior Software Engineer I, Inference

CoreWeave· Technology
Apply on company site
Sunnyvale, CA, Bellevue, WA$139k - $204kFull-timePosted 7mo ago

About the role

Senior engineer leading designs and reliability improvements for CoreWeave's Kubernetes-native inference platform, collaborating with product, orchestration, and hardware teams to meet strict P99 SLAs at scale.

Responsibilities

  • Lead design reviews and drive architecture within the team; decompose multi-service work into clear milestones.
  • Define and own SLIs/SLOs; ensure post-incident actions land and reliability improves release-over-release.
  • Implement advanced optimizations (e.g., micro-batch schedulers, speculative decoding, KV-cache reuse) and quantify impact.
  • Strengthen incident posture: capacity planning, autoscaling policy, graceful degradation, rollback/traffic-shift strategies.
  • Mentor IC1/IC2 engineers; review cross-team designs and elevate coding/testing standards.
  • For IC4: own an area spanning multiple services and teams (e.g., request routing & adaptive scheduling, cost-per-token analytics, GPU resource isolation).

Qualifications

  • IC3: ~3–5 years; IC4: ~5–8 years industry experience building distributed systems or cloud services.
  • Computer Science or equivalent education.
  • Strong coding in Python or Go (C++ a plus) and deep familiarity with networked systems and performance.
  • Hands-on experience with Kubernetes at production scale, CI/CD, and observability stacks (Prometheus, Grafana, OpenTelemetry).
  • Practical knowledge of inference internals: batching, caching, mixed precision (BF16/FP8), streaming token delivery.
  • Proven track record improving tail latency (P95/P99) and service reliability through metrics-driven work.
  • Bachelor’s or Master’s in CS, EE, or related field (or equivalent practical experience).

Skills

Required:PythonGoKubernetesCI/CDObservability
Nice to have:C++

Benefits

  • Medical, dental, and vision insurance - 100% paid for by CoreWeave
  • Company-paid Life Insurance
  • Voluntary supplemental life insurance
  • Short and long-term disability insurance
  • Flexible Spending Account
  • Health Savings Account
  • Tuition Reimbursement
  • Opportunity to participate in Employee Stock Purchase Program (ESPP)
  • Mental Wellness Benefits through Spring Health
  • Family-Forming support provided by Carrot
  • Paid Parental Leave
  • Flexible, full-service childcare support with Kinside
  • 401(k) with employer match
  • Flexible PTO
  • Catered lunch daily in offices and data center locations
  • Casual work environment
  • Culture focused on innovative disruption
Last updated Aug 12, 2026. Interested? Apply on the company site.

About CoreWeave

The Essential Cloud for AI

CoreWeave is the force multiplier that empowers pioneers with momentum, magnitude, and mastery—enabling them to innovate with confidence. Explore the #1 AI Cloud.

AI CloudCluster ManagementGPU computeManaged ServicesNetworkingPlatformStorageliquid-ai-recruiting-target
Company profileWebsite

More open roles at CoreWeave