← All roles

Software Engineer, Inference AI/ML

CoreWeave· Technology
Apply on company site
Hybrid (Sunnyvale, CA), Hybrid (Bellevue, WA)$92k - $135k + equity + bonusfull-timePosted 7mo ago

About the role

Software Engineer on the Inference team focused on production features to improve latency, reliability, and cost for model serving on CoreWeave's GPU platform. IC1 role with mentorship and rapid development.

Responsibilities

  • Implement well-scoped features and fixes in Python/Go/C++ for model-serving services (e.g., Triton, vLLM, TensorRT-LLM, Ray Serve).
  • Write tests, code comments, and short design docs; participate in code reviews.
  • Add basic metrics and dashboards; assist with alarms and runbooks.
  • Follow on-call runbooks and learn incident response in a guided rotation.
  • Contribute to performance experiments (e.g., request batching, concurrency, caching) with guidance.

Qualifications

  • BS/MS in CS, EE, or related field, or equivalent practical experience.
  • Foundations in data structures, algorithms, and networked services.
  • Experience with Python or Go (C++ a plus) and Linux fundamentals; Git/CI basics.
  • Exposure to containers and Kubernetes (coursework or projects welcome).
  • Curiosity about GPU inference concepts (micro-batching, KV cache, streaming).

Skills

Required:PythonGoLinux
Nice to have:C++Containers & KubernetesGPU inference concepts (micro-batching, KV cache, streaming)

Benefits

  • Medical, dental, and vision insurance - 100% paid for by CoreWeave
  • Company-paid Life Insurance
  • Voluntary supplemental life insurance
  • Short and long-term disability insurance
  • Flexible Spending Account
  • Health Savings Account
  • Tuition Reimbursement
  • Employee Stock Purchase Program (ESPP)
  • Mental Wellness Benefits through Spring Health
  • Family-Forming support provided by Carrot
  • Paid Parental Leave
  • Flexible, full-service childcare support with Kinside
  • 401(k) with a generous employer match
  • Flexible PTO
  • Catered lunch each day in our office and data center locations
  • Casual work environment
  • Work culture focused on innovative disruption
Last updated Aug 12, 2026. Interested? Apply on the company site.

About CoreWeave

The Essential Cloud for AI

CoreWeave is the force multiplier that empowers pioneers with momentum, magnitude, and mastery—enabling them to innovate with confidence. Explore the #1 AI Cloud.

AI CloudCluster ManagementGPU computeManaged ServicesNetworkingPlatformStorageliquid-ai-recruiting-target
Company profileWebsite

More open roles at CoreWeave