← All roles

Staff Product Manager, AI Inference

CoreWeave· Technology
Apply on company site
Hybrid (Bellevue, WA; Sunnyvale, CA)$207k - $275k + equity + bonusFull-timePosted 1w ago

About the role

Lead CoreWeave's strategic efforts in shaping and developing AI inference services to enable customers to build, deploy, scale, and optimize AI models and applications on the CoreWeave platform.

Responsibilities

  • Product Vision and Strategy: Refine the product strategy for AI application cloud services focused on foundational model inference and optimize across the CoreWeave portfolio for AI workloads.
  • Roadmap Development: Own the product roadmap for AI inference services, balancing near-term customer needs with long-term vision.
  • AI and Cloud Expertise: Stay current on AI/ML advancements, including inference engines and cloud infrastructures, to inform product decisions.
  • Define product portfolio: Define investments and develop a portfolio of inference capabilities with long-term differentiation and value.
  • Customer Engagement: Collaborate with key customers to understand AI workloads and requirements to improve offerings.
  • Cross-functional Leadership: Work with engineering, sales, marketing, and customer success for seamless product development and deployment.
  • Market Analysis: Analyze market trends, feedback, and competition to identify growth opportunities.
  • Go-to-Market Strategy: Partner with marketing and sales to develop pricing, positioning, messaging, and differentiation for AI cloud services.

Qualifications

  • 8+ years in product management, with at least 5 years in cloud services or AI/ML market segment.
  • Hands-on practitioner with deep understanding of AI/ML workloads including foundation model inference and related tooling (e.g., vllm, SGLang, TensorRT-llm, llm-d).
  • Experience with inference optimization techniques (quantization, speculative decoding) and cloud infrastructure (GPUs) as well as cloud-native architectures (Kubernetes, microservices).
  • Proven cross-functional leadership and mentoring abilities.
  • Customer-centric approach with experience translating needs into features and solutions.
  • Excellent verbal and written communication skills with ability to influence stakeholders.
  • Bachelor's or Master's in Computer Science, Engineering, or a related technical field; MBA or equivalent is a plus.

Skills

Required:AI/ML workload expertiseInference optimizationCloud infrastructureProduct leadershipCommunication

Benefits

  • Medical, dental, and vision insurance - 100% paid by CoreWeave
  • Company-paid Life Insurance
  • Voluntary supplemental life insurance
  • Short and long-term disability insurance
  • Flexible Spending Account
  • Health Savings Account
  • Tuition Reimbursement
  • ESPP (Employee Stock Purchase Program) participation
  • Mental Wellness benefits
  • Family-Forming support (Carrot)
  • Paid Parental Leave
  • Childcare support (Kinside)
  • 401(k) with company match
  • Flexible PTO
  • Catered lunch in office/data center locations
  • Casual work environment
  • Culture focused on innovative disruption
Last updated Oct 14, 2026. Interested? Apply on the company site.

About CoreWeave

The Essential Cloud for AI

CoreWeave is the force multiplier that empowers pioneers with momentum, magnitude, and mastery—enabling them to innovate with confidence. Explore the #1 AI Cloud.

AI CloudCluster ManagementGPU computeManaged ServicesNetworkingPlatformStorageliquid-ai-recruiting-target
Company profileWebsite

More open roles at CoreWeave