Senior AI Product Manager
Hybrid (New York, NY; San Francisco, CA)$205.6k - $257kfull-timePosted 2mo ago
About the role
Senior AI Product Manager roles at Scale, focusing on Coding and Leaderboard portfolios within AI evaluation, data products, and frontier model benchmarking. Own end-to-end roadmaps, governance, and cross-functional execution across AI-PM, ML, Engineering, Operations, and GTM to turn evaluation capabilities into scalable products and revenue.
Responsibilities
- Own the roadmap and strategy for your portfolio, setting priorities across product development, launches, infrastructure investments, and expansion.
- Drive alignment across AI-PM, ML, Engineering, Operations, and GTM stakeholders.
- Evaluate, prioritize, and operationalize new product proposals, ensuring alignment with customer demand, model capability frontiers, and company strategy.
- Define and manage the end-to-end product lifecycle from ideation and design to launch, scaling, maintenance, and sunset decisions.
- Partner with ML researchers and domain experts to develop trustworthy evaluation methodologies, task specifications, scoring and grader design, and quality bars.
- Drive the roadmap for infrastructure, automation, and operational tooling to improve scalability, reduce manual effort, and accelerate delivery.
- Establish governance processes for quality, evaluation integrity, contamination prevention, reproducibility, auditability, and release management.
- Work directly with frontier AI labs and enterprise customers to understand where their models fail, gather feedback, and shape future investments.
- Track adoption, usage, model impact, and business outcomes, using data to guide roadmap decisions and resource allocation.
- Identify new capability areas and product opportunities that strengthen Scale's leadership and create new revenue.
- Collaborate closely with GTM on customer engagements, thought leadership, product launches, and strategic partnerships.
Qualifications
- 5+ years of experience in product management, technical program management, consulting, or customer-facing technical roles.
- Strong technical fluency with machine learning systems, AI model evaluation, benchmarking, or data products.
- Experience building and scaling products requiring coordination across engineering, operations, and business teams.
- Excellent stakeholder management and executive communication skills with proven cross-functional alignment.
- Strong analytical skills and ability to translate market and customer signals into clear product strategy.
- Experience working with AI researchers, ML teams, evaluation frameworks, developer tools, or human-in-the-loop data pipelines is strongly preferred.
- Entrepreneurial mindset with track record of creating new products, programs, or business initiatives from the ground up.
- Bias for action and comfort operating in fast-moving, ambiguous environments.
- Passion for advancing trustworthy AI and shaping industry standards for frontier model capabilities.
- Coding role: strong software engineering depth, familiarity with coding model training/evaluation (post-training methods, agentic scaffolds/harnesses, SWE-Bench, Terminal-Bench).
Skills
Required:Product strategy and roadmapCross-functional collaborationETP: end-to-end product lifecycle managementData-driven decision making
Benefits
- comprehensive health, dental and vision coverage
- retirement benefits
- learning and development stipend
- generous PTO
- potential commuter stipend
Last updated Sep 30, 2026. Interested? Apply on the company site.
About Scale AI
Data-centric infrastructure to accelerate the development of AI
Scale accelerates the development of AI within organizations of any size to deliver critical business insights and operational efficiency. Its data-centric infrastructure platform leverages RLHF (Reinforced Learning with Human Feedback) to help organizations build the strongest AI models that supercharge their business, with customers across industries including Meta, Microsoft, U.S. Army, DoD’s Defense Innovation Unit, Open AI, General Motors, Toyota Research Institute, Brex, Instacart and Flexport.
artificial-intelligenceliquid-ai-recruiting-targetmachine-learning
More open roles at Scale AI
- Strategic Contracts Lead, Public Sector5d agoWashington, DC · Public Sector
- Web Designer, Brand Web Experience5d agoSan Francisco, CA · Marketing
- Head of Strategic Partnerships, Global Systems Integrators5d agoSan Francisco, CA · Enterprise Sales
- Safety Research Scholar - Human Frontier Labs5d agoHybrid (United States) · Human Frontier Collective
- Machine Learning Research Intern (Summer 2027)5d agoHybrid (San Francisco, CA), Hybrid (New York, NY) · University