← All roles

Product Manager, APEX

Mercor· Engineering
Apply on company site
San Francisco$160k - $300kFull-timePosted 2mo ago

About the role

Mercor is hiring a Product Manager to own and scale the APEX brand and public leaderboard, defining the positioning, strategy, roadmap, and operational excellence of Mercor's evaluation products, benchmarks, and leaderboards across Research, Engineering, Operations, and Go-To-Market teams.

Responsibilities

  • Own the roadmap and portfolio strategy: set and influence priorities across new benchmark development, leaderboard launches, infrastructure investment, and expansion into new evaluation categories.
  • Run the intake for new benchmarks: evaluate and prioritize proposals from research, customers, and GTM against real demand and company strategy.
  • Enforce eval integrity: own contamination policy, holdout strategy, versioning, auditability, and release cadence. Publish methodology clearly enough that a skeptical researcher can reconstruct our results.
  • Build end-to-end eval pipeline: own the path from eval run to published result, including harness execution, grading, model onboarding, hyperparameter scaffolds, cost and latency reporting, and the leaderboard surface itself.
  • Work directly with labs and customers: understand evaluation needs, present and defend results, and turn what you hear into the next benchmark. Support GTM on launches, partnerships, and thought leadership to influence customer model development strategies.
  • Close the loop to the business: connect leaderboard demand signals to loss analysis investments and dataset production. Track adoption, usage, and downstream revenue to continuously justify leaderboard ROI.
  • Get in the weeds: write specs and PRDs, but also read trajectories, spot-check failures, and make small PRs to unblock yourself and continuously improve the system.

Qualifications

  • 5+ years in product management, technical program management, or a customer-facing technical role. Prior background in SWE, ML, or DS strongly preferred.
  • Eval literacy: ability to reason about rubric design, inter-rater reliability, contamination and overfitting, and what a small sample can/can't support.
  • Public judgment: experience publishing numbers about other people's models with neutrality and defensibility.
  • Taste for what matters: instincts for which capabilities are worth measuring and what results are worth highlighting.
  • Entrepreneurial: track record of building a product, program, or business line from nothing.
  • High ownership: accountability for outcomes, not just outputs.
  • Independence: ability to self-direct in ambiguous contexts and create clarity for others.
  • Stakeholder alignment: ability to bring research, engineering, operations, and GTM around a shared methodology.

Skills

Required:Roadmap and Portfolio ManagementEvaluation MethodologyStakeholder Alignment

Benefits

  • Bi-annual performance bonus structure
  • Generous equity grant vested over 4 years
  • Up to $15k Relocation bonus
  • $10K housing bonus (if you live within 0.5 miles of our office)
  • $1.5K monthly stipend for meals
  • Free Equinox membership
  • $200 monthly laundry reimbursement
  • $200 monthly personal wellness reimbursement
  • Health, Dental, Vision insurance
Last updated Sep 16, 2026. Interested? Apply on the company site.

About Mercor

Shape the future of work

Find top-tier, remote, AI roles for your expertise. Available only on Mercor.

AIremotejobstechnology
Company profileWebsite

More open roles at Mercor