Machine Learning Engineer, Frontier Data Products
Mercor· Engineering
San Francisco, New York City$180k - $500k + equityFull-timePosted 6mo ago
About the role
Frontier AI product-focused ML engineer role building systems that score, validate, and improve complex, noisy work products; end-to-end production ML behavior ownership with emphasis on evaluation design, feedback loops, and human-in-the-loop workflows.
Responsibilities
- Build ML systems that score, validate, and improve complex work products where correctness is nuanced and labels are imperfect.
- Design evaluation frameworks for ambiguous tasks where ground truth is partial, delayed, or disputed.
- Build feedback loops that turn review, disagreement, correction, and adjudication into measurable model and system improvements.
- Own production ML behavior end-to-end: precision/recall tradeoffs, regression detection, drift, latency, cost, and explainability.
- Improve model quality using the right tool for the job — prompting, fine-tuning, retrieval, active learning, heuristics, and error analysis.
- Partner with backend engineers to integrate inference into durable, long-running workflows without sacrificing debuggability or human oversight.
Qualifications
- Track record of shipping ML systems that improved a real product, workflow, or business metric.
- Strong instincts for model quality, evaluation design, error analysis, and production failure modes.
- Comfort operating in ambiguous problem spaces where labels are imperfect and correctness evolves.
- Sound judgment about when to reach for prompting, fine-tuning, heuristics, retrieval, human review, or a simpler product constraint.
- Solid engineering fundamentals across the full ML stack — not just modeling.
- Familiarity with LLM applications, model-assisted workflows, evaluation frameworks, or human-in-the-loop ML is a strong plus.
Skills
Required:ML system designEvaluation framework designProduction ML engineeringModel improvement techniques
Benefits
- Bi-annual performance bonus structure.
- Generous equity grant vested over 4 years.
- Up to $15k Relocation bonus.
- $10K housing bonus (if you live within 0.5 miles of our office).
- $1.5K monthly stipend for meals.
- Free Equinox membership.
- $200 monthly laundry reimbursement.
- $200 monthly personal wellness reimbursement.
- Health, Dental, Vision insurance.
Last updated Oct 21, 2026. Interested? Apply on the company site.
About Mercor
Shape the future of work
Find top-tier, remote, AI roles for your expertise. Available only on Mercor.
AIremotejobstechnology
More open roles at Mercor
- Mercor AI Research Fund Grants: Economics of AI4d agoSan Francisco, Mexico | Mexico City +2 more · Research
- Pricing and Monetization Manager4d agoSan Francisco · Engineering
- People Programs Specialist1w agoMercor HQ, 181 Fremont Street · People Team
- Senior PMM, Evals1w agoMercor HQ, 181 Fremont Street · Marketing
- Marketing Manager1w agoMercor HQ, 181 Fremont Street · Marketing