← All roles

Member of Technical Staff, North Modelling (Evals)

Cohere· Modeling
Apply on company site
Hybrid (London), Hybrid (Europe), Hybrid (Toronto)CA$295k - CA$535kFull-timePosted 2mo ago

About the role

North is Cohere’s AI workspace platform for enterprises. This role focuses on building evaluation systems and applied modelling workflows to ensure model progress translates into better product outcomes for North users, working with North product teams, customer-facing teams, and modelling teams to define what “good” means and guide model updates.

Responsibilities

  • Own the eval strategy for North: define what we need to measure across agent workflows, tool use, enterprise knowledge work such as deep research, document creation or editing, and other human-AI interactions.

Qualifications

  • You have improved LLM-powered, agent-powered, or AI-product systems through evals, feedback loops, data curation, prompting, model adaptation, or model selection.
  • You care deeply about evaluation as a craft: representative tasks, precise rubrics, clean data, failure analysis, regression tracking, and knowing when a metric is giving false confidence.
  • You have strong applied MLE judgment and can reason clearly about model behavior, eval validity, product outcomes, and production tradeoffs.
  • You are comfortable working close to users and product teams, while translating messy qualitative signals into measurement that other modelling teams can act on.
  • You are self-directed, practical, and motivated by open-ended problems where the right answer requires both technical depth and product understanding.
  • You care about making AI systems genuinely useful in real enterprise settings, not just better on abstract benchmarks.

Skills

Required:Eval strategy design for enterprise AI productsExperience with evals in LLM/agent-powered systems

Benefits

  • A weekly lunch stipend of $75/£75 or equivalent in local currency for lunch.
  • Full health and dental benefits, including a separate budget for mental health.
  • RRSP matching, 401K, Pension Scheme.
  • 100% Parental Leave top-up for up to 6 months, for either parent.
  • Annual enrichment benefits: arts & culture, fitness/wellness, quality time, workspace improvement credit; education & learning stipend for conferences, courses, and coaching.
  • 6 weeks of paid vacation (30 working days)
  • Budget for traveling to other offices if remote, plus an annual company offsite.
  • Remote-friendly with offices in multiple cities and a $500 home office stipend.
Last updated Oct 21, 2026. Interested? Apply on the company site.
Cohere logo

About Cohere

Support automation that's actually intelligent

Cohere resolves 40-70% of support requests using AI, over all channels, within just a few days.

artificial-intelligenceautomationliquid-ai-recruiting-target
Company profileWebsite

More open roles at Cohere