← All roles

Software Engineer, Agent Quality

Cursor· SpaceXAI / Cursor team
Apply on company site
Hybrid (SF / remote)Full-timePosted 6mo ago

About the role

Software Engineer on the Agent Quality team at SpaceXAI, building measurement, evaluation, and feedback-loop infrastructure to improve Cursor core agent performance over time. Role spans product, data, and engineering to instrument key metrics, define quality criteria, build scalable pipelines and tooling, and collaborate with research, product, and infrastructure teams to drive improvements across Cursor products.

Responsibilities

  • Designing and building best-in-class AI evaluation system: curated datasets, offline replay, scorers / judges, regression alerts, and dashboards.
  • Designing feedback loops from real usage: collecting, cleaning, and interpreting user signals to inform model and harness changes.
  • Developing analysis tooling and workflows for debugging agent behavior: deep dives on failure modes, clustering themes, and surfacing actionable insights.
  • Improving reliability and guardrails by making quality measurable and operational: defining “good/bad/degraded” sessions, alerting, and triage primitives.

Qualifications

  • Built and operated evaluation or measurement systems (e.g., AI evals, experimentation, ranking/relevance, or search quality) and translated abstract quality concepts into metrics, pipelines, and decisions.
  • Strong data acumen and ability to collaborate with data scientists and researchers.
  • Tastes and opinions on model and agent behaviors, with up-to-date knowledge of emerging research and industry trends.
  • Strong software engineering fundamentals and experience shipping production systems.

Skills

Required:AI evaluation systemsData analysisSoftware engineering
Last updated Oct 15, 2026. Interested? Apply on the company site.
Cursor logo

About Cursor

The best way to code with AI

Built to make you extraordinarily productive, Cursor is the best way to build software with AI.

AIai-infrastructure-and-developmentai-plg-top-20brex-fastest-growing-2025code completionliquid-ai-recruiting-targetmultimodal agentsproductivity
Company profileWebsite

More open roles at Cursor