← All roles

Research Engineer - Data and Evaluation

Prime Intellect· Research
Apply on company site
San Francisco, Remote$150k - $350kFull-timePosted 5d ago

About the role

Build tasks, environments, and evaluation methods to train Prime Intellect’s models through RL, collaborating with researchers to analyze failures and improve model performance.

Responsibilities

  • Design and build challenging evaluations for coding and long-horizon agents.
  • Build executable environments in Verifiers, with realistic task setup and clear success criteria.
  • Develop and test scoring logic and verifiers, investigating reward hacks and misleading measures of progress.
  • Trace failures through model outputs and harness code to distinguish model limitations from problems in the environment or scoring.
  • Build and scale RL data pipelines that generate and curate challenging coding and agentic tasks.
  • Work with RL researchers to test whether changes to tasks and training data improve performance on held-out tasks.

Qualifications

  • Strong software engineering skills in Python and experience building data pipelines, evaluation systems, or ML workflows used by others.
  • Hands-on experience working with language models or agents, with an understanding of how training data and evaluation choices affect model behavior.
  • Ability to inspect complex data and model outputs, identify failure modes, and turn an ambiguous quality question into a testable measurement.
  • A record of owning technical projects through experimentation, implementation, and validation, while collaborating closely with researchers and engineers.
  • Hands-on experience building technical evaluations or agent environments, with the engineering depth to inspect model traces and debug harness and scoring code.

Skills

Required:PythonLanguage models / agentsEvaluation designData pipelines

Benefits

  • Cash Compensation Range of $150-350k, including equity incentives, aligning your success with the growth and impact of Prime Intellect.
  • Flexible work arrangements, with the option to work remotely or in-person at our offices in San Francisco.
  • Visa sponsorship and relocation assistance for international candidates.
  • Quarterly team off-sites, hackathons, conferences and learning opportunities.
  • Opportunity to work with a talented, hard-working and mission-driven team, united by a shared passion for leveraging technology to accelerate science and AI.
Last updated Oct 21, 2026. Interested? Apply on the company site.

About Prime Intellect

Commoditizing Compute & Intelligence

Prime Intellect democratizes AI development at scale. Our platform makes it easy to find global compute resources and train state-of-the-art models through distributed training across clusters. Collectively own the resulting open AI innovations, from language models to scientific breakthroughs.

AI developmentbessemer-ai-infrastructure-2026compute resourcesdistributed trainingmodelsreinforcement-learning-platformsscience
Company profileWebsite

More open roles at Prime Intellect