← All roles

Research Engineer, Coding Evaluation & Training Data

Surge AI· Field Engineering & Operations
Apply on company site
RemoteFull-timePosted 7mo ago

About the role

Research Engineer role at Surge focused on building and running systems that teach frontier models how to code, owning end-to-end coding data projects, designing tasks and evaluation schemes, and collaborating with clients and Surge teams to improve coding data products and workflows.

Responsibilities

  • Own end-to-end coding data projects, from initial scoping and pilot design through execution, iteration, and scale-up.
  • Design agentic training workflows and task structures that mirror real-world SWE work (e.g., refactoring, debugging, code review, large-repo navigation, tool use).
  • Define and iterate on rubrics, golden sets, and reward signals that capture true engineering value, not just “does it compile.”
  • Evaluate data and worker output with strong SWE taste, and make calls about what meets the bar for frontier training.
  • Design and run qualification processes for coding workers, including hands-on assessments of their coding ability.
  • Set up or partner on complex technical environments (e.g., containers, repos, test harnesses, sandboxes, code execution infrastructure).
  • Partner with technical staff at clients to translate high-level training goals into concrete projects and technical environments.
  • Collaborate closely with Surge engineering, product, and operations to improve coding data products, internal tools, and execution processes.

Qualifications

  • 3–6+ years of professional software engineering experience building and maintaining real systems.
  • Strong coding ability in at least one mainstream language and comfort working in production codebases.
  • High “taste” for good engineering: attention to correctness, code quality, and real-world engineering practices.
  • Ability to reason about and debug technical environments, including containers, dependencies, and automated test setups.
  • Interest in owning projects end-to-end, including scoping, workflow design, execution, and continuous improvement.
  • Excellent written and verbal communication skills, with the ability to speak credibly with senior client engineers and translate fuzzy goals into actionable plans.
  • Excitement about AI/ML systems and the role of data, evaluation, and reward design in improving agentic coding capabilities.

Skills

Required:Software engineeringProduction codingSystems debugging and environmentsCommunication
Last updated Sep 30, 2026. Interested? Apply on the company site.

About Surge AI

Human Intelligence for AGI

Our mission is to raise AGI with the richness of human intelligence — curious, witty, imaginative, and full of unexpected brilliance.

AGIArtificial Intelligenceliquid-ai-recruiting-target
Company profileWebsite

More open roles at Surge AI