← All roles

Human Data Architect

Surge AI· Field Engineering & Operations
Apply on company site
RemoteFull-timePosted 6mo ago

About the role

Design and govern systems for collecting, structuring, and delivering human data to train frontier AI models, with a focus on task design, evaluation methodology, and scalable data pipelines for SFT, RLHF, and model evaluation.

Responsibilities

  • Architect end-to-end data workflows — from task design through quality assurance and delivery — ensuring data is well-structured for post-training purposes (e.g., SFT, RL, model evaluation).
  • Design collection structures and task frameworks that translate client needs into scalable data generation processes.
  • Build and monitor data quality frameworks to catch problems before they reach the client.
  • Partner with engineering and product teams to improve data pipelines, enhancing throughput without sacrificing quality.
  • Translate patterns in data quality and project structure into actionable insights for project design, client deliverables, and product development.

Qualifications

  • Experience designing human data collection at scale (e.g., computational cognitive science, HCI, crowdsourcing research)
  • Familiarity with ML post-training paradigms (SFT, RL) and how data quality decisions map to model outcomes
  • Strong technical skills across data pipelines
  • Systems-level thinking about how task design affects training data
  • Excellent communication skills to explain measurement concepts to engineers and constraints to researchers

Skills

Required:End-to-end data workflow designTask design for scalable data generationData quality framework development
Nice to have:Data pipeline collaboration with engineering

Benefits

  • —
Last updated Sep 30, 2026. Interested? Apply on the company site.

About Surge AI

Human Intelligence for AGI

Our mission is to raise AGI with the richness of human intelligence — curious, witty, imaginative, and full of unexpected brilliance.

AGIArtificial Intelligenceliquid-ai-recruiting-target
Company profileWebsite

More open roles at Surge AI