← All roles

Lead Research Engineer, Data Quality

HUD· Engineering & Research
Apply on company site
San Francisco, Singapore, Remote (Asia), Remote (North America)$120k - $295kFull-timePosted 2mo ago

About the role

Lead the data quality team at HUD to measure, improve, and scale the quality of training data for frontier agents, building systems that evaluate tasks across RL environments, synthetic data, benchmarks, and domain-specific workflows.

Responsibilities

  • Lead HUD’s data quality strategy including building QC systems, defining and enforcing quality standards, and designing experiments to grade agent outputs
  • Develop new methods for validating synthetic data at scale, such as failure-mode analysis, task mutation checks, and trajectory auditing
  • Partner with research engineers, domain experts, and data vendors to diagnose quality issues and improve data generation workflows
  • Turn qualitative research insights into production systems, internal tools, dashboards, validation pipelines, and feedback loops
  • Help build internal research taste around what makes agent training data actually useful, not just superficially correct
  • Mentor other research engineers to maintain a high bar for technical rigor, clarity, and execution speed

Qualifications

  • Advanced proficiency in Python, Docker, and Linux environments
  • Deep intuition for data quality - you can reason about what makes tasks realistic, learnable, diverse, reliable, and useful for training
  • Experience building QC systems, evals, benchmarks, synthetic data pipelines, validation workflows, or model evaluation infrastructure
  • Comfort working across messy human and technical systems, including domain experts, vendors, generated data, model outputs, graders, and infrastructure
  • Strong written communication and the ability to explain methodology clearly to researchers, engineers, labs, and external audiences

Skills

Required:PythonDockerLinuxData qualityQC systems / evals / benchmarksCommunication
Nice to have:Mentoring

Benefits

  • Competitive compensation
  • 100% covered top-of-the-line medical, dental, and vision (US and Singapore employees)
  • Lunch and dinner for in-office employees
  • Company-wide holiday break (Christmas Eve to New Year’s Day) on top of PTO and paid holidays
  • 401k with a 4% match
  • Other perks including an Equinox membership and commuter benefits (US employees) and a health/wellness stipend (Singapore employees)
  • Unlimited access to tokens for ChatGPT, Claude Code, Cursor, etc.
  • Two top-floor offices in San Francisco’s Union Square and Singapore’s Raffles Place
  • Annual travel budget to visit either office
Last updated Oct 25, 2026. Interested? Apply on the company site.

About HUD

The platform for building RL environments

The platform for building RL environments. Train specialized agents, evaluate models, and deliver frontier‑grade post‑training data to labs.

AI benchmarkingEnvironment SDKGRPO trainingHUD Vendor PlatformMCP environmentsRL environmentsTraining + Eval Platformagent training
Company profileWebsite

More open roles at HUD