← All roles

Research Engineer, QC Automation

HUD· Engineering & Research
Apply on company site
San Francisco, Singapore, Remote (Asia), Remote (North America)$100k - $230kFull-timePosted 3mo ago

About the role

Research Engineer focused on automating QC for training data, building scalable quality assurance systems to support HUD’s data infrastructure and data vendor integrations.

Responsibilities

  • Create QC systems based on true understanding and human judgement, without relying heavily on LLMs
  • Define and enforce quality standards for training data
  • Design experiments and metrics to grade agent outputs
  • Partner with data vendors to debug quality issues and diagnose agent failure modes, provide actionable feedback, and improve their data generation processes
  • Translate QC learnings into systems for auditing supplier-generated datasets, including sampling strategies, validation pipelines (rule-based and model-assisted), and feedback loops
  • Continuously integrate QC learnings into infrastructure tools and data vendor portal to reduce anomalies, inconsistencies, and edge cases

Qualifications

  • Proficiency in Python, Docker, and Linux environments
  • Strong understanding of what “good data” means and how to measure it
  • Genuine curiosity of different domains and ability to ask clarifying questions
  • Built scalable data validation pipelines and automated QA/QC systems end-to-end without a fully prescribed roadmap
  • Experience working on benchmarks and evals – ability to reason about task realism, rubric reliability, environment usability, and RL training trajectory
  • Early-stage startup experience with ability to work independently in fast-paced environments

Skills

Required:PythonDockerLinuxQuality assurance / QA automationExperiment design and metrics

Benefits

  • Competitive compensation
  • 100% covered medical, dental, and vision (US and Singapore)
  • Lunch and dinner for in-office employees
  • Company-wide holiday break (Christmas Eve to New Year’s Day) on top of PTO and holidays
  • 401k with a 4% match
  • Equinox membership and commuter benefits (US) and health/wellness stipend (Singapore)
  • Unlimited access to tokens for ChatGPT, Claude Code, Cursor, etc.
  • Two top-floor offices in San Francisco and Singapore
  • Annual travel budget to visit either office
Last updated Oct 25, 2026. Interested? Apply on the company site.

About HUD

The platform for building RL environments

The platform for building RL environments. Train specialized agents, evaluate models, and deliver frontier‑grade post‑training data to labs.

AI benchmarkingEnvironment SDKGRPO trainingHUD Vendor PlatformMCP environmentsRL environmentsTraining + Eval Platformagent training
Company profileWebsite

More open roles at HUD