Research Engineer (General)
About the role
HUD is building reliable, fair and open infrastructure for AI data. This general application is for candidates to explore roles in QC Automation, Benchmarks, or Synthetic Data, with the option to apply to a specific focus. The role centers on building systems for training/environments, evaluating agents, and improving data quality for frontier AI training.
Responsibilities
- Build systems for creating, running, evaluating, and improving agent training environments
- Design experiments to understand model behavior, agent failure modes, and data quality issues
- Develop tools that help researchers, engineers, and data vendors create higher-quality tasks, trajectories, and feedback loops
- Work across the full lifecycle of agent training data - task design, environment setup, trajectory collection, evaluation, and validation
- Partner with external vendors to identify bottlenecks and improve the quality and throughput of HUD’s data engine
- Build metrics and analyses that help us understand whether our tasks, environments, and evals are actually useful for training frontier agents
Qualifications
- Proficiency in Python, Docker, and Linux environments
- Experience working on benchmarks and evals - you can reason about what makes a task realistic, a rubric reliable, an environment usable, and a trajectory useful for RL training
- Strong attention to detail and the ability to spot subtle inconsistencies in data, model behavior, or task design
- Experience building tools, pipelines, experiments, or infrastructure without a fully prescribed roadmap
- Early-stage startup experience with ability to work independently in fast-paced environments
Skills
Benefits
- Competitive compensation
- 100% covered medical, dental, and vision (US and Singapore)
- Lunch and dinner for in-office employees
- Company-wide holiday break (Christmas Eve to New Year’s Day) on top of PTO and paid holidays
- Equinox membership, 401k, and commuter benefits (US employees) or health/wellness stipend (Singapore employees)
- Unlimited access to tokens for ChatGPT, Claude Code, Cursor, etc.
- Two top-floor offices in San Francisco and Singapore
- Annual travel budget to visit either office

About hud
Platform for building RL environments and evals
HUD (YC W25) is developing agentic evals and RL environments for Computer Use Agents (CUAs) that browse the web for frontier AI labs. Our CUA Evals framework is the first comprehensive evaluation tool for CUAs. People don't actually know if AI agents are working reliably. To make AI agents work in the real world, we need detailed evals for a huge range of tasks. We're backed by Y Combinator, and work closely with frontier AI labs to provide agent evaluation and training infrastructure at scale.
More open roles at hud
- Delivery Engineer4d agoHybrid (San Francisco, CA), Hybrid (Singapore) +2 more · Operations
- Senior Software Engineer, Reinforcement Learning4d agoHybrid (San Francisco, CA), Hybrid (Singapore) · Engineering
- Senior Software Engineer, Design4d agoHybrid (San Francisco), Hybrid (Singapore) +1 more
- Technical Program Manager4d agoHybrid (San Francisco), Hybrid (Singapore) +2 more · Operations
- Technical Writer1w agoHybrid (San Francisco or Singapore)
