← All roles

Research Scientist, Oversight

Fleet
Apply on company site
San Francisco$200k - $600kFull-timePosted 2mo ago

About the role

Research Scientist role focused on scalable oversight for agents, including detection of misbehavior (e.g., reward hacking and deception), understanding root causes, and maintaining reliable verification as models scale. Role involves owning research threads that may ship as papers, benchmarks, training gyms, or production systems in collaboration with frontier labs.

Responsibilities

  • Scalable oversight: methods that keep verification reliable as tasks get longer and models get stronger.
  • Monitoring: detecting reward hacking or undesirable behavior patterns in agent traces.
  • Failure mode analysis and attribution: tracing agents' mistakes and misbehaviors upstream to root causes in data, environments, or model weights.
  • Turning oversight into training signal: better verifiers, process supervision, and models trained to catch what humans miss.

Qualifications

  • Publication record at top venues (NeurIPS, ICML, ICLR, or equivalent), or equivalent shipped research, in oversight, monitoring, evaluations, alignment, interpretability, AI control, or RL.
  • Strong empirical instincts; comfortable with LLM APIs, harnesses, and large trace datasets.
  • High ownership: you run your own research threads and are measured by what you ship.

Skills

Required:Publication and research disseminationEmpirical researchLLM APIs and trace data analysisOwnership and project leadership
Last updated Oct 15, 2026. Interested? Apply on the company site.

About Fleet

Fleet - AI-powered workflows

Fleet creates simulated worlds and real-world challenges to better understand and shape the behavior of artificial intelligences.

AI-powered workflowsbessemer-ai-infrastructure-2026reinforcement-learning-platforms
Company profileWebsite

More open roles at Fleet