← All roles

RL Environments Architect

Surge AI· Field Engineering & Operations
Apply on company site
RemoteFull-timePosted 10mo ago

About the role

Design, instrument, and govern simulated worlds for reinforcement learning agents, from small task environments to multi-agent ecosystems. Define primitives, reward structures, interfaces, and telemetry to ensure faithful, stable, and scalable training signals, while establishing data quality standards and reproducibility across large-scale agent environments.

Responsibilities

  • Architect a modular environment framework with clear APIs, curriculum scaffolds, and configurable reward/termination schemas
  • Establish quality bars: coverage metrics, invariance checks, and trace audits for environment outputs and agent experience buffers
  • Instrument rich telemetry for episode rollouts; mitigate reward hacking, mode collapse, and exploitable loopholes
  • Partner with researchers to translate real-world tasks into robust simulations, including synthetic data generators and evaluation suites

Qualifications

  • Simulation & Systems Depth – Experience building RL environments or simulators with attention to determinism, performance, and observability
  • Data Quality Leadership – Strong instincts for designing reward functions, scenario taxonomies, and QA pipelines that keep signals aligned and drift-free
  • Builder’s Mindset – Comfort collaborating across research and engineering to ship pragmatic, testable environments that evolve with model capabilities

Skills

Required:RL environment design and implementationData quality and QA for RL signals
Last updated Sep 30, 2026. Interested? Apply on the company site.

About Surge AI

Human Intelligence for AGI

Our mission is to raise AGI with the richness of human intelligence — curious, witty, imaginative, and full of unexpected brilliance.

AGIArtificial Intelligenceliquid-ai-recruiting-target
Company profileWebsite

More open roles at Surge AI