Software Engineer - RL Environments
San Francisco$260k - $290k + bonusFull-timePosted 5mo ago
About the role
SWE role focused on designing simulations, data, and evaluations for frontier models, partnering with research teams to expose failure modes, build data pipelines, and develop metrics for dataset quality and model alignment.
Responsibilities
- Construct simulated worlds and explore data shapes that expose meaningful model failure modes across domains like finance, code, and enterprise workflows
- Build and refine evaluation rubrics and reward signals for RLHF and RLVR training pipelines
- Analyze agent-produced trajectories and run experiments to improve different model capabilities
- Develop quantitative frameworks for measuring dataset quality, diversity, and downstream impact on model alignment and capability
- Create and manage both real world & synthetic data pipelines
- Partner with lab research teams to translate their training objectives into concrete data and evaluation specifications
- Partner with in-house researchers to run post-training experiments and scale training infrastructure
Qualifications
- Ability to design lightweight experiments, move fast, and extract actionable insights from messy results
- Experience with using Docker, or similar containerization tools, to design and monitor systems at scale
- Strong familiarity with common reinforcement learning algorithms and methods, especially with respect to post-training LLMs
Skills
Required:Experiment designContainerizationReinforcement learning
Benefits
- Health Insurance: Medical, Vision, Dental
- 401(k) with Employer Match
- Daily Meals: Daily UberEats Stipend
- Monthly Wellness Stipend
Last updated Sep 30, 2026. Interested? Apply on the company site.
About AfterQuery
AfterQuery is an applied research lab curating data solutions to accelerate foundation model development.
AI researchdata solutionsfoundation model developmenttraining datasupervised fine-tuningreinforcement learningagent environmentscomputer use trajectories
More open roles at AfterQuery
- Research Program Manager1w agoSan Francisco · Research
- Associate2w agoSan Francisco · Revenue
- Product Manager3w agoSan Francisco · Engineering
- Technical Content Writer (Contract)4w agoRemote · Marketing
- Research Scholar1mo agoSan Francisco · Research