Member of Technical Staff - Research Software Engineer - Safety Evaluations Infrastructure
Reflection· Research
New York, NY, San Francisco, CA, LondonFull-timePosted 2mo ago
About the role
Research Software Engineer on the Safety team responsible for designing, building, and owning the infrastructure for sensitive model evaluations (CBRN, child safety, and other dangerous-capability domains) to inform release decisions for open models. Emphasis on secure, isolated, reproducible, and trustworthy systems at the intersection of platform engineering, security, and safety research.
Responsibilities
- Design and build secure, sandboxed infrastructure for running sensitive model evaluations, including CBRN and other dangerous-capability domains.
- Build controlled data pipelines and storage for sensitive evaluation material, applying least-privilege and need-to-know access, RBAC, encryption at rest and in transit, audit logging, and data-minimization safeguards.
- Partner with safety researchers and domain experts to translate evaluation designs into reliable, reproducible, and scalable systems.
- Build eval-orchestration tooling and harnesses that let researchers run high-throughput evaluations against models and agents in isolated environments.
- Develop infrastructure for measuring AI capability uplift in high-consequence domains, and integrate results into pipelines that inform release decisions.
- Implement guardrails, monitoring, and compartmentalization so sensitive work stays siloed, applying least-privilege, need-to-know, and defense-in-depth across compute, data, and tooling.
- Write production-quality Python (and related tooling) for high-throughput data processing and evaluation systems.
- Improve the reliability, security posture, and developer experience of the safety team's evaluation platform over time.
Qualifications
- Strong software engineering skills, particularly in Python, with a track record of building reliable, scalable infrastructure or platform systems.
- Experience building sandboxed, isolated, or security-sensitive execution environments (e.g., containerization, VM isolation, secure compute) for Trust and Safety teams.
- Solid grounding in security engineering fundamentals: principle of least privilege, need-to-know access, RBAC, secrets management, encryption, audit logging, compartmentalization, and defense-in-depth design.
- Experience building data pipelines and handling sensitive or restricted data with appropriate safeguards.
- Ability to own entire problems end-to-end, including ambiguous, cross-functional ones.
- Comfort working on sensitive projects that require discretion, integrity, and sound judgment.
- Thrive in a fast-paced, high-agency startup environment with a bias toward action.
Skills
Required:PythonSandboxed/secure execution environmentsSecurity fundamentalsData pipelines for sensitive dataCross-functional collaboration
Benefits
- Top-tier compensation: Salary and equity structured to recognize and retain our talent globally.
- Stock options: Everyone who joins and contributes to Reflection's success gets to share in the upside through stock options.
- Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance.
- Meals: Lunch and dinner are provided in the office daily.
- Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys.
- Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K.
- Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable.
- Team building: Regular off-sites, happy hours, and team celebrations.
Last updated Oct 1, 2026. Interested? Apply on the company site.
About Reflection
Building frontier open intelligence
Building frontier open intelligence.
liquid-ai-recruiting-target
More open roles at Reflection
- Human Data Operations Manager4d agoNew York, NY, San Francisco, CA · Research
- Member of Technical Staff - Pre-Training Evals Infra1w agoNew York, NY, San Francisco, CA +1 more · Research
- Senior Talent Operations Specialist1w agoSan Francisco, CA, New York, NY · People
- GRC Engineer1w agoNew York, NY, San Francisco, CA · Legal
- Compliance Manager1w agoNew York, NY, San Francisco, CA · Legal