Senior Specialist / Manager, AI Safety Data and Evaluation Program
Hybrid (Cambridge, MA; London, UK; San Francisco, CA)$88k - $144kfull-timePosted 5d ago
About the role
Senior role focused on building and executing an AI safety data and evaluation program to identify, mitigate and govern risks from scientific superintelligence, aligning safety work with researchers and external experts while enabling scientific discovery.
Responsibilities
- Translate scientific briefs into executable plans covering tasks, contributors, instructions, milestones, quality standards and delivery expectations.
- Source and coordinate external experts with scientific colleagues, and organize access to relevant expertise within Lila.
- Manage contributor onboarding, task assignment, training and support so specialists can contribute effectively and consistently.
- Run expert-data collection, annotation, red-teaming and evaluation programs, tracking progress and resolving delivery problems.
- Establish quality controls covering completeness, consistency, provenance and adherence to rubrics; coordinate calibration, review, disagreement resolution and rework with scientific owners.
- Maintain clear records, versioned guidance and usable datasets, and improve workflows based on quality findings and researcher feedback.
- Identify questions that require scientific judgment and bring them to the appropriate specialists, ensuring decisions are reflected in program materials and subsequent work.
Qualifications
- Experience delivering expert-data, research-operations, evaluation or similarly demanding programs involving specialist contributors.
- A substantial working understanding of AI safety, including threat models, capability evaluations, red teaming and safeguards; ability to interpret safety briefs and assess data-quality implications.
- Evidence of applying AI safety understanding in research, evaluation or expert-data work; impact on scoping, execution or review of a program.
- Strong operational judgment and ability to manage dependencies, changing requirements and multiple parallel workstreams.
- Track record of setting measurable quality standards, detecting recurring problems and improving data-producing processes.
- Clear communication, careful documentation and ability to build relationships with researchers, experts and vendors.
- Sufficient technical and scientific fluency to understand research briefs and work with subject-matter experts.
Skills
Required:Expert-data program managementAI safety understandingData quality and governanceOperations and project management
Benefits
- Full benefits for U.S. employees including medical, dental, vision; employer-paid life and disability; flexible time off with holidays; paid parental leave; educational assistance; commuter benefits and office lunch program.
- International benefits tailored to region; USD salary ranges apply to U.S.-based positions; international salaries set to local market.
Last updated Oct 21, 2026. Interested? Apply on the company site.
About Lila Sciences
Pioneering Scientific Superintelligence
Pioneering Scientific Superintelligence to solve humankind’s greatest challenges.
Scientific SuperintelligenceAIAutonomous LabsLife SciencesChemical SciencesMaterials Sciences
More open roles at Lila Sciences
- Staff IT Systems Engineer, Endpoints5d agoCambridge, MA · Business Operations
- Principal Network Engineer5d agoCambridge, MA · Business Operations
- Contractor, P2P Specialist5d agoCambridge, MA · Corporate Development
- Staff / Principal Research Engineer, AI Safety Mitigations5d agoHybrid (Cambridge, MA; London, UK; San Francisco, CA) · AI
- Specialist / Senior Procurement Specialist5d agoCambridge, MA · Corporate Development