Member of Technical Staff, Coding Agents
San Francisco, CA, Remote (USA), New York, NY, Mountain View, CA$200k - $350kFull-timePosted 1w ago
About the role
Role to help define benchmarking and evaluation for frontier coding agents, with high ownership and influence on technical direction, open-source software, benchmarks, and research products.
Responsibilities
- Create/publish Coding benchmarks that challenge state-of-the-art frontier agents.
- Understand/shape the frontier of coding agents and where the space is headed, publishing studies of interesting/impactful findings.
- Help the world’s top AI Labs improve their models for coding.
- Publicly contribute to the field through benchmarks, open-source tools, research, and technical writing.
Qualifications
- You’re extremely passionate about building software with agents, and regularly tinkering with the latest coding agents.
- Comfort operating in an ambiguous, fast-moving environment with substantial ownership.
- At least one of the following: - Previous experience working on a Coding benchmark. - Published research on AI for Software / Code-Generation at NeurIPS, ICLR, ICML, COLM, etc. - Extensive software engineering experience or strong GitHub profile of OSS contributions, along with deep knowledge of agent harnesses.
Skills
Required:Benchmark developmentAgent evaluation methodologies
Nice to have:Open-source contribution
Benefits
- Ownership: Equity in a fast-growing company
- Financial Wellness: 401(k) match, competitive compensation, financial coaching
- Family Support: Paid parental leave, fertility benefits, parental coaching
- Wellbeing: Medical, dental, and vision, mental health support, $500 wellness stipend
- Growth: $2,000 learning stipend, ongoing development
- Office: Commuting support, free lunch, and gym in our SF office
- Time Off: Flexible PTO, 15 holidays + 2 flex days
- Connection: Team outings & referral bonuses
Last updated Oct 15, 2026. Interested? Apply on the company site.
About Handshake
Careers start here
The better career platform for Gen Z changing how, where, and why the next generation of talent builds their career.
educationcareer platformtalent acquisitionstudent engagement
More open roles at Handshake
- Privacy Associate5d agoSan Francisco, CA · General & Administrative
- Seattle Site Lead5d agoSeattle, WA · HAI Delivery Ops
- Senior Recruiter5d agoSan Francisco, CA · General & Administrative
- Director, Product Marketing5d agoHybrid (San Francisco, CA) · Marketing
- AI Product Counsel5d agoSan Francisco, CA · General & Administrative