Member of Technical Staff (Answer Quality & Evals)
Perplexity· AI Research & Systems
Hybrid (San Francisco), Hybrid (Palo Alto)$200k - $350kFull-timePosted 8mo ago
About the role
Role focused on building and improving evaluation infrastructure and platforms to support answer quality across Perplexity, including replaying/analyzing agent traces and turning evaluation findings into product improvements.
Responsibilities
- Build shared evaluation infrastructure that helps teams run reliable evals, analyze results, and make product and model decisions
- Develop the platform for replaying and analyzing agent traces to reproduce production behavior and diagnose failures
- Build and operate scalable systems for processing, storing, and monitoring interaction, trace, and evaluation data
- Partner with data scientists, engineers, and product teams to turn answer-quality problems into evaluations, analyses, and product improvements
- Operate in a small, high-impact team where your work directly shapes how Perplexity measures and improves Answer Quality
Qualifications
- 4+ years of software, data, or machine learning engineering experience shipping and operating production systems
- Strong proficiency in Python and SQL, with solid fundamentals in system design, data modeling, and distributed systems
- Experience building big-data systems, including distributed compute, large-scale storage, and high-volume pipelines
- Demonstrated ownership of ambiguous technical projects from initial design through production operation
- Ability to work effectively with data scientists, engineers, and product partners
Skills
Required:PythonSQL
Benefits
- Full-time U.S. employees enjoy a comprehensive benefits program including equity, health, dental, vision, retirement, fitness, commuter and dependent care accounts, and more.
- International Benefits: Full-time employees outside the U.S. enjoy a comprehensive benefits program tailored to their region of residence.
Last updated Sep 2, 2026. Interested? Apply on the company site.
About Perplexity
ai-plg-top-20brex-fastest-growing-2025liquid-ai-recruiting-targetsetter-30setter-30-2026-q1
More open roles at Perplexity
- Member of Technical Staff (Software Engineer, Enterprise Agent Evals & Efficiency)4d agoSan Francisco, Seattle +1 more · Platform & Infrastructure
- Global Treasury Manager, Investments & Risk4d agoHybrid (San Francisco) · Finance
- Member of Technical Staff (Software Engineer, Enterprise Trust & Governance)4d agoSan Francisco, London +3 more · Platform & Infrastructure
- Sr. Workplace Coordinator4d agoSan Francisco · Workplace
- Strategic Finance Lead - GTM1w agoHybrid (San Francisco), Hybrid (New York City) · Finance