← All roles

Member of Technical Staff (Software Engineer, Enterprise Agent Evals & Efficiency)

Perplexity· Platform & Infrastructure
Apply on company site
San Francisco, Seattle, New York City$220k - $405kFull-timePosted 4d ago

About the role

Hands-on engineering role focused on building and shipping improvements to Perplexity's enterprise agent evaluation environments, harness, tools, and workflows to improve task success, latency, and cost.

Responsibilities

  • Build realistic enterprise evaluation environments spanning connected applications, representative datasets, user roles, and permissions, with complex, multi-step workflows and reproducible system state.
  • Own evaluation infrastructure, task suites, and automated graders that measure how well agents complete enterprise work, calibrated against human judgment and grounded in end-to-end outcomes.
  • Analyze agent trajectories and production failures, identify root causes, and ship improvements across the agent harness, tools, and skills that measurably improve task success and reliability.
  • Develop reusable skills and improve tool descriptions, schemas, and result handling so agents can select the right tools, execute workflows correctly, and recover from errors with fewer unnecessary calls.
  • Build and evaluate model-selection and routing strategies that match each task to the right model and effort level, balancing quality, latency, reliability, and cost.
  • Improve agent efficiency through context management, skill loading, caching, and execution strategies that reduce wasted tokens and cost per successful task without compromising quality or safety.
  • Build regression gates and launch-readiness signals for model, connector, tool, skill, and harness changes, and validate that evaluation gains translate into better production outcomes.

Qualifications

  • 5+ years of software engineering or machine learning engineering experience, with a track record of owning complex production systems from design through deployment and operation.

Skills

Required:Backend development
Last updated Oct 21, 2026. Interested? Apply on the company site.

About Perplexity

ai-plg-top-20brex-fastest-growing-2025liquid-ai-recruiting-targetsetter-30setter-30-2026-q1
Company profileWebsite

More open roles at Perplexity