← All roles

Senior Software Engineer, Agents

Harvey· Engineering
Apply on company site
Hybrid (New York)$193.4k - $290kFull-timePosted 6mo ago

About the role

Role focused on building AI agent systems for legal professionals, including environment/action design, model selection, context management, tool development, and eval harnesses to enable faster iteration and new capabilities.

Responsibilities

  • Partner with customers and PMs to understand legal workflows, design practical evaluations that capture what “excellent” means, and ship agents that get the job done.
  • Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
  • Work with our model infra team to design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, or subagent patterns.
  • Improve our observability and instrumentation to profile agent behavior, identify bottlenecks, and drive optimization decisions.
  • Stay current on new developments in agentic systems and bring those learnings back to the products we build.

Qualifications

  • 5-8 years (post-BS/MS) of software engineering experience.
  • Proficiency in Python and experience working with LLM APIs and agent frameworks.
  • Experience with shipping user-facing products, either on the backend or full-stack.
  • Passion for building effective domain-specific agents.
  • Iterative mindset: you develop proof of concepts, make decisions quickly, and ship v0s.
  • Comfortable with when and how to use evaluations to drive quality.
  • Humble and adaptable about code and frameworks. We expect you to drive adoption of new best practices as they develop.

Skills

Required:PythonLLM APIsAgent frameworks
Nice to have:Prompt engineering

Benefits

  • Comprehensive health, dental and vision coverage, retirement benefits (401k match up to 4%), and flexible PTO.
Last updated Aug 5, 2026. Interested? Apply on the company site.
Harvey logo

About Harvey

Professional Class AI

Harvey is a platform built to meet the standards of the world’s leading professional service firms.

AILegalLegal AILegal AnalysisLegal Document AnalysisLegal ResearchLegal Techsetter-30
Company profileWebsite

More open roles at Harvey