Senior Software Engineer, AI Platform
Hybrid (San Francisco)$185k - $325kFull-timePosted 7mo ago
About the role
Role focused on building the AI Platform foundation (model routing, agent infrastructure, context management, evals) to support Harvey’s AI-powered products and agent systems in a hybrid, San Francisco–based environment.
Responsibilities
- Design and build abstractions and platform-level systems that improve all of Harvey’s agentic products.
- Own infrastructure for model integration, routing, and evaluation that helps Harvey choose and deploy the right foundation model for any given context.
- Build evaluation frameworks and tooling that let every team across Harvey iterate on AI quality effectively.
- Partner closely with product engineering teams, PMs, and design to launch cutting-edge AI products.
- Evaluate, prototype, and integrate the latest advancements in AI and agentic systems as they emerge.
Qualifications
- 5+ years of experience building backend systems, with at least 1+ year focused on AI/ML engineering.
- Experience building and shipping multi-model or multi-provider AI systems in production.
- Familiarity with context management, session state, or memory systems in AI or distributed systems.
- Track record of building internal platforms, SDKs, or shared infrastructure used by other engineering teams.
- Strong judgment about abstractions and pragmatic shipping.
- Excitement about agentic AI and infrastructure challenges of reliable autonomous systems.
- Bias toward full ownership and ability to navigate ambiguity.
Skills
Required:Backend developmentAI/ML engineeringMulti-model / multi-provider AI systems
Benefits
- Benefits include, but not limited to: Comprehensive health, dental and vision coverage, retirement benefits (401k match up to 4%), and flexible PTO.
Last updated Aug 5, 2026. Interested? Apply on the company site.
About Harvey
Professional Class AI
Harvey is a platform built to meet the standards of the world’s leading professional service firms.
AILegalLegal AILegal AnalysisLegal Document AnalysisLegal ResearchLegal Techsetter-30
More open roles at Harvey
- Senior Deal Desk Analyst, APAC5d agoSydney · Sales
- Deal Operations Analyst5d agoHybrid (Chicago) · Sales
- Deal Operations Analyst5d agoHybrid (Dallas) · Sales
- Account Executive, Enterprise5d agoHybrid (Toronto) · Sales
- Head of Mid Market Sales, North America5d agoHybrid (Chicago) · Sales