Senior Software Engineer, Production Engineering
New York$190k - $280kFull-timePosted 2mo ago
About the role
Role focused on building and operating Harvey’s core compute, networking, Kubernetes platform, and production infrastructure to enable scalable, reliable AI workloads and services.
Responsibilities
- Design, build, and operate the production infrastructure that powers Harvey’s products and AI workloads.
- Drive technical direction across compute infrastructure, networking, Kubernetes, workflow orchestration, and production operations.
- Lead complex, cross-functional technical initiatives that improve reliability, scalability, security, operational efficiency, and infrastructure cost.
- Partner with Product Engineering, Security, AI Infrastructure, and Platform teams to translate product and business requirements into resilient infrastructure solutions.
- Establish reusable patterns, tooling, and paved paths that help engineering teams ship and operate production services safely.
- Raise the engineering bar through thoughtful design reviews, clear technical documentation, operational rigor, and mentorship.
- Build and operate Harvey’s global compute and network infrastructure, ensuring high availability, scalability, reliability, and performance.
- Improve compute utilization, performance, and service availability while supporting rapidly growing AI workloads.
- Develop capacity models, demand forecasts, and fleet lifecycle automation to help infrastructure scale efficiently with business growth.
- Operate and continuously improve Harvey’s Kubernetes platform, including cluster provisioning, upgrades, networking, monitoring, reliability, performance, and operational automation.
- Drive infrastructure cost efficiency through capacity management, resource rightsizing, workload optimization, and utilization monitoring.
- Build secure infrastructure foundations, including identity and access management, network isolation, secrets management, auditing, and compliance controls.
- Develop scalable Infrastructure-as-Code and automation frameworks using Terraform and Pulumi.
- Improve observability, monitoring, alerting, incident response, and operational readiness across the infrastructure platform.
- Participate in the on-call rotation, lead incident response when needed, and turn production learnings into durable engineering improvements.
Qualifications
- 5+ years of software, infrastructure, site reliability, or production engineering experience.
- Deep experience building and operating large-scale cloud infrastructure on AWS, Azure, or Google Cloud Platform.
- Strong hands-on experience operating Kubernetes in production, including cluster lifecycle management, networking, and reliability.
- Experience building and operating distributed systems with strong reliability, scalability, and performance characteristics.
- Experience with infrastructure automation and Infrastructure-as-Code using tools such as Terraform or Pulumi.
- Strong understanding of compute infrastructure, networking, capacity planning, fleet management, and production operations.
- Experience designing and operating observability systems, including monitoring, logging, alerting, and incident response.
- Strong understanding of infrastructure security, including IAM, network security, secrets management, and compliance best practices.
- A track record of driving complex, cross-functional technical initiatives and influencing engineering decisions without relying on formal authority.
- Excellent communication skills and the ability to explain technical concepts clearly to engineering partners and other stakeholders.
- A systems-thinking mindset and a passion for building simple, reliable, and scalable infrastructure platforms.
Skills
Required:Compute infrastructureNetworkingKubernetesInfrastructure as CodeObservability & incident response
Benefits
- Comprehensive health, dental and vision coverage
- Retirement benefits (401k match up to 4%)
- Flexible PTO
Last updated Oct 22, 2026. Interested? Apply on the company site.
About Harvey
Professional Class AI
Harvey is a platform built to meet the standards of the world’s leading professional service firms.
AILegalLegal AILegal AnalysisLegal Document AnalysisLegal ResearchLegal Techsetter-30
More open roles at Harvey
- Senior Deal Desk Analyst, APAC4d agoSydney · Sales
- Deal Operations Analyst4d agoHybrid (Chicago) · Sales
- Deal Operations Analyst4d agoHybrid (Dallas) · Sales
- Account Executive, Enterprise4d agoHybrid (Toronto) · Sales
- Head of Mid Market Sales, North America4d agoHybrid (Chicago) · Sales