← All roles

Software Engineer, Caching Infrastructure

OpenAI· Applied AI
Apply on company site
San FranciscoFull-timePosted 11mo ago

About the role

Engineer role responsible for designing, scaling, and operating OpenAI’s multi-tenant caching platform to support inference, identity, quota, and product experiences, with a focus on low latency, high availability, and cost efficiency.

Responsibilities

  • Design, build, and operate OpenAI’s multi-tenant caching platform used across inference, identity, quota, and product experiences.
  • Define the long-term vision and roadmap for caching as a core infra capability, balancing performance, durability, and cost.
  • Collaborate with other infra teams (e.g., networking, observability, databases) and product teams to ensure our caching platform meets their needs.

Qualifications

  • 5+ years of experience building and scaling distributed systems, with a strong focus on caching, load balancing, or storage systems.
  • Deep expertise with Redis, Memcached, or similar solutions, including clustering, durability configurations, client-side connection patterns, and performance tuning.
  • Production experience with Kubernetes, service meshes (e.g., Envoy), and autoscaling systems.
  • Ability to think rigorously about latency, reliability, throughput, and cost in designing platform capabilities.
  • Thrives in a fast-paced environment and balances pragmatic engineering with long-term technical excellence.

Skills

Required:Distributed caching systemsRedisMemcachedKubernetes
Nice to have:Service meshes (Envoy)

Benefits

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends
Last updated Jul 16, 2026. Interested? Apply on the company site.

About OpenAI

ai-infrastructure-and-developmentliquid-ai-recruiting-targetllmsetter-30setter-30-2026-q1speech-to-texttext-to-speechvoice-ai-stack
Company profileWebsite

More open roles at OpenAI