← All roles

Engineering Manager, ChatGPT Search Infrastructure

OpenAI· Applied AI
Apply on company site
San Francisco$401k - $445kFull-timePosted 1mo ago

About the role

Engineering Manager leading the team responsible for ChatGPT’s Search Infrastructure, setting technical direction across search orchestration, model and prompt integration, serving infrastructure, experimentation, observability, evaluation, and product integrations.

Responsibilities

  • Define and drive the technical strategy, architecture, and roadmap for ChatGPT Search Infrastructure, spanning search orchestration, APIs, model and prompt integration, serving, experimentation, evaluation, observability, and product integrations.
  • Lead and develop a team of experienced engineers, create meaningful ownership opportunities, and foster an inclusive, high-trust culture with clear accountability and high standards.
  • Partner with Post-Training on model launches, A/B experiments, search-behavior evaluation, and prompt optimization, translating model improvements into production-ready product experiences.
  • Build reusable platforms that enable Search product vertical teams to independently implement, test, and launch features, with automated guardrails that protect reliability, scalability, quality, and latency.
  • Partner with Inference, Indexing, and Retrieval teams to evolve the end-to-end Search architecture, adapt serving optimizations, and improve product outcomes across the stack.
  • Define and uphold service objectives of at least 99.9% availability, sub-second latency where required by the user experience, and the scalability needed to support ChatGPT’s continued growth.
  • Establish strong engineering practices across system design, testability, observability, experimentation, capacity planning, rollout safety, operational readiness, and incident prevention.
  • Independently lead multiple complex workstreams, remove technical and organizational bottlenecks, and build alignment across product, research, and infrastructure teams in ambiguous and rapidly changing environments.

Qualifications

  • Have experience managing senior engineers and leading teams responsible for complex, high-scale infrastructure, online serving, or distributed systems.
  • Bring significant technical depth in backend infrastructure, platform engineering, APIs, low-latency serving, experimentation platforms, or AI-powered product development.
  • Understand how models, prompts, inference systems, search orchestration, indexing, retrieval, and infrastructure work together to deliver an end-to-end user experience.
  • Have partnered with research or Post-Training teams to launch models, run controlled experiments, evaluate model behavior, or optimize prompts in production.
  • Have built shared platforms that allow other engineering teams to independently develop and launch features within well-defined reliability, scalability, quality, and performance guardrails.
  • Have shaped the architecture of systems with demanding availability, latency, and scale requirements, with testability, observability, safe rollout, and operational excellence built in from the outset.
  • Can move comfortably between technical depth, product strategy, organizational leadership, and people management while exercising strong judgment in ambiguous environments.
  • Build strong cross-functional partnerships, empower experienced engineers to lead, and care deeply about developing people and creating an inclusive, sustainable team culture.

Skills

Required:Technical leadershipBackend infrastructureSearch orchestration and indexingCross-functional leadership
Nice to have:Experimentation platforms

Benefits

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends may also be provided.
Last updated Sep 24, 2026. Interested? Apply on the company site.

About OpenAI

ai-infrastructure-and-developmentliquid-ai-recruiting-targetllmsetter-30setter-30-2026-q1speech-to-texttext-to-speechvoice-ai-stack
Company profileWebsite

More open roles at OpenAI