← All roles

Technical Lead Manager - Training Runtime, Data(set) Movement

OpenAI· Scaling
Apply on company site
Hybrid (San Francisco)$295k - $445kFull-timePosted 4mo ago

About the role

Technical Lead Manager responsible for owning datasets throughout OpenAI's training infrastructure, defining APIs, storage contracts, versioning, and reliability for data access across training frameworks, with a hands-on leadership approach and a focus on scalable, observable data movement in large-scale training environments.

Responsibilities

  • Design and build a unified dataset read platform for multiple current and future training frameworks.
  • Define dataset APIs, storage-format expectations, registration/versioning, and migration paths that make data access reproducible and maintainable.
  • Build reliability into the read path, including stateful iteration, caching, fast restart, recovery, and clear operational contracts.
  • Build terminal and web-based visualizers that let teams inspect text, multimodal, and reinforcement learning data late in the pipeline, where bugs are most visible.
  • Write and review production code in core data loading, service, caching, and reliability paths.
  • Partner with teams working on training frameworks, reinforcement learning, multimodal models, storage, runtime, and cluster infrastructure.

Qualifications

  • Have built or owned dataset, data loading, storage, or distributed training infrastructure at large scale (e.g. torch.utils.data)
  • Care equally about API design, debugging ergonomics, performance, and bit-level correctness.
  • Understand the failure modes of large distributed training jobs and know how data systems can create or prevent them.
  • Have experience with stateful iterators, checkpoint/restart semantics, caching, remote services, or high-throughput storage reads.
  • Are comfortable working across Python and lower-level systems code; Rust or C++ experience is useful but not required.
  • Have worked with multimodal, video, reinforcement learning, or pretraining data pipelines where small data bugs are expensive and hard to diagnose.
  • Can lead through code and technical judgment before a team exists, and can later manage engineers without losing the hands-on edge.
  • Obsess over developer experience by eliminating friction, such as manual preprocessing scripts and niche cluster-specific bugs, ensuring a reliable and efficient experience for researchers.

Skills

Required:Dataset read platform designAPI designReliability engineering for data pipelines
Nice to have:Data visualization tooling

Benefits

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends
Last updated Sep 3, 2026. Interested? Apply on the company site.

About OpenAI

ai-infrastructure-and-developmentliquid-ai-recruiting-targetllmsetter-30setter-30-2026-q1speech-to-texttext-to-speechvoice-ai-stack
Company profileWebsite

More open roles at OpenAI