← All roles

Software Engineer, Accelerators

OpenAI· Scaling
Apply on company site
San Francisco$295k - $380k + bonusFull-timePosted 11mo ago

About the role

OpenAI seeks a Software Engineer on the Accelerators team to evaluate and bring up new compute platforms for large-scale AI training and inference, prototyping system software on accelerators, and driving performance optimizations across AI workloads.

Responsibilities

  • Prototype and enable OpenAI's AI software stack on new, exploratory accelerator platforms.
  • Optimize large-scale model performance (LLMs, recommender systems, distributed AI workloads) for diverse hardware environments.
  • Develop kernels, sharding mechanisms, and system scaling strategies tailored to emerging accelerators.
  • Collaborate on optimizations at the model code level (e.g. PyTorch) and below to enhance performance on non-traditional hardware. Perform system-level performance modeling, debug bottlenecks, and drive end-to-end optimization.
  • Work with hardware teams and vendors to evaluate alternatives to existing platforms and adapt the software stack to their architectures.
  • Contribute to runtime improvements, compute/communication overlapping, and scaling efforts for frontier AI workloads.

Qualifications

  • 3+ years of experience working on AI infrastructure, including kernels, systems, or hardware-software co-design
  • Hands-on experience with accelerator platforms for AI at data center scale (e.g., TPUs, custom silicon, exploratory architectures).
  • Strong understanding of kernels, sharding, runtime systems, or distributed scaling techniques.
  • Familiarity with optimizing LLMs, CNNs, or recommender models for hardware efficiency.
  • Experience with performance modeling, system debugging, and software stack adaptation for novel architectures.
  • Exposure to mobile accelerators is welcome, but experience enabling data center-scale AI hardware is preferred.
  • Ability to operate across multiple levels of the stack, rapidly prototype solutions, and navigate ambiguity in early hardware bring-up phases
  • Interest in shaping the future of AI compute through exploration of alternatives to mainstream accelerators.

Skills

Required:AI infrastructureAccelerator platforms (data center scale)Kernels and runtime systemsModel optimization (LLMs/CNNs/recommenders)

Benefits

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends
Last updated Aug 13, 2026. Interested? Apply on the company site.

About OpenAI

ai-infrastructure-and-developmentliquid-ai-recruiting-targetllmsetter-30setter-30-2026-q1speech-to-texttext-to-speechvoice-ai-stack
Company profileWebsite

More open roles at OpenAI