← All roles

Software Engineer, Inference - Multi Modal

OpenAI· Scaling
Apply on company site
San FranciscoFull-timePosted 11mo ago

About the role

Software engineer to design and operate inference infrastructure for large-scale multimodal models (image, audio, and other non-text modalities) at OpenAI, focusing on high-throughput, low-latency production systems and collaboration with research and product teams.

Responsibilities

  • Design and implement inference infrastructure for large-scale multimodal models.
  • Optimize systems for high-throughput, low-latency delivery of image and audio inputs and outputs.
  • Enable experimental research workflows to transition into reliable production services.
  • Collaborate closely with researchers, infra teams, and product engineers to deploy state-of-the-art capabilities.
  • Contribute to system-level improvements including GPU utilization, tensor parallelism, and hardware abstraction layers.

Qualifications

  • Have experience building and scaling inference systems for LLMs or multimodal models.
  • Have worked with GPU-based ML workloads and understand the performance dynamics of large models, especially with complex data like images or audio.
  • Enjoy experimental, fast-evolving work and collaborating closely with research.
  • Are comfortable dealing with systems that span networking, distributed compute, and high-throughput data handling.
  • Have familiarity with inference tooling like vLLM, TensorRT-LLM, or custom model parallel systems.
  • Own problems end-to-end and are excited to operate in ambiguous, fast-moving spaces.

Skills

Required:Inference system designHigh-throughput, low-latency systemsCollaboration with researchers and product teams
Nice to have:GPU utilization and tensor parallelism

Benefits

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends
Last updated Aug 20, 2026. Interested? Apply on the company site.

About OpenAI

ai-infrastructure-and-developmentliquid-ai-recruiting-targetllmsetter-30setter-30-2026-q1speech-to-texttext-to-speechvoice-ai-stack
Company profileWebsite

More open roles at OpenAI