← All roles

Operating Systems Engineer, On-Device Inference | Consumer Devices

OpenAI· Consumer Devices
Apply on company site
San Francisco$230k - $385kFull-timePosted 4w ago

About the role

OpenAI is hiring an Operating Systems Engineer focused on on-device AI inference for consumer devices to design, develop, and ship the OS stack enabling reliable, responsive, and energy-efficient on-device AI capabilities.

Responsibilities

  • Build the inference platform: Design and implement maintainable OS services, frameworks, and clear interfaces for inference execution, model loading and lifecycle, and resource management.
  • Fit models to device constraints: Partner with researchers on quantization, runtime integration, and memory optimization to meet memory, compute, and energy budgets while evaluating model quality and product behavior.
  • Coordinate system resources: Develop scheduling and resource policies that balance inference with other device activity, preserving responsiveness within latency, memory, battery, and thermal constraints.
  • Advance performance and power management: Develop and validate execution strategies that adapt to workload needs, available resources, and changing device conditions.
  • Debug across the stack: Use tracing, profiling, and structured debugging to investigate correctness, concurrency, performance, and reliability issues across models, inference runtimes, and OS components.
  • Measure and validate improvements: Build diagnostic tools, instrumentation, representative device workloads, and automated tests to demonstrate repeatable performance and energy gains on physical devices, catch regressions, and validate sustained use.
  • Bring capabilities to production: Collaborate with research, hardware, firmware, platform, and product engineering teams to turn emerging model capabilities into maintainable systems and reliable shipped features.

Qualifications

  • Substantial hands-on experience designing, developing, and debugging operating system components, system services, or performance-critical platform software.
  • Proficiency in C++ for systems development, including concurrent programming, memory ownership, and resource lifetime management.
  • Hands-on experience integrating or optimizing inference runtimes or machine learning workloads in resource-constrained environments.
  • Strong understanding of scheduling, memory management, and how workloads compete for shared system resources.
  • Experience diagnosing complex system behavior and delivering performance or power improvements supported by repeatable measurements.
  • Ability to work across disciplines, translate research and product needs into system requirements, and explain technical decisions and tradeoffs clearly.

Skills

Required:C++ (systems development)On-device inference integrationScheduling and memory managementPerformance and power optimizationDebugging and profilingCross-disciplinary collaboration

Benefits

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided
Last updated Sep 24, 2026. Interested? Apply on the company site.

About OpenAI

ai-infrastructure-and-developmentliquid-ai-recruiting-targetllmsetter-30setter-30-2026-q1speech-to-texttext-to-speechvoice-ai-stack
Company profileWebsite

More open roles at OpenAI