← All roles

Software Engineer, Workload Enablement

OpenAI· Scaling
Apply on company site
Hybrid (San Francisco), Hybrid (Seattle)$293k - $385kFull-timePosted 6mo ago

About the role

Software Engineer to enable production workloads and end-to-end testing on new platforms, porting workloads, building benchmarks, and optimizing performance for OpenAI's infrastructure.

Responsibilities

  • Port and validate key inference and training workloads on new platforms/SKUs as they arrive; drive correctness, performance, and stability to an internal readiness bar.
  • Build a suite of benchmarks and stress tests that capture real E2E behavior of our workloads by exercising all aspects of a system, including CPU, GPU, memory subsystem, frontend, scale-up, and scale-out networking (including WAN traffic, NVlink and RDMA collectives), storage, thermals, and any other relevant parts.
  • Deep-dive performance on distributed training/inference: Collective performance and tuning (across NCCL/RCCL and internal libraries), Overlap of compute/communication, kernel-level bottlenecks, memory bandwidth and scheduling effects.
  • Create repeatable test harnesses that run in CI / lab environments and produce actionable outputs (pass/fail, performance score, regression detection).
  • Partner with systems + fleet bring-up engineers to ensure the platform is stable, performant, operationally usable and scalable (containerization, K8s integration, telemetry hooks, failure triage loops).
  • Work cross-functionally with vendors and internal stakeholders by producing clear bug reports, minimal repros, and prioritized issue lists.

Qualifications

  • BS in CS/EE (or equivalent practical experience).
  • 5+ years in one or more of: ML systems, performance engineering, distributed systems, or HPC.
  • Strong hands-on experience with: PyTorch and modern LLM training/inference stacks; Large-scale distributed training concepts (data/model/pipeline parallel, collective comms); Experience with RDMA and debugging/optimizing comms libraries (NCCL or RCCL) and their interaction with hardware/network.
  • Proficiency in Python plus comfort reading/writing performance-critical code (C++/CUDA/HIP is a plus).
  • Strong profiling/debugging skills (e.g., Nsight, rocprof, perf, flamegraphs; ability to reason from traces/counters).

Skills

Required:BS in CS/EE (or equivalent practical experience)ML systemsPyTorch and modern LLM training/inference stacksRDMA and NCCL/RCCLPython; C++/CUDA/HIPProfiling/debugging (Nsight, rocprof, perf, flamegraphs)

Benefits

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends
Last updated Jul 16, 2026. Interested? Apply on the company site.

About OpenAI

ai-infrastructure-and-developmentliquid-ai-recruiting-targetllmsetter-30setter-30-2026-q1speech-to-texttext-to-speechvoice-ai-stack
Company profileWebsite

More open roles at OpenAI