← All roles

Software Engineer, Data Acquisition

OpenAI· Research
Apply on company site
San Francisco$295k - $536kFull-timePosted 11mo ago

About the role

Data Acquisition team at OpenAI handles data collection to support model training, including web crawling and GPTBot services. Seeking a Software Engineer to lead and build scalable data ingestion, indexing, and search systems within a Kubernetes/IaC environment.

Responsibilities

  • Own and lead engineering projects in the area of data acquisition including web crawling, data ingestion, and search.
  • Collaborate with other sub-teams, such as Data Processing, Architecture, and Scaling, to ensure smooth data flow and system operability.
  • Work closely with the legal team to handle any compliance or data privacy-related matters.
  • Develop and deploy highly scalable distributed systems capable of handling petabytes of data.
  • Architect and implement algorithms for data indexing and search capabilities.
  • Build and maintain backend services for data storage, including work with key-value databases and synchronization.
  • Deploy solutions in a Kubernetes Infrastructure-as-Code environment and perform routine system checks.
  • Conduct and analyze experiments on data to provide insights into system performance.

Qualifications

  • BS/MS/PhD in Computer Science or a related field.
  • 4+ years of industry experience in software development.
  • Experience with large web crawlers a plus
  • Strong expertise in large stateful distributed systems and data processing.
  • Proficiency in Kubernetes, and Infrastructure-as-Code concepts.
  • Willingness and enthusiasm for trying new approaches and technologies.
  • Ability to handle multiple tasks and adapt to changing priorities.
  • Strong communication skills, both written and verbal.

Skills

Required:Data acquisition and ingestionDistributed systemsKubernetes

Benefits

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided.
Last updated Sep 3, 2026. Interested? Apply on the company site.

About OpenAI

ai-infrastructure-and-developmentliquid-ai-recruiting-targetllmsetter-30setter-30-2026-q1speech-to-texttext-to-speechvoice-ai-stack
Company profileWebsite

More open roles at OpenAI