← All roles

Software Engineer, Data Infrastructure

Thinking Machines Lab· Core Engineering, Product, and Infrastructure
Apply on company site
San Francisco, CA$350k - $475kPosted 11mo ago

About the role

Software Engineer role focused on designing, building, and operating scalable data infrastructure for LLM research, including distributed training pipelines, data catalogs, and multimodal processing over petabytes of data.

Responsibilities

  • Design, build, and operate scalable, fault-tolerant infrastructure for LLM Research: distributed compute, data orchestration, and storage across modalities.
  • Develop high-throughput systems for data ingestion, processing, and transformation — including training data catalogs, deduplication, quality checks, and search.
  • Build systems for traceability, reproducibility, and robust quality control at every stage of the data lifecycle.
  • Implement and maintain monitoring and alerting to support platform reliability and performance.
  • Collaborate with research teams to unlock new features, improve data quality, and accelerate training cycles.

Qualifications

  • Bachelor’s degree or equivalent experience in computer science, engineering, or similar.
  • Proficiency in at least one backend language (Python or Rust).
  • Fluent in distributed compute frameworks such as Apache Spark or Ray.
  • Deep familiarity with cloud infrastructure, data lake architectures, and batch and streaming pipelines.
  • Comfort operating across the stack and owning projects end-to-end.
  • Thrive in a highly collaborative environment involving cross-functional partners and subject matter experts.
  • Bias for action with initiative to work across different stacks and teams to ship solutions.

Skills

Required:Backend developmentDistributed compute frameworksCloud infrastructure and data pipelinesEnd-to-end project ownershipCollaborative cross-functional work

Benefits

  • generous health, dental, and vision benefits
  • unlimited PTO
  • paid parental leave
  • relocation support as needed
Last updated Jul 8, 2026. Interested? Apply on the company site.
Thinking Machines Lab logo

About Thinking Machines Lab

Connectionism: Research Blog by Thinking Machines Lab

Thinking Machines Lab is an artificial intelligence research and product company. We’re building a future where everyone has access to the knowledge and tools to make AI work for their unique needs and goals.

AIartificial intelligencebessemer-ai-infrastructure-2026deep learningliquid-ai-recruiting-targetmachine learningproductreinforcement-learning-platforms
Company profileWebsite

More open roles at Thinking Machines Lab