← All roles

Research Engineer, Infrastructure, Inference

Thinking Machines Lab· Research Infrastructure (ML Infra)
Apply on company site
San Francisco, CA$350k - $475kfull-timePosted 11mo ago

About the role

Infrastructure research engineer focused on designing, optimizing, and scaling systems that power large AI model inference to improve speed, cost, reliability, and reproducibility across experiments, evaluations, and deployments.

Responsibilities

  • Work alongside researchers and engineers to bring cutting-edge AI models into production.
  • Collaborate with research teams to enable high-performance inference for novel architectures.
  • Design and implement new techniques, tools, and architectures that improve performance, latency, throughput, and efficiency.
  • Optimize our codebase and compute fleet (e.g., GPUs) to fully utilize hardware FLOPs, bandwidth, and memory.
  • Extend orchestration frameworks (e.g., Kubernetes, Ray, SLURM) for distributed inference, evaluation, and large-batch serving.
  • Establish standards for reliability, observability, and reproducibility across the inference stack.
  • Publish and share learnings through internal documentation, open-source libraries, or technical reports that advance the field of scalable AI infrastructure.

Qualifications

  • Bachelor’s degree or equivalent experience in computer science, engineering, or similar.
  • Understanding of deep learning frameworks (e.g., PyTorch, JAX) and their underlying system architectures.
  • Experience with inference serving systems optimized for throughput and latency (e.g., SGLang, vLLM).
  • Thrive in a highly collaborative environment involving many, different cross-functional partners and subject matter experts.
  • A bias for action with a mindset to take initiative to work across different stacks and different teams where you spot the opportunity to make sure something ships.
  • Strong engineering skills, ability to contribute performant, maintainable code and debug in complex codebases

Skills

Required:Bachelor’s degree or equivalent experienceDeep learning frameworksInference serving systemsCollaboration across cross-functional teamsPerformance optimization

Benefits

  • generous health, dental, and vision benefits
  • unlimited PTO
  • paid parental leave
  • relocation support as needed
Last updated Jul 8, 2026. Interested? Apply on the company site.
Thinking Machines Lab logo

About Thinking Machines Lab

Connectionism: Research Blog by Thinking Machines Lab

Thinking Machines Lab is an artificial intelligence research and product company. We’re building a future where everyone has access to the knowledge and tools to make AI work for their unique needs and goals.

AIartificial intelligencebessemer-ai-infrastructure-2026deep learningliquid-ai-recruiting-targetmachine learningproductreinforcement-learning-platforms
Company profileWebsite

More open roles at Thinking Machines Lab