← All roles

Network Engineer, Supercomputing

Thinking Machines Lab· Core Engineering, Product, and Infrastructure
Apply on company site
San Francisco, CA$350k - $475kFull-timePosted 3mo ago

About the role

Position focused on owning and improving the lowest layers of the network stack for large-scale GPU training and inference, ensuring interconnect reliability across RDMA/RoCE fabric and NVLink/NVSwitch domains. Hands-on, cross-stack role involving debugging, instrumentation, and collaboration with cloud providers’ networking teams to keep researchers’ workloads flowing without fabric concerns.

Responsibilities

  • Reason about and validate GPU network fabric design across deployments.
  • Debug RDMA / RoCEv2 across different NIC vendors. Diagnose collective failures of production NCCL, PFC/ECN tuning, and congestion control behavior.
  • Own NVLink / NVSwitch interconnect — including fabric manager and IMEX health, link and lane errors, and interaction with the GPU fabric and collectives.
  • Build host-level network instrumentation and use Linux tooling to build dashboards and alerts.
  • Navigate cross-cloud fabric quirks across providers and triage across the NIC, driver, kernel, switch, and workload boundaries.
  • Drive escalations with cloud-provider networking teams, owning issues end-to-end until they're resolved.

Qualifications

  • Bachelor’s degree or equivalent experience in computer science, engineering, or similar.
  • Proficiency in at least one backend language (Python or Rust).
  • Experience operating large-scale clusters and container orchestration systems (e.g. Kubernetes or Slurm).
  • Comfort operating across the stack and owning projects end-to-end.
  • Thrive in a highly collaborative environment involving many cross-functional partners and subject matter experts.
  • Bias for action with initiative to work across stacks and teams to drive shipping.

Skills

Required:Backend programmingLarge-scale cluster operationsCross-stack debugging
Nice to have:Linux host-level debuggingCommunication with cloud providersCUDA/NCCL & distributed training familiarityNVLink/NVSwitch experience

Benefits

  • generous health, dental, and vision benefits
  • unlimited PTO
  • paid parental leave
  • relocation support as needed
Last updated Jul 8, 2026. Interested? Apply on the company site.
Thinking Machines Lab logo

About Thinking Machines Lab

Connectionism: Research Blog by Thinking Machines Lab

Thinking Machines Lab is an artificial intelligence research and product company. We’re building a future where everyone has access to the knowledge and tools to make AI work for their unique needs and goals.

AIartificial intelligencebessemer-ai-infrastructure-2026deep learningliquid-ai-recruiting-targetmachine learningproductreinforcement-learning-platforms
Company profileWebsite

More open roles at Thinking Machines Lab