← All roles

Software Engineer - Training Infrastructure

Baseten· EPD
Apply on company site
Hybrid (San Francisco), Hybrid (New York)$165k - $330kFull-timePosted 11mo ago

About the role

Software Engineer on the Training Infrastructure team responsible for architecting and leading development of Baseten's training platform, including scheduling, storage, networking, reliability, and observability for ML training workloads.

Responsibilities

  • Design and architect scalable infrastructure systems for our ML training platform (e.g. scheduling, storage, and networking)
  • Partner closely with developers and research engineers to translate complex training requirements into technical solutions
  • Design and architect a global training scheduler
  • Design and architect reinforcement learning systems and continuous learning pipelines
  • Drive long-term improvements to increase reliability of systems and velocity of development
  • Partner closely with SRE and Capacity teams to unlock state of the art training infrastructure
  • Make critical architectural decisions balancing performance with system reliability
  • Lead technical discussions and mentor junior engineers on infrastructure best practices
  • Contribute to long-term technical strategy and infrastructure roadmap

Qualifications

  • Bachelor’s degree or higher in Computer Science or related field
  • 5+ years of experience
  • Proficiency in Go, with
  • Deep expertise with Kubernetes in production environments
  • Advanced understanding of distributed systems concepts and performance tuning
  • Proven experience designing observability systems
  • Experience with ML/AI workloads and MLOps platforms

Skills

Required:GoKubernetesDistributed systemsObservabilityML/AI workloads

Benefits

  • Competitive compensation, including meaningful equity
  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break (offices closed 12/24–1/1)
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • (U.S. only) Company-facilitated 401(k)
  • Exposure to a variety of ML startups, offering learning and networking opportunities
Last updated Oct 21, 2026. Interested? Apply on the company site.
Baseten logo

About Baseten

Inference is everything

Effortlessly serve optimized open source & custom models on the fastest, most reliable model delivery network.

AICloud InfrastructureDeveloper ToolsInference PlatformMachine LearningModel DeploymentModel Runtimesai-infrastructure-and-development
Company profileWebsite

More open roles at Baseten