Software Engineer - Dedicated Inference
Hybrid (San Francisco), Hybrid (Toronto), Hybrid (New York), Hybrid (Montreal), Hybrid (Seattle)$165k - $330k + equityFull-timePosted 11mo ago
About the role
Engineer on the Dedicated Inference team building tools and infrastructure for deploying and operating AI workloads in production (CLI/SDKs, APIs, observability, debugging workflows).
Responsibilities
- Implement new features and products for the team
- Design ergonomic APIs and abstractions to solve customer problems
- Fix bugs and resolve customer issues with urgency
- Work across the stack - React Components and Kubernetes Pods
- Work closely with the product and forward deployed engineering teams to develop and drive new product ideas
Qualifications
- Bachelor's degree or higher in Computer Science or related field
- Proficient coding abilities in one or more popular programming or scripting languages; Python, Go, or JavaScript proficiency is a plus
- Familiarity with web applications & databases
- Good taste in product, particularly developer-oriented tools
- Interest in ML/AI infrastructure and willingness to learn
- Strong collaboration and communication skills
Skills
Required:API designKubernetes
Nice to have:React
Benefits
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (offices closed from Christmas Eve to New Year’s Day)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities
Last updated Oct 21, 2026. Interested? Apply on the company site.
About Baseten
Inference is everything
Effortlessly serve optimized open source & custom models on the fastest, most reliable model delivery network.
AICloud InfrastructureDeveloper ToolsInference PlatformMachine LearningModel DeploymentModel Runtimesai-infrastructure-and-development
More open roles at Baseten
- Partner Enablement Lead4d agoHybrid (San Francisco), Hybrid (New York) · G&A
- Engineering Manager Runtime - Storage4d agoHybrid (San Francisco) · EPD
- Sales Manager - Enterprise (New York)1w agoHybrid (New York) · GTM
- GRC Manager1w agoHybrid (San Francisco), Hybrid (Remote) +4 more · EPD
- Software Engineer - Inference Platform2w agoHybrid (San Francisco), Hybrid (Toronto) +3 more · EPD