AI Inference Engineer
Hybrid (San Francisco), Hybrid (Remote), Hybrid (Toronto), Hybrid (New York), Hybrid (Montreal)$165k - $330kFull-timePosted 2mo ago
About the role
Forward Deployed Engineering role partnering with customers to architect, build, and deploy high-scale production AI applications on Baseten’s platform. Combines engineering with product management and customer-facing responsibilities to translate business goals into observable, low-latency, cost-conscious services.
Responsibilities
- Develop and maintain software systems and product features using one or more general-purpose programming languages in a production-level environment, with a preference for Python due to its relevance in ML projects.
- Drive customer impact by designing, implementing, and deploying Baseten solutions end-to-end (problem framing → evaluation → production deployment → monitoring) with customers’ engineering teams across sales, implementation, and expansion.
- Deliver with velocity: turn vague objectives into clear specs and well-defined PoCs to rapidly ship well-tested services and outcomes.
- Optimize and enhance AI/ML projects, contributing to the continuous improvement of the technical stack, including developing features and PRDs with other engineering and product orgs.
- Own products and customer projects end-to-end, functioning as engineer, project manager, and product manager with focus on user empathy, specification, and execution.
- Navigate ambiguity and exercise good judgment on tradeoffs and tools to solve problems, avoiding unnecessary complexity.
- Demonstrate pride, ownership, and accountability for work, with similar expectations from teammates.
Qualifications
- Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, Mathematics, or related field.
- 2+ years of professional work experience in a fast-paced, high-growth environment.
- Demonstrated experience with one or more general-purpose programming languages in a production-level environment, with a strong preference for Python.
- Familiarity with AI/ML pipelines and the lifecycle of ML model development and deployment.
- Strong communication skills, particularly on complex technical topics.
- Experience in building or optimizing AI/ML projects is highly valued.
Skills
Required:PythonML/AI pipelines
Benefits
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (offices closed from Christmas Eve to New Year’s Day)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering learning and networking opportunities.
Last updated Oct 21, 2026. Interested? Apply on the company site.
About Baseten
Inference is everything
Effortlessly serve optimized open source & custom models on the fastest, most reliable model delivery network.
AICloud InfrastructureDeveloper ToolsInference PlatformMachine LearningModel DeploymentModel Runtimesai-infrastructure-and-development
More open roles at Baseten
- Partner Enablement Lead4d agoHybrid (San Francisco), Hybrid (New York) · G&A
- Engineering Manager Runtime - Storage4d agoHybrid (San Francisco) · EPD
- Sales Manager - Enterprise (New York)1w agoHybrid (New York) · GTM
- GRC Manager1w agoHybrid (San Francisco), Hybrid (Remote) +4 more · EPD
- Software Engineer - Inference Platform2w agoHybrid (San Francisco), Hybrid (Toronto) +3 more · EPD