Solutions Architect
Hybrid (San Francisco), Hybrid (New York)$165k - $330kFull-timePosted 7mo ago
About the role
Solutions Architect at Baseten partnering with Sales and customers to translate business needs into technical solutions, run technical discovery, and guide repeatable deployments and proofs of value for customers.
Responsibilities
- Partner with Sales on customer discovery calls (most often second calls, occasionally first calls for large accounts).
- Lead demos and technical scoping to align on success criteria, architecture, and deployment approach.
- Own benchmarking and repeatable deployments, including handling standard deployment patterns across LLMs, embeddings, image and video generation, Voice AI, etc.
- Advising on tradeoffs like H100s vs B200s and latency-optimized vs throughput-optimized setups.
- Drive consistent “playbook” style deployments for common models and use cases.
- Become a power user of runtimes such as vLLM, SGLang, and TRT-LLM and understand common configurations and tradeoffs.
- Drive POC and project execution, including scoping POCs, keeping stakeholders aligned on timeline and deliverables, and acting as the project manager for POCs.
- Pull in Forward Deployed Engineering (FDE) support when deeper or more complex technical work is needed.
Qualifications
- AI/ML background and the ability to credibly discuss AI/ML topics with technical stakeholders.
- Strong customer-facing communication skills, including the ability to run structured discovery and clarify ambiguous requirements.
- Technical depth to scope solutions, without needing to write production code.
- Ability to script and prototype as needed, including comfort “vibe coding” to move quickly in technical workflows.
Skills
Required:AI/ML proficiency for stakeholder communicationCustomer discovery and requirements elicitationSolution scoping and architecturePrototype scripting or rapid prototyping
Benefits
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (office closed from Christmas Eve to New Year’s Day)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering learning and networking opportunities.
Last updated Oct 21, 2026. Interested? Apply on the company site.
About Baseten
Inference is everything
Effortlessly serve optimized open source & custom models on the fastest, most reliable model delivery network.
AICloud InfrastructureDeveloper ToolsInference PlatformMachine LearningModel DeploymentModel Runtimesai-infrastructure-and-development
More open roles at Baseten
- Partner Enablement Lead5d agoHybrid (San Francisco), Hybrid (New York) · G&A
- Engineering Manager Runtime - Storage5d agoHybrid (San Francisco) · EPD
- Sales Manager - Enterprise (New York)1w agoHybrid (New York) · GTM
- GRC Manager1w agoHybrid (San Francisco), Hybrid (Remote) +4 more · EPD
- Software Engineer - Inference Platform2w agoHybrid (San Francisco), Hybrid (Toronto) +3 more · EPD