Senior Principal AI Solutions Engineer
SambaNova· Core Tech
San Jose, CA$234k - $286kFull-timePosted 3w ago
About the role
Senior technical leader responsible for defining technical direction of the solutions portfolio, building hands-on agentic AI systems, and leading engagements with strategic customers across the full modern AI stack.
Responsibilities
- Build agentic and self-improving systems: design and build single- and multi-agent systems with planning, tool and function calling, memory, MCPS, long-running workflows; create self-improving feedback loops with automated evals, LLM-as-judge, trace-driven optimizations, synthetic data generation, and production fine-tuning.
- Evaluation and Observability: set up eval harnesses, tracing and guardrails to measure quality, cost and latency for deployed solutions.
- Open-Weight Model Expertise: select, adapt and combine open models (e.g. Llama, Qwen, DeepSeek, gpt-oss, Gemma, GLM) with LoRA/PEFT fine-tuning, distillation and routing.
- Performance and Benchmarking: benchmark end-to-end solutions and illustrate impact of fast inference on application capabilities.
- Model Integration: validate new models on SambaNova’s platform stack and report gaps to Product and Engineering.
- Front-End and Product Build: develop polished web applications (React/Next.js, TypeScript) for non-technical knowledge workers.
- Vertical Knowledge Work: create domain solutions for financial services, legal, healthcare, public sector and research (document analysis, research agents, RAG, knowledge assistants, workflow automation).
- Multimodal Solutions: build vision-language and document-understanding pipelines (OCR, charts, forms, images, video) with agentic reasoning.
- Audio and Voice: develop real-time voice agents and audio pipelines (ASR, TTS, speech-to-speech, streaming, turn-taking) with low latency.
- Solutions Technical Strategy: set direction for agentic, multimodal and vertical patterns, shared frameworks, components, and engineering standards.
- Technical Leadership and Mentorship: provide senior technical guidance, review designs, mentor engineers, improve ship quality.
- Executive Engagement: advise customer CTOs and AI leaders on architecture, build-vs-buy, and enterprise scaling.
- Customer Engagement: lead technical discovery, workshops, hackathons, and hands-on co-builds from prototype to production.
- Reference Architectures: publish reference architectures, starter kits, open-source examples and best practices.
- SambaStack Tooling: develop tooling and automation for deployment, management and integration.
- Product Feedback: feed field learnings into roadmap and platform priorities.
- Thought Leadership: represent SambaNova via demos, talks, blogs and community contributions.
Qualifications
- Bachelor's degree or higher in Computer Science, Electrical Engineering, Applied Mathematics, Physics, Statistics or related field
- 8+ years (IC5) or 10+ years (IC6) of industry experience in software, ML or solutions engineering, including 3+ years building LLM-based applications in production
- Proven experience building agentic systems: tool and function calling, multi-agent orchestration and frameworks such as LangGraph, CrewAI, OpenAI Agents SDK, Claude Agent SDK or equivalent
- Hands-on experience with open-weight models: serving, prompting, fine-tuning (LoRA/PEFT) and evaluation
- Strong full-stack skills: expert Python plus modern front-end development (TypeScript, React/Next.js), APIs and cloud deployment
- Experience designing evals and benchmarks for LLM applications (quality, latency, cost)
- Excellent customer communication with ability to lead workshops and explain architecture to executives and engineers
- Track record of technical leadership across teams: setting architecture direction, mentoring senior engineers and owning outcomes for strategic accounts
Skills
Required:Agentic system designEvaluation and observabilityOpen-weight model expertiseFront-end development
Nice to have:Self-improving systemsVertical domain knowledge
Benefits
- Base Salary Range: $234,000—$286,000 USD per year
- Equity and benefits package (including health insurance, HSA, dental, vision, disability and life insurance)
- Well-being and lifestyle benefits (Headspace, Gympass+, One Medical membership, EAP, counseling, etc.)
Last updated Oct 4, 2026. Interested? Apply on the company site.
About SambaNova
The Fastest AI Inference Platform
Discover SambaNova - the complete AI platform delivering the fastest AI inference, fine-tuning, and scalable solutions for agentic AI easily integrated into existing data center infrastructures.
DataflowOpenAI gpt-oss-120bRDUSambaCloudSambaManagedSambaRackSambaStackSovereign AI
More open roles at SambaNova
- AI Performance Engineer - New GradtodayHybrid (Austin, TX / San Jose, CA) · Software
- Senior GTM Recruiter1w agoHybrid (Austin, TX; San Jose, CA) · People
- Principal Product Manager1w agoSan Jose, CA · Core Tech
- Data Center Operations Technician3w agoSanta Clara, CA · IT
- Digital Content Manager4w agoSan Jose, CA · Marketing