← All roles

Software Architect

SambaNova· Software
Apply on company site
San Jose, California, United States$245k - $325kFull-timePosted 3mo ago

About the role

Software Architect for the SambaStack platform, defining the technical direction and owning cross-cutting architectural decisions for an enterprise-grade AI inference platform powered by SambaStack and RDU hardware.

Responsibilities

  • Own the end-to-end technical architecture of the SambaStack inference platform, ensuring it meets enterprise-grade standards for scalability, reliability, and performance.
  • Define and drive architectural strategy across engineering teams, aligning long-term platform direction with product and business objectives.
  • Lead design reviews for major new capabilities and cross-cutting system changes, providing authoritative technical guidance and raising the quality bar across the SambaStack engineering organization.
  • Proactively identify and resolve systemic risks, including performance bottlenecks, reliability gaps, and scaling constraints, before they impact customers.
  • Establish and evolve architectural standards, patterns, and best practices across the SambaStack engineering organization.
  • Partner with ML Engineers, Product Managers, QA, and DevOps to translate complex, ambiguous requirements into sound architectural decisions.
  • Serve as a technical thought leader and mentor, growing the architectural thinking and design skills of Software Engineers across the team.
  • Evaluate emerging technologies and industry trends to inform the platform's technical roadmap.
  • Architect new systems, components, and capabilities to solve new and interesting problems in the AI inference space.

Qualifications

  • 12+ years of software engineering experience, including significant time in a role with organization-wide technical influence.
  • Proven track record of owning large-scale distributed systems architectures end-to-end from design to production.
  • Expertise building backend systems in Python, Go, or Rust.
  • Expert-level understanding of Kubernetes, including Operators, Helm Charts, and cluster-scale resource management.
  • Strong command of distributed systems principles: consistency, fault tolerance, observability, and performance at scale.
  • Demonstrated experience setting technical direction across multiple teams and driving cross-functional alignment.
  • Excellent written and verbal communication skills: able to clearly articulate complex architectural decisions to engineering and non-technical audiences.
  • Track record of mentoring more junior engineers and elevating team-wide engineering quality.

Skills

Required:Technical architecture leadershipBackend developmentDistributed systemsKubernetes

Benefits

  • Health insurance premium coverage: 95% for employee, 77% for dependents
  • Health Savings Account (HSA) with employer contribution
  • Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance
  • Flexible Spending Accounts (FSA) for Health Care, Limited Purpose, and Dependent Care
  • Headspace well-being benefit, Gympass+ membership, One Medical membership
  • Employee Assistance Program and counseling services
Last updated Sep 20, 2026. Interested? Apply on the company site.

About SambaNova

The Fastest AI Inference Platform

Discover SambaNova - the complete AI platform delivering the fastest AI inference, fine-tuning, and scalable solutions for agentic AI easily integrated into existing data center infrastructures.

DataflowOpenAI gpt-oss-120bRDUSambaCloudSambaManagedSambaRackSambaStackSovereign AI
Company profileWebsite

More open roles at SambaNova