← All roles

Director of Engineering - Inference Platform

SambaNova· Software
Apply on company site
San Jose, CA$245k - $325kFull-timePosted 3mo ago

About the role

Engineering Director role leading a software team responsible for the SambaStack inference serving platform on RDU hardware, with hands-on technical contribution and ownership of team growth, technical quality, and roadmap.

Responsibilities

  • Lead, grow, and inspire a software team, fostering a culture of technical excellence, collaboration, and continuous improvement
  • Own hiring for your team: define roles, assess candidates, and build a diverse, high-performing engineering organization
  • Drive the career development of your engineers through regular 1:1s, meaningful feedback, and clear growth plans
  • Set clear goals and expectations, track team progress, and remove blockers to keep the team executing effectively
  • Partner with Product, ML, QA, and DevOps leadership to align team priorities with broader organizational objectives
  • Contribute directly as a software engineer: designing systems, writing code, and leading implementation on critical platform initiatives
  • Participate in and lead design reviews, providing authoritative technical guidance on major features and cross-cutting changes
  • Establish and uphold engineering standards, best practices, and coding quality across the team
  • Proactively identify and drive the resolution of systemic risks: performance bottlenecks, reliability gaps, and scaling constraints
  • Stay current on emerging technologies and AI inference trends to inform the team's technical direction

Qualifications

  • 12+ years of software engineering experience, including 2+ years leading and managing engineering teams
  • Demonstrated ability to manage, develop, and hire strong engineers while remaining a hands-on technical contributor
  • Strong technical depth in backend systems built with Python, Go, or Rust
  • Experience with AI inference serving, orchestration, and the infrastructure challenges of LLM workloads at production scale
  • Proven ability to drive engineering excellence across an engineering team
  • Excellent communication skills: able to work effectively with engineers, cross-functional partners, and senior leadership
  • Experience running iterative engineering processes in a fast-paced environment

Skills

Required:Software architecture and systems designBackend developmentAI inference platform experiencePeople management

Benefits

  • Base Salary Range: $245,000—$325,000 USD per year
  • Equity and benefits package
  • Health insurance premium coverage (employee 95%, dependents 77%) with HSA employer contributions
  • Dental, Vision, Disability, Life, Voluntary Life, AD&D insurance
  • Flexible Spending Account options (Health Care, Limited Purpose, Dependent Care)
  • Headspace, Gympass+, One Medical membership, counseling and EAP services
Last updated Oct 18, 2026. Interested? Apply on the company site.

About SambaNova

The Fastest AI Inference Platform

Discover SambaNova - the complete AI platform delivering the fastest AI inference, fine-tuning, and scalable solutions for agentic AI easily integrated into existing data center infrastructures.

DataflowOpenAI gpt-oss-120bRDUSambaCloudSambaManagedSambaRackSambaStackSovereign AI
Company profileWebsite

More open roles at SambaNova