← All roles

Senior Principal Runtime Engineer

SambaNova· Software
Apply on company site
San Jose, CAPosted 3mo ago

About the role

Senior-level software engineer focused on building and optimizing a high-performance distributed runtime for SambaNova's SambaStack and Cloud platforms, supporting data-flow AI workloads, ML training/inference, and HPC applications.

Responsibilities

  • New and enhanced features to support high-performance, scalable ML inference and training applications
  • Drivers and kernels for next generation silicon
  • Eliminate networking bottlenecks to enable high performance distributed systems
  • User-space libraries for high performance and high utilization of HW resources
  • User-facing tools (analysis, job and HW management, profiling, debugging, etc) for Datascale systems
  • Cross-functional collaboration including Hardware, ML Application, Compiler, and DevOps

Qualifications

  • B.S. in Computer Science, Engineering, or related field
  • 5+ years of software engineering experience, often with emphasis on distributed systems, networking, or cloud infrastructure
  • Proven experience building, testing, and tuning software for distributed, high-performance systems. In-depth knowledge of user libraries, and runtime stacks
  • Solid understanding of Switching and Routing and ability to configure and debug switches and routers for maximum application performance
  • Significant experience with RDMA and RoCE networking stacks, such as RDMA based verbs and congestion management
  • Hands-on experience with kernel drivers and system-level software that directly interfaces with hardware
  • Expertise in designing and optimizing systems that handle massive parallel workloads, including machine learning training and inference tasks that involve billions of operations per second
  • Deep understanding of hardware-software interaction, including registers, device memory management, and the intricacies of accelerator design. Experience working with ASIC accelerators is highly desirable
  • Familiarity with distributed systems architecture, including networking, communication protocols, and the challenges of scaling compute resources efficiently
  • Hands-on experience with software development tools such as Git, Jenkins, and Jira, with an ability to drive automation and continuous integration efforts
  • Ability to work at the intersection of hardware and software, designing systems that optimize both performance and reliability

Skills

Required:Distributed systemsRDMA and RoCE networkingKernel driversHardware-software co-designSoftware development tools

Benefits

  • Competitive total rewards package, base salary plus equity and benefits
  • 95% premium coverage for employee medical insurance, 77% premium coverage for dependents
  • Health Savings Account (HSA) with employer contribution
  • Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans
  • Flexible Spending Accounts (FSA) options: Health Care, Limited Purpose, and Dependent Care
  • Well-being benefits including Headspace, Gympass+, One Medical membership, counseling services with EAP
Last updated Sep 20, 2026. Interested? Apply on the company site.

About SambaNova

The Fastest AI Inference Platform

Discover SambaNova - the complete AI platform delivering the fastest AI inference, fine-tuning, and scalable solutions for agentic AI easily integrated into existing data center infrastructures.

DataflowOpenAI gpt-oss-120bRDUSambaCloudSambaManagedSambaRackSambaStackSovereign AI
Company profileWebsite

More open roles at SambaNova