← All roles

Senior AI Performance Engineer

SambaNova· Software
Apply on company site
San Jose, CA$180k - $255kfull-timePosted 3mo ago

About the role

Senior AI Performance Engineer to optimize and scale state-of-the-art foundation models on SambaNova's reconfigurable dataflow platform, collaborating across compiler, runtime, and hardware layers to deliver high-throughput, low-latency AI inference.

Responsibilities

  • Bring up and optimize cutting-edge foundation models (e.g., DeepSeek, Llama, Qwen, and others) on the SambaNova platform through the SambaNova software stack.
  • Profile and enhance model performance across compiler, runtime, and hardware layers to achieve SOTA throughput and latency.
  • Collaborate with machine learning, compiler, runtime, and hardware teams to deliver co-designed, high-performance AI applications.
  • Integrate the latest advances in model architecture, quantization, scheduling, and memory optimization from both academia and industry.
  • Develop robust, scalable, and efficient end-to-end inference solutions aligned with customer needs.
  • Identify performance bottlenecks and propose dataflow or scheduling optimizations for both single-node and distributed systems.

Qualifications

  • Bachelor's or higher degree in computer science, electrical engineering, or a related field (e.g., applied mathematics, physics, or statistics).
  • 3+ years of experience in one or more of the following areas:
  • - Deep learning model development and performance optimization
  • - Compiler, runtime, or kernel-level optimization
  • - Software–hardware co-design or systems performance tuning
  • Proficiency in Python or C++, with strong foundations in algorithms, data structures, and numerical computing.
  • Experience with at least one major ML framework — PyTorch, TensorFlow, or JAX.
  • Demonstrated ability to analyze and optimize performance in real-world ML pipelines.

Skills

Required:Foundation model deployment and optimizationCompiler, runtime, or kernel-level optimizationPythonC++ML frameworksPerformance analysis

Benefits

  • Base Salary Range: $180,000—$255,000 USD (base pay)
  • Equity and benefits package including health insurance premium coverage for employee and dependents, HSA employer contribution, Dental, Vision, Disability, Life, Voluntary Life, and other wellness benefits
  • Employee assistance programs and well-being benefits (Headspace, Gympass+, One Medical, counseling services, etc.)
Last updated Sep 13, 2026. Interested? Apply on the company site.

About SambaNova

The Fastest AI Inference Platform

Discover SambaNova - the complete AI platform delivering the fastest AI inference, fine-tuning, and scalable solutions for agentic AI easily integrated into existing data center infrastructures.

DataflowOpenAI gpt-oss-120bRDUSambaCloudSambaManagedSambaRackSambaStackSovereign AI
Company profileWebsite

More open roles at SambaNova