AI Performance Engineer - New Grad
SambaNova· Software
Hybrid (Austin, TX / San Jose, CA)$131.2k - $196.8kfull-timePosted today
About the role
New graduate AI Performance Engineer role focused on bringing up open source models on SambaNova's stack, profiling performance, identifying bottlenecks, and applying optimizations across compiler, runtime, and hardware layers to improve throughput and latency.
Responsibilities
- Bring up new foundation models on the SambaNova platform using our software stack
- Profile model performance across the compiler, runtime, and hardware layers
- Identify bottlenecks and propose dataflow or scheduling optimizations for single-node and distributed systems
- Apply techniques from recent research in quantization, scheduling, and memory optimization
- Benchmark throughput and latency and track performance changes across releases
- Work with the machine learning, compiler, runtime, and hardware teams to ship performance improvements into SambaNova products
Qualifications
- B.S. in Computer Science, Electrical Engineering, or related field
- Strong programming skills in Python or C++
- Understanding of algorithms, data structures, and numerical computing
- Experience with PyTorch, TensorFlow, or JAX
- Experience with inference frameworks such as vLLM, TensorRT, or SGLang
- GPU programming experience with CUDA or Triton
Skills
Required:PythonC++PyTorch/TensorFlow/JAXInference frameworks (vLLM, TensorRT, SGLang)CUDA/Triton
Benefits
- Base Salary Range: $131,200—$196,800 USD per year
- Health insurance premium coverage details (employee 95%, dependents 77%) and HSA employer contributions
- Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance
- Flexible Spending Account options (Health Care, Limited Purpose, Dependent Care)
- Headspace subscription, Gympass+ membership, One Medical, EAP counseling services
Last updated Oct 25, 2026. Interested? Apply on the company site.
About SambaNova
The Fastest AI Inference Platform
Discover SambaNova - the complete AI platform delivering the fastest AI inference, fine-tuning, and scalable solutions for agentic AI easily integrated into existing data center infrastructures.
DataflowOpenAI gpt-oss-120bRDUSambaCloudSambaManagedSambaRackSambaStackSovereign AI
More open roles at SambaNova
- Senior GTM Recruiter1w agoHybrid (Austin, TX; San Jose, CA) · People
- Principal Product Manager1w agoSan Jose, CA · Core Tech
- Senior Principal AI Solutions Engineer3w agoSan Jose, CA · Core Tech
- Data Center Operations Technician3w agoSanta Clara, CA · IT
- Digital Content Manager4w agoSan Jose, CA · Marketing