← All roles

Principal Cloud Platform Engineer

SambaNova· Software
Apply on company site
Hybrid (Austin, TX and San Jose, CA)$210k - $280kfull-timePosted 2mo ago

About the role

Principal Cloud Platform Engineer specializing in the AI Inference Service to ensure reliability, performance, and scalability of 24/7 inference endpoints across regions, bridging software development and operations with a focus on uptime, latency, and resource utilization.

Responsibilities

  • Shared ownership of the production inferencing service across regions, covering availability, latency, performance, change management, and capacity planning
  • Standing-up and automating AI infrastructure in new regions
  • Participating in a shared primary/secondary on-call rotation, and leading incident response
  • Building monitoring, alerting, and dashboards in Prometheus, Grafana, and Datadog for service health, model latency and throughput, and accelerator utilization
  • Finding and eliminating performance bottlenecks
  • Designing auto-scaling policies that handle variable inference loads
  • Managing cloud and on-prem infrastructure as code in Terraform and Ansible
  • Building CI/CD pipelines that safely deploy new model versions and service updates
  • Forecasting infrastructure needs against the product roadmap and usage trends, and working with finance to manage cloud spend
  • Defining and reporting on SLOs and SLIs for the inferencing platform, using that data to prioritize reliability work

Qualifications

  • B.S. in Computer Science, Computer Engineering, or related field
  • 5+ years of experience in a Site Reliability Engineering, DevOps
  • Experience supporting a large-scale, customer-facing service in a public cloud environment (AWS, GCP, Azure)
  • Strong programming and scripting skills in languages like Python, Go, Rust, or Java
  • Proven experience with containerization and orchestration technologies (Docker and Kubernetes)
  • Deep understanding of monitoring and observability principles and tools (e.g., Prometheus, Grafana, ELK Stack, Datadog)
  • Experience with Infrastructure as Code (e.g., Terraform, CloudFormation)
  • Experience with CI/CD principles and tools (e.g., Jenkins, GitHub Actions, ArgoCD)
  • Strong Linux/Unix system administration fundamentals

Skills

Required:Cloud platform engineeringPythonDockerKubernetesPrometheusGrafanaDatadogTerraformAnsibleCI/CDLinux/Unix
Nice to have:GoRustJava

Benefits

  • Base salary range: $210,000—$280,000 USD per year
  • Equity
  • Health insurance with premium coverage details (employee 95%, dependents 77%), HSA with employer contribution
  • Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, AD&D insurance
  • Flexible Spending Accounts (FSA) options
  • Well-being benefits (Headspace, Gympass+, One Medical, EAP, etc.)
Last updated Sep 13, 2026. Interested? Apply on the company site.

About SambaNova

The Fastest AI Inference Platform

Discover SambaNova - the complete AI platform delivering the fastest AI inference, fine-tuning, and scalable solutions for agentic AI easily integrated into existing data center infrastructures.

DataflowOpenAI gpt-oss-120bRDUSambaCloudSambaManagedSambaRackSambaStackSovereign AI
Company profileWebsite

More open roles at SambaNova