Infrastructure Platform Reliability Engineer
Sakana AI· PD Team / Infrastructure
Full-timePosted 3mo ago
About the role
Role focused on reliability of Sakana AI products and production inference platform, covering cloud infrastructure, GPU resources, LLM serving, SLA management, monitoring, incident response, cost optimization, and enterprise non-functional requirements.
Responsibilities
- Own reliability and SLA management across Sakana AI products, including Sakana Chat, Marlin, Fugu, and Namazu.
- Own production inference infrastructure for our LLM products, improving reliability, latency, throughput, GPU utilization, and cost efficiency.
- Operate LLM serving systems and support safe deployment and rollback workflows.
- Build monitoring, alerting, incident response, postmortems, and prevention practices, and participate in the on-call rotation.
- Translate enterprise security, availability, compliance, and SLA needs into infrastructure design.
- Support capacity planning and cost management, and provide technical requirements and capacity forecasts to the business team responsible for GPU and cloud procurement.
- Collaborate within a global team that works in both Japanese and English.
Qualifications
- Experience designing and operating production infrastructure in a cloud environment such as AWS or GCP.
- Experience operating containerized services, APIs, batch jobs, or model inference workloads in production.
- Experience managing and automating infrastructure with IaC or comparable tooling.
- Hands-on experience with monitoring, alerting, incident response, and postmortems.
- Ability to reason about GPU, cloud, and serving resource usage from cost, performance, and availability perspectives.
- Experience with LLM serving frameworks such as vLLM, TensorRT-LLM, or SGLang.
- English communication skills sufficient to drive technical projects with internal and external stakeholders, including discussions around requirements, cost, capacity, and priorities.
- Japanese language ability (if you are a native speaker or have JLPT N1/N2, please mention this in your application).
Skills
Required:Cloud infrastructure design and operationContainerized services and model inference workloadsInfrastructure as Code (IaC)Monitoring and incident responseGPU/resource cost optimizationLLM serving frameworksEnglish communication
Last updated Oct 25, 2026. Interested? Apply on the company site.
About Sakana AI
Building Frontier AI in Japan
We are creating a new kind of foundation model based on nature-inspired intelligence.
AI research labTokyofoundation modelfrontier AIliquid-ai-recruiting-targetnature-inspired intelligence
More open roles at Sakana AI
- Associate to the ChairmantodayHybrid (Japan / International) · 社長室 / Chairman's Office
- 知財担当（Intellectual Property Specialist）todayTokyo, Japan · Corporate
- Corporate & HR Operations AssociatetodayTokyo · Corporate / HR Operations
- Product Strategy & Operations LeadtodayHybrid (Japan/Global) · Product
- Developer Marketing Manager1w agoHybrid (Global) · Marketing