← All roles

Member of Technical Staff (AI Infrastructure Engineer)

Perplexity· AI Research & Systems
Apply on company site
San Francisco, Palo Alto$220k - $405kFull-timePosted 11mo ago

About the role

AI Infrastructure Engineer focusing on building, deploying, and optimizing large-scale AI training and inference clusters using Kubernetes, Slurm, Python, C++, PyTorch, primarily on AWS.

Responsibilities

  • Design, deploy, and maintain scalable Kubernetes clusters for AI model inference and training workloads
  • Manage and optimize Slurm-based HPC environments for distributed training of large language models
  • Develop robust APIs and orchestration systems for both training pipelines and inference services
  • Implement resource scheduling and job management systems across heterogeneous compute environments
  • Benchmark system performance, diagnose bottlenecks, and implement improvements across both training and inference infrastructure
  • Build monitoring, alerting, and observability solutions tailored to ML workloads running on Kubernetes and Slurm
  • Respond swiftly to system outages and collaborate across teams to maintain high uptime for critical training runs and inference services
  • Optimize cluster utilization and implement autoscaling strategies for dynamic workload demands

Qualifications

  • Strong expertise in Kubernetes administration, including custom resource definitions, operators, and cluster management
  • Hands-on experience with Slurm workload management, including job scheduling, resource allocation, and cluster optimization
  • Experience with deploying and managing distributed training systems at scale
  • Deep understanding of container orchestration and distributed systems architecture
  • High level familiarity with LLM architecture and training processes (Multi-Head Attention, Multi/Grouped-Query, distributed training strategies)
  • Experience managing GPU clusters and optimizing compute resource utilization

Skills

Required:Kubernetes administrationSlurmPythonC++Distributed trainingPyTorchNetworking / Storage / Compute management

Benefits

  • Full-time U.S. employee benefits including equity, health, dental, vision, retirement, fitness, commuter and dependent care accounts, and more
  • International benefits tailored to region of residence
Last updated Aug 12, 2026. Interested? Apply on the company site.

About Perplexity

ai-plg-top-20brex-fastest-growing-2025liquid-ai-recruiting-targetsetter-30setter-30-2026-q1
Company profileWebsite

More open roles at Perplexity