Member of Technical Staff (AI Infrastructure Engineer)
Perplexity· AI Research & Systems
Hybrid (London)Full-timePosted 6mo ago
About the role
AI Infrastructure Engineer role focusing on building, deploying, and optimizing large-scale AI training and inference clusters using Kubernetes, Slurm, Python, C++, PyTorch on AWS; collaborates with Inference and Research teams to support AI model workloads.
Responsibilities
- Design, deploy, and maintain scalable Kubernetes clusters for AI model inference and training workloads
- Manage and optimize Slurm-based HPC environments for distributed training of large language models
- Develop robust APIs and orchestration systems for both training pipelines and inference services
- Implement resource scheduling and job management systems across heterogeneous compute environments
- Benchmark system performance, diagnose bottlenecks, and implement improvements across both training and inference infrastructure
- Build monitoring, alerting, and observability solutions tailored to ML workloads running on Kubernetes and Slurm
- Respond swiftly to system outages and collaborate across teams to maintain high uptime for critical training runs and inference services
- Optimize cluster utilization and implement autoscaling strategies for dynamic workload demands
Qualifications
- Strong expertise in Kubernetes administration, including custom resource definitions, operators, and cluster management
- Hands-on experience with Slurm workload management, including job scheduling, resource allocation, and cluster optimization
- Experience with deploying and managing distributed training systems at scale
- Deep understanding of container orchestration and distributed systems architecture
- High level familiarity with LLM architecture and training processes (Multi-Head Attention, Multi/Grouped-Query, distributed training strategies)
- Experience managing GPU clusters and optimizing compute resource utilization
Skills
Required:Kubernetes administrationSlurmPythonC++PyTorchDistributed systemsGPU management
Nice to have:LLM training concepts
Last updated Jul 15, 2026. Interested? Apply on the company site.
About Perplexity
ai-plg-top-20brex-fastest-growing-2025liquid-ai-recruiting-targetsetter-30setter-30-2026-q1
More open roles at Perplexity
- Member of Technical Staff (Software Engineer, Enterprise Agent Evals & Efficiency)4d agoSan Francisco, Seattle +1 more · Platform & Infrastructure
- Global Treasury Manager, Investments & Risk4d agoHybrid (San Francisco) · Finance
- Member of Technical Staff (Software Engineer, Enterprise Trust & Governance)4d agoSan Francisco, London +3 more · Platform & Infrastructure
- Sr. Workplace Coordinator4d agoSan Francisco · Workplace
- Strategic Finance Lead - GTM1w agoHybrid (San Francisco), Hybrid (New York City) · Finance