AI Infrastructure Systems Engineer (Amsterdam & London)
Together AI· Engineering
Hybrid (Amsterdam / UK)Full-timePosted 11mo ago
About the role
Role focused on building and operating a large GPU fleet for frontier model training and inference, with emphasis on automation, scalability, and reducing manual work. Hybrid in Amsterdam or remote in the UK.
Responsibilities
- Design and build fleet automation systems that provision, validate, deploy, upgrade, repair, and retire GPU clusters with minimal human intervention.
- Build AI Infrastructure Agents that automate deployment, root-cause failures, incident triage, and autonomous remediation.
- Develop Fleet Intelligence platforms that continuously monitor hardware health, firmware, networking, storage, thermals, and workload performance to predict failures before they impact customers.
- Build software that maximizes GPU availability, utilization, performance, and reliability across thousands of accelerators.
- Create automated validation systems for GPUs, InfiniBand/RoCE fabrics, NVLink/NVSwitch, storage, and distributed AI workloads.
- Build internal platforms and developer tools that allow infrastructure to be managed through software—not manual operations.
- Continuously improve deployment velocity, reliability, and operational efficiency through automation.
- Partner closely with hardware, networking, platform, and AI teams to push the limits of AI infrastructure.
Qualifications
- 3+ years building distributed systems, infrastructure platforms, or large-scale backend software.
- Strong software engineering skills in Python, Go, or Rust.
- Experience building platforms, automation systems, or developer infrastructure.
- Experience with Linux, Kubernetes, Terraform, Ansible, or similar infrastructure technologies.
- Strong systems thinking with the ability to understand problems across hardware and software.
- A passion for solving complex infrastructure challenges through software.
- Automation-first mindset—if a task is repeated, build a system to eliminate it.
Skills
Required:Distributed systemsPythonGo or RustLinuxKubernetesTerraformAnsibleAutomationSystems thinking
Last updated Sep 9, 2026. Interested? Apply on the company site.
About Together AI
The AI Acceleration Cloud - Fast Inference, Fine-Tuning & Training
Run and fine-tune generative AI models with simple APIs and scalable GPU clusters. Train & deploy at scale on The AI Acceleration Cloud.
AI native cloudFine-TuningGPU clustersInferenceTrainingai-infrastructure-and-developmentbrex-fastest-growing-2025liquid-ai-recruiting-target
More open roles at Together AI
- Research Intern, Frontier Speculative Decoding (Summer 2027)4d agoHybrid (San Francisco, CA) · Research
- Research Intern, Frontier Speculative Decoding (Winter 2027)4d agoHybrid (San Francisco) · Research
- Director of Investor Relations4d agoHybrid (San Francisco, CA) · Finance
- Recruiting Sourcer, Business (GTM, Infrastructure Strategy & G&A)4d agoHybrid (San Francisco) · People
- Staff Software Engineer - AI Compute, Together Cloud4d agoAmsterdam · Engineering