← All roles

Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud

Zyphra· R&D - Engineering
Apply on company site
San FranciscoFull-timePosted 4d ago

About the role

Machine Learning Systems Administrator / DevOps Engineer responsible for maintaining and building the core infrastructure for model training and inference cloud, spanning large-scale training clusters and production inference services across heterogeneous accelerators.

Responsibilities

  • Administration and automation of Linux-based training cluster environments
  • User onboarding/offboarding, access control, and security auditing
  • Monitoring system resources, job scheduling, and cluster health
  • Bring-up and validation of new hardware (compute, networking, storage)
  • Supporting and improving developer workflows (e.g., VSCode remote development, Docker)
  • Enabling and supporting large-scale training jobs
  • Deploying, operating, and scaling inference services across heterogeneous accelerators
  • Managing container orchestration, CI/CD, and rollout pipelines for model deployments
  • Building observability for production services, including metrics, logging, alerting, and dashboards
  • Owning service reliability: uptime, incident response, and postmortems
  • Capacity planning, autoscaling, and utilization/cost tracking across hardware types
  • Securing production systems through secrets management, network policy, and tenant isolation

Qualifications

  • Experience with Linux system administration, user and access management, and automation
  • Demonstrated expertise in scripting languages for system tooling and automation (bash, Python, etc.)
  • Experience with containers (Docker) and scheduling/orchestration systems (Slurm, Kubernetes)
  • Experience running production services, including monitoring and alerting (e.g., Prometheus, Grafana), deployment pipelines, and incident response
  • Experience building tooling for cluster validation and reliability (accelerator, networking, and storage health checks)
  • Experience setting up and managing developer tools and third-party services (e.g., cloud storage providers, Docker Hub, Slack, Gmail, Telegraf, experiment trackers)
  • Excellent debugging and troubleshooting skills across compute, storage, and networking
  • Strong communication skills and ability to collaborate across technical and non-technical teams

Skills

Required:Linux system administrationScriptingContainerizationMonitoring / Observability

Benefits

  • Comprehensive medical, dental, vision, and FSA plans
  • Competitive compensation and 401(k) plan
  • Relocation and immigration support on a case-by-case basis
  • In-office snacks and meals provided
  • Unlimited PTO and company holidays
  • In-person team in San Francisco with a collaborative, high-energy environment
Last updated Oct 22, 2026. Interested? Apply on the company site.

About Zyphra

Zyphra Technologies Inc.

Company profileWebsite

More open roles at Zyphra