← All roles

Member of Technical Staff, ML Platform

Runway· Engineering
Apply on company site
Remote$240k - $290kFull-timePosted 4w ago

About the role

ML infrastructure engineer focused on owning model evaluation end-to-end, building a scalable evaluation platform to measure and ship frontier models, embedded with research teams as part of the ML Platform.

Responsibilities

  • Own the evaluation platform end to end: the tooling and systems required to generate, annotate, review and adapt at frontier scale
  • Define the CLIs, APIs, GUIs and storage layers required to make this process seamless, fast, sophisticated and collaborative
  • Work directly with research teams on video, image, audio, agents, and robotics to understand what they need to measure and build it, then generalize the result into the platform
  • Help set the standards for how we evaluate models at Runway: reproducibility, metric definitions, reporting formats, and when a result is trustworthy enough to act on
  • Support broad adoption of the platform and its integration throughout Runway’s research efforts across training, production model serving and more
  • Contribute broadly as a member of the ML Platform team to tools and systems that help Runway train and serve frontier models

Qualifications

  • 5+ years of experience building ML infrastructure or data platforms in production environments, with at least some of that time spent on evaluation, experimentation, or benchmarking systems
  • Strong Python and PyTorch, and hands-on experience running large batch GPU workloads on Kubernetes
  • Experience designing data pipelines and storage for large volumes of media or model outputs, with attention to versioning and reproducibility
  • Familiarity with experimental statistics: paired comparisons, confidence intervals, multiple-comparison pitfalls, inter-rater agreement
  • Comfort building internal tools end to end, from the command line to the browser
  • Ability to lead a broad technical area: gather requirements from many teams, set direction, make tradeoffs, and drive a roadmap without waiting to be told
  • Familiarity with the full model development lifecycle: data, training, evaluation, serving
  • Self-starter who can work embedded with research teams and move fast
  • Strong systems thinking and pragmatic approach to production reliability
  • Humility and open mindedness; at Runway we love to learn from one another

Skills

Required:ML infrastructure engineeringPythonPyTorchKubernetesData pipelinesEnd-to-end internal toolingCross-team leadershipModel development lifecycleSystems thinkingCollaborative mindset
Nice to have:Experimental statistics

Benefits

  • Salary range: $240K – $290K
Last updated Oct 25, 2026. Interested? Apply on the company site.
Runway logo

About Runway

Make anything.

Generate images and video with AI. Text to video, image to video, plus more. Runway's AI image and video generation tools trusted by millions worldwide

AI Image and Video GeneratorAI toolsText to videobrex-fastest-growing-2025image to videoliquid-ai-recruiting-target
Company profileWebsite

More open roles at Runway