← All roles

Staff Software Engineer, AI Gateway

Docker· Engineering
Apply on company site
Remote$170.4k - $275.6kFull-timePosted 4d ago

About the role

Staff Software Engineer leading the AI Gateway technical direction and architecture, focusing on core systems such as model routing, MCP gateway, and control plane, with a hands-on role in delivering strategy, scalable infrastructure, and developer experience for enterprise-grade AI agent tooling.

Responsibilities

  • Set technical direction for core systems powering the AI Gateway (model router, MCP gateway, and control plane) and ensure architectural decisions hold up as usage scales by 10x
  • Identify gaps in infrastructure, process, or tooling and drive fixes from idea to production
  • Take a significant, hands-on role in defining, delivering, and implementing the Gateway's technical strategy in partnership with engineering leadership
  • Own hardest, highest-ambiguity problems: dynamic model selection, auto-failover, cost-based routing, and policy enforcement end-to-end
  • Serve as go-to expert for secure credential storage, session summarization, caching, and rate limiting
  • Build infrastructure to evaluate, replay, and backtest agent and LLM behavior with confidence
  • Mentor senior and mid-level engineers and raise technical bar through code/design reviews
  • Collaborate with product, design, and leadership to shape future directions of the control plane UI and product roadmap

Qualifications

  • 8+ years of backend engineering experience with production-grade systems at significant scale
  • Deep specialization in distributed systems, cloud-native infrastructure, and API design
  • Experience building secure, high-throughput services (gateways, proxies, load balancers, policy engines)
  • Fluency in Go and/or Rust
  • Track record of identifying systemic gaps and driving fixes across team boundaries
  • Strong product mindset with experience shaping technical direction
  • Comfortable operating with significant autonomy in solving problems
  • Bachelor's degree in Computer Science, Engineering, or related field, or equivalent practical experience

Skills

Required:Backend engineeringDistributed systemsGo or Rust programmingAPI designSecurity and credentials

Benefits

  • Remote-first culture
  • Flexible schedule
  • Generous PTO and quarterly Whaleness Days plus end-of-year break
  • Home office setup support
  • Technology stipend (US$100 net per month)
  • Annual learning & development stipend
  • 16 weeks paid parental leave after six months
  • Equity for all full-time employees
  • Comprehensive benefits (medical, retirement, holidays vary by country)
  • Docker swag
Last updated Oct 21, 2026. Interested? Apply on the company site.
Docker logo

About Docker

Accelerated Container Application Development

Docker is a platform designed to help developers build, share, and run container applications. We handle the tedious setup, so you can focus on the code.

ContainerizationDevOpsCloud InfrastructureSecurityOpen Source
Company profileWebsite

More open roles at Docker