← All roles

Senior Systems Engineer, Workers AI

Cloudflare· Emerging Technology and Incubation
Apply on company site
Hybrid (Austin, TX & London, UK)full-timePosted 6mo ago

About the role

Senior Systems Engineer role focused on designing and building the core infrastructure for Cloudflare's AI inference platform across a global, heterogeneous GPU fleet, solving distributed systems and high-performance computing challenges at the edge.

Responsibilities

  • Platform Architecture: Develop and maintain core components of the serverless inference platform to ensure high availability and scalability for Cloudflare users.
  • Optimization & Performance: Optimize the model scheduling system to significantly increase efficiency and resource utilization across our inference infrastructure, and implement improvements to request routing logic to reduce latency for end-users.
  • System Reliability: Drive significant, measurable improvements in the platform's reliability and resilience by identifying and mitigating systemic risks.
  • Observability: Expand and refine the observability stack (metrics, logging, tracing) and fine-tune alerts to proactively identify and resolve production issues.
  • Technical Leadership: Lead complex, cross-functional technical projects from initial concept and design through final deployment and operationalization.
  • Mentorship: Act as a mentor to junior engineers and actively contribute to cultivating a strong, collaborative engineering culture within the team.

Qualifications

  • Proven experience in systems engineering, with a primary focus on distributed, high-performance systems.
  • Expert proficiency in Rust programming, particularly in an asynchronous environment.
  • Deep understanding and hands-on experience with relevant networking and application protocols (e.g., TCP, HTTP, WebSocket).
  • Solid experience with scaling and performance optimization techniques, including load balancing and caching in a distributed environment.

Skills

Required:Rust (asynchronous)Distributed systemsNetworking protocols (TCP, HTTP, WebSocket)

Benefits

  • —
Last updated Sep 2, 2026. Interested? Apply on the company site.

About Cloudflare

Connect, protect, and build everywhere | Cloudflare

Make employees, applications and networks faster and more secure everywhere, while reducing complexity and cost.

NetworkingSecurityPerformanceDeveloper PlatformAI
Company profileWebsite

More open roles at Cloudflare