← All roles

Staff Software Engineer (Agentic Search) - Runtime

Nebius· Agentic Search
Apply on company site
Hybrid (London)Full-timePosted 5d ago

About the role

Staff Software Engineer focused on the runtime systems of a novel agentic search engine, delivering low-latency, high-throughput request handling and integration with indexing/ML components.

Responsibilities

  • Design, implement, and operate core runtime services for serving search queries at scale
  • Build and optimise request flows, including query processing, retrieval orchestration, and response assembly under strict latency budgets
  • Develop systems that maintain performance and predictability under high load
  • Optimise CPU, memory, and data access patterns in performance-critical paths
  • Ensure reliability, observability, and predictability across production services
  • Build well-tested systems with clear responsibilities and interaction contracts, while remaining flexible as architecture evolves
  • Define and implement observability primitives, including structured logs, metrics, traces, and latency breakdowns
  • Monitor throughput, latency, and resource usage, and drive improvements in performance and cost efficiency
  • Collaborate with indexing and ML teams to integrate retrieval and ranking components, keeping ML logic decoupled from core system internals
  • Support experimentation and iteration through controlled rollouts and rigorous benchmarking

Qualifications

  • 8+ years of experience as a software engineer working on production backend systems
  • Strong hands-on expertise in C++ or Rust in real-world, high-load services
  • Built and operated high-load, low-latency user-facing systems handling thousands of RPS under strict latency constraints
  • Understand performance at a systems level — CPU, memory, networking, and data access
  • Operated your own code in production: deployed it, debugged incidents, and rolled back changes when necessary
  • Think end-to-end about request flows rather than staying within isolated components
  • Can balance correctness, latency, and development velocity, making pragmatic tradeoffs when scope or time requires
  • Collaborate effectively across engineering, ML, and product teams, communicating clearly in cross-functional settings

Skills

Required:C++RustLow-latency systems

Benefits

  • Competitive compensation
  • Career growth and learning opportunities
  • Flexibility and ownership
  • Collaborative and innovative culture
  • Opportunity to work on impactful AI projects
  • International environment and talented teams
Last updated Oct 21, 2026. Interested? Apply on the company site.
Nebius logo

About Nebius

The ultimate cloud for AI explorers

Discover the most efficient way to build, tune and run your AI models and applications on top-notch NVIDIA® GPUs.

AI CloudToken FactoryGPUKubernetesSlurmManaged servicesTerraformAPI
Company profileWebsite

More open roles at Nebius