← All roles

Staff Software Engineer (Agentic Search) - Runtime

Nebius· Agentic Search
Apply on company site
Zurichfull-timePosted 5d ago

About the role

Staff Software Engineer focusing on runtime systems for a novel agentic search platform, delivering low-latency, high-throughput query processing and real-time data retrieval at scale.

Responsibilities

  • Design, implement, and operate core runtime services for serving search queries at scale
  • Build and optimise request flows, including query processing, retrieval orchestration, and response assembly under strict latency budgets
  • Develop systems that maintain performance and predictability under high load
  • Optimise CPU, memory, and data access patterns in performance-critical paths
  • Ensure reliability, observability, and predictability across production services
  • Build well-tested systems with clear responsibilities and interaction contracts, while remaining flexible as architecture evolves
  • Define and implement observability primitives, including structured logs, metrics, traces, and latency breakdowns
  • Monitor throughput, latency, and resource usage, and drive improvements in performance and cost efficiency
  • Collaborate with indexing and ML teams to integrate retrieval and ranking components, keeping ML logic decoupled from core system internals
  • Support experimentation and iteration through controlled rollouts and rigorous benchmarking

Qualifications

  • 8+ years of experience as a software engineer working on production backend systems
  • Strong hands-on expertise in C++ or Rust in real-world, high-load services
  • Experience building and operating high-load, low-latency user-facing systems handling thousands of RPS under strict latency constraints
  • Understanding of performance at a systems level — CPU, memory, networking, and data access
  • Experience deploying, debugging incidents, and rolling back changes in production
  • Ability to think end-to-end about request flows and make pragmatic tradeoffs between correctness, latency, and velocity
  • Strong collaboration and clear communication across engineering, ML, and product teams
  • Ability to balance development velocity with reliability and observability

Skills

Required:C++ or RustLow-latency systemsPerformance optimizationObservabilityCollaboration across teams

Benefits

  • Competitive compensation
  • Career growth and learning opportunities
  • Flexibility and ownership
  • Collaborative and innovative culture
  • Opportunity to work on impactful AI projects
  • International environment and talented teams
Last updated Oct 21, 2026. Interested? Apply on the company site.
Nebius logo

About Nebius

The ultimate cloud for AI explorers

Discover the most efficient way to build, tune and run your AI models and applications on top-notch NVIDIA® GPUs.

AI CloudToken FactoryGPUKubernetesSlurmManaged servicesTerraformAPI
Company profileWebsite

More open roles at Nebius