Staff Software Engineer (Agentic Search) - Runtime
AmsterdamFull-timePosted 5d ago
About the role
Staff Software Engineer focusing on the runtime systems of a novel agent-native search platform, delivering low-latency, high-throughput query handling at scale with observable, well-structured systems and close collaboration with indexing and ML teams.
Responsibilities
- Design, implement, and operate core runtime services for serving search queries at scale
- Build and optimise request flows, including query processing, retrieval orchestration, and response assembly under strict latency budgets
- Develop systems that maintain performance and predictability under high load
- Optimise CPU, memory, and data access patterns in performance-critical paths
- Ensure reliability, observability, and predictability across production services
- Build well-tested systems with clear responsibilities and interaction contracts, while remaining flexible as architecture evolves
- Define and implement observability primitives, including structured logs, metrics, traces, and latency breakdowns
- Monitor throughput, latency, and resource usage, and drive improvements in performance and cost efficiency
- Collaborate with indexing and ML teams to integrate retrieval and ranking components, keeping ML logic decoupled from core system internals
- Support experimentation and iteration through controlled rollouts and rigorous benchmarking
Qualifications
- 8+ years of experience as a software engineer working on production backend systems
- Strong hands-on expertise in C++ or Rust in real-world, high-load services
- Built and operated high-load, low-latency user-facing systems handling thousands of RPS under strict latency constraints
- Understanding of performance at a systems level — CPU, memory, networking, and data access
- Experience operating code in production: deployed it, debugged incidents, and rolled back changes when necessary
- Ability to think end-to-end about request flows
- Ability to balance correctness, latency, and development velocity with pragmatic tradeoffs
- Collaborate effectively across engineering, ML, and product teams and communicate clearly in cross-functional settings
Skills
Required:C++ or RustSystems performanceBack-end design for low-latency servicesObservability
Benefits
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
Last updated Oct 21, 2026. Interested? Apply on the company site.
About Nebius
The ultimate cloud for AI explorers
Discover the most efficient way to build, tune and run your AI models and applications on top-notch NVIDIA® GPUs.
AI CloudToken FactoryGPUKubernetesSlurmManaged servicesTerraformAPI
More open roles at Nebius
- Staff Machine Learning Engineer, LLM Inference Optimization5d agoHybrid (Remote/Hybrid across listed locations) · ML
- Staff Site Reliability engineer - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Engineering manager - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Staff Software engineer - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Transportation Logistics Specialist5d agoHybrid (Europe) · Infrastructure