← All roles

Senior Software Engineer, AIOps

NVIDIA· Engineer, Sys SW
Apply on company site
Raanana, Israel, Tel Aviv, IsraelFull-timePosted 4mo ago

About the role

Senior Software Engineer to join the AIOps platform team to build core distributed systems that ingest massive telemetry streams from GPU clusters and operationalize predictive AI models at scale on SaaS and on-prem deployments.

Responsibilities

  • Architect and build an agentic AIOps system that autonomously monitors GPU fleet health, aggregates and correlates massive telemetry streams, surfaces intelligent alerts, and orchestrates multi-step diagnostic workflows and corrective actions - powering real-time dashboards, automated root-cause analysis, and proactive incident response.
  • Research, evaluate, and prototype data storage strategies and data representations across diverse database technologies and modalities, ensuring AI models are trained on high-quality, well-structured data that improves predictive accuracy and generalization.
  • High-Scale Engineering: Design distributed systems to handle the extreme telemetry density of large-scale AI clusters, ensuring efficient data ingestion, processing, and real-time analysis.
  • Instrument services with deep observability (metrics, logs, traces) to support rapid debugging and continuous performance improvement.
  • Build and own the model-serving infrastructure that operationalizes predictive algorithms at scale - packaging, versioning, deploying, and monitoring AI models in both SaaS and on-premises environments.
  • Contribute to the platform's core libraries and abstractions that accelerate development across the broader AIOps engineering team.

Qualifications

  • B.Sc./M.Sc. in Computer Science, Computer Engineering, or a related technical field.
  • 8+ years of software engineering experience building production distributed systems.
  • Core Systems Programming: Expert-level proficiency in languages such as Go, C++, or Rust, with a focus on high-performance, concurrent architectures.
  • Solid understanding of Kubernetes and container-based deployments for production services.
  • Experience deploying, monitoring, and maintaining ML models or data-intensive services in a production environment.
  • Comfort working in ambiguous, fast-moving environments where the product is still being shaped.

Skills

Required:GoKubernetes
Nice to have:C++Rust
Last updated Jul 3, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA