← All roles

Senior System Software Engineer - Local AI

NVIDIA· Engineer, Sys SW
Apply on company site
Pune, IndiaFull-timePosted 4d ago

About the role

Senior System Software Engineer to lead development of system-level software and infrastructure for deploying, benchmarking, and qualifying AI workloads across Linux and Windows on RTX and DGX-class GPUs. Collaborate with inference engineers, model developers, and AI application teams to build scalable, reproducible AI infrastructure and autonomous agents for infrastructure management and diagnostics.

Responsibilities

  • Partner across organizations to define requirements and maintain shared infrastructure for deploying, benchmarking, and qualifying AI workloads across inference backends (e.g., llama.cpp, Ollama, PyTorch, vLLM, WinML).
  • Build Git-based CI infrastructure for automated builds, integration testing, and regression detection across hardware platforms, operating systems, and runtime configurations.
  • Develop model management services to download, version, cache, and synchronize checkpoints and dependencies for reproducible execution.
  • Design databases, backend services, and data pipelines to store and query model metadata, benchmark results, telemetry, and execution artifacts.
  • Create dashboards and reports to compare inference configurations, identify regressions, and investigate bottlenecks.
  • Develop and operate server infrastructure including environment provisioning, workload scheduling, resource management, and failure recovery.
  • Develop autonomous AI agents for infrastructure management, workload orchestration, monitoring, and diagnostics with proper access controls and safeguards.
  • Maintain Git repositories and companion websites with code, documentation, model recommendations, and evaluation results.
  • Collaborate with inference developers to implement instrumentation, debugging capabilities, and improve infrastructure efficiency and scalability.

Qualifications

  • B.Tech or higher in Computer Science, Computer Engineering, Information Technology, Software Engineering, or related field, or equivalent experience.
  • 5+ years of software development experience with strong programming skills in Python, C/C++, C#, or other systems programming language.
  • Experience developing system software, backend services, or infrastructure supporting engineering development.
  • Understanding of system APIs, multithreading, process and resource management, and systems debugging.
  • Hands-on experience with Git-based CI, databases, SQL, and data modeling.
  • Strong analytical and problem-solving skills with ability to own projects and manage competing priorities.
  • Excellent written and verbal communication skills for cross-team collaboration.

Skills

Required:PythonC/C++Git-based CIDatabases/SQLMultithreading/Systems debugging
Nice to have:C#Telemetry/ObservabilityDocumentation/publication
Last updated Oct 23, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA