← All roles

Senior System Software Engineer - Local AI Automation

NVIDIA· Engineer, Sys SW
Apply on company site
Pune, Indiafull-timePosted 1w ago

About the role

Senior System Software Engineer focused on building and maintaining robust system-level software and infrastructure for deploying, benchmarking, and qualifying AI applications and models within Local AI automation.

Responsibilities

  • Design, implement, and maintain robust system software and infrastructure to efficiently run various AI workloads through different inference backends such as Llama.cpp, Ollama, PyTorch, vLLM, WinML, TRT-RTX, and others
  • Scope out system requirements for deploying various AI applications, benchmarks, and models in automation, and develop solutions to measure correctness, functionality, reliability, and overall system performance
  • Develop infrastructure to download AI models from various sources, manage a local model repository, and create automated synchronization mechanisms to keep the repository up to date
  • Analyze large datasets and system workload metrics, implement data processing infrastructure to transform raw data into actionable information for developers, and design visualizations
  • Collaborate with internal Local AI developers to implement system-level instrumentation, diagnostics, and debugging capabilities
  • Design, implement, and maintain robust infrastructure for automated build, integration, deployment, and qualification across different inference frameworks and environments
  • Understand existing infrastructure and system software architecture, debug issues, identify performance bottlenecks, and devise solutions to enhance system efficiency and scalability

Qualifications

  • 5+ years of experience with a B.Tech or higher in Computer Science, IT, Software Engineering, or related field
  • Strong analytical, systems debugging, and problem-solving abilities with multitasking in dynamic environments
  • 5+ years of software development experience with strong programming skills in C/C++, C#, Java, or other systems programming language, plus exposure to Python
  • Experience with system APIs, multithreaded software, process and resource management, debugging, or performance analysis
  • Familiarity with databases and SQL, source control systems, and CI/CD infrastructure such as Git, Perforce, and Jenkins
  • Outstanding written and oral communication skills

Skills

Required:Programming in systems languagesSystem APIs and multithreaded softwareDebugging and performance analysis
Last updated Oct 16, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA