← All roles

Senior Staff Software Engineer - AI Agent Platform

NVIDIA· Engineer, SW
Apply on company site
Santa Clara, CA$200k - $322kfull-timePosted 4d ago

About the role

Senior engineer to design, build, and scale infrastructure powering NVIDIA’s AI agent ecosystem, focusing on distributed systems, developer platforms, and agentic AI to enable production-grade autonomous agents across teams.

Responsibilities

  • Build and develop platform services that manage the full agent lifecycle from registration through deployment, execution, and teardown
  • Architect multi-tenant Kubernetes execution environments with pod lifecycle management, per-tenant namespace isolation, persistent storage, admission policy enforcement, and identity propagation
  • Develop and maintain automated CI/CD pipelines using GitLab CI and ArgoCD, including reusable pipeline templates and deployment blueprints that standardize how agents are built across teams
  • Build framework-agnostic infrastructure supporting multiple agent SDKs and harnesses — lifecycle hooks, skills configuration, memory services, and OTEL instrumentation — so teams can onboard new agent frameworks without platform changes
  • Build and operate Kafka-based message pipelines and real-time event streaming using Redis PubSub and SSE
  • Develop data ingestion pipelines, access interfaces, and storage layers that power AI agent knowledge and context
  • Implement session management for state persistence, conversation history, and agent recovery across sessions
  • Develop multi-layer auth using OAuth 2.0, JWT validation, token exchange, and gateway integration, and manage secrets lifecycle with Vault
  • Partner with security teams on compliance, access controls, and approval workflows for agent operations

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field (or equivalent experience), with 12+ years in software engineering — ideally in platform engineering, infrastructure, or developer tools
  • Experience building and scaling AI agents in production using frameworks like Claude Code, Codex, or LangGraph
  • Deep Kubernetes expertise including pod orchestration, persistent storage, RBAC, and multi-cluster management
  • Strong Python skills with production API experience using FastAPI, Flask, or similar async frameworks
  • Proven track record designing distributed systems with Kafka, Redis, and MongoDB or PostgreSQL
  • Expertise building and managing robust CI/CD pipelines using GitLab CI and ArgoCD for continuous delivery to Kubernetes
  • Experience designing AI data platform components (ingestion pipelines, vector stores, retrieval APIs, data preprocessing workflows) and building developer-facing platform APIs consumed by multiple engineering teams
  • Solid grasp of auth and identity: OAuth 2.0, JWT, token exchange, and secrets management with Vault
  • History of leading sophisticated technical projects such as migrations or greenfield platform builds, with strong interpersonal skills to drive alignment across teams and write clear design documents

Skills

Required:KubernetesPythonDistributed SystemsCI/CDAuth & Identity

Benefits

  • equity
  • benefits (see company benefits page)
Last updated Oct 23, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA