← All roles

Senior Solutions Architect, AI Factory Observability and Visualization - NVIS

NVIDIA· Architect, Solutions
Apply on company site
Hybrid (Remote / Local)$184k - $287.5k + equityfull-timePosted 4mo ago

About the role

Senior Solutions Architect specializing in AI factory observability and visualization. Responsible for end-to-end visibility, telemetry, and automation to validate and optimize HPC and AI factory systems, collaborating across NVIDIA teams to prepare deployments and provide actionable insights.

Responsibilities

  • Run AI factory validation tools, microbenchmarks, and workloads provided by the team, and interpret results to assess system health and performance.
  • Gain a comprehensive understanding of the system from start to finish, including network topology, interconnects, and compute.
  • Establish what 'healthy' represents across the stack — the metrics, logs, and signals that confirm a system is functioning well, and the thresholds that show it isn't.
  • Build and extend the telemetry surface across hardware, fabric, and workload, crafting how data is collected, transformed, stored, and surfaced.
  • Serve as the observability expert, investigating gaps in visibility to ensure it reflects true system behavior.
  • Develop automation (Python, Shell) for collecting, transforming, and presenting system and network data.
  • Recommend improvements to system visibility, data sources, and reporting that give teams clearer insight.
  • Collaborate with hardware, software, networking, datacenter, and product groups to ready HPC systems and AI factories for customer deployment, contributing documentation and readiness materials throughout the process.

Qualifications

  • Bachelor's degree or equivalent experience in Computer Science, Mathematics, Engineering, Physics, or related field.
  • 6+ years of experience managing Linux-based systems in HPC, distributed systems, or large AI/ML settings.
  • Hands-on experience with the architecture of multi-GPU and/or multi-node clusters, including networking and interconnects.
  • Solid grasp of how HPC and AI factory systems fit together end to end, from network fabric through compute.
  • Proficiency with Python and Shell/Bash for scripting, automation, and tooling.
  • Practical experience working with observability systems (e.g., Prometheus, Grafana, Loki, or similar), including building custom exporters or collectors, setting up alerts, and handling metric cardinality and retention on a large scale.
  • Experience transforming metrics, logs, and traces into clear, actionable insight for complex distributed environments.
  • Familiarity with GPU and fabric telemetry (e.g., DCGM, NVLink, InfiniBand/Ethernet fabric counters) and using it to diagnose performance regressions.
  • Strong communication skills and the ability to work effectively with cross-functional teams.

Skills

Required:PythonShell/BashObservability systemsGPU/Interconnect telemetryDistributed systemsCommunication
Last updated Sep 25, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA