← All roles

Senior Software Engineer, Open Harness Engineering

NVIDIA· Engineer, Sys SW
Apply on company site
Hybrid (US-CA-Remote), Hybrid (US-DC-Remote), Hybrid (US-TX-Remote), Hybrid (US-CO-Remote), Hybrid (US-NY-Remote)$184k - $287.5k + equityFull-timePosted 1mo ago

About the role

Senior Software Engineer to help build core libraries, evaluation systems, and reusable harness capabilities for open-agent harnesses, sandboxed execution, model-provider infrastructure, and agent benchmarks. Focus on diagnosing failures, upstream contributions, and delivering improvements in quality, reliability, cost, and latency across models.

Responsibilities

  • Define and evolve the technical approach for evaluating and improving open agent harnesses across frameworks, models, and benchmark environments.
  • Build and operate scalable, reproducible evaluation systems spanning CI, scheduled compute, sandboxed execution, artifact provenance, trace capture, and analysis.
  • Diagnose agent failures from traces, logs, tool results, and benchmark artifacts, separating harness, evaluator, environment, inference, and model causes.
  • Design controlled experiments and promotion criteria that distinguish genuine harness improvements from noise, benchmark artifacts, or model-specific gains.
  • Ship focused harness and runtime improvements, including upstream open-source contributions, detectors, regression tests, and maintainable documentation.
  • Partner with Relay, Hermes, model, infrastructure, and research teams to turn recurring optimization needs into reusable runtime, trace, and evaluation capabilities.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Applied Math, or a related field, or equivalent experience.
  • 8+ years of hands-on software-engineering experience, with demonstrated technical ownership of production systems; and architecture design leadership.
  • Expert Python skills and working proficiency in Rust, Go, C++, or TypeScript, with the ability to debug systems across language and process boundaries.
  • Experience building or extending LLM agents, coding agents, tool-use loops, model-provider integrations, developer tools, or evaluation infrastructure.
  • Solid understanding of asynchronous execution, subprocesses, containers, sandboxing, callbacks, retries, networking, and distributed compute.
  • Experience crafting reproducible experiments, benchmark methodology, performance investigations, regression gates, or reliability analysis under nondeterministic conditions.
  • A record of shipping and maintaining open-source or developer-facing software with sound testing, API development, documentation, and code reviews.

Skills

Required:PythonRustDistributed systems
Nice to have:GoC++TypeScript

Benefits

  • equity
  • comprehensive benefits package (as referenced in job description)
Last updated Oct 23, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA