← All roles

Senior Deep Learning Engineer, Accuracy Evaluation

NVIDIA· Engineer, Sys SW
Apply on company site
Hybrid (Poland), Hybrid (Netherlands), Hybrid (France)PLN 375k - PLN 650kfull-timePosted 2mo ago

About the role

Senior engineer to design, develop, and operate evaluation methodologies and infrastructure for NVIDIA frontier models, delivering auditable accuracy signals to gate model releases and inform decision making across research, product, and customer teams.

Responsibilities

  • Design and build decision-grade evaluation environments for frontier models (reasoning, multimodal, long-context, agentic systems) producing auditable accuracy signals for model releases.
  • Research and develop novel evaluation methodologies for emerging model families and capability domains where benchmarks do not yet exist or generalize.
  • Build and operate evaluation infrastructure and pipelines including benchmark environments, regression CI systems, and statistical analysis tooling for model, product, and applied research teams across NVIDIA.
  • Partner with model research, training, and customer teams to translate evaluation signals into concrete decisions (release go/no-go, training direction, competitive positioning).

Qualifications

  • BS, MS, or PhD in Computer Science, Machine Learning, Statistics, or related field
  • 6+ years of hands-on experience with LLMs, designing and running evaluations for large language models or multimodal AI systems (including agentic, multi-turn, or reasoning-heavy settings)
  • Strong statistical foundations: experimental design, significance testing, regression analysis, and ability to distinguish signal from noise in benchmark results at scale
  • Proven experience building evaluation infrastructure (pipelines, benchmark harnesses, reproducible CI systems)
  • Clear, precise communicator able to translate quantitative evaluation results into decisions for researchers, product teams, and senior leadership

Skills

Required:Evaluation design and methodologyStatistical analysisEvaluation infrastructureCommunication of results
Last updated Oct 23, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA