← All roles

Staff Applied Scientist - Dashboards

Datadog· Engineering
Apply on company site
New York, NY$276k - $345kfull-timePosted 4mo ago

About the role

Staff Applied Scientist to define and guarantee the quality of the AI system behind Datadog's Dashboards scale, focusing on evaluation strategies, datasets, and measurable improvements across retrieval, tool selection, and context efficiency.

Responsibilities

  • Own the evaluation strategy for Dashboards and sister teams, defining offline/online metrics, quality and cost, single-turn and multi-turn metrics.
  • Build evaluation datasets, golden traces, and regression harnesses to catch quality changes before customers, reusable across teams building dashboards and widgets through agents.
  • Drive improvements to retrieval relevance, tool-selection accuracy, and context efficiency, partnering with engineers.
  • Provide technical leadership through design reviews, working groups, and mentorship.

Qualifications

  • BS/MS/PhD in a scientific field, or equivalent experience
  • 10+ years of relevant engineering or applied science experience, including time as a technical lead
  • Proven track record of leading ML or GenAI initiatives in a product-driven environment, from research through production
  • Significant experience with evaluation, experimentation, or measurement of ML systems at scale
  • Strong product mindset and ability to drive initiatives across cross-functional teams
  • Thrives in ambiguity and can make sound technical calls when path isn’t defined

Skills

Required:Evaluation and measurement of ML systems at scaleLeadership and cross-functional collaboration

Benefits

  • New hire stock equity (RSUs) and employee stock purchase plan (ESPP)
  • Continuous professional development, product training, and career pathing
  • Inclusive culture, giving programs, and Community Guilds
  • Competitive global benefits and Spring Health benefits for employees and dependents age 6+
Last updated Oct 22, 2026. Interested? Apply on the company site.

About Datadog

AI-Powered Observability and Security

See inside any stack, any app, at any scale, anywhere.

Company profileWebsite

More open roles at Datadog