← All roles

Engineering Manager, Evaluations & Observability

Retool
Apply on company site
Hybrid (San Francisco), Hybrid (United States)$260.1k - $306kFull-timePosted 8mo ago

About the role

Engineering Manager role at Retool focusing on the Evaluations & Observability platform, including building and evolving AI quality systems, evaluation pipelines, data curation, and support for the Assist roadmap. Lead a engineering team to measure, understand, and improve AI quality at scale, balancing execution with long-term product strategy.

Responsibilities

  • Communicate and collaborate effectively with Product and other Engineering counterparts
  • Manage a team of engineers; support the team by identifying growth opportunities, providing continuous feedback, and performance management as appropriate
  • Understand the needs of our Assist roadmap, helping define rubrics & automated systems that allow engineers to iterate quickly on product features, with confidence
  • Establish and define your team's strategy to ensure execution maximizes business impact
  • Introduce scalable, repeatable processes that help engineering and product teams deliver a successful product
  • Partner with recruiting on building out a diverse team of exceptionally motivated engineers

Qualifications

  • 3+ years of experience successfully leading and managing teams
  • Familiarity with AI evaluation & observability systems – exposure to Braintrust or general evaluation & LLM observability systems is a plus
  • Deep technical curiosity with hands-on coding and architectural exploration
  • Ability to champion an engineering team through macro process changes
  • History of orienting teams and setting strategy toward engineering goals with impact
  • Business-owner mindset with customer, product, and team empathy
  • Thoughtfulness around engineering culture, process, and identity
  • Proficiency in navigating ambiguity, stakeholders, structured communication, accountability
  • Collaborative skills to partner effectively with product, design, and go-to-market teams

Skills

Required:People managementAI evaluation & observabilitySystem design and architectureCross-functional collaboration

Benefits

  • medical, dental, vision, and 401(k) benefits
Last updated Oct 14, 2026. Interested? Apply on the company site.
Retool logo

About Retool

Build internal tools fast.

Retool is the fast way to build internal tools.

developer-tools
Company profileWebsite

More open roles at Retool