← All roles

Software Engineer, Evals

Glean· Engineering
Apply on company site
Bangalore, IndiaFull-timePosted 3mo ago

About the role

Backend and infrastructure engineer role focused on building platforms to measure, explain, and improve AI quality at scale. Owner of large-scale evaluation pipelines, observability infrastructure, and systems governing model releases and agent behavior for enterprise AI products.

Responsibilities

  • Design and build large-scale evaluation pipelines that measure assistant and agent quality across thousands of real user and synthetic workflows.
  • Evaluate frontier model releases and the latest OSS model drops, building infrastructure and quality signals to understand regressions, tradeoffs, and launch readiness.
  • Build agent observability infrastructure, including trace enrichment, durable telemetry pipelines, dashboards, and debugging workflows that make AI behavior inspectable.
  • Own backend systems from architecture and design docs through production rollout, reliability, monitoring, and iteration.
  • Partner with product, ML, and infrastructure engineers to make evals a first-class part of how Glean ships AI features.
  • Improve the quality loop by connecting eval results, customer feedback, regression analysis, and engineering workflows into concrete product improvements.
  • Build systems that balance speed, reliability, enterprise security, and cost across modern cloud-native environments.
  • Mentor other engineers, raise the bar for technical design, and help shape the engineering culture of Glean’s Bangalore AI quality team.

Qualifications

  • 6+ years of software engineering experience building backend systems, infrastructure, distributed systems, or data platforms.
  • Strong coding skills in Go, Python, Java, C++, or similar languages, with an emphasis on reliability, scale, and well-tested components.
  • Comfortable working with distributed data pipelines, production services, observability systems, or cloud-native infrastructure.
  • Analytically rigorous and care about whether metrics reflect real user experience.
  • Enjoy customer-focused, cross-functional environments and take on impactful work.
  • Care deeply about quality in systems and AI product measurement.
  • Experience with LLM applications, evals, tracing, data warehouses, workflow orchestration, or ML infrastructure is a strong plus.

Skills

Required:Backend engineeringGoDistributed data pipelinesObservability & telemetry
Nice to have:Python

Benefits

  • Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience.
  • Certain roles may be eligible for variable compensation, equity, and benefits.
  • We are committed to inclusion and diversity and do not discriminate based on gender, ethnicity, sexual orientation, religion, civil or family status, age, disability, or race.
Last updated Oct 14, 2026. Interested? Apply on the company site.

About Glean

Work AI that Works | Agents, Assistant & Search

Glean is the Work AI platform connected to your enterprise's data. Find, create, and automate anything. Explore what Work AI can do for you!

AIAgentsAssistantEnterprise DataSearchWork AI Platformai-agents-and-applicationsliquid-ai-recruiting-target
Company profileWebsite

More open roles at Glean