← All roles

Senior Staff Software Engineer- Search Quality

Databricks
Apply on company site
Bengalurufull-timePosted 7mo ago

About the role

Senior Staff Software Engineer focusing on Search Quality at Databricks, responsible for owning and improving the quality of search results for both AI agents and human users, across hybrid retrieval and RAG contexts.

Responsibilities

  • Own the quality of results for two distinct users: the AI Agent (optimizing retrieval for LLMs with ground truth) and the Human User (improving traditional search for assets and answers).
  • Tackle Hybrid Retrieval (keyword-based search and semantic vector search).
  • Engage in Dual-Optimization of ranking models for human readability and LLM-ready context.
  • Build guardrails and relevance scoring to prevent hallucinations and ensure high-stakes accuracy.
  • Work with data from structured SQL, unstructured documents, and real-time metrics to connect data sources.

Qualifications

  • Experience with Lucene/Elasticsearch, embeddings, and ranking algorithms.
  • Strong focus on relevance metrics (nDCG, MRR, Precision@K) and evaluation frameworks (human-in-the-loop and LLM-based).
  • Experience applying traditional IR concepts to Retrieval-Augmented Generation (RAG).

Skills

Required:Lucene/ElasticsearchEmbeddingsRanking algorithmsRelevance metricsRetrieval-Augmented Generation (RAG)
Last updated Sep 10, 2026. Interested? Apply on the company site.

About Databricks

Leading Data and AI Platform for Enterprises

Databricks offers a unified platform for data, analytics and AI. Build better AI with a data-centric approach. Simplify ETL, data warehousing, governance and AI on the Data Intelligence Platform.

AIanalyticsbig datadatadata warehousingenterprise-infrastructuregovernanceliquid-ai-recruiting-target
Company profileWebsite

More open roles at Databricks