Staff Software Engineer- Search Quality
Databricks· Engineering
Bengalurufull-timePosted 7mo ago
About the role
Role focused on building the contextual backbone for search quality across both AI agents and human users, balancing hybrid retrieval, dual-optimization, and high-stakes accuracy to ensure grounded, actionable results.
Responsibilities
- Own the quality of results for two distinct users: the AI Agent and the Human User.
- Tackle Hybrid Retrieval combining keyword-based search with semantic vector search.
- Engage in Dual-Optimization to fine-tune ranking models for human readability and LLM-ready context.
- Build guardrails and relevance scoring to prevent hallucinations and maintain grounding.
- Work with data from structured SQL, unstructured docs, and real-time business metrics.
- Develop evaluation frameworks (human-in-the-loop and LLM-based) to measure relevance (nDCG, MRR, Precision@K).
Qualifications
- Experience with Lucene/Elasticsearch, embeddings, and ranking algorithms.
- Strong understanding of relevance metrics (nDCG, MRR, Precision@K).
- Knowledge of Information Retrieval (IR) and Retrieval-Augmented Generation (RAG).
Skills
Required:Lucene/ElasticsearchEmbeddingsRanking algorithmsRelevance evaluation
Benefits
- Comprehensive benefits and perks (region-specific details available via linked document).
Last updated Sep 10, 2026. Interested? Apply on the company site.
About Databricks
Leading Data and AI Platform for Enterprises
Databricks offers a unified platform for data, analytics and AI. Build better AI with a data-centric approach. Simplify ETL, data warehousing, governance and AI on the Data Intelligence Platform.
AIanalyticsbig datadatadata warehousingenterprise-infrastructuregovernanceliquid-ai-recruiting-target
More open roles at Databricks
- Strategic Enterprise Account Executive, Life Sciences5d agoHybrid (Illinois) · Sales
- Strategic Core Account Executive5d agoHybrid (Texas) · Sales
- Strategic Core Account Executive - Retail5d agoNorth Rhine-Westphalia, Germany
- Strategic Core Account Executive - Automotive5d agoHybrid (Germany) · Sales
- Strategic Core Account Executive5d agoHybrid (Remote - VA/DC)