← All roles

Staff Software Engineer- Foundation Model Inference

Databricks· Engineering
Apply on company site
San Francisco, CA$190k - $265kFull-timePosted 2mo ago

About the role

The Foundation Model Inference team builds the infrastructure that enables enterprise-scale AI model serving, reliability, and performance. You’ll power inference workloads across partner and self-hosted models, improving latency and efficiency while collaborating across platform, infra, and ML teams.

Responsibilities

  • Build LLM infrastructure powering large-scale inference workloads for customers through partner models (OpenAI, Anthropic, Gemini) and self-hosted models (Qwen, GPT-OSS, Llama)
  • Improve reliability, latency, and efficiency of distributed AI workloads
  • Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences
  • Shape how developers and data scientists build and interact with AI on Databricks

Qualifications

  • 8+ years of experience in backend or infrastructure engineering
  • Experience with distributed systems, scalable APIs, or cloud-native infrastructure
  • Experience with real-time serving, ML infrastructure, or GPU orchestration
  • Familiarity with service-oriented architecture, deployment pipelines, and system observability

Skills

Required:Distributed systemsReal-time model servingService-oriented architecture

Benefits

  • Benefits details available in regional document linked in job posting
Last updated Oct 15, 2026. Interested? Apply on the company site.

About Databricks

Leading Data and AI Platform for Enterprises

Databricks offers a unified platform for data, analytics and AI. Build better AI with a data-centric approach. Simplify ETL, data warehousing, governance and AI on the Data Intelligence Platform.

AIanalyticsbig datadatadata warehousingenterprise-infrastructuregovernanceliquid-ai-recruiting-target
Company profileWebsite

More open roles at Databricks