← All roles

Senior Staff Software Engineer - Lakeflow Pipelines Datasets

Databricks· Lakeflow Engineering
Apply on company site
Hybrid (Mountain View / San Francisco)$228.6k - $314.3kFull-timePosted 6mo ago

About the role

Senior Staff Engineer to serve as a technical architect and engineering leader for the Lakeflow platform, owning long-term technical direction for declarative pipelines, materialized views, and related data infrastructure.

Responsibilities

  • Architect and deliver a highly scalable, fault-tolerant platform for declarative pipelines and materialized views serving thousands of production customers.
  • Turn ambiguous, large-scale technical challenges into clear execution plans that ship incrementally and hold up at exabyte scale.
  • Bridge the gap between research and production by bringing ideas from the academic literature or internal R&D into systems that solve real customer problems.
  • Lead deep systems work: performance diagnosis on large production clusters, low-level debugging, and optimization that moves the needle on cost and latency.
  • Shape product direction alongside engineering and product leadership, owning technical strategy from design through delivery.
  • Drive complex, multi-team technical initiatives that require sustained coordination and clear technical judgment.

Qualifications

  • 10+ years of experience building, operating, and evolving large-scale distributed systems in production.
  • Deep expertise in one or more of: database internals, storage systems, distributed computing, streaming systems, language/API design, or performance engineering.
  • Track record of executing against a multi-year technical vision through well-sequenced incremental milestones.
  • Strong algorithmic foundations with practical judgment on when they matter.
  • Bias toward customer impact over technical novelty for its own sake.
  • Experience building alignment across teams and driving initiatives from conception through customer adoption.
  • BS, MS, or PhD in Computer Science or related field (or equivalent depth of experience).

Skills

Required:Distributed systemsAlgorithmic designSystem architectureCross-team leadership
Nice to have:Academic-to-production translation

Benefits

  • Benefits information available via regional details (link provided in job description).
Last updated Sep 17, 2026. Interested? Apply on the company site.

About Databricks

Leading Data and AI Platform for Enterprises

Databricks offers a unified platform for data, analytics and AI. Build better AI with a data-centric approach. Simplify ETL, data warehousing, governance and AI on the Data Intelligence Platform.

AIanalyticsbig datadatadata warehousingenterprise-infrastructuregovernanceliquid-ai-recruiting-target
Company profileWebsite

More open roles at Databricks