← All roles

Staff Software Engineer, Lakeflow Pipelines DR

Databricks
Apply on company site
Hybrid (California)$192k - $260kPosted 1mo ago

About the role

Staff Engineer on the Lakeflow Disaster Recovery team at Databricks, focusing on designing and implementing distributed systems that replicate and recover pipelines across regions to ensure reliability and safe recovery without data loss or duplication.

Responsibilities

  • Cross-region replication and recovery for Lakeflow pipelines, streaming tables, and materialized views
  • Distributed consistency across pipeline dependencies, table versions, and transaction logs
  • Failover and failback workflows with conservative correctness guardrails
  • Deep clone, metadata reconciliation, observability, and failure-injection testing
  • High-fidelity recovery simulations, game-day testing, and formal reasoning about failure modes

Qualifications

  • 8+ years of experience working on related systems preferred
  • Strong software engineering skills in Java, Scala, C++, Go, Python, or a similar production language
  • Understanding of consistency, transactions, idempotency, replication, checkpointing, and data lineage
  • Ability to define and work toward a multi-year technical vision with incremental, production-quality deliverables
  • Optional: PhD or advanced research experience in databases, distributed systems, or storage

Skills

Required:Distributed systemsJava
Nice to have:ScalaC++GoPython
Last updated Sep 17, 2026. Interested? Apply on the company site.

About Databricks

Leading Data and AI Platform for Enterprises

Databricks offers a unified platform for data, analytics and AI. Build better AI with a data-centric approach. Simplify ETL, data warehousing, governance and AI on the Data Intelligence Platform.

AIanalyticsbig datadatadata warehousingenterprise-infrastructuregovernanceliquid-ai-recruiting-target
Company profileWebsite

More open roles at Databricks