← All roles

Staff Software Engineer (Data Platform)

Databricks· Engineering
Apply on company site
Bengaluru$0Full-timePosted 8mo ago

About the role

Staff Software Engineer on the Data Platform team at Databricks, focusing on building the Data Intelligence Platform and supporting tooling for logging, orchestration, data transformation, metric store, governance, and data consumption layers to enable automated decision-making across the company.

Responsibilities

  • Design and run the Databricks metrics store for cross-unit sharing and high performance.
  • Design and run the cross-company Data Intelligence Platform with balanced data protection and shareability as the company transitions to a public company.
  • Develop tooling and infrastructure to run Databricks on Databricks at scale across clouds, geographies, and deployment types (CI/CD, test frameworks for pipelines and data quality, infrastructure-as-code).
  • Design the base ETL framework used by all pipelines.
  • Partner with engineering teams to provide leadership on long-term vision and requirements for the Databricks product.
  • Build reliable data pipelines and solve data problems using Databricks and other OSS tools; provide early product design and operations feedback.
  • Establish conventions and APIs for telemetry, debug, feature and audit event log data, evolving them over time.
  • Represent Databricks at academic and industrial conferences and events.

Qualifications

  • 12+ years of industry experience
  • 4+ years of experience building large scale distributed systems
  • 5+ years providing technical leadership on large projects (ETL frameworks, metrics stores, infrastructure management, data security)
  • Experience building, shipping and operating reliable multi-geo data pipelines at scale
  • Experience with workflow/orchestration frameworks (e.g., Airflow, DBT, or commercial tools)
  • Experience with large-scale messaging systems (Kafka, RabbitMQ, or equivalents)
  • Excellent cross-functional and communication skills and consensus-building abilities
  • Passion for data infrastructure and enabling others by making data easily accessible

Skills

Required:distributed systemsETL frameworksdata pipelines
Nice to have:data governance

Benefits

  • Benefits details available regionally via company link
Last updated Sep 10, 2026. Interested? Apply on the company site.

About Databricks

Leading Data and AI Platform for Enterprises

Databricks offers a unified platform for data, analytics and AI. Build better AI with a data-centric approach. Simplify ETL, data warehousing, governance and AI on the Data Intelligence Platform.

AIanalyticsbig datadatadata warehousingenterprise-infrastructuregovernanceliquid-ai-recruiting-target
Company profileWebsite

More open roles at Databricks