← All roles

Senior Software Engineer (Data Platform)

Databricks· Data Platform
Apply on company site
BengaluruFull-timePosted 8mo ago

About the role

Senior Software Engineer on the Data Platform team at Databricks, building the Data Intelligence Platform and related tooling for data metrics, ETL frameworks, and data pipelines at scale across multiple clouds and geographies.

Responsibilities

  • Design and run the Databricks metrics store for cross-unit sharing and high-performance querying.
  • Design and run the cross-company Data Intelligence Platform with data protections and shareability considerations as the company transitions to a public entity.
  • Develop tooling and infrastructure to manage and run Databricks on Databricks at scale, including CI/CD processes, data quality pipelines, and infrastructure-as-code tooling.
  • Design the base ETL framework used by pipelines across the company.
  • Partner with engineering teams to provide leadership on long-term product vision and requirements for the Databricks product.
  • Build reliable data pipelines and solve data problems using Databricks, OSS tools, and partner products; provide early feedback on design and operations.
  • Establish conventions and APIs for telemetry, debug, feature, and audit event log data; evolve as products/services change.
  • Represent Databricks at academic and industrial conferences and events.

Qualifications

  • 6+ years of industry experience
  • 4+ years of technical leadership on large projects (ETL frameworks, metrics stores, infrastructure management, data security)
  • Experience building, shipping and operating reliable multi-geo data pipelines at scale
  • Experience with workflow/orchestration frameworks (Airflow, DBT, or equivalent)
  • Experience with large-scale messaging systems (Kafka, RabbitMQ, or equivalent)
  • Excellent cross-functional and communication skills, consensus builder
  • Passion for data infrastructure and enabling access to data

Skills

Required:ETL frameworksMetrics storesData orchestrationMessaging systems

Benefits

  • Comprehensive benefits and perks (region-specific details available)
Last updated Sep 10, 2026. Interested? Apply on the company site.

About Databricks

Leading Data and AI Platform for Enterprises

Databricks offers a unified platform for data, analytics and AI. Build better AI with a data-centric approach. Simplify ETL, data warehousing, governance and AI on the Data Intelligence Platform.

AIanalyticsbig datadatadata warehousingenterprise-infrastructuregovernanceliquid-ai-recruiting-target
Company profileWebsite

More open roles at Databricks