Finance Data and AI Lead
Databricks· Finance
Hybrid (Bengaluru)full-timePosted 2mo ago
About the role
Finance Data Lead responsible for data pipelines, AI systems, and internal applications powering Databricks' Finance and Accounting organization; technical authority, architecture decisions, and mentoring for the Finance data engineering team. Based in Bengaluru, India.
Responsibilities
- Design and develop ETL pipelines using Databricks SQL and Python / PySpark to enhance reporting, automate journal entries, and transform core financial processes across accounting and FP&A (revenue, expenses, equity, commissions, tax)
- Architect, build, and own the most complex finance data pipelines in the Finance data lake using Databricks Jobs and Lakeflow Declarative Pipelines with built-in data validation and reconciliations
- Lead the technical design of AI use cases for Finance and Accounting (forecasting automation, anomaly detection, natural language interfaces to financial data)
- Build and maintain internal Finance applications (Databricks Apps, Genie Agents, AI/BI dashboards) for self-service by non-technical stakeholders
- Design and deliver curated Finance datasets with row-level security, data access policies, and Unity Catalog governance
- Define and champion coding standards, data modelling conventions, documentation practices, and testing frameworks
- Enforce and evolve Git-based version control, PR review, and CI/CD pipelines to satisfy SOX change management
- Lead technical scoping and solutioning for Accounting, FP&A, Internal Audit, and Procurement requirements
- Serve as primary technical contact during financial close to ensure data accuracy and timely issue resolution
- Partner with IT and Engineering on system integrations and lead UAT
- Mentor junior and mid-level engineers through code reviews and design discussions
- Identify architectural debt, performance bottlenecks, and tooling gaps, driving resolutions with minimal direction
Qualifications
- 12+ years of experience in data engineering, analytics engineering, or finance systems with ownership of complex, production-grade pipelines end-to-end
- Deep proficiency in SQL and Python; hands-on experience with Apache Spark and Databricks platform
- Experience building and maintaining ELT/ETL pipelines from financial source systems (NetSuite, Salesforce, Stripe, Zuora, or similar) into a centralized data lake
- Strong understanding of core finance and accounting concepts (close processes, revenue recognition, intercompany, chart of accounts, financial reporting)
- Ability to translate ambiguous Finance requirements into well-architected, maintainable technical solutions
- Comfortable driving technical conversations with engineers and non-technical Finance stakeholders
- Experience building Finance-facing dashboards, self-service BI products, and executive reporting layers
- Familiarity with AI/ML concepts and applying them to Finance workflows
Skills
Required:SQLPythonApache SparkDatabricks platformELT/ETL pipelines
Benefits
- Comprehensive benefits and perks; region-specific details available via provided link
Last updated Sep 10, 2026. Interested? Apply on the company site.
About Databricks
Leading Data and AI Platform for Enterprises
Databricks offers a unified platform for data, analytics and AI. Build better AI with a data-centric approach. Simplify ETL, data warehousing, governance and AI on the Data Intelligence Platform.
AIanalyticsbig datadatadata warehousingenterprise-infrastructuregovernanceliquid-ai-recruiting-target
More open roles at Databricks
- Strategic Enterprise Account Executive, Life Sciences4d agoHybrid (Illinois) · Sales
- Strategic Core Account Executive4d agoHybrid (Texas) · Sales
- Strategic Core Account Executive - Retail4d agoNorth Rhine-Westphalia, Germany
- Strategic Core Account Executive - Automotive4d agoHybrid (Germany) · Sales
- Strategic Core Account Executive4d agoHybrid (Remote - VA/DC)