← All roles

[Job-32197] Tech Lead Data - Databricks

CI&T· Data / Data Engineering
Apply on company site
Remotefull-timePosted 1w ago

About the role

Senior hands-on Data Tech Lead to drive technical leadership of data engineering initiatives on Databricks in Azure, partnering with the Data Architect to define standards and enable the Data Engineering team to deliver scalable, reliable pipelines within the Medallion architecture.

Responsibilities

  • Provide technical leadership to Data Engineering squads, supporting design, reviews, and decision-making to unblock delivery.
  • Co-define with the Data Architect the technical vision, coding standards, modeling conventions, and best practices for the Lakehouse (Delta Lake + Medallion).
  • Design and oversee pipelines in Databricks (PySpark/Spark SQL) across Bronze/Silver/Gold layers, ensuring security, performance, and governance.
  • Implement and reinforce DataOps practices: version control (Git), CI/CD, testing (unit/integration/data quality), and documentation.
  • Optimize jobs/pipelines: partitioning, Spark tuning, cost management, and reliability (baseline observability and alerting).
  • Ensure non-functional requirements: security, access control, and data policies in Azure/Databricks aligned with defined governance.
  • Collaborate with stakeholders (business/analytics) to translate requirements into scalable solutions with realistic delivery plans.
  • Mentor engineers, promote standards, and create references (templates, playbooks) to accelerate the team.

Qualifications

  • Strong experience in Data Engineering and projects, with experience as a Tech Lead/Senior leading teams technically and operationally.
  • Strong hands-on experience in Databricks: PySpark and Spark SQL; batch pipelines (and working knowledge of streaming when needed).
  • Mastery of Delta Lake and practical application of the Medallion architecture (Bronze/Silver/Gold).
  • Solid experience with Azure for data, including at least: Azure Databricks, Azure Data Lake Storage (ADLS), and integration with security/identity services (e.g., Azure Active Directory).
  • Strong SQL and Python skills; fundamentals in modeling (dimensional/consumption) and good practices for contracts/schemas.
  • Experience with DataOps: Git, CI/CD for data pipelines, automated testing, and clear documentation.
  • Proven ability to review design/code, resolve performance/scale issues, and guide teams.
  • Advanced English to work with stakeholders and produce technical documentation.

Skills

Required:Databricks (PySpark/Spark SQL)Delta LakeAzure (Databricks, ADLS, security/identity integration)SQLPythonDataOpsLeadership

Benefits

  • Health and dental insurance
  • Meal and food allowance
  • Childcare assistance
  • Extended paternity leave
  • Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass
  • Profit Sharing and Results Participation (PLR)
  • Life insurance
  • Continuous learning platform (CI&T University)
  • Discount club
  • Free online platform dedicated to physical, mental, and overall well-being
  • Pregnancy and responsible parenting course
  • Partnerships with online learning platforms
  • Language learning platform
  • And many more!
Last updated Oct 21, 2026. Interested? Apply on the company site.

About CI&T

Technology Transformation Specialists

A global technology consulting and digital transformation firm that combines human expertise with AI to develop innovative solutions.

Technology transformationAISoftware developmentCloud servicesDigital experienceData analyticsApplication modernizationConsulting
Company profileWebsite

More open roles at CI&T