← All roles

Sr. Staff Platform/Data Reliability Engineer, Databricks (R5537)

Shield AI· Enterprise Operations Division – Enterprise Technology Services
Apply on company site
Remote$180k - $270kFull Time EmployeePosted 2mo ago

About the role

Senior-level platform reliability engineer focused on Databricks, building a reliable, secure, scalable lakehouse platform for enterprise use, partnering with data engineers and cloud/infrastructure teams to enforce standards and enable multi-domain onboarding.

Responsibilities

  • Own operational excellence for the Databricks platform, including monitoring, alerting, observability, incident response support, and production runbook patterns for data jobs and platform services.
  • Define and maintain CI/CD and promotion standards for Databricks assets, including workflows, jobs, notebooks, code packages, infrastructure configuration, and environment promotion from dev to prod.
  • Design and maintain platform standards for job orchestration, cluster and compute policies, service principal usage, environment isolation, and production execution reliability.
  • Establish reusable operational templates and enablement patterns for new domains onboarding to Databricks, including logging conventions, job tagging, metadata capture, and support handoff expectations.
  • Partner with the Senior Data Engineer to ensure ingestion and medallion patterns are implemented in a way that is observable, recoverable, cost-aware, and secure in production.
  • Work with the cloud/infrastructure team to align Databricks configuration and usage patterns with broader enterprise cloud standards, especially for government-hosted environments.
  • Help enforce technical controls for data segregation, access boundaries, and operational compliance in a highly regulated environment.
  • Track and improve platform health metrics such as job success rates, incident trends, data pipeline reliability, cost efficiency, and environment drift.
  • Document platform standards, operational expectations, and support models so the Databricks platform can scale beyond a small founding team.
  • Mentor internal engineers who are growing into platform responsibilities, helping expand Databricks operational knowledge within the team.

Qualifications

  • 12+ years of relevant experience in data platform engineering, platform operations, site reliability engineering, or modern cloud data infrastructure.
  • Hands-on experience with Databricks or a closely related cloud data platform in production environments.
  • Experience designing or operating CI/CD, environment promotion, version control, and deployment automation for data platforms and pipelines.
  • Strong understanding of platform operations concepts such as observability, monitoring, alerting, incident management, and reliability engineering.
  • Experience with compute policy design, workload isolation, service principals, and secure production execution patterns on cloud data platforms.
  • Ability to work effectively in a regulated or security-sensitive environment with strong expectations around access control, auditability, and operational discipline.
  • Strong collaboration skills and comfort partnering with cloud/infrastructure, security, data engineering, and analytics stakeholders.

Skills

Required:Databricks platform operationsCI/CD for data platformsObservability and incident management

Benefits

  • Pay within range listed + Bonus + Benefits + Equity
  • Temporary benefits package (applicable after 60 days of employment)
  • Salary compensation is influenced by a wide array of factors including skill set, level of experience, licenses and certifications, and specific work location. All offers contingent on cleared background and possible reference check.
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Shield AI

Autonomy for the world.

Our mission is to protect service members and civilians with intelligent systems.

AerospaceAutonomyDefenseliquid-ai-recruiting-targetsetter-30setter-30-2026-q1
Company profileWebsite

More open roles at Shield AI