← All roles

Sr Software Engineer, Infrastructure

Databricks· Engineering
Apply on company site
Hybrid (San Francisco, CA)$159.9k - $219.9kFull-timePosted 6mo ago

About the role

Senior Software Engineer (Infrastructure) on the IT Infrastructure team at Databricks, focusing on building resilient, scalable, automated infrastructure in AWS and related tooling, with an emphasis on observability, security, cost optimization, and collaboration across Security, Engineering, Infrastructure, and Support.

Responsibilities

  • Architect and Automate: Design and deploy production-grade infrastructure on AWS using Terraform or Pulumi.
  • Orchestration: Manage and scale containerized workloads using AKS (Azure Kubernetes Service) or EKS, focusing on cluster security and resource efficiency.
  • CI/CD Excellence: Architect robust deployment pipelines using GitHub Actions, managing both GitHub-hosted and self-hosted runners for specialized build requirements.
  • Drive "Observable by Default" Frameworks: Create underlying infrastructure to ensure new internal applications are secure and have logging and metrics enabled by default
  • Tooling, Scripting & AI : Build internal CLI tools,AI plugins and automation scripts to streamline developer workflows and enhance operational efficiency
  • Partner Cross-Functionally: Collaborate with stakeholders across Security, Engineering, Infrastructure, and Support to deliver impactful projects with real business outcomes.
  • Mentor and Document: Participate in Code reviews, Document solutions and failure triage playbooks, and mentor junior engineers on the platforms you own.

Qualifications

  • 5+ years of production-level software engineering experience with strong proficiency in Python (non-negotiable).
  • Expert-level proficiency in Terraform (modules, state management) or Pulumi (Preferred).
  • Hands-on experience with AWS (or Azure/GCP), Kubernetes, Docker and containerization concepts.
  • Experience building and troubleshooting integrations between infrastructure, data pipelines, and observability platforms.
  • Advanced knowledge of Github Actions, Github Runners.
  • Understanding of observability pillars (logging, metrics, tracing) and hands-on experience with Datadog, Prometheus, or ELK.
  • Proficiency in distributed systems concepts with Kafka or messaging queues.
  • Ability to operate with minimal guidance, take ownership of ambiguous projects, and follow a vision set by tech leads to execute independently.

Skills

Required:PythonTerraformAWSKubernetesDockerGitHub ActionsObservability toolsDistributed systemsSRE mindsetAutomation
Nice to have:Pulumi

Benefits

  • Comprehensive benefits package (region-specific details available via provided link)
Last updated Sep 10, 2026. Interested? Apply on the company site.

About Databricks

Leading Data and AI Platform for Enterprises

Databricks offers a unified platform for data, analytics and AI. Build better AI with a data-centric approach. Simplify ETL, data warehousing, governance and AI on the Data Intelligence Platform.

AIanalyticsbig datadatadata warehousingenterprise-infrastructuregovernanceliquid-ai-recruiting-target
Company profileWebsite

More open roles at Databricks