← All roles

Senior Software Engineer - Husky Storage

Datadog
Apply on company site
Hybrid (Boston, MA; New York, NY)$192k - $240kfull-timePosted 5d ago

About the role

Senior Software Engineer on the Husky Storage team, Datadog’s petabyte-scale distributed storage system. Focus on migrating storage format to open source Parquet, optimizing compaction, cost reductions, and enabling scale for AI-era workloads with Iceberg-compatible handoffs to Lakehouse/ADP.

Responsibilities

  • Drive Husky to the next level of adoption by migrating our storage format to open source Parquet and re-imagining compaction on a DataFusion-based substrate
  • Drive concrete cost-reduction work: block-level inverted index compression, combining the database with external objects at the row level, and storage tiering/caching
  • Scale our solution to enable customers to manage event versioning at scale, using temporal-database techniques.
  • Play an influential role in operating and deciding how to best operate our service going forward.
  • Work across the write path (with Ingestion) and toward a cleaner Iceberg-based handoff to ADP/Lakehouse for batch/analytical workloads

Qualifications

  • Enthusiastic and experienced with large-scale distributed systems and/or storage engines
  • Comfortable with improving and operating large distributed systems that customers rely on for critical business functions
  • Strong fundamentals in columnar/file storage formats (Parquet, ORC, Arrow) or comparable systems
  • Bonus: experience with Go, Java, or Rust; with compaction or compression/encoding schemes (RLE, dictionary, delta, gorilla); with object storage (S3/GCS/Azure Blob) at scale, including caching and cost optimization; with Kafka and stream processing; or with Kubernetes

Skills

Required:Distributed systemsColumnar/file storage formatsOpen source/open standards
Nice to have:Go/Java/RustCompaction/compression schemesObject storage at scaleKafka/stream processingKubernetes

Benefits

  • New hire stock equity (RSUs) and employee stock purchase plan (ESPP)
  • Continuous professional development, product training, and career pathing
  • Intradepartmental mentor and buddy program for in-house networking
  • An inclusive company culture, ability to join our Community Guilds (Datadog employee resource groups)
  • Free, global mental health benefits for employees and dependents age 6+
Last updated Oct 22, 2026. Interested? Apply on the company site.

About Datadog

AI-Powered Observability and Security

See inside any stack, any app, at any scale, anywhere.

Company profileWebsite

More open roles at Datadog