← All roles

Software Engineer, Distributed Data Systems

Exa· Engineering
Apply on company site
San Francisco, California$180k - $350kFull-timePosted 10mo ago

About the role

Data Engineer role focused on architecting and building scalable data infrastructure to power crawling, training embedding models, and real-time search at Exa.

Responsibilities

  • Design a lakehouse architecture that handles 100+ PB of web crawl data
  • Build streaming pipelines that process billions of documents per day for real-time indexing
  • Architect the data layer for our embedding training infrastructure on Ray
  • Scale our ClickHouse deployment to handle analytical queries across petabytes of search logs

Qualifications

  • Deep understanding of lakehouse architectures (Delta Lake, Iceberg, Hudi) and when to use them
  • Experience building and operating large-scale distributed data processing pipelines
  • Hands-on experience with streaming data systems (Kafka, Flink, or similar)
  • Familiarity with Ray, Spark, or ClickHouse at production scale
  • An obsessive focus on reliability and building systems that don't page you at 3am

Skills

Required:Lakehouse architectures (Delta Lake, Iceberg, Hudi)Distributed data processingStreaming data systemsRay/Spark/ClickHouse

Benefits

  • premium healthcare benefits (medical, dental, vision)
  • fertility benefits
  • 16 weeks of fully paid parental leave for all new parents
  • monthly wellness stipend
Last updated Oct 7, 2026. Interested? Apply on the company site.
Exa logo

About Exa

Web search rebuilt for LLMs

Exa is a search engine built for AIs. We enable developers to filter the internet's content with complex queries in order to bring the world's knowledge into their AI apps.

ai-infrastructure-and-developmentapisartificial-intelligencebrex-fastest-growing-2025searchwing-list-2026wing-list-2026-mid-stage
Company profileWebsite

More open roles at Exa