← All roles

Software Engineer, Data Platform

xAI· Product
Apply on company site
Palo Alto, CA$180k - $440kFull-timePosted 11mo ago

About the role

Software engineer on SpaceXSI's Data Platform team, building and operating large-scale data transport and processing infrastructure (Kafka, HDFS, Spark, Flink, Trino) to support real-time pipelines, analytics, and ML workloads at petabyte scale in a fast-moving environment.

Responsibilities

  • Design and implement high-throughput, low-latency data ingestion and transport systems.
  • Scale and optimize multi-tenant Kafka infrastructure supporting real-time workloads.
  • Extend and tune Spark, Flink, and Trino for demanding production pipelines.
  • Build interfaces, APIs, and pipelines enabling teams to query, process, and move data at petabyte scale.
  • Debug and optimize distributed systems, with a focus on reliability and performance under load.
  • Collaborate with ML, product, and infrastructure teams to unblock critical data workflows.

Qualifications

  • Proven expertise in distributed systems, stream processing, or large-scale data platforms.
  • Proficiency in Rust, Go, Scala or similar systems languages.
  • Hands-on experience with Kafka, Flink, Spark, Trino, or Hadoop in production.
  • Strong debugging, profiling, and performance optimization skills.
  • Track record of shipping and maintaining critical infrastructure.
  • Comfortable working in fast-moving, high-stakes environments with minimal guardrails.

Skills

Required:Distributed systemsRustKafkaFlinkSparkTrino
Nice to have:GoScala

Benefits

  • equity
  • comprehensive medical, vision, and dental coverage
  • access to a 401(k) retirement plan
  • short & long-term disability insurance
  • life insurance
  • various other discounts and perks
Last updated Oct 14, 2026. Interested? Apply on the company site.

About xAI

liquid-ai-recruiting-target
Company profileWebsite

More open roles at xAI