← All roles

Staff Software Engineer, Data Infrastructure

Peregrine Technologies· Engineering
Apply on company site
San Francisco, CA$200k - $275kfull-timePosted 7mo ago

About the role

Staff Data Infrastructure Engineer responsible for architecting and building the data layer that ingests, stores, and serves massive real-time operational data, enabling rapid, data-driven decisions across Peregrine’s platform.

Responsibilities

  • Designing and operating a high-throughput, real-time data integration platform across diverse customer environments
  • Architecting a scalable open table format layer for reliable data storage at petabyte scale
  • Building and optimizing distributed data processing pipelines with Apache Spark and adjacent streaming technologies
  • Driving performance, reliability, and cost efficiency across the full data infrastructure stack
  • Collaborating with platform and product engineering teams to define data contracts, schemas, and integration patterns
  • Establishing best practices, tooling, and patterns that raise the quality bar for data infrastructure across the organization

Qualifications

  • 8+ years of experience architecting and operating large-scale data infrastructure systems in production environments
  • Deep expertise with open table formats, particularly Apache Iceberg — including schema evolution, partitioning strategies, compaction, and time travel
  • Extensive hands-on experience with Apache Spark for batch and streaming data processing at scale
  • Strong background in real-time data integration and stream processing, leveraging technologies such as Apache Kafka, Apache Flink, or equivalents
  • Solid experience with data pipeline orchestration using Airflow or similar tools
  • Strong software engineering fundamentals in Python and/or Scala, with a track record of writing production-quality code
  • Extensive experience with AWS or comparable cloud platforms, including S3-based data lake architectures
  • Experience with Kubernetes and containerized deployment of data workloads
  • Degree in Computer Science, Engineering, or a related field, or equivalent practical experience
  • Located in San Francisco and open to working in office

Skills

Required:Data architecture and designOpen table formats (Apache Iceberg)Apache SparkReal-time data integration (Kafka/Flink)AirflowPython/ScalaAWS/GCP/Azure cloudKubernetes

Benefits

  • Annual Salary + Benefits + Equity (if applicable) + Bonus (if applicable)
Last updated Sep 9, 2026. Interested? Apply on the company site.

About Peregrine Technologies

Effective, efficient and easy to use, Peregrine is the real-time public safety and police data management platform that delivers true interoperability.

public safetypolice data managementinteroperability
Company profileWebsite

More open roles at Peregrine Technologies