← All roles

Staff Software Engineer, Data Infrastructure

Peregrine Technologies· Engineering
Apply on company site
New York, NY$200k - $275kFull-timePosted 7mo ago

About the role

Staff Data Infrastructure Engineer focused on designing and building the data layer that ingests, stores, and serves massive volumes of real-time operational data, enabling fast and reliable decision-making for Peregrine’s platform.

Responsibilities

  • Designing and operating a high-throughput, real-time data integration platform across diverse customer environments
  • Architecting a scalable open table format layer for reliable data storage at petabyte scale
  • Building and optimizing distributed data processing pipelines with Apache Spark and adjacent streaming technologies
  • Driving performance, reliability, and cost efficiency across the full data infrastructure stack
  • Collaborating with platform and product engineering teams to define data contracts, schemas, and integration patterns
  • Establishing best practices, tooling, and patterns that raise the quality bar for data infrastructure across the organization

Qualifications

  • 8+ years of experience architecting and operating large-scale data infrastructure systems in production environments
  • Deep expertise with open table formats, particularly Apache Iceberg — including schema evolution, partitioning strategies, compaction, and time travel
  • Extensive hands-on experience with Apache Spark for batch and streaming data processing at scale
  • Strong background in real-time data integration and stream processing, leveraging technologies such as Apache Kafka, Apache Flink, or equivalents
  • Solid experience with data pipeline orchestration using Airflow or similar tools
  • Strong software engineering fundamentals in Python and/or Scala, with a track record of writing production-quality code
  • Extensive experience with AWS or comparable cloud platforms, including S3-based data lake architectures
  • Experience with Kubernetes and containerized deployment of data workloads
  • Degree in Computer Science, Engineering, or a related field, or equivalent practical experience
  • Located in New York and open to working in office

Skills

Required:Data infrastructure designApache IcebergApache SparkKafka / Flink

Benefits

  • Annual Salary + Benefits + Equity (if applicable) + Bonus (if applicable)
  • Information on the benefits offered is here (link provided in description)
Last updated Sep 9, 2026. Interested? Apply on the company site.

About Peregrine Technologies

Effective, efficient and easy to use, Peregrine is the real-time public safety and police data management platform that delivers true interoperability.

public safetypolice data managementinteroperability
Company profileWebsite

More open roles at Peregrine Technologies