← All roles

Data Engineer (Detect & Track Distillation)

Harmattan AI· R&D
Apply on company site
Paris, Lausanne, ZurichFull-timePosted 2mo ago

About the role

Data Engineer responsible for the data layer powering ML models, transforming raw unstructured data into clean, versioned, training-ready datasets to enable modelers and deep-learning pipelines.

Responsibilities

  • Ingestion Pipeline: Ingest, decode, and store raw, unstructured field data (video and other sensor streams) from field logs into efficient, controlled formats.
  • Multimodal Alignment: Align multiple data streams temporally and spatially so paired data is usable for training.
  • Curation: Transfer both ingested data and public datasets into high-value data, including parsing, filtering, de-duplication and revision.
  • Data & Labeling Requirements: Define which data to gather and what and how to label it, and own the dataset-construction workflow and labeling tooling. Coordinate with the teams responsible for data gathering and labeling.
  • Dataset Construction: Build task-specific datasets for the team’s training and evaluation needs, in collaboration with acquisition, annotation and product teams.
  • Versioning & Lineage: Version datasets and maintain lineage so training runs stay reproducible.
  • Storage & Formats: Store data in efficient, training-ready formats (such as columnar or sharded formats) and manage storage tiering to balance cost and latency as datasets grow.
  • Efficient Delivery: Deliver clean, documented datasets and the corresponding tools for loading to keep training from being I/O-bound, shaping their structure with the modelers.

Qualifications

  • A degree in a STEM field, or equivalent practical experience.
  • Experience building and maintaining pipelines for unstructured data at scale (video, images, or sensor data).
  • Strong Python skills and data engineering expertise; ability to optimize data loaders for training frameworks (e.g., PyTorch).

Skills

Required:PythonData pipeline design and implementationUnstructured data handling (video, sensor data)Dataset versioning and lineage
Nice to have:Data loading optimization for ML frameworks
Last updated Aug 12, 2026. Interested? Apply on the company site.
Harmattan AI logo

About Harmattan AI

Building the Future of Autonomous Warfare.

Building the Future of Autonomous Warfare.

Autonomous WarfareUASPayloadCounter-UAS
Company profileWebsite

More open roles at Harmattan AI