ML Infra Engineer, Data Systems
San FranciscoFull-timePosted 8mo ago
About the role
ML Infra Engineer focused on building and operating data infrastructure for large-scale robot learning, bridging raw data sources and training/evaluation with emphasis on performance, correctness, and reliability at scale.
Responsibilities
- Data Ingestion & Processing: Design and build high-throughput pipelines that validate, transform, and featurize raw multimodal data.
- Batch & Streaming Systems: Operate large-scale batch and streaming workflows over massive datasets.
- Storage Systems: Design object storage layouts, metadata systems, and efficient access patterns; choose file formats with performance and scalability in mind.
- Data Lifecycle Management: Build systems for backfills, dataset rebuilds, garbage collection, and large-scale transformations.
- Training-Time Performance: Optimize dataloaders, sharding, prefetching, caching, and throughput to reduce time from data arrival → model training.
- Metadata & Indexing: Build scalable metadata stores for datasets, annotations, and training artifacts.
- Data Movement: Move petabytes efficiently across clusters and environments.
- Operational Correctness: Implement observability, validation, and guardrails to prevent silent data regressions.
- Cross-Functional Collaboration: Work with researchers, engineers and roboticists to translate evolving data needs into robust systems.
Qualifications
- Strong software engineering fundamentals.
- Experience building distributed systems or large-scale data pipelines.
- Comfort reasoning about performance, memory, I/O, and storage efficiency.
- Familiarity with batch and/or streaming processing systems.
- Experience with object storage systems and data format tradeoffs.
- Ownership mindset: design, build, operate, and iterate on systems end-to-end.
- Enjoy working closely with researchers and unblocking fast-moving projects.
Skills
Required:Software engineeringDistributed systemsBatch processingObject storageData pipeline designObservability and data quality
Nice to have:Streaming processing
Last updated Sep 2, 2026. Interested? Apply on the company site.
About Physical Intelligence
Physical Intelligence (π)
Physical Intelligence is bringing general-purpose AI into the physical world.
AIliquid-ai-recruiting-target
More open roles at Physical Intelligence
- General Manager, Research Operations4d agoSan Francisco · Operations
- Environment Specialist4d agoSan Francisco · Operations
- Learning & Development Lead, Operations4d agoSan Francisco · Operations
- Environment Manager4d agoSan Francisco · Operations
- Environment Coordinator4d agoSan Francisco · Operations