Software Engineer, ML Inference Optimization
Foster City, CA$177k - $270kFull-timePosted 4mo ago
About the role
Role focused on ML Inference Optimization to accelerate VLMs, VLAs, and Foundational models for autonomous driving; involves design, implementation, and operation of cutting-edge ML training or inference performance optimization techniques and collaboration with cross-functional teams.
Responsibilities
- Design, implement, and operate cutting-edge ML Training OR Inference performance optimization techniques to scale our VLM, VLA, and Foundational models and deploy them efficiently in our robotaxi.
- Collaborate closely with cross-functional teams, including ML researchers, software engineers, data engineers, and hardware engineers, to define requirements and align on architectural decisions.
Qualifications
- 4+ years of total experience, including 2+ years of working on large-scale model training or inference platforms.
- Experience with training frameworks like PyTorch, leveraging GPUs efficiently for distributed model training.
- Experience with GPU-accelerated inference using TensorRT or similar frameworks.
- Experience using profiling tools like NVIDIA's Nsight or PyTorch's Profiler for identifying model training and serving bottlenecks.
- Proficient in Python or C++.
Skills
Required:Large-scale model training or inference platformsPyTorchGPU-accelerated inferenceProfiling toolsProgramming languages
Benefits
- paid time off (e.g. sick leave, vacation, bereavement)
- unpaid time off
- Zoox Stock Appreciation Rights
- Amazon RSUs
- health insurance
- long-term care insurance
- long-term and short-term disability insurance
- life insurance
Last updated Oct 21, 2026. Interested? Apply on the company site.
About Zoox
It's Not a Car | Zoox
Zoox is a purpose-built autonomous vehicle designed for riders, not drivers. Learn more about the Zoox robotaxi and the future of ride-hailing.
autonomous vehiclerobotaxiride-hailing
More open roles at Zoox
- Contract Student Worker - Freeways Data Evaluation (20 hrs/wk)4d agoHybrid (Foster City, CA) · Zoox Internships – Software
- Software Engineer, ML Training Optimization4d agoFoster City, CA · Software Systems
- Strategic Sourcing Manager, IT Software & Services4d agoHybrid (Foster City, CA) · Supply Chain Quality and Reliability – Indirect Procurement
- Program Analyst4d agoFoster City, CA · Vehicle Development – Vehicle Program Management
- Hardware Engineer - Test Development4d agoFoster City, CA · Vehicle Development – Vehicle Integration, Testing & Validation