Contract Student Worker – AI Validation and Benchmarking Engineer (40hrs / week Full-Time)
Hybrid (Foster City, CA)ContractPosted 1w ago
About the role
Contract student worker role focused on supporting end-to-end validation pipeline for AI tools, maintaining test datasets, running benchmarks, and measuring agent accuracy across routing decisions, classification labels, and structured output fields.
Responsibilities
- Run and maintain the benchmark pipeline, analyzing results to identify routing errors and regressions across agent variants
- Build and expand ground truth datasets used to evaluate agent outputs against known-correct answers
- Identify and address gaps in benchmark validation and support building a more comprehensive evaluation infrastructure to improve validation prior to release
- Develop new evaluation dimensions such as label accuracy and structured output correctness beyond the existing team classification benchmarks
- Investigate failure modes in agent outputs and work with engineers to surface actionable improvements
- Write scripts and tooling to automate data collection, result parsing, and metric reporting
- Document findings, track benchmark trends over time, and present results to the team
Qualifications
- Familiar with Cursor or Claude
- Familiar with Python
- Familiar with evaluation concepts: precision, recall, F1 score, and confusion matrices
- Comfortable working with structured data (CSV, JSON)
- Experience modifying or writing reproducible analysis scripts
Skills
Required:Cursor or Claude familiarityPythonEvaluation metrics (precision, recall, F1, confusion matrices)Structured data handling (CSV, JSON)Reproducible analysis scripting
Last updated Oct 21, 2026. Interested? Apply on the company site.
About Zoox
It's Not a Car | Zoox
Zoox is a purpose-built autonomous vehicle designed for riders, not drivers. Learn more about the Zoox robotaxi and the future of ride-hailing.
autonomous vehiclerobotaxiride-hailing
More open roles at Zoox
- Contract Student Worker - Freeways Data Evaluation (20 hrs/wk)5d agoHybrid (Foster City, CA) · Zoox Internships – Software
- Software Engineer, ML Training Optimization5d agoFoster City, CA · Software Systems
- Strategic Sourcing Manager, IT Software & Services5d agoHybrid (Foster City, CA) · Supply Chain Quality and Reliability – Indirect Procurement
- Program Analyst5d agoFoster City, CA · Vehicle Development – Vehicle Program Management
- Hardware Engineer - Test Development5d agoFoster City, CA · Vehicle Development – Vehicle Integration, Testing & Validation