Applied Scientist, Fauna
Amazon· Amazon Robotics
Hybrid (New York, NY)$172.4k - $223.4kFull-timePosted yesterday
About the role
Applied Scientist to lead development of evaluation frameworks and data collection protocols for robotic capabilities, focusing on measuring, stress-testing, and improving robot behavior across real-world tasks. Bridge between robotics, machine learning, and human-in-the-loop systems to enable scalable data collection and validated policies.
Responsibilities
- Design and implement evaluation frameworks to measure robot capabilities across structured tasks, edge cases, and real-world scenarios
- Develop task definitions, success criteria, and benchmarking methodologies that enable consistent and reproducible evaluation of policies
- Create and refine data collection protocols that generate high-quality, task-relevant datasets aligned with model development needs
- Build and iterate on teleoperation workflows and operator interfaces to support efficient, reliable, and scalable data collection
- Analyze evaluation results and collected data to identify performance gaps, failure modes, and opportunities for targeted data collection
- Collaborate with engineering teams to integrate evaluation tooling, logging systems, and data pipelines into the broader robotics stack
- Stay current with advances in robotics, evaluation methodologies, and human-in-the-loop learning to continuously improve internal approaches
- Lead technical projects from conception through production deployment
- Mentor junior scientists and engineers
Qualifications
- 3+ years of building models for business application experience
- PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience
- Experience in patents or publications at top-tier peer-reviewed conferences or journals
- Experience programming in Java, C++, Python or related language
- Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing
Skills
Required:Evaluation framework designTask definition and benchmarkingData collection protocolsTeleoperation workflowsRobotics software
Benefits
- Health insurance (medical, dental, vision, prescription)
- Basic Life & AD&D insurance and option for Supplemental life plans
- EAP, Mental Health Support, Medical Advice Line
- Flexible Spending Accounts
- Adoption and Surrogacy Reimbursement coverage
- 401(k) matching
- Paid time off
- Parental leave
Last updated Oct 25, 2026. Interested? Apply on the company site.
More open roles at Amazon
- IT Support Associate II, Ops Tech Solutions (OTS)yesterdayPlainfield, Indiana · Operations IT Support Engineering
- Head of Energy and Water, AWS LegalyesterdayHybrid (Seattle, WA) · Legal
- Software Development Engineer, Creative Asset Library, CreativeXyesterdaySeattle · Software Development
- Software Development Engineer, Creative Asset Library, CreativeXyesterdayHybrid (Seattle, WA) · Software Development
- IT Support Associate II, OTSyesterdayIrving, TX · Operations IT Support Engineering