AI Hardware Systems Manager
Amazon· Annapurna Labs / Trainium Machine Learning Fleet Operations
Austin, TX$175.1k - $236.9kFull-timePosted 1mo ago
About the role
Technical leader and people manager responsible for overseeing ML fleet operations across multiple accelerator platforms, defining roadmaps, driving automation and data infrastructure, and ensuring operational excellence for a globally distributed ML hardware fleet.
Responsibilities
- Build, hire, mentor, and grow a team of platform development engineers responsible for ML fleet operations across multiple accelerator platforms
- Define team roadmap and technical strategy for fleet health, automation, and data infrastructure — balancing near-term operational demands against long-term engineering investments
- Drive operational excellence by establishing metrics, SLAs, and processes that maximize platform sellability and customer experience
- Partner with hardware engineering, software engineering, and product teams to prioritize debug efforts and translate fleet learnings into permanent design fixes
- Own escalation paths for critical fleet incidents and lead cross-functional war rooms to resolution
- Influence org-level priorities by surfacing fleet-wide patterns and advocating for systemic improvements across the ML hardware portfolio
- Raise the bar on team software practices — ensuring automation is maintainable, tested, documented, and reusable at scale
- Represent fleet operations in executive reviews, providing data-driven narratives on platform health and roadmap
- A day in the life: manage people, review fleet health, advocate for fleet-informed design changes, lead critical incident responses, and communicate with senior leadership
Qualifications
- Bachelor's degree in computer science, electrical engineering, or related field
- 2+ years of engineering team management experience
- Knowledge of and proficiency in the use of Python scripting language
- Experience with general troubleshooting/debugging of hardware
- Experience designing, building, operating, and managing large-scale distributed systems or web services
- 7+ years of experience in systems engineering, platform engineering, SRE, or hardware operations
Skills
Required:People managementFleet operationsPythonDebugging hardware issuesDistributed systems
Benefits
- Health insurance (medical, dental, vision, prescription) and Basic Life & AD&D insurance with option for Supplemental life plans
- 401(k) matching
- Paid time off and parental leave
- EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage
Last updated Oct 25, 2026. Interested? Apply on the company site.
More open roles at Amazon
- IT Support Associate II, Ops Tech Solutions (OTS)todayPlainfield, Indiana · Operations IT Support Engineering
- Head of Energy and Water, AWS LegaltodayHybrid (Seattle, WA) · Legal
- Software Development Engineer, Creative Asset Library, CreativeXtodaySeattle · Software Development
- Software Development Engineer, Creative Asset Library, CreativeXtodayHybrid (Seattle, WA) · Software Development
- IT Support Associate II, OTStodayIrving, TX · Operations IT Support Engineering