Sr Systems Development Engineer, AWS AI/ML Servers
Amazon· Systems, Quality, & Security Engineering
Cupertino, CA, Seattle, WA, Austin, TX$173.9k - $235.2k + equityFull-timePosted 1mo ago
About the role
Automation software, diagnostic tooling, and fleet health infrastructure for AWS AI/ML accelerator servers. Build end-to-end, scalable systems to prevent failures across hardware, firmware, kernel, and software for large-scale accelerated compute fleets.
Responsibilities
- Build and own the automation infrastructure for accelerator (AI/ML) fleet health at a large scale of servers, driving toward zero-touch operations that detect, diagnose, triage, and remediate faults without human intervention
- Design and develop test frameworks, test coverage strategies, and diagnostic tooling to validate hardware functionality, detect faults, and ensure qualification coverage across the platform lifecycle
- Design predictive failure detection using telemetry, sensor data, error trending, and log correlation to identify degrading components before customer impact
- Develop monitoring dashboards and alerting for real-time fleet health visibility across manufacturing, lab, and production environments
- Define and track fleet health metrics: failure rates, mean time to detect and resolve issues, first-time fix rate, test dwell time, and predictive accuracy
- Debug complex system-level issues across compute, GPU, and networking in production — including Linux boot/runtime failures, PCIe, power, NIC, NVMe, and GPU subsystems on x86 and ARM
- Perform root cause analysis correlating across firmware, kernel, driver, and physical layer; feed findings into manufacturing quality and design improvements
- Design scalable test automation for hardware bring-up, regression, and qualification — reducing manufacturing test cycle times without sacrificing coverage through intelligent test sequencing and parallel execution
- Build data pipelines correlating test results, sensor telemetry, and component-level data to identify systemic yield issues and drive upstream fixes
- Develop and maintain Linux device drivers on ARM and x86; work with OS internals and accelerator/GPU software stacks
- Build and manage tests covering all functional aspects of the system and CI/CD pipelines for rapid deployment to manufacturing lines and production fleet
- Work across engineering teams and internal customers to ensure new accelerated compute hardware meets data path, control path, and onboarding requirements
- Engage with ODMs and design partners on testability, diagnostic coverage, and automation requirements during hardware design and bring-up phases
- Partner with datacenter operations to close the loop between field failures, manufacturing escapes, and design improvements
- Participate in post-incident reviews, identify contributing causes and drive permanent fixes that eliminate whole classes of risk
- Produce clear, maintainable documentation for systems, runbooks, and automation to enable others to operate and extend your work
- Drive process improvements that increase team agility — reducing development friction, eliminating unnecessary gates, and improving delivery velocity
- May require occasional (<10%) regional and international travel to Design and Manufacturing Partner sites.
- A day in the life description provided in the job listing.
- The Hardware Engineering AI/ML UltraServer platform team located in Seattle, Austin, and Cupertino
Qualifications
- 6+ years of systems design, software development, operations, automation, and process improvement experience
- 6+ years of non-internship professional software development experience
- 6+ years of programming with at least one modern language such as C++, C#, Java, Python, Golang, PowerShell, Ruby
- 6+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
- Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent work experience
- 5+ years of Linux/Unix operating systems experience
Skills
Required:Automation infrastructureTelemetry and diagnosticsLinux device driversSystem debuggingCross-team collaboration
Benefits
- Health insurance (medical, dental, vision, prescription) and Life & AD&D insurance; option for Supplemental life plans; EAP; Mental Health Support; Flexible Spending Accounts; Adoption and Surrogacy Reimbursement coverage
- 401(k) matching
- Paid time off and parental leave
- RSUs and sign-on payments as part of compensation package
Last updated Oct 25, 2026. Interested? Apply on the company site.
More open roles at Amazon
- IT Support Associate II, Ops Tech Solutions (OTS)todayPlainfield, Indiana · Operations IT Support Engineering
- Head of Energy and Water, AWS LegaltodayHybrid (Seattle, WA) · Legal
- Software Development Engineer, Creative Asset Library, CreativeXtodaySeattle · Software Development
- Software Development Engineer, Creative Asset Library, CreativeXtodayHybrid (Seattle, WA) · Software Development
- IT Support Associate II, OTStodayIrving, TX · Operations IT Support Engineering