Senior Test Engineer
Heartflow· Software Engineering
San Francisco, CA$165k - $205kFull-timePosted 1mo ago
About the role
Hands-on contributor driving end-to-end system testing, post-deployment verification, and automated test suite development for HeartFlow's regulated SaMD products, spanning ML/AI pipelines, UI, web viewers, and reporting layers; emphasizes AI-first automation, QA under QMS, and offshore/contractor test engineer coordination.
Responsibilities
- Design, implement, and maintain end-to-end (E2E) automated test suites that exercise complete user workflows across UI, API, and back-end services, executing against the architecture and standards set by the Test Architect.
- Champion an AI-first automation strategy. Implement and scale test coverage using AI-assisted authoring and generative test planning derived from AI-generated requirements, while leveraging intelligent triage to minimize maintenance overhead.
- Build and own a baseline suite of daily smoke/build-acceptance tests covering core workflows across development and staging environments, closing a current gap where automated testing only runs during formal V&V cycles.
- Lead post-deployment testing activities, including production smoke tests, monitoring-driven verification, and continuous validation against live environments.
- Design and implement golden-dataset regression tests for HeartFlow's ML pipeline services, validating algorithmic outputs against curated reference cases.
- Build automated test coverage for HeartFlow's WebGL-based 3D Web Viewer and Clinical/CaseOps UIs using Playwright, including visual regression for 3D model rendering and view generation.
- Author clear, traceable test plans, test protocols, and test reports that meet the documentation expectations of a regulated medical device QMS.
- Perform tool validation for test infrastructure and automation tooling in accordance with internal QMS procedures and applicable standards.
- Build and maintain UI automation using Selenium and Playwright; extend frameworks for stability, parallelism, and reuse across product lines.
- Collaborate with software engineering teams to standardize API-level and integration tests using tools such as REST Assured, Postman, or Karate, including testing for DICOM ingestion and HL7 output validation at the hospital/cloud boundary.
- Partner with software engineers, product managers, and RA/QA to translate requirements into verifiable test cases with full traceability, contributing to closing the current gap between code commits and Ketryx-generated audit evidence.
- Triage and root-cause failures across complex distributed systems; drive defects to resolution and contribute to defect-prevention initiatives.
- Contribute to CI/CD pipelines so that automated tests run reliably and provide fast, actionable feedback to engineering teams.
- Support quality-related audits, CAPAs, and regulatory submissions by providing test evidence, traceability, and documentation.
- Support and coordinate offshore/contractor test engineers for overlapping product areas, helping ramp them on HeartFlow's systems and test standards.
- Mentor the Test Engineer role and contribute to hiring as the team scales.
Qualifications
- 5–8 years of experience in software test engineering, SDET, or quality engineering roles, with a strong hands-on automation background.
- Direct experience testing Software as a Medical Device (SaMD) or other regulated medical device software.
- Working knowledge of medical device QMS practices and applicable standards (e.g., ISO 13485, IEC 62304, ISO 14971, 21 CFR Part 820), including test documentation, traceability, and tool validation.
- Strong proficiency with Selenium / WebDriver and Playwright, including framework design, page-object patterns, and stability/flake reduction techniques.
- Demonstrated experience designing and maintaining E2E automation frameworks that cover complete workflows and system integrations.
- Experience authoring test plans, protocols, and reports in a regulated environment, with attention to traceability between requirements, test cases, and evidence.
- Practical experience with AI-assisted testing tools and techniques (e.g., AI-augmented test authoring, self-healing automation, LLM-driven test generation or triage).
- Solid programming skills in Python and at least one additional mainstream language used for automation (e.g., TypeScript/JavaScript, Java, or C#).
- Experience with API testing tools (REST Assured, Postman, Karate, Pact.io or equivalent) and basic familiarity with contract testing concepts.
- Experience integrating automated tests into CI/CD pipelines (e.g., GitHub Actions, Harness) and working with cloud environments such as AWS.
- Strong analytical and debugging skills across distributed systems, with a structured approach to root-cause analysis.
- Excellent written and verbal communication skills; able to clearly document test designs, defects, and risk.
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
Skills
Required:End-to-end automated testingUI automationAI-assisted testingPythonTypeScript/JavaScript or Java or C#
Benefits
- bonus
- equity
Last updated Sep 14, 2026. Interested? Apply on the company site.
About Heartflow
Decisive Coronary Care
Heartflow’s vision is to transform CAD from the leading cause of death into a disease that can be managed for life.
CCTA ResourcesRoadmap AnalysisFFRCT AnalysisPlaque AnalysisHeartflow OneHeartflow One PlatformMeasurable Impact
More open roles at Heartflow
- Territory Account Manager - Seattle, WA; Bellevue, WA; Everett, WAtodayRemote · US Sales
- Territory Account Manager - North Chicago, ILtodayNorth Chicago, IL · US Sales
- Territory Account Manager - North Denver, COtodayHybrid (Denver, CO) · US Sales
- Territory Account Manager - Atlantic City, NJtodayRemote · US Sales
- IT Director, Infrastructure and OperationstodayHybrid (Rohnert Park, CA) · Corp IT