Physician AI Engineer
Counsel Health· Engineering
RemoteFull-timePosted 1w ago
About the role
Counsel Health is building an AI-enabled care delivery platform. This role sits at the intersection of clinical, technical, and product judgment to own the 0→1 build of clinical AI agents, safety systems, and evaluations that meet a practicing physician's standards for patient care.
Responsibilities
- Own the full arc of clinical and safety agents: scoping with Product and relevant teams, writing the PRD, designing the architecture and evals, building, and shipping to production.
- Stand up a clinical eval framework that becomes the canonical quality bar for at least one agent, built to be testable and productionized so engineers or researchers can run their work against it and know whether it's safe to ship.
- Measurably improve core components of Counsel AI (history-taking, differential diagnosis, triage, treatment planning), benchmarked against physician performance on representative case sets.
- Get fluent in the existing stack quickly by reading the code, running the evals, sitting with the clinical team, and surfacing a prioritized list of where Counsel’s AI and safety systems are weakest.
- Ship early, guided work end-to-end from shadowing current workflows, picking a tractable agent or safety component, prototyping it, getting it through review, and shipping it.
Qualifications
- MD, DO, or international equivalent, with residency training or 3+ years of clinical experience completed.
- Substantive, hands-on experience building with LLMs in production, beyond just experimentation.
- A track record of real ownership over shipped products in industry or startup settings; health tech experience is strongly preferred.
- Board-eligible or board-certified status with meaningful active or recent clinical practice (strongly preferred).
- Published research, open-source work, or public writing on clinical AI, LLM evaluations, or related areas (strongly preferred).
- Experience embedded inside an engineering organization (strongly preferred).
Skills
Required:Clinical reasoning and medical knowledgeLLM development in productionProduct ownership
Last updated Oct 15, 2026. Interested? Apply on the company site.
About Counsel Health
Meet the doctor that's with you for life
Chat With Medical AI and a Doctor Online | Counsel Health
healthcareAItelemedicinedoctor
More open roles at Counsel Health
- Medical Director4d agoRemote · Clinical
- Product Designer (Consumer)1mo agoHybrid (Boston), Hybrid (New York Office (Flatiron)) · Product
- Research Scientist1mo agoHybrid (New York Office (Flatiron)), Hybrid (Boston) · Engineering
- Senior Software Engineer (Fullstack)3mo agoHybrid (New York Office (Flatiron)), Hybrid (Boston) · Engineering
- Senior Software Engineer (Backend)3mo agoHybrid (New York Office (Flatiron)), Hybrid (Boston) · Engineering