← All roles

Member of Technical Staff - Applied AI Software Engineer, Health

Microsoft· Software Engineering
Apply on company site
London£93.5k - £161.8kFull-timePosted 1mo ago

About the role

Engineers to design, build, and evaluate LLM-based health products within Microsoft AI, focusing on safe, informative, and trustworthy health information; responsible for eval pipelines, data curation, analyses, and communicating results to stakeholders.

Responsibilities

  • Be a key cross-functional team member, and close collaborator to product teams. Make significant contributions from translating research into benchmarks to co-authoring product roadmap.
  • Design and build evaluation systems that test LLM capabilities in the healthcare domain, and interpret and communicate results.
  • Run experiments to determine how different prompting techniques affect results on internal and industry benchmarks.
  • Improve the tooling that is used internally to implement, run and analyze evaluations.
  • Design internal benchmarking and regression testing capabilities that capture model accuracy, safety and utility.

Qualifications

  • Bachelor's or Higher Degree in Computer Science, or related technical discipline AND significant Python programming experience / machine learning research.
  • Experience building with and around LLMs including prompt / context and harness engineering.
  • Deep expertise in evaluating and understanding the performance of agents.
  • Experience collaborating in cross functional teams, working through ambiguity to deliver high quality results.
  • Have 0 to 1 experience with a bias towards shipping and learning, while balancing a high-quality bar.
  • Proven ability to collaborate and contribute to a positive, inclusive work environment, fostering knowledge sharing and growth within the team.

Skills

Required:Python programmingLLM design and evaluationEval pipelines and data curationCross-functional collaboration
Last updated Sep 3, 2026. Interested? Apply on the company site.

About Microsoft

Cloud ComputingConsumer ElectronicsSoftwareTechnologyliquid-ai-recruiting-target
Company profileWebsite

More open roles at Microsoft