← All roles

Senior and/or Principal Software Engineer- AI Frameworks

Microsoft· Software Engineering
Apply on company site
Hybrid (US-Multiple)$142.8k - $274.8kfull-timePosted 1mo ago

About the role

Senior and/or Principal Software Engineers - AI Frameworks at Microsoft partner across model developers, researchers, hardware teams, and production services to accelerate model onboarding, improve performance and reliability, and turn performance insights into durable platform capabilities. Role encompasses design, implementation, benchmarking, automation, and tooling for AI frameworks, runtimes, and hardware integrations, with hands-on leadership in cross-stack initiatives and measurable production impact.

Responsibilities

  • Design, implement, test, and operate production-quality components across AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations.
  • Benchmark, profile, debug, and optimize large language model training and inference workloads across GPUs and Microsoft hardware.
  • Build automation and observability that detect regressions, improve reproducibility, surface actionable insights, and accelerate model and hardware onboarding.
  • Drive scoped projects from problem definition through deployment, balancing delivery speed, maintainability, reliability, and measurable customer or capacity impact.
  • Partner with researchers, model teams, infrastructure owners, and hardware vendors to diagnose cross-stack issues and deliver production-ready solutions.
  • Contribute to technical design reviews, engineering standards, operational health, and mentoring of other engineers.
  • Embodiment of Microsoft’s culture and values.
  • Define technical vision, architecture, and multi-release strategy for AI framework, performance, benchmarking, or developer-productivity capabilities.
  • Lead ambiguous, cross-stack investigations spanning models, frameworks, compilers, runtimes, systems, services, and silicon.
  • Establish common measurement, automation, observability, and engineering mechanisms for scalable platform capabilities.
  • Drive improvements in model onboarding velocity, runtime performance, reliability, hardware utilization, and Azure capacity efficiency.
  • Influence architecture and priorities across teams; align researchers, product groups, infrastructure owners, and hardware partners.
  • Provide hands-on technical leadership through prototypes, critical-path implementation, design/code reviews, debugging, and operational readiness.
  • Mentor senior engineers, develop technical leaders, and advance standards for quality, maintainability, and collaboration.
  • Embodiment of Microsoft’s culture and values.

Qualifications

  • Bachelor’s Degree in Computer Science or related technical field and 4+ years of technical engineering experience coding in C++, Python, or equivalent.

Skills

Required:C++Python
Nice to have:Experience with AI/ML frameworksGPU software and profiling
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Microsoft

Cloud ComputingConsumer ElectronicsSoftwareTechnologyliquid-ai-recruiting-target
Company profileWebsite

More open roles at Microsoft