← All roles

Senior and/or Principal Software Engineer - AI Infrastructure

Microsoft· Software Engineering
Apply on company site
United States, Washington, Redmond, United States, California, Mountain View$119.8k - $234.7kfull-timePosted 1w ago

About the role

Senior/Principal software engineer to define the future of engineering systems and developer productivity by building high-scale distributed services for AI training and inference infrastructure supporting large-scale model workloads and Generative AI platforms.

Responsibilities

  • Work on the architecture, design and development of the core compute services powering AzureML to tackle challenging AI problems using state-of-the-art LLM models such as GPT5 and OSS models.
  • Work on the architecture, design, and development of the core AI Infrastructure services that support large scale AI training and inferencing.
  • Develop, test, and maintain backend services written in C#, Go, Rust, C++, hosted on Kubernetes clusters and Docker containers.
  • Develop and operate training/inference infra framework and machine learning systems.
  • Enhance systems and applications to ensure high stability, efficiency, & maintainability, low latency, tight cloud security.
  • Provide operational support and DRI responsibilities for the product.
  • Collaborate closely with engineers, data scientists within the team, internal Microsoft Research teams and external enterprises to build better solutions together.
  • Provide vision, expertise, and technical leadership to other team members.

Qualifications

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.

Skills

Required:C++C#GoPython
Nice to have:CRustJava

Benefits

  • Benefits and other compensation may apply per location (see link provided in job description).
Last updated Oct 16, 2026. Interested? Apply on the company site.

About Microsoft

Cloud ComputingConsumer ElectronicsSoftwareTechnologyliquid-ai-recruiting-target
Company profileWebsite

More open roles at Microsoft