← All roles

Principal Software Engineering, AI Infrastructure

Microsoft· Software Engineering
Apply on company site
United Statesfull-timePosted 4d ago

About the role

The FIT Infrastructure team builds foundational accelerated compute platforms for large-scale AI training and inference. Role focuses on mission-critical AI infrastructure, cloud GPU platforms, and end-to-end platform capabilities across hardware, networking, and AI deployment/serving software.

Responsibilities

  • Develop systems for AI Workload management, scheduling, preemption, and failover.
  • Develop systems for AI Workload serving.
  • Design and build GPU accelerated infrastructure for training and inference workloads, spanning bare metal, virtual machines, and containerized environments.
  • Build and operate advanced orchestration and resource governance using AKS and Kubernetes to enable fair sharing, isolation, and efficient utilization of accelerated resources.
  • Design, develop, test, and maintain services written in C#, Golang hosted on Kubernetes clusters.
  • Optimize performance, reliability, and utilization across large GPU fleets, including scaleup and scale out configurations.
  • Drive end-to-end platform features from design through production, including observability, diagnostics, and operational excellence.
  • Influence platform architecture and technical direction across teams through design reviews and technical leadership.
  • Embody our Culture and Values

Qualifications

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Linux, Go or Python - OR equivalent experience.

Skills

Required:GPU infrastructureAI workload managementAI workload servingC#GolangKubernetes

Benefits

  • Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Microsoft

Cloud ComputingConsumer ElectronicsSoftwareTechnologyliquid-ai-recruiting-target
Company profileWebsite

More open roles at Microsoft