← All roles

Principal Technical Program Manager

Microsoft· Technical Program Management
Apply on company site
Hybrid (United States)$142.8k - $274.8kFull-timePosted 1w ago

About the role

Lead technical strategy and architecture for AI infrastructure networking at hyperscale, focusing on InfiniBand, RDMA, high-performance Ethernet, and emerging AI interconnects to support Microsoft's large-scale AI training and inference workloads.

Responsibilities

  • Define the technical strategy and multi-year AI architecture direction for networking capabilities supporting Microsoft’s large-scale AI training and inference infrastructure.
  • Provide technical leadership across complex AI infrastructure systems spanning GPU and accelerated computing infrastructure, systems software, telemetry, and operations into scalable end-to-end solutions.
  • Translate AI workload requirements into system and networking architecture requirements spanning bandwidth, latency, topology, congestion management, resiliency, security, observability, serviceability, and operational efficiency.
  • Lead technical evaluation and architectural decision-making across technologies including InfiniBand, RDMA, advanced Ethernet fabrics, network interface devices, switches, optics, cables, GPU interconnects, and emerging AI networking technologies.
  • Create clarity in highly ambiguous problem spaces by driving alignment on complex architectural decisions and technical tradeoffs across networking, hardware and software engineering, systems architecture, datacenter infrastructure, operations, supply chain, finance, and customer-facing organizations.
  • Partner with internal AI workload teams and strategic customers to understand evolving training and inference requirements and convert those requirements into infrastructure capabilities and technology roadmap investments.
  • Influence the roadmaps and technical direction of strategic silicon, networking, and systems suppliers, ensuring emerging technologies can meet Microsoft’s requirements for performance, reliability, scale, serviceability, supply, and cost.
  • Lead complex infrastructure initiatives from early technology exploration and proof of concept through architecture definition, engineering qualification, production readiness, fleet deployment, and lifecycle improvement.
  • Establish technical success criteria and engineering mechanisms for measuring performance, reliability, availability, deployment readiness, operational health, and infrastructure efficiency.
  • Identify architectural, execution, and operational risks early and drive cross-organizational resolution of issues that can affect infrastructure readiness, capacity delivery, workload performance, or customer commitments.

Qualifications

  • Bachelor's Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience.
  • 3+ years of experience managing cross-functional and/or cross-team projects.

Skills

Required:Networking architectures for AI infrastructureInfiniBand, RDMA, Ethernet fabrics
Last updated Oct 16, 2026. Interested? Apply on the company site.

About Microsoft

Cloud ComputingConsumer ElectronicsSoftwareTechnologyliquid-ai-recruiting-target
Company profileWebsite

More open roles at Microsoft