← All roles

Principal Software Engineer

Microsoft· Software Engineering
Apply on company site
United States$142.8k - $274.8kfull-timePosted 1w ago

About the role

The HPC/AI team is building next-generation distributed AI supercomputer infrastructure for high-performance AI model training at scale, focusing on networking capabilities with low latency and low jitter for distributed AI workloads in Azure Cloud.

Responsibilities

  • Partner with appropriate stakeholders to determine user requirements for a set of scenarios.
  • Lead identification of dependencies and the development of design documents for a product, application, service, or platform.
  • Leads by example and mentors others to produce extensible and maintainable code used across products.
  • Design, develop, and optimize networking solutions tailored for large-scale AI training infrastructure.
  • Architect and implement high-performance, low-latency, and low-jitter communication frameworks for distributed systems.
  • Benchmark, analyze, and enhance the scalability and reliability of networking systems to handle petabyte-scale data transfer.
  • Debug and resolve complex networking issues in large-scale, high-performance environments.
  • Drive identification of dependencies and the development of design documents for a product, application, service, or platform.
  • Create, implement, optimize, debug, refactor, and reuse code to establish and improve performance and maintainability, effectiveness, and ROI.
  • Act as a Designated Responsible Individual (DRI) and guides other engineers by developing and following the playbook, working on call to monitor system/product/service for degradation, downtime, or interruptions, alerting stakeholders about status and initiates actions to restore system/product/service for simple and complex problems when appropriate.
  • Proactively seek new knowledge and adapts to new AI trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale.

Qualifications

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.

Skills

Required:Networking for large-scale AI trainingHigh-performance, low-latency, low-jitter communicationBenchmarking and scalability analysisDebugging in large-scale environmentsDesign and documentationMentoring and leadership
Last updated Oct 16, 2026. Interested? Apply on the company site.

About Microsoft

Cloud ComputingConsumer ElectronicsSoftwareTechnologyliquid-ai-recruiting-target
Company profileWebsite

More open roles at Microsoft