← All roles

Principal Software Engineer

Microsoft· Software Engineering
Apply on company site
full-timePosted 4w ago

About the role

Principal Software Engineer in Microsoft’s AI infrastructure NeST group at the India Development Centre, focusing on building end-to-end system software and distributed infrastructure for large-scale AI accelerator platforms across cloud services, OS, host and device management, virtualization, and Kubernetes-based infrastructure.

Responsibilities

  • Architect and develop distributed control-plane services for provisioning, orchestration and lifecycle management of AI accelerator infrastructure.
  • Design scalable systems for state management, health monitoring, reconciliation and fault recovery.
  • Build host and device management software connecting cloud infrastructure with operating systems, drivers, firmware and accelerator devices.
  • Develop infrastructure supporting accelerator virtualization, device assignment, isolation and resource management.
  • Integrate accelerator infrastructure with Kubernetes and cloud-native platforms.
  • Design robust APIs and abstractions across cloud services, host software and device interfaces.
  • Drive improvements in reliability, security, observability, diagnostics, testing and operational readiness.
  • Champion AI-assisted engineering practices across architecture, design, coding, testing, debugging, code reviews and documentation to improve engineering velocity and software quality.
  • Apply AI-assisted workflows to accelerate code comprehension, root-cause analysis, test development, design exploration and engineering automation.
  • Identify opportunities to integrate AI into engineering workflows to reduce repetitive work, shorten development feedback loops and improve developer effectiveness.
  • Use AI-assisted learning together with engineering fundamentals to accelerate development of systems, hardware and AI infrastructure domain competency.
  • Establish reusable engineering practices and mentor engineers on the responsible and effective application of AI throughout the software development lifecycle.
  • Diagnose complex system issues spanning distributed services, operating systems, host software, drivers, firmware and hardware.
  • Lead architecture and design reviews, solve complex cross-layer system issues and mentor engineers.
  • Collaborate across hardware, firmware, OS, cloud infrastructure and AI platform teams to deliver end-to-end solutions.
  • Partner with hardware, firmware, operating system, cloud infrastructure and AI platform teams to deliver end-to-end solutions.
  • Mentor engineers and contribute to raising the technical capabilities and engineering standards of the broader organisation.

Qualifications

  • Bachelor’s Degree in Computer Science, Computer Engineering or related technical discipline, or equivalent experience with at least 12+ years of relevant industry experience.
  • Software engineering experience in C++, C, C#, Rust, Go or similar languages.
  • Experience designing and developing distributed systems, cloud infrastructure or systems software.
  • Understanding of concurrency, state management, asynchronous programming and failure recovery.
  • Experience building reliable production software with strong debugging and problem-solving skills.
  • Demonstrated technical leadership across complex, multi-team engineering projects.
  • Ability to leverage AI-assisted engineering tools and workflows, combined with strong engineering judgement, to improve software development effectiveness, quality and technical problem solving.
  • Ability to rapidly develop expertise in complex technical domains and help raise engineering competency across the team through mentoring, technical guidance and knowledge sharing.

Skills

Required:Distributed systems designProgramming languages
Nice to have:Cloud and KubernetesAI-assisted engineering

Benefits

  • Microsoft’s equal opportunity employer statement is included in the description. (Explicit benefits not enumerated in the text)
Last updated Sep 24, 2026. Interested? Apply on the company site.

About Microsoft

Cloud ComputingConsumer ElectronicsSoftwareTechnologyliquid-ai-recruiting-target
Company profileWebsite

More open roles at Microsoft