← All roles

Principal Software Engineer, Storage Infrastructure

Microsoft· Software Engineering
Apply on company site
Redmond, WA, Hybrid (Multiple Locations)$142.8k - $304.2kfull-timePosted 1w ago

About the role

Design, build, and operate storage platforms for foundation-model pre-training, post-training, fine-tuning, and inference on Azure. Lead architecture, performance, reliability, and cross-team collaboration for storage and KV caching in cloud-scale AI training and inference workflows.

Responsibilities

  • Design, build, and evolve distributed storage systems and file systems for cloud-scale AI training and inference workloads.
  • Architect and operationalize storage stacks for large Kubernetes clusters, optimizing data access, throughput, latency, scalability, and reliability for GPU-accelerated workloads.
  • Design storage and KVkey-value caching architectures that improve LLM inference latency, throughput, resource utilization, and cost efficiency.
  • Improve durability, availability, performance, and operational maturity through automation, observability, diagnostics, incident response, and resiliency engineering.
  • Analyze complex cross-layer production issues, identify root causes, and implement durable improvements across storage, compute, networking, and runtime components.
  • Partner with infrastructure and machine learning/LLM platform teams to deliver end-to-end capabilities for foundation-model pre-training, post-training, fine-tuning, and inference.
  • Lead architecture reviews, influence long-term storage strategy, mentor engineers, and establish engineering practices for secure and reliable cloud services.
  • Embodiment of Culture and Values

Qualifications

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.

Skills

Required:Distributed storage systemsKubernetes clusters / storage stacksKV caching for LLM inferenceDurability, availability, performance, resiliency engineeringCross-team collaboration / architecture reviews
Last updated Oct 16, 2026. Interested? Apply on the company site.

About Microsoft

Cloud ComputingConsumer ElectronicsSoftwareTechnologyliquid-ai-recruiting-target
Company profileWebsite

More open roles at Microsoft