← All roles

Applied AI Engineer II

Microsoft· Software Engineering
Apply on company site
Hyderabad, Telangana, Indiafull-timePosted 4d ago

About the role

ACES CØDE at Microsoft focuses on reducing operational demand across the Microsoft Cloud by building AI-powered, autonomous systems and production AI services. The role involves turning product specifications into scalable AI services using LLM orchestration, multi-agent coordination, and RAG-based systems to resolve Azure customer issues at scale.

Responsibilities

  • Translate product specifications into AI service architectures — decompose business intent into agent workflows, data source integrations, and scalable service designs.
  • Build agentic AI workflows using Azure AI Foundry Agent Service and Microsoft Agent Framework, including multi-agent coordination, tool integrations, and agent lifecycle management.
  • Develop and iterate on LLM-based solutions including prompt engineering, model selection, cost/token optimization, and RAG pipeline design.
  • Build evaluation systems including rubrics, golden datasets, and judge agents to validate agent correctness and safety before production deployment.
  • Write production-quality C# and Python with test-driven development, ensuring services meet reliability, performance, and security standards.
  • Deploy services using CI/CD pipelines, feature flags, and staged rollouts with full production observability (tracing, logging, metrics).
  • Implement secure service patterns including RBAC, Managed Identities, and secrets management.
  • Integrate agents with Azure data sources and cloud-native services to ground agent responses in real-time signals.
  • Apply Responsible AI practices across all agent development, ensuring outputs are safe, fair, and compliant.
  • Execute reliably within sprint and co-development commitments across ACES and partner engineering teams.
  • Own the end-to-end lifecycle of AI service components, including design, development, testing, deployment, monitoring, and incident response.

Qualifications

  • Bachelor's degree in Computer Science, Engineering, or related field.
  • 3+ years of software engineering experience in C# and/or Python, with production deployment experience.
  • Experience building or integrating with LLM-based systems (prompt engineering, RAG, or agent frameworks).
  • Familiarity with Azure services (Azure OpenAI, Azure AI Foundry, Azure Functions, Cosmos DB, or similar cloud-native technologies).
  • Experience with CI/CD pipelines, automated testing, and production observability.
  • Understanding of data structures, algorithms, and system design fundamentals.

Skills

Required:C#PythonLLM-based systemsAzure servicesCI/CD
Nice to have:Security practices
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Microsoft

Cloud ComputingConsumer ElectronicsSoftwareTechnologyliquid-ai-recruiting-target
Company profileWebsite

More open roles at Microsoft