← All roles

Principal Applied AI Engineer

Microsoft· Software Engineering
Apply on company site
Hyderabadfull-timePosted 4d ago

About the role

Technical architect and hands-on developer role building production AI agentic services for Azure customer support. Architect scalable AI agents, lead end-to-end delivery, define standards, and drive measurable customer impact in an on-site role in Hyderabad, India.

Responsibilities

  • Architect and build production agentic AI systems: Design and implement scalable AI agents and services, including LLM orchestration, multi-agent workflows, RAG pipelines, tool integrations, memory and state management, and human-in-the-loop experiences.
  • Lead through hands-on engineering: Write, review, and maintain production-quality C# and Python code. Build critical components, reference implementations, prototypes, and reusable platform capabilities that accelerate delivery across the engineering organization.
  • Own end-to-end technical delivery: Translate ambiguous customer support scenarios into clear technical requirements and take solutions from architecture and experimentation through implementation, deployment, operation, and continuous improvement.
  • Define technical architecture and engineering standards: Establish architecture patterns, API and data contracts, code quality expectations, evaluation practices, deployment strategies, and observability standards for AI services.
  • Advance evaluation-driven AI development: Design and implement evaluation frameworks using rubrics, golden datasets, simulation, judge models, and offline and online evaluation.
  • Own production quality and reliability: Ensure AI services meet demanding standards for correctness, availability, latency, scalability, cost, and safety.
  • Design for responsible and secure AI: Embed responsible AI principles, privacy protections, prompt-injection defenses, tool authorization, data boundaries, action controls, auditability, and fail-safe behavior into system architecture and implementation.
  • Make consequential technical decisions: Evaluate models, frameworks, platforms, and architectural approaches using evidence from experiments and production telemetry.
  • Influence product and platform roadmaps: Partner with product managers, researchers, platform engineers, and Azure service teams to shape technical strategy and platform capabilities.
  • Drive measurable customer and business impact: Instrument systems and use data to improve automation accuracy, case volume reduction, resolution time, engineering efficiency, and customer satisfaction.
  • Provide technical leadership across teams: Lead architecture reviews, resolve complex technical disagreements, and align engineers and partner organizations around shared designs.
  • Raise the engineering capability of the organization: Mentor engineers in system design, software engineering, applied AI, and evaluation-driven development.

Qualifications

  • Bachelor's degree in Computer Science, Engineering, or a related technical field.
  • 12+ years of professional software engineering experience designing, building, and operating production software systems.
  • Proficiency in C# and/or Python, with demonstrated ability to design and implement production-quality services and distributed systems.
  • Experience serving as a technical architect or technical lead for complex, cross-team engineering initiatives.
  • Experience with applied AI systems, including LLM-based applications, prompt engineering, RAG architectures, agent frameworks, or machine learning services.
  • Experience with cloud platforms, preferably Azure, and cloud-native engineering practices including microservices, APIs, containers, CI/CD, infrastructure as code, and observability.
  • Demonstrated success owning the full engineering lifecycle, from problem definition and architecture through implementation, deployment, and production operations.
  • Proficiency in software architecture, distributed systems, data structures, algorithms, API design, security, testing, and service reliability.
  • Proven ability to influence technical direction and align multiple teams without direct management authority.

Skills

Required:LLM orchestrationMulti-agent systemsRAG (retrieval-augmented generation)Tool integrationC#Python

Benefits

  • Not specified in the description.
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Microsoft

Cloud ComputingConsumer ElectronicsSoftwareTechnologyliquid-ai-recruiting-target

More open roles at Microsoft