← All roles

Software Engineer III, Copilot Models Inference

GitHub· Engineering
Apply on company site
Hybrid (Remote United States)$107.7k - $285.9kFull-timePosted 1mo ago

About the role

Software Engineer III responsible for designing, implementing, and maintaining backend services and APIs that connect GitHub Copilot experiences to AI model providers, with focus on reliability, performance, and safe rollout in a distributed, on-call environment.

Responsibilities

  • Design, implement, test, deploy, and maintain backend services and APIs that connect GitHub Copilot experiences to model providers.
  • Own scoped features end to end, from technical design and implementation through operational readiness, safe rollout, measurement, and follow-up.
  • Integrate new models and provider capabilities while accounting for availability, compatibility, capacity, failure modes, and safe fallback behavior.
  • Improve service latency, throughput, capacity efficiency, and high-availability behavior using measurable production outcomes.
  • Add and maintain automated tests, dashboards, alerts, runbooks, and diagnostics that make service and model health understandable and actionable
  • Keep teammates and partners informed through clear discussions, written updates, and documentation, especially when decisions, risks, or incidents affect others.
  • Participate in code reviews and design discussions, incorporating feedback and helping teammates ship maintainable changes.
  • Participate in on-call and first-responder rotations, investigate incidents, communicate impact, restore service, and complete appropriate repair and automation work.
  • Use progressive delivery practices and production evidence to reduce risk when launching models, changing routing behavior, or updating provider integrations.
  • Collaborate with Models Lifecycle, product, safety, infrastructure, and provider partners to deliver model availability and operational improvements across team boundaries.

Qualifications

  • 4+ years experience in Software Engineering, Computer Science, or related technical discipline with proven experience maintaining and delivering production software languages including, but not limited to, C, C++, C#, JavaScript, Go, Ruby, Rust, or Python.
  • OR Associate’s Degree in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field AND 3+ years experience.
  • OR Bachelor's Degree in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field AND 2+ years experience in Computer Science, or related technical discipline with proven experience coding in languages including, but not limited to, C, C++, C#, JavaScript, Go, Ruby, Rust, or Python.
  • OR Master's Degree in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field.
  • OR equivalent experience

Skills

Required:Backend developmentSystem design and architectureOn-call / incident response
Nice to have:Progressive delivery / canary releases

Benefits

  • Open to GitHub benefits and additional rewards including annual bonus and stock where applicable.
Last updated Sep 17, 2026. Interested? Apply on the company site.

About GitHub

Change is constant. GitHub keeps you ahead.

Join the world's most widely adopted, AI-powered developer platform where millions of developers, businesses, and the largest open source community build software that advances humanity.

developer platformAI-poweredsoftware developmentopen source
Company profileWebsite

More open roles at GitHub