Software Engineer, Frontier AI Infrastructure
About the role
Software Engineer role on Scale AI's Public Sector Engineering team, owning the model inference layer, debugging AI tools, managing networking and latency, and tracking pricing/usage metrics for AI models. Involves collaboration with cloud vendors and customers, proactive integration testing with Product, and contributing to platform roadmap for Public Sector.
Responsibilities
- Design and implement secure scalable backend systems for Public Sector customers, leveraging Scale's modern and cloud-native AI infrastructure.
- Own services or systems and define their long-term health goals, while improving the health of surrounding components
- Re-architect the stack to run in compliant or restrictive environments, designing swappable components to meet government/security mandates without breaking the product
- Work with Product to build integration tests that catch issues early, shifting focus from infra-only debugging to preventing failures upstream
- Participate actively in customer engagements, understanding requirements and delivering innovative solutions
- Contribute to the platform roadmap and product strategy for Scale AI's Public Sector business
Qualifications
- At least an active secret clearance and the ability & willingness to up level to TS/SCI with CI Poly (required)
Skills
Benefits
- comprehensive health, dental and vision coverage
- retirement benefits
- learning and development stipend
- generous PTO
- commuter stipend (may be eligible)

About Scale AI
Data-centric infrastructure to accelerate the development of AI
Scale accelerates the development of AI within organizations of any size to deliver critical business insights and operational efficiency. Its data-centric infrastructure platform leverages RLHF (Reinforced Learning with Human Feedback) to help organizations build the strongest AI models that supercharge their business, with customers across industries including Meta, Microsoft, U.S. Army, DoD’s Defense Innovation Unit, Open AI, General Motors, Toyota Research Institute, Brex, Instacart and Flexport.
More open roles at Scale AI
- Strategic Contracts Lead, Public Sector5d agoWashington, DC · Public Sector
- Web Designer, Brand Web Experience5d agoSan Francisco, CA · Marketing
- Head of Strategic Partnerships, Global Systems Integrators5d agoSan Francisco, CA · Enterprise Sales
- Safety Research Scholar - Human Frontier Labs5d agoHybrid (United States) · Human Frontier Collective
- Machine Learning Research Intern (Summer 2027)5d agoHybrid (San Francisco, CA), Hybrid (New York, NY) · University
