Infrastructure Software Engineer, Enterprise GenAI
About the role
Infrastructure-focused role to design and scale multi-cloud, distributed systems for Scale GP (Scale Generative AI Platform), with emphasis on integrating with customer environments across AWS, Azure, and GCP.
Responsibilities
- Architect multi-cloud systems and abstractions to allow the SGP platform to run on top of existing Cloud providers
- Implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs)
- Collaborate with platform, product teams and our customers directly to develop and implement innovative infrastructure that scales to meet evolving needs
- Deliver experiments at a high velocity and level of quality to engage our customers
- Work across the entire product lifecycle from conceptualization through production
- Be able, and willing, to multi-task and learn new technologies quickly
Qualifications
- 4+ years of full-time engineering experience, post-graduation
- Experience scaling products at hyper growth startups
- Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies
- Proficient in Python or Javascript/Typescript, and SQL
- Experience with Kubernetes
- Experience with major cloud providers (AWS, Azure, GCP)
- Excellent communication skills with the ability to explain technical concepts to both technical and non-technical audiences
Skills
Benefits
- comprehensive health, dental and vision coverage
- retirement benefits
- a learning and development stipend
- generous PTO
- commuter stipend (potentially)

About Scale AI
Data-centric infrastructure to accelerate the development of AI
Scale accelerates the development of AI within organizations of any size to deliver critical business insights and operational efficiency. Its data-centric infrastructure platform leverages RLHF (Reinforced Learning with Human Feedback) to help organizations build the strongest AI models that supercharge their business, with customers across industries including Meta, Microsoft, U.S. Army, DoD’s Defense Innovation Unit, Open AI, General Motors, Toyota Research Institute, Brex, Instacart and Flexport.
More open roles at Scale AI
- Strategic Contracts Lead, Public Sector5d agoWashington, DC · Public Sector
- Web Designer, Brand Web Experience5d agoSan Francisco, CA · Marketing
- Head of Strategic Partnerships, Global Systems Integrators5d agoSan Francisco, CA · Enterprise Sales
- Safety Research Scholar - Human Frontier Labs5d agoHybrid (United States) · Human Frontier Collective
- Machine Learning Research Intern (Summer 2027)5d agoHybrid (San Francisco, CA), Hybrid (New York, NY) · University
