Senior Software Engineer, Inference
About the role
Senior Software Engineer role focused on turning cutting-edge AI research into production-ready APIs and scalable inference infrastructure for AssemblyAI’s Voice AI platform.
Responsibilities
- Design and ship customer-facing APIs that expose new model capabilities, owning them from prototype through launch and ongoing iteration.
- Scale inference infrastructure to support 1M+ API users
- Partner with researchers to productionize new techniques, turning proofs-of-concept into production-grade services with appropriate latency and reliability
- Work with customers and Applied teams to understand usage and inform product design and research direction
- Contribute across the stack as needed: backend services, inference infrastructure, SDKs, internal tooling
Qualifications
- Strong backend engineering experience, including building and supporting machine learning infrastructure and/or customer-facing APIs in production
- Comfort operating with ambiguity and aligning research timelines with product timelines
- Genuine curiosity about AI/ML and ability to make informed engineering decisions around models
- Strong collaboration skills across researchers, applied engineers, and customers
Skills

About AssemblyAI
APIs for AI models
AssemblyAI is an applied AI company. We research, train, and deploy State-of-the-Art AI models for developers and product teams to integrate into their products/apps. Today, we offer AI models for audio transcription, content moderation, summarization, topic detection, and many other tasks. We are working towards building the "Stripe for AI models" - where developers and product teams will be able to easily access State-of-the-Art AI through a simple API. We're a fully remote team of AI researchers and ML engineers, and have raised over $65M in funding from top investors including Accel, Insight Partners, Y Combinator, John/Patrick Collison, Daniel Gross, and Nat Friedman.
More open roles at AssemblyAI
- Digital Native AI Account Executive4d agoHybrid (New York / San Francisco) · Operations
- Senior Researcher4d agoHybrid (Remote (US)) · Operations
- Digital Native AI Account Executive4d agoHybrid (New York City, NY and San Francisco, CA) · Operations
- Digital Native AI Account Executive4d agoHybrid (New York City, NY; San Francisco, CA) · Operations
- Sr. Technical Recruiter4d agoHybrid (United States)
