Senior Software Engineer, Inference
About the role
Senior Software Engineer role focused on turning cutting-edge AI research into production-ready inference APIs and scalable infrastructure for AssemblyAI’s model capabilities.
Responsibilities
- Design and ship customer-facing APIs that expose new model capabilities, owning them from prototype through launch and ongoing iteration.
- Scale inference infrastructure to support 1M+ API users.
- Partner with researchers to productionize new techniques, turning notebooks/POCs into production-ready systems with latency, reliability, and ergonomics for customers.
- Work with customers and Applied teams to feed user feedback into product design and research direction.
- Contribute across the stack as needed: backend services, inference infrastructure, SDKs, internal tooling.
Qualifications
- Strong backend engineering experience, including building and supporting machine learning infrastructure and/or customer-facing APIs in production.
- Comfort operating with ambiguity between research timelines and product timelines.
- Genuine curiosity about AI/ML; ability to understand model behavior to inform engineering decisions.
- Strong collaboration skills, experience working with researchers, applied engineers, and customers.
Skills
About AssemblyAI
APIs for AI models
AssemblyAI is an applied AI company. We research, train, and deploy State-of-the-Art AI models for developers and product teams to integrate into their products/apps. Today, we offer AI models for audio transcription, content moderation, summarization, topic detection, and many other tasks. We are working towards building the "Stripe for AI models" - where developers and product teams will be able to easily access State-of-the-Art AI through a simple API. We're a fully remote team of AI researchers and ML engineers, and have raised over $65M in funding from top investors including Accel, Insight Partners, Y Combinator, John/Patrick Collison, Daniel Gross, and Nat Friedman.
More open roles at AssemblyAI
- Digital Native AI Account Executive4d agoHybrid (New York / San Francisco) · Operations
- Senior Researcher4d agoHybrid (Remote (US)) · Operations
- Digital Native AI Account Executive4d agoHybrid (New York City, NY and San Francisco, CA) · Operations
- Digital Native AI Account Executive4d agoHybrid (New York City, NY; San Francisco, CA) · Operations
- Sr. Technical Recruiter4d agoHybrid (United States)