Director/Sr. Manager, AI Inference Model Scaling
Cerebras· Software Engineering
Hybrid (Sunnyvale, CA)Full-timePosted 3mo ago
About the role
Engineering leadership role responsible for defining the technical vision, strategy, and execution roadmap to enable state-of-the-art foundation models on Cerebras hardware, focusing on ML model compilation, optimization, and high-performance kernel development for AI inference at scale.
Responsibilities
- Define the technical roadmap and strategy for the team.
- Establish technical direction across multiple teams and engineering leaders.
- Lead design reviews and establish engineering standards.
- Drive support for emerging LLM architectures and inference workloads.
- Hire, mentor, and grow a high-performing engineering team.
- Develop future technical leaders and managers.
- Drive organizational planning, headcount strategy, and investment priorities.
- Foster a strong engineering culture focused on execution, quality, and innovation.
- Scale engineering processes while maintaining execution velocity.
- Partner with Cloud Platform, ML, and Hardware teams in planning and delivering for end-to-end service enablement in Cloud and On-Premise settings
- Work with Product Management to prioritize model enablement and customer needs.
- Collaborate closely with customers and solution architects on new model bring-up.
- Influence future hardware/software co-design through ML model enablement and optimization insights.
- Own planning, prioritization, and execution across multiple concurrent initiatives.
- Balance rapid model support with long-term ML Compiler architecture.
- Drive predictable delivery for strategic customer commitments.
Qualifications
- BS, MS, or PhD in Computer Science, Computer Engineering or related field.
- 12+ years building compiler, ML systems, or infrastructure software.
- 5+ years leading engineering teams.
- Deep experience with modern compiler infrastructure (LLVM, MLIR, XLA, TVM, Torch FX, or similar).
- Strong understanding of graph compilation and optimization.
- Experience with Python and C++.
- Experience delivering production-quality software.
- Strong communication and cross-functional leadership skills.
Skills
Required:Compiler infrastructureGraph compilation and optimizationPythonC++
Last updated Aug 30, 2026. Interested? Apply on the company site.
About Cerebras
Cerebras is the go-to platform for fast and effortless AI training. Learn more at cerebras.ai.
Cerebras is the go-to platform for fast and effortless AI training.
AICerebras Wafer-Scale Enginechipshardwareinferenceliquid-ai-recruiting-targetmultimodalsetter-30
More open roles at Cerebras
- Infrastructure Systems Engineer – Linux, Storage & AutomationtodayHybrid (Sunnyvale, CA) · Datacenter
- Cloud Infrastructure EngineertodayHybrid (Sunnyvale, CA) · Software Engineering
- Power Manufacturing Test Development EngineertodaySunnyvale, CA · Hardware
- Supplier Quality Engineer - New Grad1w agoSunnyvale, CA · University Departments
- Supply Chain Program Manager1w agoHybrid (Sunnyvale, CA) · Hardware