← All roles

Senior Manager, Engineering - AI Inference

Crusoe· Cloud Engineering
Apply on company site
San Francisco, CA - US$250k - $300kFull-timePosted 3w ago

About the role

Senior Engineering Manager leading an engineering team focused on making large language models run faster, cheaper, and more reliably in production. Combines people management with hands-on coding, performance profiling, and customer-facing technical leadership to optimize inference stacks for diverse models and workloads.

Responsibilities

  • Bring current inference techniques into production and refine them.
  • Design and optimize serving architectures, including prefill and decode disaggregation, request routing, and related approaches.
  • Work down into the serving stack, from frameworks like vLLM and SGLang to the CUDA kernels underneath, profiling and running in-depth analysis to find and fix performance problems.
  • Adapt and scale optimization methods across many kinds of ML models, with an emphasis on large language models.
  • Profile and tune deployments against clear targets for latency, throughput, and cost, and keep them dependable under real traffic.
  • Tailor deployments to each customer's models and constraints, partnering with their engineering teams to move a workload from an early proof of concept through to a live, well-monitored production service.
  • Build and support the software and product features around the inference stack in a production setting, using one or more general-purpose languages, with Python preferred given how central it is to ML work.
  • Experiment quickly: take fuzzy goals, shape them into clear specs and focused proofs of concept, run fast experiments to find what works, and ship well-tested results without delay.
  • Lead team delivery end to end, guiding projects from early experiments to production optimizations, establishing performance goals, and partnering with product and engineering leaders on technical strategy and roadmaps.
  • Work through ambiguity and make sound calls on tradeoffs and tooling, steering away from complexity that is not needed.
  • Take real pride and ownership in your work, hold yourself accountable, and look for the same from the people around you.

Qualifications

  • 2+ years of experience directly managing and leading an engineering team in a high-performance or ML-focused environment.
  • Strong technical, hands-on experience in software engineering, low-level optimization, or ML infrastructure, with a continued desire to stay close to code and architecture.
  • A Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, Mathematics, or a related field.
  • Hands-on experience shipping code in production with one or more general-purpose languages, such as Python or C++, with a strong preference for Python.
  • Familiarity with methods for optimizing LLMs for high throughput / low latency inference.
  • Comfort with modern LLM serving frameworks such as vLLM or SGLang, and with profiling and analyzing performance down to the kernel level.
  • A firm grasp of how GPUs are built and how they behave.
  • Clear interest and hands-on experience with large language models.
  • A working knowledge of AI/ML pipelines and the full path of developing and deploying ML models.
  • Strong communication skills, particularly when explaining hard technical topics to customers and teammates.

Skills

Required:People managementProduction software engineering

Benefits

  • Competitive compensation and equity packages
  • Restricted Stock Units
  • Paid time off, paid holidays & leave of absence programs
  • Comprehensive health, dental & vision insurance
  • Employer contributions to HSA account
  • Paid parental leave
  • Paid life insurance, short-term and long-term disability
  • Professional development & tuition reimbursement
  • Mental health & wellness support
  • Commuter benefits (parking & transit)
  • Cell phone stipend
  • 401(k) Retirement plan with company match up to 4% of salary
  • Volunteer time off
  • Global travel insurance & emergency assistance
  • Daily meals allowance
  • Additional perks & programs specific to location
Last updated Sep 30, 2026. Interested? Apply on the company site.

About Crusoe

The AI factory company | Renewable-powered AI infrastructure

Crusoe provides next-gen AI infrastructure and cloud compute using an energy-first approach. Deploy AI workloads at scale with reliable performance and 24/7 support.

AI infrastructureData centersEdge computingGPU computingRenewable energycloud computeenergy-first approachsetter-30
Company profileWebsite

More open roles at Crusoe