← All roles

Member of Technical Staff, Model Efficiency

Cohere· Modeling
Apply on company site
RemoteCA$295k - CA$535kFull-timePosted 11mo ago

About the role

Research-driven engineer focused on building reliable ML systems and improving LLM inference efficiency to achieve lower latency, higher throughput, and consistent quality across diverse workloads.

Responsibilities

  • Work across the inference stack to improve core performance metrics by diving deep into model execution, identifying bottlenecks, and developing optimizations.
  • Collaborate with modeling and systems teams to experiment, measure, and ship improvements that accelerate inference.
  • Develop expertise in advanced performance techniques, including GPU/CUDA optimizations, kernel-level improvements, and model execution strategies for MoE and large-scale architectures.

Qualifications

  • 5+ years of experience writing high-performance, production-quality code
  • Strong programming skills in C++ or Python (Rust/Go also welcome)
  • Experience working with large language models and familiarity with the LLM inference ecosystem (e.g., vLLM, SGLang, etc.)
  • Ability to diagnose and resolve performance bottlenecks across the model execution stack
  • A strong bias for action — you ship fast, measure impact, and iterate

Skills

Required:High-performance software developmentC++Python
Nice to have:GPU programming / CUDATransformer-based language modelingDistributed systems performance

Benefits

  • A weekly lunch stipend of $75/£75 or equivalent in local currency
  • Full health and dental benefits, including a separate budget for mental health
  • RRSP matching, 401K, Pension Scheme
  • 100% Parental Leave top-up for up to 6 months for either parent
  • Annual enrichment benefits (arts & culture, fitness/wellness, quality time, workspace improvement credit)
  • Education & learning stipend for conferences, courses, and coaching
  • 6 weeks of paid vacation (30 working days)
  • Budget for traveling to other offices if remote, plus annual company offsite
  • A $500 home office stipend
Last updated Oct 21, 2026. Interested? Apply on the company site.
Cohere logo

About Cohere

Support automation that's actually intelligent

Cohere resolves 40-70% of support requests using AI, over all channels, within just a few days.

artificial-intelligenceautomationliquid-ai-recruiting-target
Company profileWebsite

More open roles at Cohere