Member of Technical Staff, Training Infra Engineer
RemoteFull-timePosted 11mo ago
About the role
Role focused on contributing to model training pipelines, shipping state-of-the-art models to production, and bridging research and production in a high-compute environment. Remote-friendly with multiple international offices.
Responsibilities
- Design and write high-performant and scalable software for training.
- Improve our training setup from an infrastructure and codebase performance standpoint.
- Craft and implement tools to speed up our training cycles and improve the overall efficacy of our training infrastructure
- Research, implement, and experiment with ideas on our supercompute and data infrastructure.
- Learn from and work with the best researchers in the field.
Qualifications
- Extremely strong software engineering skills.
- Proficiency in Python and related ML frameworks such as JAX, Pytorch and XLA/MLIR.
- Experience with distributed training infrastructures (Kubernetes, Slurm) and associated frameworks (Ray)
- Experience using large-scale distributed training strategies.
- Hands on experience on training large model at scale and having contributed to the tooling and/or setup of the training infrastructure
- Bonus: paper at top-tier venues (NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP)
Skills
Required:Software engineeringPythonML frameworks (JAX, PyTorch, XLA/MLIR)Distributed training infrastructuresDistributed frameworks (Ray)Large-scale model training
Benefits
- A weekly lunch stipend per location
- Full health and dental benefits, including mental health budget
- RRSP matching, 401K, Pension Scheme
- 100% Parental Leave top-up for up to 6 months
- Annual enrichment benefits (arts & culture, fitness, workspace improvement, learning stipend)
- 6 weeks of paid vacation (30 working days)
- Travel budget to other offices and annual company offsite
- Co-working benefit and $500 home office stipend
Last updated Oct 21, 2026. Interested? Apply on the company site.

About Cohere
Support automation that's actually intelligent
Cohere resolves 40-70% of support requests using AI, over all channels, within just a few days.
artificial-intelligenceautomationliquid-ai-recruiting-target
More open roles at Cohere
- Partner Development Manager - Berlin4d agoRemote · Revenue
- VP of Sales - Public Sector4d agoRemote · Revenue
- Delivery Operations Analyst4d agoRemote · Product Management & Program Management
- Technical Program Manager, AI Delivery for Public Sector & Defense, Germany4d agoRemote · Product Management & Program Management
- Senior/Staff Software Engineer (Back-End), Inference4d agoRemote · Inference
