← All roles

Member of Technical Staff, Data Analysis and Evaluation

Cohere· Modeling
Apply on company site
RemoteFull-timePosted 11mo ago

About the role

Role focused on designing data collection, evaluating dataset quality, and assessing robustness/generalisation of large language models. Collaborates with researchers, engineers, and data annotators to drive data-driven decisions and improve AI systems quality, reliability, and performance.

Responsibilities

  • Design and oversee data collection tasks, including supporting human annotators and ensuring data quality.
  • Develop and apply statistical methods to evaluate the quality and reliability of datasets.
  • Analyse and assess the generalisability and robustness of ML systems across diverse use cases.
  • Collaborate with teams to improve dataset quality and model performance.
  • Train and fine-tune large language models (LLMs) on distributed training infrastructures.
  • Conduct experiments to evaluate model performance and identify areas for improvement.

Qualifications

  • Extremely strong software engineering skills.
  • Strong expertise in designing and conducting data collection tasks, including working with human annotators.
  • Strong statistical skills and experience evaluating scientific experiments related to data collection and model performance.
  • Experience analysing datasets with respect to their quality, biases, and suitability for training ML models.
  • Hands-on experience training large language models (LLMs) on distributed training infrastructures.
  • Familiarity with evaluating and improving the generalisability and robustness of ML systems.
  • Proficiency in programming languages such as Python and ML frameworks (e.g., PyTorch, TensorFlow, JAX).
  • Excellent communication skills to collaborate effectively with cross-functional teams and present findings.
  • One or more papers at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP).

Skills

Required:Software engineeringData collection task designStatistical evaluationDataset quality analysisLLM trainingGeneralisation/robustness evaluationPythonML frameworksCommunication
Nice to have:Research/publications

Benefits

  • Weekly lunch stipend of $75/£75 or equivalent
  • Full health and dental benefits, including mental health budget
  • RRSP matching, 401K, Pension Scheme
  • 100% Parental Leave top-up for up to 6 months
  • Annual enrichment benefits (arts, fitness, workspace improvement, education stipend)
  • 6 weeks of paid vacation (30 working days)
  • Budget for traveling to other offices and annual company offsite
  • $500 home office stipend
Last updated Oct 21, 2026. Interested? Apply on the company site.
Cohere logo

About Cohere

Support automation that's actually intelligent

Cohere resolves 40-70% of support requests using AI, over all channels, within just a few days.

artificial-intelligenceautomationliquid-ai-recruiting-target
Company profileWebsite

More open roles at Cohere