Senior Data Labeler
Hybrid (Paris), Hybrid (London)Full-timePosted 3mo ago
About the role
Data labeling lead to build and manage the annotation team, define guidelines and evaluation frameworks, oversee labeling operations for safety evals, RLHF, and benchmarks, ensuring quality, throughput, and cost efficiency.
Responsibilities
- - Build from scratch and lead the Data Labeling team (hiring, coaching, and performance management)
- - Define annotation guidelines, quality standards, and evaluation frameworks
- - Develop quality assurance processes, calibration sessions, and auditing systems
- - Partner with AI researchers and engineers to translate research objectives into labeling workflows
- - Prioritize labeling projects based on business and research needs
- - Monitor operational metrics including quality, consistency, throughput, and cost
- - Improve annotation tooling, automation, and workflow efficiency
- - Lead complex AI evaluation projects, including safety, preference ranking, RLHF, policy evaluation, and benchmark creation
- - Analyse disagreement patterns and edge cases to improve guidelines and model performance
- - Manage vendor relationships and ensure consistent quality across distributed teams
- - Build reporting dashboards and communicate operational insights to leadership
- - Foster a culture of continuous improvement, accountability, and operational excellence
Qualifications
- - Has experience leading data annotation or AI evaluation teams
- - Has strong operational and people management skills
- - Understands AI model evaluation, LLM behaviour, and modern annotation workflows
- - Can design scalable processes without sacrificing quality
- - Communicates clearly across technical and non-technical teams
- - Thrives in fast-moving startup environments
Skills
Required:Data annotation leadershipOperational managementAI model evaluationProcess design
Benefits
- Competitive compensation, including equity
- Flexible time off
- A spacious office in the heart of Paris’s 2nd arrondissement, hybrid setup
- Relocation support after probationary period
- Premium private health insurance
- Mental health support, including therapy coverage
- Language lessons (English or French)
- Lunch and dinner when in the office
- Learning and development support for courses and conferences
- All the hardware, subscriptions, tools, and services
- Team off-sites twice a year
Last updated Sep 30, 2026. Interested? Apply on the company site.
About White Circle
We keep your AI models safe, reliable, and secure.
We keep your AI models safe, reliable, and secure.
AI governanceAI safetycase studiescomplianceenterpriseheadline-ai-europe-100-2026model governancepolicy enforcement
More open roles at White Circle
- DevRel Lead (Developer Relations)2w agoRemote · Product
- Communications Designer2w agoRemote · Creative
- Production Manager1mo agoRemote · Creative
- Talent Lead1mo agoRemote · Operations
- Finance Lead1mo agoRemote · Operations