Assessment Design Lead
Remote$100k - $140kFull-timePosted 2mo ago
About the role
Lead the design and validation of Speak's language assessment measures across Curriculum Mastery, Proficiency, and Placement tests, ensuring construct clarity, validity, fairness, and alignment to proficiency standards.
Responsibilities
- Own Assessment Design — Define whatSpeak measures, why, and how often across three assessment types (Curriculum Mastery Assessment, Proficiency Test, Placement Test), with immediate focus on the Proficiency Test, ensuring constructs (fluency, pronunciation, grammar, task achievement) map to CEFR or comparable standards.
Qualifications
- Assessment/Psychometric Design: 4+ years designing rubrics, blueprints, and item specs for shipped language assessment products or equivalent depth in psychometrics.
- Language Proficiency Domain Expertise: Deep familiarity with CEFR or ACTFL/IELTS/TOEFL descriptors.
- Fairness Across Learner Populations: Ability to identify differential item functioning and ensure fairness across diverse L1 backgrounds.
- Translates Qualitative → Technical: Ability to convert constructs into concrete specs for ML pipelines.
- Quantitative Rigor: Experience with inter-rater reliability, classical test theory, and basics of IRT.
- Ownership of Quality Bar: Comfortable sign-off authority on content validity.
- AI Fluency & Judgment: Familiarity with using AI tools in drafting item variants and rubric language, with discernment on when human revision is needed.
- Comfort with Ambiguity: ability to operate in 0-to-1 environment and turn fuzzy goals into concrete plans.
Skills
Required:Assessment design and psychometricsCEFR/linguistic proficiency frameworksFairness / DIF analysisQualitative to technical translationStatistics and psychometrics
Benefits
- Not specified in description
Last updated Aug 26, 2026. Interested? Apply on the company site.
About Speak
A superhuman, AI-powered language tutor in your pocket
artificial-intelligenceeducation
More open roles at Speak
- B2B Growth Marketer4d agoHybrid (Seoul) · B2B
- CX Agent, Taiwan4d agoHybrid (Seoul) · Operations
- Product Manager, Learning Outcomes1w agoHybrid (San Francisco) · Product
- Head of Korea1w agoHybrid (Seoul) · Marketing
- Growth Marketing Intern1w agoHybrid (Seoul) · Marketing