Product Content Engineer
Meta· Content Strategy
Los Angeles, CA$162k - $227kFull-timePosted 7mo ago
About the role
Content Strategy function supporting Meta's family of apps. Focused on evaluating and improving AI-powered content experiences by defining quality standards, creating evaluation frameworks, and building workflows to assess AI outputs across products.
Responsibilities
- Define content quality standards and use them to systematically evaluate how AI models are performing across our products and content experiences
- Design golden sets, taxonomies, and guidelines that enable consistent, repeatable content quality assessments
- Build repeatable workflows for collecting, annotating, and analyzing AI outputs so evaluations can run efficiently as models evolve
- Evaluate successive model releases through structured comparison, documenting what improved, what regressed, and what to prioritize next
- Design evaluation frameworks that integrate qualitative and quantitative signals to measure dimensions like user trust, content depth, and topical relevance
- Develop processes to track content quality and model performance over time and flag regressions
- Synthesize evaluation results into structured error patterns and concrete recommendations that engineering and product teams can act on
- Work cross-functionally with engineers, data scientists, product managers, and content strategists to align AI behaviors with real-world user expectations
Qualifications
- 5+ years of experience working collaboratively with product, engineering, design, and user research teams
- 1+ years working with generative AI products, AI evaluation, prompt engineering, annotation, and/or content labeling and analysis
- Experience designing and implementing evaluation frameworks, annotation guidelines, or quality rubrics for AI/ML systems
- Demonstrated data analysis skills, with experience exploring data, identifying patterns, and producing actionable insights
- Experience building new products or platform/ecosystem products
- Critical thinking, experience leading data-driven analyses to inform product or content decisions, and experience communicating to executive leadership
- Proven track record of cross-functional collaboration and delivering results in environments with evolving requirements and competing priorities
Skills
Required:Content quality standardsEvaluation frameworksData analysis
Benefits
- Benefit information described in the posting is available via the linked Meta Benefits page; specific items are not enumerated in the job description.
Last updated Oct 23, 2026. Interested? Apply on the company site.
About Meta
Shop the latest AI glasses and wearable technology from Meta.
Shop the latest AI glasses and wearable technology from Meta. Explore Ray-Ban Meta, Oakley Meta, display glasses, and cutting-edge VR headsets.
AI glassesOakley MetaRay-Ban MetaVR headsetsliquid-ai-recruiting-targetwearable technology
More open roles at Meta
- Research Scientist Intern, 3D-grounded Generalist Model for Robotics (PhD)4d agoRedmond, WA · Artificial Intelligence
- 4d ago
- Research Scientist Intern, Robotics - Meta Reality Labs Research (PhD)4d agoZurich, Switzerland · Artificial Intelligence
- 4d ago
- Product Designer, Instagram4d agoHybrid (New York, NY) · Design