← All roles

Product Content Engineer

Meta· Content Strategy
Apply on company site
Los Angeles, CA$162k - $227kFull-timePosted 7mo ago

About the role

Content Strategy function supporting Meta's family of apps. Focused on evaluating and improving AI-powered content experiences by defining quality standards, creating evaluation frameworks, and building workflows to assess AI outputs across products.

Responsibilities

  • Define content quality standards and use them to systematically evaluate how AI models are performing across our products and content experiences
  • Design golden sets, taxonomies, and guidelines that enable consistent, repeatable content quality assessments
  • Build repeatable workflows for collecting, annotating, and analyzing AI outputs so evaluations can run efficiently as models evolve
  • Evaluate successive model releases through structured comparison, documenting what improved, what regressed, and what to prioritize next
  • Design evaluation frameworks that integrate qualitative and quantitative signals to measure dimensions like user trust, content depth, and topical relevance
  • Develop processes to track content quality and model performance over time and flag regressions
  • Synthesize evaluation results into structured error patterns and concrete recommendations that engineering and product teams can act on
  • Work cross-functionally with engineers, data scientists, product managers, and content strategists to align AI behaviors with real-world user expectations

Qualifications

  • 5+ years of experience working collaboratively with product, engineering, design, and user research teams
  • 1+ years working with generative AI products, AI evaluation, prompt engineering, annotation, and/or content labeling and analysis
  • Experience designing and implementing evaluation frameworks, annotation guidelines, or quality rubrics for AI/ML systems
  • Demonstrated data analysis skills, with experience exploring data, identifying patterns, and producing actionable insights
  • Experience building new products or platform/ecosystem products
  • Critical thinking, experience leading data-driven analyses to inform product or content decisions, and experience communicating to executive leadership
  • Proven track record of cross-functional collaboration and delivering results in environments with evolving requirements and competing priorities

Skills

Required:Content quality standardsEvaluation frameworksData analysis

Benefits

  • Benefit information described in the posting is available via the linked Meta Benefits page; specific items are not enumerated in the job description.
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Meta

Shop the latest AI glasses and wearable technology from Meta.

Shop the latest AI glasses and wearable technology from Meta. Explore Ray-Ban Meta, Oakley Meta, display glasses, and cutting-edge VR headsets.

AI glassesOakley MetaRay-Ban MetaVR headsetsliquid-ai-recruiting-targetwearable technology

More open roles at Meta