← All roles

Product Content Engineer

Meta· Content Strategy
Apply on company site
Los Angeles, CAFull-timePosted 2w ago

About the role

Product Content Engineering supports initiatives across Instagram and Meta AI, focusing on model training for image and video generation. Own the human evaluation layer to define quality, design rubrics, run evaluation rounds, and translate subjective judgments into measurable signals that shape model behavior and launch decisions. Requires hands-on video production experience and craft vocabulary to describe media quality.

Responsibilities

  • Build and maintain evaluation rubrics for image and video generation quality, including dimension definitions, rating scales and annotator guidelines
  • Execute human evaluation rounds on model output, side-by-sides, absolute scoring and prompt-adherence checks, and produce clear, actionable writeups
  • Construct and curate prompt sets and golden sets that stress-test specific model capabilities and failure modes
  • Calibrate with fellow raters and vendor teams; help drive inter-rater reliability
  • Partner with research and modeling teams so eval findings translate into training and post-training signal
  • Support the transition of human judgment into automated measurement and help validate automated scores against human ground truth
  • Track quality trends across model versions and flag regressions early
  • Deliver high-quality evaluation work on model and launch timelines in a fast-paced, dynamic environment

Qualifications

  • 6+ years of experience in video production, content strategy, editorial standards, media evaluation or relevant fields
  • Hands-on video production experience, including shooting, editing, post and/or motion work, with the craft vocabulary to describe quality failures precisely
  • Experience creating or substantially contributing to evaluation rubrics or quality guidelines for video or image content
  • Experience producing or evaluating short-form video and emerging video formats
  • Experience applying editorial judgment, plus the ability to document judgment logic into reusable frameworks that scale across teams
  • Experience leveraging quantitative insights to inform content and quality decisions
  • Experience collaborating with cross-functional teams (product, engineering, design, research, analytics)
  • Experience working independently and navigating ambiguity in fast-paced environments
  • Bachelor's degree in a directly related field, or equivalent practical experience

Skills

Required:evaluation rubricshuman evaluationprompt sets / golden setsinter-rater reliabilitytraining signal
Nice to have:measurement tooling

Benefits

  • bonus
  • equity
  • benefits (listed separately in posting)
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Meta

Shop the latest AI glasses and wearable technology from Meta.

Shop the latest AI glasses and wearable technology from Meta. Explore Ray-Ban Meta, Oakley Meta, display glasses, and cutting-edge VR headsets.

AI glassesOakley MetaRay-Ban MetaVR headsetsliquid-ai-recruiting-targetwearable technology
Company profileWebsite

More open roles at Meta