← All roles

Research Scientist Intern, Audio-Visual Conversation Scene Generation (PhD)

Meta· Computer Vision
Apply on company site
Redmond, WA$7.7k/mo - $12.7k/moInternPosted 1w ago

About the role

Internship at Meta Reality Labs Research focusing on generating realistic audio-visual multi-person conversation scenes with controllable 3D layout and egocentric camera trajectories. Aims to produce data for training audio-visual models and evaluating realism, synchronization, and pose consistency.

Responsibilities

  • Design and train video diffusion or flow-matching models for multi-person conversation scenes, generating audio and video together.
  • Develop ways to condition generation on 3D layout, group structure and egocentric camera trajectory.
  • Keep each person's identity consistent across frames and viewpoints, from one or several reference images.
  • Model natural conversational behavior: speech-driven faces and gestures, gaze, turn-taking and listener reactions.
  • Build evaluations for realism, audio-visual sync, identity consistency, and how closely the generated 3D positions and poses match the specified ones.
  • Use the generated data to train downstream egocentric perception models, and measure how much it helps.
  • Publish results at top venues together with Meta researchers.

Qualifications

  • Currently has, or is in the process of obtaining, a PhD in Computer Science, Electrical Engineering, Machine Learning or a related field
  • Research experience in generative modeling for video or images, with first-author publications at venues such as CVPR, ICCV, ECCV, NeurIPS, ICLR or SIGGRAPH
  • Hands-on experience training or fine-tuning modern video diffusion or flow-matching models (e.g. DiT-based architectures), including conditioning methods such as adapters, ControlNet or LoRA
  • Experience with controllable generation from geometric or structural signals: camera pose, 3D layout, depth or human pose
  • Solid grounding in 3D vision: camera models, multi-view geometry and coordinate transforms
  • 3+ years experience with Python, Matlab, Pytorch, large-scale distributed GPU training or similar
  • Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment

Skills

Required:Video diffusion or flow-matching models3D layout conditioningIdentity consistency across framesGaze, turn-taking, and social interaction modelingEvaluation designPython, PyTorch, Matlab

Benefits

  • Benefits information available on Meta Careers site (not listed in this description)
Last updated Oct 23, 2026. Interested? Apply on the company site.

About Meta

Shop the latest AI glasses and wearable technology from Meta.

Shop the latest AI glasses and wearable technology from Meta. Explore Ray-Ban Meta, Oakley Meta, display glasses, and cutting-edge VR headsets.

AI glassesOakley MetaRay-Ban MetaVR headsetsliquid-ai-recruiting-targetwearable technology
Company profileWebsite

More open roles at Meta