← All roles

Conversational Modelling Research Engineer

Tavus· Engineering, Product, & Design
Apply on company site
RemoteFull-timePosted 6mo ago

About the role

AI Researcher role focused on building and advancing foundation multimodal conversational models for real-time avatar-controlled interactions, with production-ready transition and collaboration with Applied ML.

Responsibilities

  • Conduct research on Large Multimodal Models in the context of Conversational Avatars (e.g. Neural Avatars, Talking-Heads).
  • Develop methods to model both verbal and non-verbal aspects of conversation, adapting and controlling avatar behavior in real time, with low-latency.
  • Experiment with fine-tuning, adaptation, and conditioning techniques to make AudioVisual Multimodal Models more expressive, controllable, and task-specific.
  • Partner with the Applied ML team to take research from prototype to production.
  • Stay up to date with cutting-edge advancements — and help define what comes next.

Qualifications

  • A PhD (or near completion) in a relevant field, or equivalent research experience.
  • Hands-on experience with Large Multimodal Models and a strong foundation in generative (language) models. This could be in the context of tasks such as VQA, Audio/Video understanding tasks, captioning behavioral analysis, Translation tasks, Speech to Speech systems.
  • Experience in fine-tuning/adapting VLMs for control, conditioning, or downstream tasks.
  • Solid background in deep learning and foundation models.
  • Strong PyTorch skills and comfort building deep learning pipelines.

Skills

Required:Large Multimodal ModelsFine-tuning / Conditioning of VLMsPyTorch
Last updated Jul 15, 2026. Interested? Apply on the company site.
Tavus logo

About Tavus

Meet the PALs

Tavus introduces PALs: AI humans that remember, empathize, and grow with you. They move fluidly between chat, voice, and video, making AI finally feel human.

AIVideoConversational AIMultimodalAPIsResearch
Company profileWebsite

More open roles at Tavus