Conversational Modelling Research Engineer, Tavus

• If you thrive in fast-moving startup environments, enjoy experimenting with new ideas, and love seeing your work come to life in production then you’ll feel right at home
• A PhD (or near completion) in a relevant field, or equivalent research experience
• Hands-on experience with Large Multimodal Models and a strong foundation in generative (language) models. This could be in the context of tasks such as VQA, Audio/Video understanding tasks, captioning behavioral analysis, Translation tasks, Speech to Speech systems
• Experience in fine-tuning/adapting VLMs for control, conditioning, or downstream tasks
• Solid background in deep learning and foundation modes
• Strong PyTorch skills and comfort building deep learning pipelines

Desirable

• We’re looking for an AI Researcher to join our core AI team and push the boundaries of Foundation Multimodal Conversational Models
• Conduct research on Large Multimodal Models in the context of Conversational Avatars (e.g. Neural Avatars, Talking-Heads)
• Develop methods to model both verbal and non-verbal aspects of conversation, adapting and controlling avatar behavior in real time, with low-latency
• Experiment with fine-tuning, adaptation, and conditioning techniques to make AudioVisual Multimodal Models, more expressive, controllable, and task-specific
• Partner with the Applied ML team to take research from prototype to production
• Stay up to date with cutting-edge advancements — and help define what comes next