Tavus Logo

Tavus

Conversational Modelling Research Engineer

Posted Yesterday
Be an Early Applicant
Remote
Hiring Remotely in USA
Expert/Leader
Remote
Hiring Remotely in USA
Expert/Leader
Conduct research on Large Multimodal Models for Conversational Avatars, developing real-time modeling methods for verbal and non-verbal conversations, and partnering with Applied ML to transition prototypes into production.
The summary above was generated by AI

About Us

Tavus is a research lab pioneering human computing. We’re building AI Humans: a new interface that closes the gap between people and machines, free from the friction of today’s systems. Our real-time human simulation models let machines see, hear, respond, and even look real—enabling meaningful, face-to-face conversations. AI Humans combine the emotional intelligence of humans with the reach and reliability of machines, making them capable, trusted agents available 24/7, in every language, on our terms.

Imagine a friend who can discuss any topic with you. A personal trainer that adapts to your schedule. A fleet of medical assistants that can give every patient the attention they need. With Tavus, individuals, enterprises, and developers can all build AI Humans to connect, understand, and act with empathy at scale.

We’re a Series B company backed by world-class investors including Sequoia Capital, Y Combinator, and Scale Venture Partners.

Be part of shaping a future where humans and machines truly understand each other.

The Role

We’re looking for an AI Researcher to join our core AI team and push the boundaries of Foundation Multimodal Conversational Models. If you thrive in fast-moving startup environments, enjoy experimenting with new ideas, and love seeing your work come to life in production then you’ll feel right at home.

Your Mission 🚀

  • Conduct research on Large Multimodal Models in the context of Conversational Avatars (e.g. Neural Avatars, Talking-Heads).

  • Develop methods to model both verbal and non-verbal aspects of conversation, adapting and controlling avatar behavior in real time, with low-latency.

  • Experiment with fine-tuning, adaptation, and conditioning techniques to make AudioVisual Multimodal Models, more expressive, controllable, and task-specific.

  • Partner with the Applied ML team to take research from prototype to production.

  • Stay up to date with cutting-edge advancements — and help define what comes next.

You’ll Be Great At This If You Have:

  • A PhD (or near completion) in a relevant field, or equivalent research experience.

  • Hands-on experience with Large Multimodal Models and a strong foundation in generative (language) models. This could be in the context of tasks such as VQA, Audio/Video understanding tasks, captioning behavioral analysis, Translation tasks, Speech to Speech systems.

  • Experience in fine-tuning/adapting VLMs for control, conditioning, or downstream tasks.

  • Solid background in deep learning and foundation modes.

  • Strong PyTorch skills and comfort building deep learning pipelines.

Nice-to-Haves

  • Knowledge of large-scale model training and optimization.

  • Experience in duplex-conversational model.

  • Broader understanding of generative AI across modalities.

  • Exposure to software development best practices.

  • A flexible, experimental mindset i.e. comfortable working across research and engineering.

  • (Bonus) Publications at EMNLP, COLING, NeurIPS, ICLR, CVPR, ICCV.

Location


Preferred: San Francisco (hybrid) or London (office opening soon).

Remote within the U.S. or Europe available for exceptional candidates.

Top Skills

Generative Models
Large Multimodal Models
PyTorch

Similar Jobs

56 Minutes Ago
Remote or Hybrid
United States
67K-101K Annually
Mid level
67K-101K Annually
Mid level
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
The Customer Relationship Manager III manages complex client portfolios, focusing on multi-channel marketing strategies and enhancing customer relationships through strategic consultation and improved campaign performance.
Top Skills: Digital AdvertisingDirect MailEmailSeoSocial MediaTexting/Sms
56 Minutes Ago
Remote or Hybrid
Tennessee, USA
45K-88K Annually
Senior level
45K-88K Annually
Senior level
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
The Senior Field Sales Representative develops new business in a defined territory, maintains client relationships, and achieves sales targets for NextGear Capital's products.
Top Skills: Microsoft Salesforce
56 Minutes Ago
Remote
United States
130K-145K Annually
Senior level
130K-145K Annually
Senior level
Healthtech • Other • Social Impact • Software • Telehealth
Drive growth by executing employer activation marketing campaigns, optimizing conversion through A/B testing, and partnering with analytics and sales teams.
Top Skills: Ai ToolsExcelGoogle SheetsHubspotLookerSFDC

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account