Protoface and Eleven Labs agents Integeration

Support
1

I’m integrating Protoface with ElevenLabs Agents, but the Protoface avatar is not showing any facial expressions during the conversation.

2

Hi, thanks for the question!

  • If the avatar is not moving at all, this seems like an integration issue with your code. Please check out the quickstart here: GitHub - protoface-ai/protoface-quickstart: Start here. · GitHub for reference implementations.
  • If the avatar is moving, then the quality of expressions is highly dependent on the input audio stream. Protoface Realtime has a single mode; please see below.

Our system is fully driven by your TTS audio (in your case ElevenLabs). You can view an example of how expressive TTS (Gemini Live) causes the character to animate.

3

Hi, Thanks for the reply
But does expression depends on what AI model are we using because i am currently using qwen 3.5-397B-A17B in eleven labs agents

4

Hi, LLM quality influences expressiveness indirectly. Protoface only sees the audio stream generated by your TTS system – the LLM generates words, and the TTS generates audio from those words. Therefore, the LLM influences what the TTS produces, and indirectly affects the quality of expressions.

If your TTS system can generate expressive audio, like Gemini Live or GPT Live can (usually the speech-to-speech models are better at this because the LLM and TTS are integrated together), then Protoface will be more expressive. You can see our website demo at Realtime AI Avatars from $0.01/min | Protoface which uses Gemini Live.