Audio stuttering with ElevenLabs v3 voices

Support Help
1

Hi Retell team,

Since the switch to ElevenLabs v3 as the only voice model, we’re experiencing consistent audio stuttering during real-time calls.

The AI voice frequently cuts out mid-sentence and sounds fragmented. This was not happening before the update, and we’ve confirmed it’s not related to our setup or network.

Could you please check if there are known issues with voice streaming stability or any recommended settings to fix this?

2

Hey @antubes30

Could you please share a bit more detail such as a few call IDs — so we can investigate the issue more effectively? Thank you!

3

Hi,

Thanks for the quick response.

Here are a few call IDs where the issue is clearly reproducible:

  • call_335a30e3f3fddda4bbd17fe39fb (notable cuts at ~32s and ~42s)

  • call_84b3d32b134d96a8ea70105ad30 (cuts around ~26–27s)

In both cases, the AI voice consistently stutters and cuts out mid-sentence, resulting in fragmented and non-continuous speech. This started after the switch to ElevenLabs v3.

Let me know if you need anything else to investigate further.

4

Hello @antubes30

I’ve escalated this to our team for further review.

We’ll update you as soon as we hear back.

Best regards

5

Hey @antubes30

Team looked into it and the switch is the cause

Recommended fixes (any one of these will help):

  • Override the model: set voiceModel = eleven_turbo_v2_5 on the agent — this stops the language-driven upgrade to v3.
  • Or remove ca-ES from the agent’s language list if Catalan isn’t actually needed; the default will fall back to eleven_turbo_v2_5.

Thank You