Tool calling - AI agent doesn't reply back. Stops interacting

Not sure why this is happening, but every time my AI Agent calls a tool, it simply stops responding. It is like it keeps waiting for the user to talk.

There is NO ERROR in the Tool Result.

I’m being explicitly in my prompt that the Agent must continue the interaction, but still get the same result. Tried ChatGPT, Gemini and Claude, but none kept going.

Attached is an example of such interaction.

Based on the available sources, I don’t have specific documentation about tool call behavior causing the agent to stop responding. However, I can see that Retell AI has configuration options that may be relevant to your issue.

The agent configuration includes a reminder_trigger_ms parameter that triggers a reminder to the agent to speak if the user has been silent for a specified duration after some agent speech(1)(2). The default value is 10,000 ms (10 seconds)(1)(2).

There’s also a reminder_max_count parameter that controls how many times the agent would remind the user when the user is unresponsive(1)(2). The default value is 1 (remind once), and you can set it to 0 to disable reminders(1)(2).

Additionally, the end_call_after_silence_ms parameter will end the call if users stay silent for a period after agent speech(1)(2). The minimum value allowed is 10,000 ms (10 seconds), and by default, this is set to 600,000 (10 minutes)(1)(2).

Since your issue involves the agent waiting after a tool call rather than continuing the conversation, these timeout settings might be contributing to the behavior you’re experiencing, though they don’t directly explain why the agent stops responding immediately after tool execution.

For additional support with this specific tool call behavior issue, you can:

Would you like a general answer based on my knowledge instead?

**

It is not the user being unresponsive, rather the Agent. So the settings you mentioned do not apply in this case.

It was my mistake. It was just a matter of selecting “Speak After Execution”.