
Why Speech-to-Speech Models Have Struggled With Tool Use
·7 min read
A caller says their booking ID is AB1526. The agent hears AB1562, calls the right tool with the right field, gets "not found," and tries the exact same lookup until the call runs out of turns. The
A caller says their booking ID is AB1526. The agent hears AB1562, calls the right tool with the right field, gets "not found," and tries the exact same lookup until the call runs out of turns. The model understood the caller. What native speech-to-speech models have struggled with is acting on it. 1. Why have cascaded agents been better at tool use? Take an airline call to change a flight. The agent needs to retrieve the booking, verify the customer, understand the requested change, check availa
7
0
4
0
