voice agents

Do Audio LLMs Listen Before They Act? Diagnosing Acoustic-Context Gating in Voice Agentsarxiv.org

The authors present VGBench, a 1,018‑item diagnostic suite that tests whether audio LLMs correctly mute actions when the acoustic context shifts (e.g., speaker switches). Training with VoxGate dramatically improves gating, raising mute rates from <15% to >90% while preserving tool‑call accuracy.