1
VākQA: A Benchmark and Evaluation Study for Telugu Spoken Factoid Question Answering
The authors present VākQA, a 2,001‑question spoken factoid QA benchmark for Telugu with audio, transcriptions, and human‑verified answers, and they validate automatic evaluation methods against human ratings. Using this setup they show that translation loses cultural nuance, ASR errors alter meaning, and cascaded ASR‑MT errors degrade model performance.
Hugging Face Daily Papersarxiv.org1 minpaper