banking

IndicBankBench: Evaluating Safety and Reliability of Language Model Assistants in Indian Retail Bankingarxiv.org

IndicBankBench is a 799‑case benchmark for Indian retail banking assistants that evaluates safety, tool use, response adequacy, and advisory quality across multiple trials. The study finds strict reliability of current LLM assistants is only 44‑58%, exposing a sizable gap between apparent and dependable performance.