confidence estimation

Confidence Comes from Experience: Experiential Confidence Estimation from Reasoning to Agentsarxiv.org

XConf (eXperiential Confidence) is a novel method for estimating language model confidence by leveraging the model's accumulated experience from past graded episodes. It significantly outperforms existing methods like self-consistency in discrimination and calibration, at a fraction of the computational cost, across various tasks.