hallucinations

MLLMs Hallucinate when Information Distribution Drifts in Synergy Headsarxiv.org

This paper introduces HEAL, a method to identify and mitigate hallucinations in Multimodal Large Language Models (MLLMs). It finds that hallucinations stem from information distribution drift in "synergy heads" within the attention mechanism and proposes dynamic calibration to steer output towards factual evidence.