proomt

Search

Search posts, papers, and topics

decoding

RSS
  1. 1

    Your Transformer Can Hold Two Thoughts at Once: Evidence of Linear Superposition in LLMs

    The paper demonstrates that transformer LLMs exhibit a linear superposition property where combined inputs produce a blended next‑token distribution, and that lightweight fine‑tuning can restore this linearity. It also introduces a guided decoding algorithm that extracts two distinct, coherent continuations from one forward pass.

    Hugging Face Daily Papersarxiv.org1 minpaper
  2. 2

    CARD: Cluster-level Adaptation with Reward-guided Decoding for Personalized Text Generation

    CARD is a hierarchical framework for personalized text generation that clusters users for group-specific LoRA adapters and learns individual preferences implicitly. It injects personalization at decoding via lightweight vectors and low-rank logit corrections, achieving superior quality and efficiency compared to baselines.

    Hugging Face Daily Papersarxiv.org1 minpaper