proomt

Search

Search posts, papers, and topics

All posts

Hugging Face Daily PapersYutong Song, Jiang Wu, Weijia Zhang1 min readpaperadvanced

CARD: Cluster-level Adaptation with Reward-guided Decoding for Personalized Text Generation

Summary

CARD is a hierarchical framework for personalized text generation that clusters users for group-specific LoRA adapters and learns individual preferences implicitly. It injects personalization at decoding via lightweight vectors and low-rank logit corrections, achieving superior quality and efficiency compared to baselines.

  • CARD clusters users by stylistic patterns to learn group-specific LoRA adapters for robust generalization.
  • Implicit preference learning infers user-specific styles by contrasting user-authored text with cluster-level generations.
  • Personalization is injected exclusively at decoding time using lightweight user preference vectors and logit corrections.
  • The base large language model remains frozen, significantly improving efficiency and scalability for personalized generation.

Engineers building personalized LLM applications should care about CARD's approach to balancing fine-grained personalization with scalable deployment challenges.

8/10

Related reading

  1. Fathom: Per-Query Read Depth for Sparse Decoding over Offloaded KV Caches

    Fathom introduces a per-query read depth mechanism for sparse decoding over offloaded KV caches, allowing each query to adaptively decide how many bits of each key channel to read. This method significantly speeds up decoding for large language models with long contexts by reducing host memory traffic, achieving 1.67x faster GPU decoding on Qwen3-8B at one million tokens.

    Hugging Face Daily Papersarxiv.org1 minpaper
  2. EvolvingAvatar: Interactive 3D Head Generation That Adapts as Conversations Unfold

    EvolvingAvatar is a novel 3D head generation model that adapts to ongoing conversations using test-time training and a self-supervised dyadic context prediction objective. It improves conversational motion statistics by learning from user audiovisual input during interaction, reducing expression mismatch by up to 11.1%.

    Hugging Face Daily Papersarxiv.org1 minpaper