Hugging Face Daily PapersYutong Song, Jiang Wu, Weijia Zhang1 min readpaperadvanced
CARD: Cluster-level Adaptation with Reward-guided Decoding for Personalized Text Generation
Summary
CARD is a hierarchical framework for personalized text generation that clusters users for group-specific LoRA adapters and learns individual preferences implicitly. It injects personalization at decoding via lightweight vectors and low-rank logit corrections, achieving superior quality and efficiency compared to baselines.
- CARD clusters users by stylistic patterns to learn group-specific LoRA adapters for robust generalization.
- Implicit preference learning infers user-specific styles by contrasting user-authored text with cluster-level generations.
- Personalization is injected exclusively at decoding time using lightweight user preference vectors and logit corrections.
- The base large language model remains frozen, significantly improving efficiency and scalability for personalized generation.
Engineers building personalized LLM applications should care about CARD's approach to balancing fine-grained personalization with scalable deployment challenges.
8/10