representation learning

RSS

1
FLAT: Resampling Image and Text into 1D Flexible-Length Aligned Transmodal Tokens for Retrieval and Generation arxiv.org
FLAT is a pre‑training framework that encodes images and text into a shared 1D token sequence with variable length via nested dropout, enabling the same embeddings for cross‑modal retrieval and generation. It attains state‑of‑the‑art scores on COCO and Flickr30K for captioning, retrieval, and text‑to‑image generation, and supports interpolation and zero‑shot composed retrieval.
Hugging Face Daily Papersarxiv.orgGuangyu Sun, Shlok Kumar Mishra, Wentao Bao7d1 minpaper
2
Training-Adaptive Convolutional Sparse Coding via Information Bottleneck for Robust Visual Representation arxiv.org
This paper introduces a training-adaptive Convolutional Sparse Coding (CSC) framework where the sparsity coefficient is learned end-to-end via FISTA unfolding. It uses an information bottleneck perspective to balance representation compression and content preservation, showing improved robustness to input perturbations on CIFAR and ImageNet.
Hugging Face Daily Papersarxiv.orgMeng'en Qin, Yinchen Liu, Mingxuan Cui5d1 minpaper
3
Disentangling Representation Evolution in Transformers through Directional Decomposition arxiv.org
The paper decomposes transformer representation updates into parallel and perpendicular components, showing that parallel updates beyond the residual path are significant. Suppressing parallel updates during pretraining improves validation loss and downstream metrics.
Hugging Face Daily Papersarxiv.orgShwai He, Haichao Zhang, Shen Yan8d1 minpaper

representation learning

FLAT: Resampling Image and Text into 1D Flexible-Length Aligned Transmodal Tokens for Retrieval and Generationarxiv.org

Training-Adaptive Convolutional Sparse Coding via Information Bottleneck for Robust Visual Representationarxiv.org

Disentangling Representation Evolution in Transformers through Directional Decompositionarxiv.org

FLAT: Resampling Image and Text into 1D Flexible-Length Aligned Transmodal Tokens for Retrieval and Generation arxiv.org

Training-Adaptive Convolutional Sparse Coding via Information Bottleneck for Robust Visual Representation arxiv.org

Disentangling Representation Evolution in Transformers through Directional Decomposition arxiv.org