proomt

Search

Search posts, papers, and topics

All posts

Lobsters

Deterministic Hypervisors For Cheap

Related reading

  1. VC-Attention: Value Smoothing and Softmax Casting for Low-bit Attention

    VC-Attention introduces a training‑free low‑bit attention pipeline for diffusion transformers. It smooths value tensors via lightweight online clustering (V‑Smooth) and quantizes only the residual after subtracting block means, restoring the mean from the softmax row sum. It also replaces the FP32 softmax exponential with a fused FP8 cast (ExpCast‑FP8) that maps log‑scores directly to E4M3 probab…

    Hugging Face Daily Papersarxiv.org1 minpaper
  2. Learning Sparse Decision Trees via Transformer Variational Auto-Encoders

    The paper presents TREVIS, a method that encodes decision trees into a continuous latent space using a Tree Transformer VAE, allowing gradient-based optimization of both accuracy and structural sparsity. Experiments claim TREVIS matches the predictive performance of near-optimal algorithms while producing sparser trees.

    Hugging Face Daily Papersarxiv.org1 minpaper