tpu

Accelerating Spatio-Temporal Attention for Video Diffusion on TPUsgoogleblog.com

This post details how Google optimized spatio-temporal attention for video diffusion models on TPUs, turning theoretical sparsity into actual inference speedups. Key optimizations include specializing tile execution paths and carefully tuning tile sizes, resulting in significant latency reductions compared to dense attention.