Hilbert-Guided Sparse Local Attention
Yunge Li, Lanyu Xu
Reordering image tokens along a Hilbert curve makes 2D local attention block-sparse, for about 4x faster window attention and 18x faster slide attention.
- Computer Vision
- Transformers
- GPU Optimization
- +1 more tags
