Skip to main content

Memory Efficiency

Explore machine learning papers and reviews related to Memory Efficiency. Find insights, analysis, and implementation details.

  • Tagged with
  • 2 papers
Back to all papers

Papers Related to Memory Efficiency

NeurIPS 2022

FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

Tri Dao, Daniel Y. Fu, +3

How FlashAttention computes exact attention with linear memory by tiling Q, K, and V into SRAM-resident blocks and fusing the softmax, avoiding the quadratic HBM cost of materializing the full attention matrix.

Mastodon