Masked and Causal Attention
Trace causal attention from shifted next-token labels through the lower-triangular mask, pre-softmax blocking, parallel training, and incremental decoding.
8 min readConcept
Tagged with
language-models
Explore machine learning concepts related to language-models. Clear explanations and practical insights.
1
Concepts Found