Masked and Causal Attention
Trace causal attention from shifted next-token labels through the lower-triangular mask, pre-softmax blocking, parallel training, and incremental decoding.
10 min readConcept
Tagged with
Language Models
Explore machine learning concepts related to Language Models. Clear explanations and practical insights.
1
Concepts Found