Layer Normalization for Transformers
Learn layer normalization for transformers and sequence models: how normalizing across features enables batch-independent training.
7 min readConcept
Tagged with
normalization
Explore machine learning concepts related to normalization. Clear explanations and practical insights.
3
Concepts Found
Concepts Related to normalization
Internal Covariate Shift
Understand internal covariate shift: why layer input distributions change during training, how it slows convergence, and how batch norm fixes it.
8 min readConcept
Batch Normalization in Deep Learning
Learn batch normalization in deep learning: how normalizing layer inputs accelerates training, improves gradient flow, and acts as regularization.
7 min readConcept