Learn layer normalization for transformers and sequence models: how normalizing across features enables batch-independent training with interactive visualizations.

Layer Normalization

Understand internal covariate shift in deep learning: why layer input distributions change during training, how it slows convergence, and how batch normalization fixes it.

Internal Covariate Shift

Learn batch normalization in deep learning: how normalizing layer inputs accelerates training, improves gradient flow, and acts as regularization with interactive visualizations.

normalization

Concepts Related to normalization

Layer Normalization

Internal Covariate Shift

Batch Normalization