Layer Normalization for Transformers
Learn layer normalization for transformers and sequence models: how normalizing across features enables batch-independent training.
No direct links0 refs
ML Concepts - Page 31
Clear explanations of core machine learning concepts, from foundational ideas to advanced techniques. Understand attention mechanisms, transformers, skip connections, and more.
191
Total Concepts
365
Topics
Page 31
of 32
Concepts - Page 31
Internal Covariate Shift
Understand internal covariate shift: why layer input distributions change during training, how it slows convergence, and how batch norm fixes it.
No direct links0 refs
Batch Normalization in Deep Learning
Learn batch normalization in deep learning: how normalizing layer inputs accelerates training, improves gradient flow, and acts as regularization.
No direct links0 refs
Skip Connections in Neural Networks
Learn how skip connections and residual learning enable training of very deep neural networks. Understand the ResNet revolution with interactive visualizations.
No direct links0 refs
C++ Virtual Tables & Inheritance
C++ virtual tables (vtables) explained. Learn virtual dispatch, single/multiple inheritance, RTTI, and object memory layout visually.
No direct links0 refs
Graph Attention Networks (GAT)
Adaptive attention-based aggregation for graph neural networks - multi-head attention, learned weights, and interpretable graph learning
No direct links0 refs
Showing 181-186 of 191 articles