Tagged with

initialization

Explore machine learning concepts related to initialization. Clear explanations and practical insights.

Concepts Found

Concepts Related to initialization

January 31, 2025

He/Kaiming Initialization

Learn He (Kaiming) initialization for ReLU networks: why ReLU needs special weight initialization, variance flow, and dead neurons explained.

deep-learning initialization relu training neural-networks

7 min readConcept

January 31, 2025

Xavier/Glorot Initialization

Learn Xavier (Glorot) initialization: how it balances forward signals and backward gradients to enable stable deep network training with tanh and sigmoid.

deep-learning initialization training neural-networks

8 min readConcept