Cross-Entropy Loss for Classification
Understand cross-entropy loss for classification: interactive demos of binary and multi-class CE, the -log(p) curve, softmax gradients, and focal loss.
15 min readConcept
Explore machine learning concepts related to Information Theory. Clear explanations and practical insights.
Understand cross-entropy loss for classification: interactive demos of binary and multi-class CE, the -log(p) curve, softmax gradients, and focal loss.
Compare edge, frequency and entropy heuristics for selecting a fixed budget of image patches, and distinguish token counts from accuracy and measured speed.
Learn KL divergence for machine learning: measure distribution differences in VAEs, knowledge distillation, and variational inference.