Emergent Abilities in Large Language Models
Explore emergent abilities in large language models: sudden capabilities that appear at scale thresholds, phase transitions, and the mirage debate, with interactive visualizations.
7 min readConcept
Tagged with
scaling
Explore machine learning concepts related to scaling. Clear explanations and practical insights.
3
Concepts Found
Concepts Related to scaling
Neural Scaling Laws
Explore neural scaling laws in deep learning: power law relationships between model size, data, and compute that predict AI performance, with interactive visualizations.
8 min readConcept
Mixture of Experts (MoE)
Understanding sparse mixture of experts models - architecture, routing mechanisms, load balancing, and efficient scaling strategies for large language models
6 min readConcept