Emergent Abilities in Large Language Models
Explore emergent abilities in large language models: sudden capabilities at scale thresholds, phase transitions, and the mirage debate.
8 min readConcept
Tagged with
Scaling
Explore machine learning concepts related to Scaling. Clear explanations and practical insights.
3
Concepts Found
Concepts Related to Scaling
Neural Scaling Laws Explained
Explore neural scaling laws in deep learning: power law relationships between model size, data, and compute that predict AI performance.
8 min readConcept
Mixture of Experts (MoE)
Understanding sparse mixture of experts models - architecture, routing mechanisms, load balancing, and efficient scaling strategies for large language models
12 min readConcept