Target Encoders, EMA, and Stop-Gradient
Follow how a learned target encoder supplies feature targets, how stop-gradient separates backward paths, and how exponential moving averages update its parameters.
6 min readConcept
Explore machine learning concepts related to EMA. Clear explanations and practical insights.
Follow how a learned target encoder supplies feature targets, how stop-gradient separates backward paths, and how exponential moving averages update its parameters.