CVPR 2022
MAE: Masked Autoencoders Are Scalable Vision Learners
Kaiming He, Xinlei Chen, +4
How masking 75% of image patches and reconstructing pixels creates a scalable self-supervised learner that trains ViT-H to 87.8% on ImageNet-1K with label-free pre-training and an efficient visible-only encoder.