Skip to main content

Representation Learning

Explore machine learning papers and reviews related to Representation Learning. Find insights, analysis, and implementation details.

  • Tagged with
  • 9 papers
Back to all papers

Papers Related to Representation Learning

ICML 2021

ALIGN: Scaling Vision-Language Learning with Noisy Text Supervision

Chao Jia, Yinfei Yang, +8

How ALIGN scales vision-language pre-training to 1.8 billion noisy image-alt-text pairs, showing that the sheer scale of a raw, uncurated dataset can outweigh careful data cleaning for a simple dual-encoder contrastive model.

CVPR 2022

MAE: Masked Autoencoders Are Scalable Vision Learners

Kaiming He, Xinlei Chen, +4

How masking 75% of image patches and reconstructing pixels creates a scalable self-supervised learner that trains ViT-H to 87.8% on ImageNet-1K with label-free pre-training and an efficient visible-only encoder.

TMLR 2024

V-JEPA: Learning Video Representations by Predicting in Latent Space

Adrien Bardes, Quentin Garrido, +6

How V-JEPA learns powerful video representations by predicting masked spatiotemporal regions in embedding space rather than reconstructing pixels, achieving state-of-the-art frozen features with superior label efficiency.

Mastodon