Skip to main content

Vision Transformer

Explore machine learning papers and reviews related to Vision Transformer. Find insights, analysis, and implementation details.

  • Tagged with
  • 7 papers
Back to all papers

Papers Related to Vision Transformer

TMLR 2024

DINOv2: Learning Robust Visual Features without Supervision

Maxime Oquab, Timothée Darcet, +24

How DINOv2 combines DINO self-distillation with iBOT masked prediction on curated LVD-142M data, with source-defined frozen-feature evaluations for classification, segmentation, depth, and retrieval.

CVPR 2023

I-JEPA: Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture

Mahmoud Assran, Quentin Duval, +6

Follow I-JEPA from the original paper and equations to runnable Python, then inspect real pretrained predictions of masked image features.

arXiv 2025

V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning

Mido Assran, Adrien Bardes, +27

How V-JEPA 2 scales self-supervised video learning to 1M+ hours with masked latent prediction and 3D-RoPE, then extends to V-JEPA 2-AC for robotic planning using 62 hours of robot video with recorded actions.

CVPR 2022

MAE: Masked Autoencoders Are Scalable Vision Learners

Kaiming He, Xinlei Chen, +4

How masking 75% of image patches and reconstructing pixels creates a scalable self-supervised learner that trains ViT-H to 87.8% on ImageNet-1K with label-free pre-training and an efficient visible-only encoder.

TMLR 2024

V-JEPA: Learning Video Representations by Predicting in Latent Space

Adrien Bardes, Quentin Garrido, +6

How V-JEPA learns powerful video representations by predicting masked spatiotemporal regions in embedding space rather than reconstructing pixels, achieving state-of-the-art frozen features with superior label efficiency.

Mastodon