Skip to main content

Self-Supervised Learning

Explore machine learning papers and reviews related to Self-Supervised Learning. Find insights, analysis, and implementation details.

  • Tagged with
  • 12 papers
Back to all papers

Papers Related to Self-Supervised Learning

2025

SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features

Michael Tschannen, Alexey Gritsenko, +12

Explore SigLIP 2 through decoder supervision, EMA teachers, masked features and NaFlex geometry, with runnable CPU mechanics and recorded image-text matching.

TMLR 2024

DINOv2: Learning Robust Visual Features without Supervision

Maxime Oquab, Timothée Darcet, +24

How DINOv2 combines DINO self-distillation with iBOT masked prediction on curated LVD-142M data, with source-defined frozen-feature evaluations for classification, segmentation, depth, and retrieval.

CVPR 2023

I-JEPA: Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture

Mahmoud Assran, Quentin Duval, +6

Follow I-JEPA from the original paper and equations to runnable Python, then inspect real pretrained predictions of masked image features.

arXiv 2025

V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning

Mido Assran, Adrien Bardes, +27

How V-JEPA 2 scales self-supervised video learning to 1M+ hours with masked latent prediction and 3D-RoPE, then extends to V-JEPA 2-AC for robotic planning using 62 hours of robot video with recorded actions.

CVPR 2022

MAE: Masked Autoencoders Are Scalable Vision Learners

Kaiming He, Xinlei Chen, +4

How masking 75% of image patches and reconstructing pixels creates a scalable self-supervised learner that trains ViT-H to 87.8% on ImageNet-1K with label-free pre-training and an efficient visible-only encoder.

TMLR 2024

V-JEPA: Learning Video Representations by Predicting in Latent Space

Adrien Bardes, Quentin Garrido, +6

How V-JEPA learns powerful video representations by predicting masked spatiotemporal regions in embedding space rather than reconstructing pixels, achieving state-of-the-art frozen features with superior label efficiency.

Mastodon