Reviews of machine learning research papers, newest first.
Jean-Baptiste Alayrac, Jeff Donahue, +25
How Flamingo bridges a frozen vision encoder and a frozen language model with a Perceiver Resampler and gated cross-attention layers, enabling few-shot learning from interleaved image-text sequences.
Bin Xiao, Haiping Wu, +7
How Florence-2 turns detection, segmentation, grounding, captioning, and OCR into one sequence-to-sequence problem driven by task prompts, expressing spatial outputs as location tokens in the text vocabulary.
Ian J. Goodfellow, Jean Pouget-Abadie, +6
How GANs frame generative modeling as a two-player minimax game: a generator turns noise into samples while a discriminator learns to tell real from fake, driving the generator toward the true data distribution.
Peng Wang, Shuai Bai, +17
How Qwen2-VL perceives images and video at any resolution with naive dynamic resolution (variable visual tokens) and M-RoPE, a multimodal rotary position embedding that decomposes position into temporal, height, and width components.
Nikhila Ravi, Valentin Gabeur, +16
How SAM 2 extends promptable segmentation from images to video with a streaming memory bank and memory attention, propagating masks across frames and recovering objects after occlusion.
Xiaohua Zhai, Basil Mustafa, +2
How SigLIP replaces CLIP’s softmax contrastive loss with a pairwise sigmoid loss, removing the global softmax denominator and enabling chunked all-pairs computation and strong language-image pre-training at smaller batch sizes.
Diederik P. Kingma, Max Welling
How the variational autoencoder turns an autoencoder into a generative model: an encoder predicts a Gaussian latent distribution, the reparameterization trick makes sampling differentiable, and the ELBO balances reconstruction against a KL prior.
Jonathan Ho, Ajay Jain, +1
How diffusion models learn to generate images by reversing a gradual noising process — the foundation of Stable Diffusion, DALL-E, and modern image generation.
Yaron Lipman, Ricky T. Q. Chen, +3
How Flow Matching simplifies generative modeling by learning straight transport paths from noise to data — faster sampling, simpler training, and the foundation of modern generation systems.