Vision Transformers

Explore machine learning papers and reviews related to Vision Transformers. Find insights, analysis, and implementation details.

Tagged with
2 papers

Back to all papers

Papers Related to Vision Transformers

CVPR 2025

MambaVision: A Hybrid Mamba-Transformer Vision Backbone

Ali Hatamizadeh, Jan Kautz

Trace MambaVision through its hierarchy, symmetric mixer paths, selective recurrence and windowed attention, with executable Python and a critical reading of the evidence.

Original paper Code

Topics and concepts (10)

Vision Transformers
Mamba
State Space Models
Computer Vision
Image Classification
Semantic Segmentation

Self Attention ViT
Convolution Operation
Layer Normalization
Feature Pyramid Networks

arXiv preprint 2024

LW-DETR: A Transformer Replacement to YOLO for Real-Time Detection

Qiang Chen, Xiangbo Su, +13

How LW-DETR combines window-major ViT features, depth aggregation, a shallow decoder and stronger training, with a careful reading of latency evidence.

Original paper Code

Topics and concepts (6)

Vision Transformers
Object Detection
DETR
Real-Time Detection

Modern Object Detection
Self Attention ViT