Fine-Tuning

Explore machine learning papers and reviews related to Fine-Tuning. Find insights, analysis, and implementation details.

Tagged with
2 papers

Back to all papers

Papers Related to Fine-Tuning

ICML 2026

VIOLIN: Spatial Priors via Space Filling Curves for ViTs

Leyla Naz Candogan, Arshia Afzal, +2

VIOLIN multiplies ViT attention by decay masks from eight space-filling curves: 1,296 extra parameters on DeiT-B and up to 8.7 points on VTAB-1K spatial tasks.

Fine-Tuning
Transformers
Computer Vision
+1 more tags

Concepts

Paper Code

Self Attention ViT
Positional Embeddings ViT
ALiBi
Linear Attention Approximations

ICLR 2022

LoRA: Low-Rank Adaptation of Large Language Models

Edward J. Hu, Yelong Shen, +6

How LoRA adapts a frozen large language model by learning a low-rank update ΔW = (α/r)·BA to each weight matrix, training under 1% of the parameters of full fine-tuning and adding zero inference latency once merged.

Fine-Tuning
Transformers
Parameter Efficiency
+2 more tags

Concepts

Paper Code

Multihead Attention
Gradient Flow
Scaling Laws