2023
Visual Instruction Tuning
LLaVA paper: align LLMs with visual information through instruction tuning on image-text pairs, enabling multimodal understanding and reasoning.
Tagged with
multimodal learning
Explore machine learning papers and reviews related to multimodal learning. Find insights, analysis, and implementation details.
3
Papers Found
Papers Related to multimodal learning
2023
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
Computer VisionNatural Language ProcessingDeep LearningMultimodal LearningBLIP-2Vision-Language Models
Introducing BLIP-2, a new vision-language model that leverages frozen image encoders and large language models to achieve improved efficiency and performance in various multimodal tasks.
2021
Learning Transferable Visual Models From Natural Language Supervision
CLIP explained: contrastive learning on 400M image-text pairs enables zero-shot image classification and powerful vision-language understanding.