A Deepdive into Aya Vision: Advancing the Frontier of Multilingual Multimodality

Cohere's Aya Vision unveils 8B and 32B multilingual vision-language models for 23 languages, with strong results on AyaVisionBench and mWildVision. It uses synthetic annotations, multilingual data expansion, and model merging, and handles high-res images via dynamic tiling and Pixel Shuffle downsampling before the vision-language connector and LLM. Training is in two stages: vision-language alignment with frozen encoders, then supervised fine-tuning across multilingual tasks.

Source

HuggingFace Blog

Ingested

MAR 04, 2025 · 19:10

Editorial score

4.0 / 5