681MAR 0400:00
articleHuggingFace Bloglast yr.
A Deepdive into Aya Vision: Advancing the Frontier of Multilingual Multimodality
Cohere's Aya Vision unveils 8B and 32B multilingual vision-language models for 23 languages, with strong results on AyaVisionBench and mWildVision. It uses synthetic annotations, multilingual data expansion, and model merging, and handles high-res images via dynamic tiling and Pixel Shuffle downsampling before the vision-language connector and LLM. Training is in two stages: vision-language alignment with frozen encoders, then supervised fine-tuning across multilingual tasks.