Falcon-H1: A Family of Hybrid-Head Language Models Redefining Efficiency and Performance

Falcon-H1 is a family of six open-source LLMs (0.5B–34B) using a hybrid attention + SSM design, delivering faster inference and lower memory with strong cross-task performance. Available as base and instruction-tuned variants, they support 256K context, 18 native languages (with a tokenizer scalable to 100+), and are optimized for edge-to-large deployments under Apache 2.0.

Source

HuggingFace Blog

Ingéré

21 MAI 2025 · 19:10

Score édito

4.0 / 5