Falcon-Edge: A series of powerful, universal, fine-tunable 1.58bit language models.

Falcon-Edge is a series of universal, fine-tunable LLMs built on BitNet with ternary weights (-1,0,1). It trains end-to-end to yield both non-quantized and quantized variants (bf16, BitNet, pre-quantized) in one pass, available in 1B and 3B sizes with base and instruction-tuned models. Early results on Hugging Face leaderboard v2 show competitive performance for its size, backed by ~1.5T tokens of pre-training and a 1-bit LLM tooling package.

Source

HuggingFace Blog

Ingéré

15 MAI 2025 · 19:10

Score édito

4.0 / 5