articleHuggingFace Blog
SmolLM3: smol, multilingual, long-context reasoner
SmolLM3 is a competitive open 3B model (11T tokens) with 128k long context via NoPE and YaRN, and multilingual support across six languages. It uses a Llama-based decoder with Grouped Query Attention, intra-document masking, and training-stability tweaks, plus a dual Instruct/Reasoning model.
published JUL 08, 2025★★★★★
Read the sourcehuggingface.co/blog/smollm3
[*] Opens in a new tab · no tracking on Lantern's side
- Source
- HuggingFace Blog
- Ingested
- JUL 08, 2025 · 19:10
- Editorial score
- 4.0 / 5