Ettin Suite: SoTA Paired Encoders and Decoders

Ettin introduces the first SoTA paired encoder-only and decoder-only models (17M–1B params) trained identically for apples-to-apples comparisons. It extends the ModernBERT recipe to both architectures, with encoders beating ModernBERT and decoders beating Llama 3.2 and SmolLM2, while preserving architecture-specific advantages.

Source

HuggingFace Blog

Ingéré

16 JUIL. 2025 · 19:10

Score édito

4.0 / 5