Ettin Suite: SoTA Paired Encoders and Decoders

Ettin introduces the first SoTA paired encoder-only and decoder-only models (17M–1B params) trained identically for apples-to-apples comparisons. It extends the ModernBERT recipe to both architectures, with encoders beating ModernBERT and decoders beating Llama 3.2 and SmolLM2, while preserving architecture-specific advantages.

Source

HuggingFace Blog

Ingested

JUL 16, 2025 · 19:10

Editorial score

4.0 / 5