Open R1: Update #2

OpenR1-Math-220k is a large-scale math-reasoning dataset built on 512 H100s, with two (often four) solutions per problem and about 800k reasoning traces. It uses automated filtering (Math Verify) and LLama3.3-70B-Instruct as a judge, and achieves high throughput with vLLM and SGLang (~300k solutions/day). The update also details distillation results and a pipeline extensible to other domains.

Source

HuggingFace Blog

Ingested

FEB 10, 2025 · 19:10

Editorial score

4.0 / 5