Last update over a year ago, so I hope (2025) gets added to the title:

> [2025/05/26] (Step 1 completed!) We release Mixture-of-Thoughts--a curated reasoning dataset of 350k verified traces distilled from R1. The dataset spans tasks in mathematics, coding, and science, and is designed to teach language models to reason step-by-step. We also provide a recipe to train OpenR1-Distill-7B, which replicates the reasoning capabilities of deepseek-ai/DeepSeek-R1-Distill-Qwen-7B and marks the completion of step 1 in the Open R1 project.

Doesn't look like they managed to actually reproduce R1, and only stopped on Step 1 out of their 3-step plan.

▲

spmurrayzzz 5 hours ago | parent [-]

One of my favorite code comments of all time is still in the src:

"# TODO: implement a proper validator to compare against ground truth. For now we just check for exact string match on each line of stdout." [1]

This was one of my chief complaints about the entire R1 news cycle, it felt like no one actually read the technical report. They were being heralded for their openness, but they left out the most meaningful details that you'd need to reproduce their work.

[1] https://github.com/huggingface/open-r1/blob/1416fa0cf21595d2...

▲

neutronicus 4 hours ago | parent | next [-]

Reminds me of my days in a computational physics PhD program.

	▲	devmor 42 minutes ago \| parent [-]
		I had some contract work years ago helping some PhD program astrophysicists write scripts to make their research algorithms compute their data before their great grandchildren retire and one of the action items we never implemented was because someone wrote an “…etc” in the middle of the math. They knew that everything was verifiably correct on the input, and verifiably correct on the output, and they swore they had figured it out at one point and just never wrote it down. I was asked if I could “just extrapolate it” and had to explain that computer programs work the same as math - I can give you a literally infinite number of ways to reach an output from an input.

▲

khazhoux 3 hours ago | parent | prev [-]

> This was one of my chief complaints about the entire R1 news cycle

For me it was the headline that a group of students replicated GPT-3 for $5000