Remix.run Logo
tanh 3 days ago

For code can't they distill from public GitHub commits? If they could figure out who used Mythos/Fable assitance in the commits.

SwellJoe 3 days ago | parent [-]

I think they're distilling "reasoning", not merely code. There's plenty of human generated code. What they're trying to extract is the process by which really large models "think" their way through complicated problems. That's what all the "traces" datasets on HuggingFace are about.