Remix.run Logo
▲ Ohentis 2 hours ago

If the majority of gains were due to post training, they just wouldn't do pre training. Many of the tasks people are trying to do with these llms (math and coding) don't actually benefit from natural language skills.