| ▲ | wrs 3 hours ago | |
At first I thought tacit knowledge would be a differentiator: LLMs are trained on writing, so they can’t learn things that have never been written down. But tacit knowledge is exactly what reinforcement learning post-training is about. So (just as with humans) the limitation is in providing a rich enough environment, with good enough feedback, to train in the tacit knowledge. | ||