Remix.run Logo
▲ pixl97 a day ago

>current AI tools don't learn

and

>and all that tedious documentation effort was just a waste of time.

Seeing where the AI is failing and then putting out good public documentation is a good way to ensure the next released model learns.

▲jltsiren a day ago | parent [-]

Public documentation can help to mitigate the issue, but only with information that can be released to the general public, and only if it can be easily put into words. But as long as there is a separation between training and inference, the divergence between what the model knows and what it should know only grows wider over time.

I've been one of the organizers of a relatively large RPG convention for ~25 years. If I had to write down all I know about that convention, it would easily take a year or two. Because most of that knowledge is not in a form that can be easily expressed in words. And in my day job as a scientist, a similar task would easily take 5–10 years.