| ▲ | sosodev an hour ago | |
If you only care about facts, maybe. Even then I'm sure there are countless facts not described outside of old books. I have a hard time believing that text valuable to humans would not be valuable to AI. | ||
| ▲ | dgellow 36 minutes ago | parent [-] | |
Agreed, in addition LLMs are trained on a lot of useless data, such as the whole Reddit dataset which has to be at least 90% Reddit garbage, and that doesn’t seem to be a problem. I don’t see why ai labs wouldn’t want to also train on older data | ||