| ▲ | hosel 2 hours ago | |||||||
Can you explain what you mean? | ||||||||
| ▲ | reconnecting an hour ago | parent | next [-] | |||||||
LLM pre-training models risk being unable to be updated with data from after 2025, as much of it is corrupted with LLM-generated content. We might be locked into outdated knowledge, where only whitelisted sources decide what to include. Taking into account the sometimes blind belief that 'LLMs know everything', the outcome could be very costly, especially for technologies and businesses unfortunate enough to emerge after 2025. | ||||||||
| ▲ | nemomarx 2 hours ago | parent | prev [-] | |||||||
It might indicate core model training and pre training is really slowing down? | ||||||||
| ||||||||