| ▲ | asah 3 hours ago | |
law of diminishing returns? i.e. any reasonable frontier lab will have enough user logs... | ||
| ▲ | londons_explore 3 hours ago | parent [-] | |
My theory is there is actual knowledge in the user logs. When a user says "I'm struggling to undo a bolt on my 1952 Mustang" and the AI responds "try hitting it with a hammer" and the user replies with "that worked thanks" - that is a tiny piece of knowledge which exists nowhere else. Future AI's can say with more confidence that hitting it with a hammer will probably work. Across billions of conversations, that can add up to more knowledge than all books. | ||