Remix.run Logo
▲ londons_explore 3 hours ago

It will become winner take all when AI companies manage to really get value from user logs.

Right now they don't even get good feedback from local sessions - I can see it make the same mistake two days running, and then months later when a new model comes out, presumably trained on my data, it still makes the same mistake.

▲asah 3 hours ago | parent [-]

law of diminishing returns? i.e. any reasonable frontier lab will have enough user logs...

▲londons_explore 3 hours ago | parent [-]

My theory is there is actual knowledge in the user logs.

When a user says "I'm struggling to undo a bolt on my 1952 Mustang" and the AI responds "try hitting it with a hammer" and the user replies with "that worked thanks" - that is a tiny piece of knowledge which exists nowhere else.

Future AI's can say with more confidence that hitting it with a hammer will probably work.

Across billions of conversations, that can add up to more knowledge than all books.