Remix.run Logo
reducesuffering 14 hours ago

No more "stochastic parrots" and "LLM's can never produce anything novel, just regurgitate" comments anymore huh?

andriy_koval 14 hours ago | parent [-]

Sure, looks like 5% of math can be solved by 1T parameters stochastic parrot after NN trillion attempts (burned tokens). By numbers it could be less impressive than some brute force distributed chess engine.. Prove me wrong.

rcxdude an hour ago | parent [-]

It's obviously significantly better than brute force. A trillion is absolutely minuscule compared to the size of the search space (like, 'rounding down to 1 is basically the same' small).