Remix.run Logo
reliablereason 2 hours ago

Clearly LLMs cant do leaps of intuition since their "intuition" is locked after training ends.

The only way a LLM can come up with new ideas if the "idea" appeared as a generalisation durring training or if it was achieved using reason in chain of thought.

buzzin__ 36 minutes ago | parent [-]

Or some randomness is aomehowntroduced in the output, which happens after every word, unless you set the temperature to zero.