It’s a simple exploration/exploitation trade off. Always explore, never exploit is probably not the optimal strategy every time.

It seems to me that everyone is in "always exploit" mode.

Seems weird when it's become apparent that LLMs aren't really special sauce outside of just having the compute.