| ▲ | WithinReason 4 hours ago | |
Apparently it's news to some people. It also helps combat the "LLMs ArE nOt DeTeRmInIsTiC" complaints. | ||
| ▲ | recursive 4 hours ago | parent | next [-] | |
Doesn't help much | ||
| ▲ | rvz 4 hours ago | parent | prev [-] | |
> It also helps combat the "LLMs ArE nOt DeTeRmInIsTiC" complaints. Reality says otherwise, especially from those who run LLMs in production at a large scale. Hacks such as baking in the weights with tiny experiments doesn't disprove anything. The same LLM boosters also continue to repeat one of the biggest misconceptions: "sEt TeMperaTurE tO zERo tO aChiEvE fUlL dEterMinIsm." | ||