| ▲ | slashdave 4 hours ago | |
Eh, conceptually true, but in practice, it is rather hard to get any decent performance out of a GPU and still produce a deterministic answer. And in any case, setting the temperature to zero will not produce a useful result, unless you don't mind your LLM constantly running into infinite loops. | ||