> You can set the temperature of LLMs to 0 and that will make them deterministic.

It will make them more deterministic, but it will not make them fully deterministic. This is a crucial distinction.

That’s an implementation choice. All the math involved is deterministic if you want it to be.

	▲	Jaxan 6 hours ago \| parent [-]
		It will still be nondeterministic in this context. Prompts like “Can you do X?” and “Please do X” might result in very different outcomes, even when it’s “technically deterministic”. For the human operating with natural language it’s nondeterministic.

falcor84 8 hours ago | parent | prev [-]

Google is significantly less deterministic than AltaVista was.