> LLMs, by their very nature are probabilistic

I believe that if you can tweak the temperature input (OpenAI recently turned it off in their API, I noticed), an input of 0 should hypothetically result in the same output, given the same input.

▲

bdhcuidbebe 5 days ago | parent | next [-]

That only works if you decide to stick to that exact model for the rest of your life, obviously.

	▲	oceanplexian 5 days ago \| parent [-]
		The point is he said "by its nature". A transformer based LLM when called with the same inputs/seed/etc is literally the textbook definition of a deterministic system.

▲

sarchertech 5 days ago | parent | prev [-]

No one uses temperature 0 because the results are terrible.