What does temperature have to do with anything?
Or however deterministic inference is supposed to happen. I don’t know LLMs.