| ▲ | piterrro 2 hours ago | |||||||
You can get determinostic output (mostly) by setting the temperature to zero. Using couple of other tricks you can get close to 100% of determinism with LLMs. | ||||||||
| ▲ | jdiff 2 hours ago | parent [-] | |||||||
That's reproducible, I wouldn't call it deterministic. Small, semantically meaningless changes in the input can still result in wildly different output. | ||||||||
| ||||||||