▲ | peanut_merchant 5 hours ago | |
I understand the point that you are making, but the example is only valid with temperature=0. Altering the temperature parameter introduces randomness by sampling from the probability distribution of possible next tokens rather than always choosing the most likely one. This means the same input can produce different outputs across multiple runs. So no, not deterministic unless we are being pedantic. | ||
▲ | blibble 5 hours ago | parent [-] | |
> So no, not deterministic unless we are being pedantic. and not even then as floating point arithmetic is non-associative |