Remix.run Logo
cubefox an hour ago

Yep. Zero temperature is neither necessary nor sufficient for deterministic inference.

cj an hour ago | parent [-]

Why?

tempay an hour ago | parent [-]

You can seed the randomness are still having nonzero temperature.

Numerical instability can introduce randomness especially on GPU like hardware unless you’re very careful about how you write your algorithms.