Remix.run Logo
Retr0id an hour ago

> [Claude] performed all ingredient classification under deterministic decoding (temperature 0–0.1)

Not that it matters much in this context, but low-temperature is not the same thing as deterministic.

cubefox an hour ago | parent [-]

Yep. Zero temperature is neither necessary nor sufficient for deterministic inference.

cj an hour ago | parent [-]

Why?

tempay an hour ago | parent [-]

You can seed the randomness are still having nonzero temperature.

Numerical instability can introduce randomness especially on GPU like hardware unless you’re very careful about how you write your algorithms.