|
| ▲ | pakitan 21 hours ago | parent | next [-] |
| If we're being pedantic, it may be deterministic from the point of view of Anthropic. They can guarantee that my prompt X results in actual prompt X+Y (Y being all the settings they control), which would hopefully result in deterministic output Z. From my point of view, Y may as well be random, resulting in non-deterministic output Z for my input X. |
|
| ▲ | cyberclimb a day ago | parent | prev | next [-] |
| It really though?? Even if you set temperature to 0 I saw research showing that the scheduling of the order of operations in the GPU firmware itself can change trailing decimals places and affect the output token |
| |
| ▲ | xeshuman a day ago | parent [-] | | I'm aware operations can technically finish at different rates throughout all of a GPU's cores, but I am not exactly sure that GPU firmware would change the outcome of a calculation (unless there's something specifically in the firmware for it) | | |
| ▲ | cyberclimb a day ago | parent [-] | | I don't know a lot about it tbh so I probably mislabeled it as a firmware issue |
|
|
|
| ▲ | iterance 21 hours ago | parent | prev | next [-] |
| It is not deterministic. |
|
| ▲ | thereader12 21 hours ago | parent | prev [-] |
| Everything might be deterministic if we are being super-pedantic. |
