*chaotic

It is deterministic, if we're being pedantic

If we're being pedantic, it may be deterministic from the point of view of Anthropic. They can guarantee that my prompt X results in actual prompt X+Y (Y being all the settings they control), which would hopefully result in deterministic output Z. From my point of view, Y may as well be random, resulting in non-deterministic output Z for my input X.

▲

cyberclimb a day ago | parent | prev | next [-]

It really though?? Even if you set temperature to 0 I saw research showing that the scheduling of the order of operations in the GPU firmware itself can change trailing decimals places and affect the output token

▲

xeshuman a day ago | parent [-]

I'm aware operations can technically finish at different rates throughout all of a GPU's cores, but I am not exactly sure that GPU firmware would change the outcome of a calculation (unless there's something specifically in the firmware for it)

	▲	cyberclimb a day ago \| parent [-]
		I don't know a lot about it tbh so I probably mislabeled it as a firmware issue

▲

iterance a day ago | parent | prev | next [-]

It is not deterministic.

▲

thereader12 a day ago | parent | prev [-]

Everything might be deterministic if we are being super-pedantic.