Remix.run Logo
yorwba 14 hours ago

Deterministic output is a property of the inference framework, not the model. E.g.

https://docs.sglang.ai/advanced_features/deterministic_infer...

https://github.com/ggml-org/llama.cpp/pull/16016

twosdai 13 hours ago | parent [-]

Really appreciate this, this is exactly what I was looking for.