Remix.run Logo
lm28469 2 days ago

No I did that HN thing where I went to an LLM, set temp to 0, pasted your comments in and got widely different outputs every single time I did so

9rx 2 days ago | parent | next [-]

"Went" is a curious turn of phrase, but I take it to mean that you used an LLM on someone else's hardware of unknown origin? How are you ensuring that said hardware isn't faulty? It is a known condition. After all, I already warned you of it.

Now try it on deterministic hardware.

lm28469 a day ago | parent [-]

Feel free to share your experiments, I cannot reproduce them but you seem very sure about your stance so I am convinced you gave it a try, right ?

9rx a day ago | parent [-]

Do you need to reproduce them? You can simply look at how an LLM is built, no? It is not exactly magic.

But what are you asking for, exactly? Do you want me to copy and paste the output (so you can say it isn't real)? Are you asking for access to my hardware? What does sharing mean here?

2 days ago | parent | prev | next [-]
[deleted]
NewsaHackO 2 days ago | parent | prev [-]

Was the seed set to the same value everytime?

whimsicalism 2 days ago | parent [-]

https://thinkingmachines.ai/blog/defeating-nondeterminism-in...