Remix.run Logo
▲ monster_truck 2 hours ago

They're actually extremely predictable. What you are experiencing is the provider you are entrusting with your time, effort, and money fucking you because they need the capacity to train the next one. So without any real notice or indication other than things vaguely seeming broken in ways everyone seems to be experiencing differently, they're serving up some shitty quant of what you already paid to use.

▲singularity2001 an hour ago | parent [-]

Extremely predictable is an exaggeration. I was teaching machine learning and we needed half a dozen lines to make even simple networks deterministic. LLMs are not really predictable, even if we want to, they will sometimes behave almost chaotic depending on the input.

▲bmacho an hour ago | parent | next [-]

> we needed half a dozen lines to make

6 lines per model? Can't you put that 6 lines in a function/macro/decorator/library so you only have to call it?

▲monster_truck an hour ago | parent | prev [-]

I'm not sure how you're arriving at "if you use the same seed with the same version of the software on the same hardware with the same drivers you get the same result is an exaggeration", it's wild that you're a teacher and you seemingly do not know this.