And if they were deterministically sometimes wrong, that wouldn't be better.

bigstrat2003 11 hours ago | parent [-]

That actually would be significantly better, because then you could work out under what conditions they were wrong and correct for it. But being stochastically wrong means you have to check everything, because you never know when the errors will creep in.

	▲	ameliaquining 11 hours ago \| parent [-]
		If it were deterministic but chaotic, which AFAIK is the case for LLMs running at temperature 0, then you would have to likewise check every time you changed anything and couldn't meaningfully correct for it.