Remix.run Logo
mynameismon 5 days ago

The point of the blog is that even at "supposed" deterministic generative sampling, non-determinism creeps in. This in turn has disastrous effects in very real experiments.

cubefox 5 days ago | parent [-]

My point is that greedy sampling is not just not sufficient but also not necessary for deterministic inference.