> inherent non-determinism in current AI architectures

There's nothing inherent about non-determinism in transformer architectures. All of it is removable.

Again comes to use of deterministic. Maybe calling AI varyingly chaotic is more helpful but would also be misunderstood. And I use that in meaning of slight changes in input generating large and somewhat unpredictable changes in output...

▲

vickychijwani 5 hours ago | parent | prev [-]

I see. Can you say more about this? What’s the trade-off of removing it?

	▲	YZF 3 hours ago \| parent \| next [-]
		You get a probability curve for the next token prediction. You can just pick the highest probability. That said the non-determinism serves a real purpose- it allows different outputs and paths to be explored. So that's kind of the tradeoff.
	▲	sssilver 4 hours ago \| parent \| prev [-]
		This explains it pretty well: https://academy.claude.com/courses/building-with-the-claude-...