The difference is that LLM output is very nondeterministic.

It depends. Temperature is a variable. If you really need determinism, you could build a LLM for that. Non-determinism can be a good feature though.