they probably mean deterministic in the sense of traditional computer programs consisting of if-else decision points and ordinary cpu logic, as opposed to numerical models (which can of course be deterministic too, as you pointed out)

Model inference is just that same logic but faster.

I think the point is determined. No-one can determine what the LLM might do.