That only works if you decide to stick to that exact model for the rest of your life, obviously.

The point is he said "by its nature". A transformer based LLM when called with the same inputs/seed/etc is literally the textbook definition of a deterministic system.