But deciding the next token is not a merely mechanical process. Even if the string of tokens from our swapped out humans ends up being syntactically incorrect, it's due to the combination of intelligently selected tokens. (Presumably intelligent human programmers seem to make syntactic errors)