It’s a simulation of language, not consciousness. Though the problem you mention is pretty much the same