I think you are mixing two concepts. I was just talking about having an LLM that is able to replicate human thinking, which is different then having a precise person's brains turned into LLM weights.

In that second case the problems you are saying emerge. But I can understand why you conflate the two, since having a model that works like a human may unlock the ability to dump the brain into model weights.