I think you could simulate something that passes a sniff test. A writer would probably spot implausibilities in the simulation if they paid attention, but then we're back to square one, because you can spot that something was written by an LLM after you've wasted your time reading it and realize that you've been led around in circles with superficial information and no coherent train of thought, but by then your time has already been wasted.