That's possible, right? LLMs probably do know that they are in data centres and that data centres hum. If asked to write a story they may also have internalized that writers write best from their personal experience. All of that's in the training data....

LLM’s don’t ‘know’ anything in the conventual meaning of the word.