If an LLM has any taste, it comes from its training data.

LLMs don’t have taste. Almost definitionally they can’t. They can parrot what they think other people think is tasteful, but they cannot have taste.