I like that blog, I had not read it before.

On first read, I think this is pretty close to how I feel about generated content. This portion, in particular, is largely where I have landed (although I'm not 100% in agreement that definition of creativity and novelty, exactly):

> If creativity and novelty is about learning or increasing compression rates, then AI-generated outputs are, in a rigorously objective sense of predicting its contents, grossly inadequate because once you guess the minimal prompt (eg. “a confused economist” or “a happy dog”), there is no more learning to be done. You can predict the image contents after just a few bits. Then the image, however big and however filled with pseudo-details, provides no more learning.

The criticism I often have of LLM generated stuff is that the prompt is the only original part. To me it feels like being presented with the results of a google search, just in a different form. Once I know roughly what the query was, I know what the core question was, and I can go get my own information. I don't need anyone to hand me the search results.

I don't necessarily phrase it in terms of learning, but it's the same principle. Why should I read a 10 paragraph response from chatGPT when the unique part is the prompt? If the prompt is only a paragraph long, then it's just adding additional work that I have to do to work backwards and understand what someone was originally trying to communicate.

Similarly, the only times I have enjoyed generated images are when my friends have used them for set pieces for a D&D campaign. They didn't really add any useful information, just being static images of bosses and locations, but because they were highly tuned to the exact events in our campaign they enhanced the overall experience.

I'm working on a 10k word short story. I'm using omp and OpenCode models, and generated a dozen files around characters, backstories, motivation, dialog style, entities in the world, locations, corporations, along with an actual plot that I'm progressively exploding with more detail and nuance. The process has taken days and hundreds of turns.

It doesn't seem like your description of AI use matches what I'm doing at all.