Remix.run Logo
Recursion into madness(blog.coredump.cx)
38 points by surprisetalk 3 days ago | 9 comments
GPerson 7 minutes ago | parent | next [-]

Does the same effect happen in a society which rewrites all of its knowledge over and over using AI?

jrochkind1 22 minutes ago | parent | prev | next [-]

> PS. For obvious reasons, this post will fail Pangram tests.

Actual pangram to me says it's 100% human. Current pangram can flag different passages differently, but these are all flagged human by it, even the LLM written ones.

pattt 2 hours ago | parent | prev | next [-]

It would be interesting how many iterations of LLM-based PR reviews and fixes it takes to turn the code into horror. It’s already started happening.

Muromec 2 hours ago | parent | prev | next [-]

It doesn't merely stabilise, it almost converges on itself

MarkusQ 2 hours ago | parent | prev | next [-]

It would have been interesting to try something closer to the movie poster example; say have the AI rewrite the passage with the room toggling between the initial light-mode decor and a dark-mode decor, then back, repeatedly. Or even change the woman's name to "Mrs. Smythe" and back.

layer8 2 hours ago | parent [-]

As the article explains: “[…] In other words, if you instruct a model to change a single word in a paragraph of text, it can almost always handle the task with no collateral damage.“

groby_b 3 hours ago | parent | prev | next [-]

The existence of attractors (e.g. "stable at iteration 31") for AI models is one of the weirdest things in AI land. They are a wonderful space to explore, fascinating and full of horrors.

Meanwhile, my hat's off to the (currently) last comment on the page: "I like how the shear-sheathed legs still earned their keep — probably load-bearing for Mrs. Regan"

amelius 3 hours ago | parent | prev | next [-]

The same happens with humans, in e.g. chain stories, cumulative stories, etc.

Not unique to AI.

lowbloodsugar 2 hours ago | parent | prev [-]

>I don’t write about generative AI much. Everyone else does; not much of consequence ever gets said.

I see he chose not to break with tradition.