You are specifically recommending asking the model which of two versions is better (the quote in my top-level comment).

We both agree that they are poor "make it better" machines, but I also believe they are bad A/B testers and I'm using the former to demonstrate the latter.

▲

tptacek 7 hours ago | parent [-]

You are writing both paragraphs. You’re specifically not asking a model to make a better paragraph. That would be a load-bearing debacle.

▲

Retr0id 7 hours ago | parent [-]

It doesn't matter who writes what, what matters is that LLMs have a preference for LLM-shaped writing. By A/B testing against an LLMs opinion, you are optimizing in the direction of LLM prose even if the LLM never writes any of the prose itself.

	▲	ameliaquining 6 hours ago \| parent [-]
		LLM style is not literally anticorrelated with quality. There are some things that they tend to do poorly, but you're not going to do those because you're writing the text yourself. If you have it judge your writing, and are careful to avoid the failure modes that the post goes into, it can be helpful by serving as a competent editor that doesn't share your blind spots.