Remix.run Logo
watwut 11 hours ago

> instruct it to not rewrite anything, only give you an overall picture of text clarity, sentiment, etc.

LLM cant really do that. It can help you produce correct sentence where you struggle to create own, but it does not have capabilities to do what you suggest.

jmmv 6 hours ago | parent | next [-]

It sounds like you haven't tried.

LLMs definitely can do this. The output tends to be overly positive though, claiming that any sort of rough draft you give them is "great, almost ready for publishing!". But the feedback you can get on clarity, narrative flow, weak spots... _is_ usually pretty good.

Now, following that feedback to the letter is going to end up with a diluted message and boring voice, so it's up to you to do with the feedback whatever you think best.

surgical_fire 3 hours ago | parent [-]

Btw, this is precisely what I implied.

I never ask the LLM to evaluate my text in terms of being good or bad. Instead I try something like this:

"In this section I tried to explain X, I intended to sound in Y and Z fashion, and I want a reader to come out with ateast W impression. Is the text achieving these goals? Do I communicate my ideas clearly and consisely, or are they too confuse and meandering?"

I typically get useful feedback. I preface specifically asking it to not rewrite, simply pointing the bits that it finds faulty and explaining why.

Of course the prompt is different is I am writing, for example, technical documentation, or if it is an attempt at creative writing.

surgical_fire 10 hours ago | parent | prev [-]

What? LLMs are very capable of doing sentiment analysis. Hell, it's basically one of the things it actually excels at - understanding tone, nuance, context, etc.

I used it many times for exactly this, with good results. It points out ambiguous contructs, parts that are dissonant from the tone I intend, etc.

I have no idea why you think that LLMs can't do that lol

watwut 9 hours ago | parent [-]

Sentiment analysis for the purpose of categorizing reddit comments, sure. For the purpose of giving you advice about nuance, overall clarity and tone of own long test, no.

surgical_fire 9 hours ago | parent [-]

I tried it myself, and it did actually a good job.

There's nothing magical about a long text you write yourself vs a stream o reddit comments in a thread. It's all sentiment analysis on text. It can extract ambiguity, how ideas are connected in the context, categorize and summarize, etc.

You should try it and see it for yourself. Feed it some large text of a single author and ask it to do those things, see if the results are satisfactory.