Remix.run Logo
Remix clone Hacker News
new | show | ask | jobsGithub
▲ syntaxing 3 days ago

I like this so much. Maybe I’m romanticizing but hoping tools like this give local news a chance against monopolies like Sinclair Broadcasting.

▲cyanydeez 2 days ago | parent [-]

It'll merely generate hyper local bots that generate hyper local slop. The media landscape is downhill.

▲ChrisMarshallNY 3 hours ago | parent | next [-]

I think it's just lead generation. If the paper decides to use AI to write/edit stories, that's another topic.

▲jasonlotito 3 hours ago | parent | prev | next [-]

That's a long way of saying you didn't read the article.

▲binarymax 8 hours ago | parent | prev [-]

Are search summaries slop?

▲phoghed 4 hours ago | parent | next [-]

Too many people use "slop" as a synonym for "AI Generated", so it's becoming useless as a term

▲Forgeties79 2 hours ago | parent [-]

If the work wasn’t so frequently sloppy we’d stop calling it slop.

▲phoghed an hour ago | parent [-]

Turns out slop is incredibly useful, valuable, and tasty

▲Forgeties79 2 minutes ago | parent [-]

Lots of caveats and qualifiers needed here

▲ginko 7 hours ago | parent | prev [-]

Yeah

▲binarymax 6 hours ago | parent [-]

It’s not a blanket ‘Yeah’. It’s a ‘sometimes’ and that sometimes depends on use. Distilling down a whole days worth of research is one of the best uses of AI.

▲irishcoffee 5 hours ago | parent [-]

My 12 year old told me that their friend group says "Oh I AI'd that" when they make a mistake, as a joke. Yet you trust AI to distill down a days worth of information in a 100% accurate way? When pre-teens already understand how unreliably they are?

▲binarymax 3 hours ago | parent | next [-]

If I'm getting citations, and the distillation has strong alignment with citations, then it's fine. In other words: the if the summary is a highlight and not a rewrite then I'm happy. I've studied this extensively and have even created metrics around this problem: https://maxirwin.com/articles/llm-rag/

▲irishcoffee 2 hours ago | parent [-]

So, if you review the entire dataset? At that point just write the summary yourself.

I use "AI" a lot, it is a fantastic tool. We need to stop pretending it is some kind of panacea. It's a tool.

▲Forgeties79 2 hours ago | parent [-]

> I use "AI" a lot, it is a fantastic tool. We need to stop pretending it is some kind of panacea. It's a tool.

I have been repeating some variation of this for months. If people would stop acting like it’s THE tech solution to ALL things ALL the time I bet a lot of critics would quiet down. The overhyping has become exhausting. It’s been going on for years.

GPT messed up the math for me the other day when I was simply adding 10 durations for a TRT. Couple of HH:MM:SS inputs, annoying to add up and I had it open.

It got it wrong, I told it it was wrong, it got it wrong again. Then out of curiosity I provided it the answer, asked for it to confirm it against the original numbers, and it went “you’re absolute right, it’s [original/wrong answer from earlier].”

This stuff happens probably 10-15% of the time for me regardless of the model. Not just math, just super simple crap. It’s wild to see at this point after 3-4 solid years of “hyperscaling” and overhyping. And it’s the kind of thing that keeps people like me from buying in beyond the foot or two we’ve stuck in the water.

▲Zambyte 3 hours ago | parent | prev | next [-]

What does "100% accurate" distillation even mean? That sounds contradictory. "Good enough" is fundamentally what makes distillation valuable, not perfection.

▲Conner_Hobbs 2 hours ago | parent [-]

[flagged]

▲ToucanLoucan 4 hours ago | parent | prev [-]

I will say, while I agree with the broad strokes of what you're saying, in my experience when you provide an LLM with data to summarize, instead of it needing to go find it, the hallucination rate goes down staggeringly. I've never had a huge hallucination when the material I'm asking to be summarized is provided to it at the time of the request.

Any further distance than that though, even summarizing the conversation it's aware of up to that point, is dicier.