Earlier today there was a post about someone submitting an incorrect AI generated bug report. I found one of the comments telling:

https://news.ycombinator.com/item?id=45331233

> Is it that crazy? He's doing exactly what the AI boosters have told him to do.

I think we're starting to see the first real AI "harms" shake out, after some years of worrying it might swear or tell you how to make a molotov cocktail.

People are getting convinced, by hype men and by sycophantic LLMs themselves, that access to a chatbot suddenly grants them polymath abilities in any field, and are acting out there dumb ideas without pushback, until the buck finally stops, hopefully with just some wasted time and reputation damage.

People should of course continue to use LLMs as they see fit - I just think the branding of work like this gives the impression that they can do more than they can, and will encourage the kind of behavior I mention.