Personally I can complain to no end about arXiv papers being insufficiently rigorous, especially in the text classification area that I've been interested in since 2005 or so.

Show me the blog posts where people talk about the results they got "vibe coding" and those arXiv papers look great in comparison!

There is the insidious thing with LLMs is that they can get the general shape of something right but that thing will not be useful if the last 1% is wrong. It might be that the operator sees the problem and fixes it, but it may also be that the LLM hypnotizes the operator into not seeing the errors and gaps.

I know there are many sorts of problems where I've had good experiences with LLMs but I know other people have had bad experiences and some of it might be my skill but some of it is just plain luck.

[dead]