> there is something different about AI, though, in that it attacks the craft of cognition itself.

It's particularly frustrating that it's simultaneously superhuman and incredibly unreliable when it comes to cognition.

E.g. it can whip out 100,000 lines of code in the time you'd write 500...but 5% of that code will be janky, or subtly buggy, etc.

It's the "oh...you're absolutely right!" effect. I can't think of any other tools that are so powerful yet so finnicky and almost guaranteed to fail in ways that are so difficult to detect.

▲

nimski 10 hours ago | parent [-]

Yes, although the folks that said "this is the worst it will ever be" have some evidence in their court. The best models now are much better than the best models a year ago.

Some big gnarly problems remain (e.g. continual learning), but I think the fact of AI existing and being better than humans at cognition no longer seems like something out in the far future.

	▲	queenkjuul 9 hours ago \| parent [-]
		> The best models now are much better than the best models a year ago. I went back to using Opus 4.8. I don't feel like the newest models are all that much better. The tooling around them has gotten better, and i guess mythos et al are good at hacking or whatever, but the models don't seem any better at not making mistakes than 6-8 months ago