Remix.run Logo
▲ astro1234 2 hours ago

I’m going to say a class of opinion that has historically been overwhelmingly rejected by this crowd:

Peer review will no longer matter in about 2 years and it will feel silly that we were ever asking ourselves these questions.

Despite being proven time and time again that performance trends are incredibly stable and if anything accelerating slightly, that pretraining scaling laws and their analogs for post training are reliable enough for this to be mathematically uncontroversial, it is just as reliable that these clearly accurate projections are so incredible that people still don’t seem to accept it. This sentence has been true and could have been said at any point in time over the last 4-5 years (and it has, many times).

The AI 2027 scenario while hilarious when posted is alarmingly not that far off from where we are today. As Dwarkesh reports from his conversations with Anthropic researchers and those at other labs, we are on track to solve RSI sometime in 2027 (again a relatively easy thing to project if you know a little bit about performance trends and how model performance is measured).

The world will not implode like a dying star, and I expect the experience to be more or less what we’re going through today, though some capabilities will experience a much higher rate of improvement, and since there are unavoidable bottlenecks that AI cannot get around ever and some that will take years to figure out how to break down. But “oh no we don’t have humans to peer review” is incredible to me: peer review is a quality filter, and humans are notoriously bad at it. Models are already better in many ways at peer review and will become so obviously better that having a human in the loop at all will be like hailing a horse and buggy ride from the airport.

▲croissants 29 minutes ago | parent | next [-]

> conversations with Anthropic researchers and those at other labs

The trouble is that most researchers at frontier labs were AGI/ASI/RSI-pilled a long time ago, likely when it was a distinctly minority position. It's part of their worldview, and as human beings, they're unlikely to say that it's not happening without very strong evidence that it's not happening.

The catch is that such evidence has not really appeared! The trends might just keep going! But I am skeptical that the predictions of the frontier lab folks are really valuable beyond the couple-of-months look into the future that their existing internal models provide.

▲robwwilliams 22 minutes ago | parent [-]

You are probably responding to the ASI component. Today Opus 5.5 is definitely better at reviewing complex papers and grant applications in my field (neurogenetics and geroscience) than most human reviewers. It is already “no contest” in my experience.

▲feralcoder an hour ago | parent | prev [-]

[flagged]