Remix.run Logo
▲ coderintherye 2 hours ago

If AI submissions, then why not go a step further and have AI reviewers?

Perhaps this will help bring more scrutiny to the metric of publishing quantity not being as valuable as it has been treated.

▲canjobear 2 hours ago | parent | next [-]

In practice this already happens, unfortunately.

▲guywithahat 2 hours ago | parent [-]

Why is it unfortunate? We should absolutely use AI reviewers to help catch errors and fact check papers

▲hunterpayne 44 minutes ago | parent | next [-]

Because the exact opposite will happen. The idea that allowing AI reviewers will increase accuracy is probably foolhardy. People being people will get lazy and review less by hand if at all. And the LLMs will miss plenty of things. Then those papers will get into the training sets for the next LLMs. I think you can see where this goes overtime.

▲hodgehog11 10 minutes ago | parent [-]

The issue is generally not accuracy in my experience (humans are even lazier about this). The issue is that LLMs do not understand what is interesting and what is procedural.

▲jruohonen 2 hours ago | parent | prev [-]

> Why is it unfortunate?

If you only knew.

▲ 2 hours ago | parent | prev [-]
[deleted]