Remix.run Logo
▲ bee_rider an hour ago

I wonder if engineering or math is weird in this case. Papers are better if they are entirely verifiable from the claims in the paper, so, ideally it should be possible to fully verify the claims just based on what is said in the paper. For math that’s perfect because math is entirely made of arguments.

For engineering… I mean, sometimes you want to publish a paper about an algorithm that is more amenable to actual hardware and/or easier to tune. The reviewer would need access to an HPC cluster to verify your claim, nobody is going to burn their credits to verify your paper.

AI reviewers could be most helpful by… running the algorithm instead of their inference stacks!