Remix.run Logo
StevenWaterman 4 hours ago

$0.10 extra per pr review is nothing. What software company is willing to accept worse reviews and less bugs found to save 10 cents?

mooman219 24 minutes ago | parent | next [-]

Worse seems subjective here. It seems Luna found bugs Astra did not, and vice versa. Astra had lower noise overall. I think my take away here is to use a blend of models given their different abilities to find different domains of bugs.

jstummbillig 4 hours ago | parent | prev | next [-]

That very much depends on how code will be written in the future, how much of it and how often it changes. If more of it will be ephemeral (kind of what agents are already doing for all sorts of tasks right now) finding ways to very cheaply check might be of high value.

(I suspect this won't be it, though. Probably something the model providers are going to bake into the models themselves.)

po1nt 4 hours ago | parent | prev | next [-]

Exactly this. It's still (at this time) cheaper than a developer that would most likely perform worse.

epolanski 2 hours ago | parent | prev [-]

Unless you're detached from reality our industry is filled with billion (trillion) dollar companies shoving broken crap on prod written by MIT-bred leetcode Ninjas and it never mattered anyway because code has no value and has always been throwaway except very rare instances.