Remix.run Logo
▲ zug_zug a day ago

I mean it's definitely remarkable.

But I don't think it's RSI.

My mental model of RSI is essentially isn't quite asymptotic but exponential. If a system can make itself 5% smarter every week then it would be 12x as smart in one year at which point it's not clear to me if we even need governments or markets because we have a being that can direct everything.

In short I don't believe there's any world where there's true RSI intelligence and anthropic returns green paper to "shareholders" so they can buy pretty cars as status symbols.

▲saulpw a day ago | parent [-]

Perhaps your mental model of [the effects of] RSI is mistaken, though? It's not an inherent part of RSI that there will be consistent 5% improvements to be made. Even with domains that have been 'solved' by AI, like Go (board game) or OCR, the improvements hit a point of diminishing returns. Like at some point there aren't any 5% improvements left, so you make 1% improvements, and then .1% improvements, etc.

And that is also just providing an explanation for the sake of accepting your premise, that we're not experiencing exponential improvements. In a lot of ways it sure seems like like a radical acceleration. I mean Claude Opus was only released exactly 1 year ago, and now long-standing math problems are being solved every other week. I mean if it were RSI, what would literally be different today?

▲zug_zug 19 hours ago | parent [-]

Yeah the 5% rate is somewhat arbitrarily picked, but the reason I expect it not to look like go is because the machine is improving itself, so presumably it unlocks a higher "iq" which in turn will in turn mean that the types of optimizations it will be able to find will grow.

Of course there is a raw hardware limit, but it's my intuition that we are under-utilizing the hardware by multiple degrees of magnitude. The whole pattern of using token prediction and realizing intelligence falls out the other end has been more or less stumbled upon by us, there's no reason to think it's optimal.