> you're basically saying "it's not theft, because now it's mine"

No, that's not at all what they're saying. Taking something is only theft if it's rightfully owned in the first place. He's saying it wasn't rightfully owned.