That'll use way more tokens.

No, the tokens are evaluated on the image itself, once downloaded and resized. The same image sent as an encoded text payload and as url will cost the same. Now, if you are sending the content the model as a text payload, then that would cost text tokens, but that doesn't work very well for non-trivial images.