I bet that's one of those areas where a finetune of a 4B model will wipe the floor with anything else.

For readable or normal handwriting yes, big models are overkill. But weird handwriting is mostly edge cases. Bitter lesson territory.