I too set it up so all unknown calls go to VM. I figure if legit they will leave a message. If two calls and no message I block the unknown number.

Roughly 100% of my spam calls come from spoofed numbers and don't repeat, so I never bother blocking anything.