It would just lead to people driving unlicensed vehicles.

People driving around in dangerous vehicles aren't doing it for fun, they are doing it to get to work, go shopping and otherwise live their lives with limited resources.