Your own link shows that what is considered toxic levels are far higher than most people would expect. Vitamin D toxicity is not that easy to accidentally hit.

Overdose has been observed at 1,925 μg/d (77,000 IU per day). Acute overdose requires between 15,000 μg/d (600,000 IU per day) and 42,000 μg/d (1,680,000 IU per day) over several days to months.