The entire point of a temporary visa is for the country to benefit from your labor. How does canceling it on a “whim” benefit anybody?

The whim might be re-evaluating that benefit and the worker coming up short.