Maybe for some people. But most people are not jerks and you can absolutely limit yourself to dealing with them only.

Unless you want to participate in your HOA or local government, then I can't see how to limit myself to dealing with only non-jerks.