Neighbors can and do do things that impinge on your life. Such as, playing loud music when you’re trying to sleep
(I have nothing to add to the HOA discussion, just saying that “live and let live” has limits)