Other social networks can ban people I follow and I have no recourse.

True, so it's not an improvement. I guess it is even worse because when they unfollow an instance they may ban hundreds of users just because there are a few problematic ones.