In the real world friends and family aren’t running their own matrix servers. At most they are signed up for whatever random one came up first in the search results.

So you end up with a similar problem to Mastodon where either you are facing problematic or inexperienced admins, servers shutting down, and everyone centralising on the main server.