I have been self hosting E-mail for close to 15 years now, and apart from the occasional and very rare delivery problem, it's not really a pain at all. Get a dedicated IP address not on a spam blacklist, don't spam, and it's pretty much set and forget. Well worth it to not have your very identity hanging off an account that you might one day be banned for for reasons you can't figure out.