Thought I'd have another look at mail providers, but from what I can see, none support the features I use with fastmail (custom domain, security key, unlimited on-the-fly aliases for sending).

They don't, but you shouldn't feel too bad as fastmail is australian, ie not american, which (at least personally) is where we're trying to divest.