I think mainly your mail won't go into the sent folder and be searchable. You can work around that by CCing your domain.

What other features will you not get? The mail composer in Gmail is pretty sucky anyway. For example when you are replying on a long thread it is very hard to see the message you are replying to.