At least on Android they've removed the ability to encrypt data stored on external media, so in exchange for the ability to do this you're carrying around everything unencrypted (except what individual apps might encrypt themselves).

This is not true at all, adopted storage is encrypted.