But you already trust your client with all the private keys and message plaintexts for your account.

I struggle to see why I should trust it with those things but not the account password.

Not necessarily, you could give restricted access to a client

my google account has way more power over me than whatever i ever wrote in matrix in my life (ever, ever)