This would be great but I'm sure the entrenched players will make it difficult enough to run effective local models that normal users won't touch them.

There are only two OS options for phones and computers for 99+% of people and it will be trivially easy to restrict local models on them.