Another way to look at it is taxes aren't quite high enough yet to justify it. Many that are wealthy see the california tax as just another expense in return for good weather.

The moving will absolutely happen, and it isn't all or nothing. If you're very wealthy the CA tax board already tracks the number of days you spend in CA so the choice will be to spend fewer.