not even google thinks this will happen, given their insistence on only offering TPU access through their cloud

As the OP points out, Google is now selling TPUs to at least some corporate customers.