And transferring money from a bank or brokerage account takes time. Enough time that anyone paying attention should be able to report the transfer as fraudulent before it completes and have the account frozen.

It depends. In UK a transfer is instant. In most of EU it happens the same day, many times in hours.