That could be kind of interesting.

It does seem to lean on the physical bank-front being trustworthy (no evil clerks).

If we’re meeting physically to set up connections, we could even use something like a one-time-pad, and be information-theoretically secure. How many bits does your bank really need to send you securely anyway?