Luckily my bank still allows a fob type device as 2FA. But of course your point is valid.

It's a travesty that this behavior is allowed, of course, but as long as it is, I'd keep the cheapest possible regular smartphone around for this purpose alone. I'd try to think of it as an unwieldy fob-like device.