You can use a different profile for banking and limit the extensions to be just your password manager.

I'm not aware of a password manager (except the browser's builtin) that allows to limit itself to only a subset of the credentials it knows.

In a "banking" browser profile, I want only the banking credentials to be available to browser. In all other browser profiles I don't want the banking credentials to be available.