If you’re not using it regularly, why would you need anything except security updates?

You will also need to accommodate the banking apps updates, banks will not support very old versions of their apps( very old varies but probably about a few months ). Beyond that the new versions may require hardware support that may not be available in a decade old phone.