This is very doable nowadays and in fact may be cheaper, more reliable, and faster than renting a VPS with unpredictable noisy neighbours. Just grab a mini-PC from Beeline for $200 and you've got a 16 GB RAM powerful baremetal server for the price of renting an equivalent VPS for 2 months from DigitalOcean.

Backup power is easily achieved with a UPS, and backup internet connection with an LTE router (or two).

But the feeling of being able to tinker with something physically in your own space? Cannot be beat. You can do so much that isn't possible over SSH, just because it is there.