And for fun, just spin up a VPS and initialize some bare repos there.

What's the purpose of using EC2 over something much cheaper, like OVH, digitalocean, or Hetnzer?

Usually the argument is for scalability, but a single VM for personal use doesn't need that, and even if you do want that, you'll need more than a bare repo.