To experiment, its still al ot cheaper to prepare everything locally and then just rent a GPU Node on all of these non hyperscalers.

1-2$ / hour.

I'm not regretting my setup at home as it got paid by my company which makes sense here, but paying for electricity is quite high and makes already 0.3$/hour alone.

I would argue, the most interesting use case for running it at home is some personal agent which you want to run 24/7.