Google tried this with Stadia. I was a pretty happy user of it, but I think it probably exposed the weakness of US bandwidth/ throughput. Still trying to find what to do with the two controllers but it was the best refund experience I've gone through and Google probably regrets setting my expectations like that.

https://christopherklay.github.io/stadiacontroller/