You're literally describing the steam machine/steam deck. Also, bazzite is an immuable distro based on silverblue that does pretty much exactly what you described.

I know there's some issues with big picture mode and Nvidia, but that's an Nvidia driver problem, not a limitation of the platform.