The client GPU still needs all those assets in its own VRAM in order to render any scene that uses them. You would need to stream all of those assets in real time to the client, and last I checked consumer network interfaces are checks notes slower than 16 PCI Express lanes.

I'm still unsure what computational resources are being saved for the client here, the actual rasterization is where the bulk of the work is done.