The density of data centers provides efficiency gains -- if you take the same workload from a high density nvidia DGX setup in a data center and instead distribute it to Tinyboxes running residentially, you'd have an overall net gain in energy use.

Yes, along with additional costs for managing and servicing a distributed set of devices and extra redundancy needed for higher expected downtime. But maybe the cost is worth it for some application.