The RTX Spark is also sold in a mac mini form factor. That's pretty well suited for home inference.

Exactly. Get yourself a DGX spark and plug it in at home.

I meanwhile, run my ridiculously OP workstation class hardware as a server - 9995wx, 768GiB, rtx pro 6000 w/ 96GiB vram - at home, and my Asus ZenBook is light, cool, and long-lived.

Runs GLM 5.3 flash at 35 tok/sec while consuming only 15 GiB VRAM, and I can run a lot more stuff on there alongside.