> why would you buy a device that's specifically not optimized to be used for 24/7 inference

because it costs $1k-$2k instead of $10k-30k+ for optimized devices