> please excuse me for calling your one-man $10,000 inference device ridiculous

It’s about the real price of early microcomputers.

Until the frontier stabilizes, this will be the cost of competitive local inference. Not pretending what we can run on a laptop will compete with a data centre.