From the OP post it costs tens of thousands of dollars to do that compile.

Given the rate of progress, it's hard to argue why this couldn't be a reality.

If in the future Taalas-type chips with baked in frontier models are commonplace, this should be quite different price-wise from what we have now.

It's a bit dizzying to imagine that LLMs might even be able operate at speeds of chatjimmy.ai, but we already have working tech that does exactly this (albeit with less intelligence/capabilities).