That's helpful insight. My prediction is that as it keeps getting more expensive for the big players to run these models, we will start to see some kind of hybrid workload where they offload some of the work to your computer for smaller agents while keeping the orchestration and planning running in the data centers.

So I think the investment in the extra hardware is worth it, even if you don't currently plan on running LLMs locally.