You can do a lot with existing devices in a medium to decent gaming PC (or probably phone/laptop, I haven't tried.) I think HN tends to skew toward only thinking of LLM as useful for coding, but they are very useful for many non-coding things, and existing local LLMs are quite capable. I imagine it won't be long before apps with LLM-based features will try to run locally first and fall back to cloud LLMs just to save token costs. Actually I'd be surprised if some apps aren't doing this already.