Whereas this is interesting with the (mac) models available today, it'll be a lot more interesting when the 512GB variety launches in October.

I wouldn't be surprised if there were (llm) models tuned specifically for this size of memory, MOE of course, the Mac doesn't do the dense variety very well. Still, there's a lot that can be done with MOE.