With common use of n-gram tables, comparing "params" count has gotten harder. Those are exceptionally sparse and light on compute, way beyond even the sparsest MoE experts. You could host them on a slow spinning disk and still have a viable local inference platform.

So that's why I can't buy a replacement 16TB HDD for less than a 1000$ when three years ago I bought them for 229$ a pop.

I wondered why do they even need slow HDDs, like, do they store training data on them? User chats? Do they assemble crazy 12-way stripes for fast speed? Do they store what, failed attempts?