I was mistaken in my thinking that open models are able to be quantized to run on average consumer hardware, I think they have outgrown that concept.

I guess that's the attraction - that they may be small enough (likely quantized) so that you can run them locally, so there is no privacy issues, and no-one can turn it off, etc, but technically "open weights" is just referring to models, of any size, where they give you the weights (basically give you the model) so you can run it yourself, instead of having to access it via paid API running on some computer that they control.