Kinda cool but also entirely useless given the limited VRAM.

The readme oversells it by pretending it would be something actually usable, when instead it is a cool achievement to make it happen.

A 20 tps Qwen3.8-27B at 2 bits quantization is limited but not useless. I've been putting one on "read this codebase and figure out XYZ" for me, where the typos are less consequential.