>Because the market of people who want huge RAM GPUs for home AI tinkering is basically about 3 Hacker News posters

You're wrong. It's probably more like 9 HN posters.

There are also 3 who, for retro reasons, want GPUs to have 8 bits and 256MB or less of VRAM