I actually do do this. I'm not sure who the 'overwhelming majority' is and where you got the data (link would be appreciated) but everybody that I know that runs these is doing so on their own infra.

▲

enraged_camel an hour ago | parent [-]

Context is useful. The parent said: "it's a cheaper product that's almost as good or better in some cases"

The only open models that are "almost as good or better in some cases" require massive amounts of RAM. I posit that most people cannot afford a decked out Mac Studio, and therefore run the smaller "flash" variants on more normal devices. The issue is that those are nowhere near frontier-level in terms of capability.

▲

CharlieDigital an hour ago | parent [-]

"Running your own infra" also includes managed infra like Bedrock, Foundry, etc.

Not just your local machines.

Enterprises are where you see this adoption. Legal, finance, tax; sensitive context where the data must be contractually opaque to external parties.

	▲	jacquesm 39 minutes ago \| parent [-]
		Precisely. I have figured out a nice recipe that is quite affordable, 288G of VRAM for a little under 20K, it takes some fiddling though, but once it works it is really neat. PCIe is incredibly powerful tech.