I don't really get the value proposition of groq as a user, the performance is really poor for the token price. Data centres on the other hand are becoming a commodity, and I don't see any reason a priori to invest in groq specifically for something like that.

▲

bluegatty an hour ago | parent [-]

Groq is considerably faster and better at inference, they have a totally superior product to Nvidia for inference based tasks, which will be the dominant concern in the future.

Plausibly, take all the Nvidia hype and multiply that by a factor and that's what 'Groq' could be worth.

And there is no real commodification - there's Nvidia, Cerebras, Groq ... not many otheres.

	▲	7thpower an hour ago \| parent \| next [-]
		Define “totally superior”? Was this comment created using quantized llama 3? I love Groq, but across every single line break in your post there is a glaring issue that is easy to refute with in 15 seconds, even without 300t/s of throughput.
	▲	TurdF3rguson an hour ago \| parent \| prev \| next [-]
		> they have a totally superior product to Nvidia for inference based tasks They're not really competing with Nvidia because 1) Nvidia owns their chips now, and 2) Nvidia is not really an inference provider.
	▲	digitaltrees 17 minutes ago \| parent \| prev [-]
		Haha. Groq is trash. It can’t be used for anything where reliable work is required. Groq lasted how long in the social contract experiment? Libertarians always forget that rules and government aren’t tyrannical they are the mechanism to ensure bullies don’t destroy everyone’s freedom.