Remix.run Logo
IshKebab 16 hours ago

> However, Groq’s architecture relies on SRAM (Static RAM). Since SRAM is typically built in logic fabs (like TSMC) alongside the processors themselves, it theoretically shouldn't face the same supply chain crunch as HBM. > > Looking at all those pieces, I feel Oracle should seriously look into buying Groq.

I don't see why. Graphcore bet on SRAM and that backfired because unless you go for insane wafer scale integration like Cerebras, you don't remotely get enough memory for modern LLMs. Graphcore's chip only got to 900MB (which is both a crazy amount and not remotely enough). They've pivoted to DRAM.

You could make an argument for buying Cerebras I guess, but even at 3x the price, DRAM is just so much more cost effective than SRAM I don't see how it can make any sense for LLMs.

twoodfin 16 hours ago | parent [-]

Forget about DRAM vs. SRAM or whatever: How does a cheaper source of non-Nvidia GPUs help Oracle? They’re not training models or even directly in the inference business. Their pitch is cloud infra for AI, and today that means CUDA & Nvidia or you’re severely limiting your addressable market.

wmf 15 hours ago | parent [-]

Yeah, some customer would have to commit to renting the chips before Oracle would buy them.