Remix.run Logo
aunty_helen 9 hours ago

I think it’s only a matter of time before we see asic vendors making TPU devices. Same thing happened with BTC. There was enough money there to spawn an industry. Nvidias 70% margins are too hard to ignore. And if playing on the open market seems too rough, there’s always acquisition potential like what happened to groq.

NitpickLawyer 8 hours ago | parent | next [-]

Aren't high end accelerators already closer to ASICs than to og GPUs, tho?

tonetegeatinst 7 hours ago | parent | next [-]

Yes, but not as much as you think.

A lot of silicon on a GPU is dedicated to upscaling and matrix multiply.

Ultimately GPU's main use is multimedia and graphics focused.

See all the miners that used to do GPU based mining...or the other niche markets where eventually the cost of custom asic becomes to attractive to ignore even if you as a consume have to handle a few years of growing pains.

ssivark 2 hours ago | parent [-]

> Ultimately GPU's main use is multimedia and graphics focused

This has long ceased to be true, especially for data center focused gpus from the last few years; the "gpu" moniker is really a misnomer / historical artifact.

alanma 6 hours ago | parent | prev [-]

hard to argue today's GPUs are really graphics focused anymore in the training / inference race :O

really excited about Rubin CPX / Feynman generations, let's see what the LPU does to the inference stack

5 hours ago | parent | prev [-]
[deleted]