| ▲ | bryanlarsen a day ago | |
everybody and their dog are designing inference chips. Even currently, Google's Tensor can do inference cheaper and more efficiently than a B200. There are dozens of companies designing inference chips; when they hit the market the pricing power of B200 will drop significantly. And it's correlated with the other bubble dropping because chip cost will matter a lot more once the margin of tokens is tight. | ||