| ▲ | jauntywundrkind 3 hours ago | |
I don't see any indications that OpenAI is doing wafer-scale work. I tend to doubt they would. Cerebras notably doesn't have a kv, is wildly high bandwidth, but within/across the chip, not able to dump/restore kv super well. I doubt openai is going to build something that is as expensive to run. Also, wafer-scale is absurdly hard & weird to pull off, so I doubt that would be their first foray. | ||