| ▲ | x312 an hour ago | |||||||||||||
I can't imagine them keeping up long term given the information asymmetry plus compute restrictions on top of it. I feel open-weight was able to keep up the past year using efficiency improvements (hybrid attention, improved MTP drafters, improved optimizers) to offset having less compute. But OpenAI/Anthropic started cutting token costs just a few months after these, which to me suggests they copied these improvements. Indeed it would be hard to work in LLM training and not know about DSpark, Muon etc. So what do you do if closed source uses your learnings, gives no knowledge back, and has 10x more compute and funding on top of it? The situation feels quite dim right now, esp. with the Nvidia thing. | ||||||||||||||
| ▲ | gimlichgu an hour ago | parent | next [-] | |||||||||||||
open always wins | ||||||||||||||
| ||||||||||||||
| ▲ | koe123 an hour ago | parent | prev [-] | |||||||||||||
Show us your stock holdings | ||||||||||||||