Remix.run Logo
noosphr 4 hours ago

Chinese models most likely are distillations of frontier models with tricks for subpar hardware. If you want to be ahead of the us labs you need to spend billions for pretraining from scratch.

tw1984 3 hours ago | parent [-]

If that is the case, it means one thing only - US labs don't have moat whatsoever and their expectation to have trillion dollar valuation is just laughable.

noosphr 3 hours ago | parent [-]

The moat is the compute.

trollbridge 2 hours ago | parent [-]

The compute for training, or for inference?