Remix.run Logo
▲ doomroot13 36 minutes ago

It seems they trained from scratch: https://microsoft.ai/news/frontier-pre-training-at-microsoft...

▲bensyverson 12 minutes ago | parent [-]

Owning the iron has got to be a massive advantage. It's interesting that the advantage has so far been pretty theoretical, but based on these benchmarks, it may be starting to pay off. It has to be hard to hire in the talent to train these models (even if you're Microsoft) when you're competing with established labs.