Remix.run Logo
baq 2 hours ago

I expect the bitter lesson to continue to be bitter. Mistral must at least attempt to catch up to SOTA 6 months ago.

coredev_ an hour ago | parent [-]

Do they really? "SOTA" is great for development and creating content but for industrial needs.... perhaps they are not really "SOTA"?

baq an hour ago | parent [-]

It follows directly from the bitter lesson - a frontier model can be relatively cheaply distilled into anything you need to run quickly (and a frontier model like Mythos will help you distill it quickly), decidedly not true the other way around.