Remix.run Logo
▲ ACCount39 18 hours ago

No, parameter scaling still works because it broadly increases sample efficiency. We don't have the raw data to make a Chinchilla optimal 100T, but that doesn't mean there are no gains in building up to 100T.