Remix.run Logo
0xbadcafebee 3 hours ago

LFM's training/post-training is famously different than other models. They target reliable operation of tiny models in ways other model families don't (they aren't just scaling a larger model to a smaller size). If you're looking for good performance out of tiny models, LFM has the most advanced design.

Note how they're much smaller than all other models in the comparison yet match or exceed them. This is for 2.6B params, but they have models as small as 230M. Nobody else designs models that small.

woadwarrior01 3 hours ago | parent [-]

> Note how they're much smaller than all other models in the comparison yet match or exceed them.

There's a strong incentive to cherry pick in self-reported comparisons. If there is a model that's better, it gets left out. Have you seen Nanbeige4.2-3B or Ling-3.0-tiny?

> Nobody else designs models that small.

There are people building even smaller models.