Remix.run Logo
kamranjon 4 hours ago

Unfortunately Fermion Research appears to entirely AI generate all of their content here, even for the research section: https://www.fermionresearch.com/research/neutrino-8b/

"Neutrino-1 8B was trained natively in its shipping format. There is no full-precision product model that was rounded afterward: the ternary representation is the medium the weights learned in, and the training methods that hold this quality at this depth are the lab’s unpublished work. The findings below are the part that travels."

This statement seems misleading at best.

Both the model page and the release page are basically unintelligible - I don't have a ton of faith in the work here, at least PrismML write coherent releases for their models.

Edit: Another beautiful piece of prose here, I almost wonder if they used the 8b model to generate the content for this release...

"Across the 6.95B coded weights, 62.63% sit at zero and the remainder splits 18.68% plus to 18.69% minus: sign-balanced to a hundredth of a point with no constraint asking for it."

LtdJorge an hour ago | parent [-]

I guess it's saying how many of the weights are -1, 0 or +1.

jdiff 10 minutes ago | parent [-]

It is, but why? And what's with the bizarre way of phrasing that? Why the bizarre observation that, indeed, nobody asked for it?