Remix.run Logo
janalsncm 2 hours ago

Is that a 1-bit LLM? I don’t understand the connection with this article.

erelong an hour ago | parent [-]

Oh, I don't actually know the difference if you want to explain it

The title says it's 27B grade running on a phone and what I was comparing it to in my mind was a model that runs at 35B grade that could presumably run on a phone "better"?

edit: I asked AI for the difference and understand a little better, thanks for the heads up to learn the difference between models... I think the thing was, although ornith was created for a specific agentic purpose, it was still outperforming a previous generalist model I had running locally (so in my mind I thought it was still a better local model) - I'd like to try bonsai out if I can figure out how to run it lol