| ▲ | janalsncm 2 hours ago | |
Is that a 1-bit LLM? I don’t understand the connection with this article. | ||
| ▲ | erelong an hour ago | parent [-] | |
Oh, I don't actually know the difference if you want to explain it The title says it's 27B grade running on a phone and what I was comparing it to in my mind was a model that runs at 35B grade that could presumably run on a phone "better"? edit: I asked AI for the difference and understand a little better, thanks for the heads up to learn the difference between models... I think the thing was, although ornith was created for a specific agentic purpose, it was still outperforming a previous generalist model I had running locally (so in my mind I thought it was still a better local model) - I'd like to try bonsai out if I can figure out how to run it lol | ||