| ▲ | nico 6 hours ago | |
You are right, they are not exactly the same thing, just wanted to have a reference point When running locally usually I have to trade off speed for a better model. I can run decently big models at about 2tk/s, or a pretty dumb one at 40-100tk/s | ||
| ▲ | serf 6 hours ago | parent [-] | |
fwiw this thing puts out results very fast even on max reasoning. the results i've gotten so far have been a little braindead though. still playing around. bad luck with traversing filesystems remotely so far. it seems to want to make concluding decisions very fast regardless of reasoning levels. | ||