| ▲ | I built a page that tells you what AI model your laptop can run(localsotabenchmark.engineersf.dev) | ||||||||||||||||
| 29 points by kumarski 8 hours ago | 22 comments | |||||||||||||||||
| ▲ | jsherer 6 hours ago | parent | next [-] | ||||||||||||||||
I find this to be pretty accurate: https://www.canirun.ai/ | |||||||||||||||||
| |||||||||||||||||
| ▲ | not_your_vase 6 hours ago | parent | prev | next [-] | ||||||||||||||||
That's not very accurate. It sees 8 GB RAM instead of 64. And it detects GTX 9 GPU, though I have an RTX30 one. (Edit: now it came to my mind that Firefox has fingerprinting protection by default. But even after whitelisting this website, the result is the same) | |||||||||||||||||
| |||||||||||||||||
| ▲ | roboror 6 hours ago | parent | prev | next [-] | ||||||||||||||||
Identified every component of my system incorrectly. W11. | |||||||||||||||||
| ▲ | spprashant 6 hours ago | parent | prev | next [-] | ||||||||||||||||
For some reason it is not able to detect 64GB RAM on my Fedora Linux mini PC. It shows only 8GB. | |||||||||||||||||
| |||||||||||||||||
| ▲ | juancn 4 hours ago | parent | prev | next [-] | ||||||||||||||||
It's too conservative, on my Air M4 I run gemma-4-12B-it-qat-UD-Q4_K_XL fine with llama.cpp The app states "Small Models (1-3B)". | |||||||||||||||||
| ▲ | kumarski 8 hours ago | parent | prev | next [-] | ||||||||||||||||
and no I'm not a software develpoer - just smacked it together with minimax for personal needs. Thought it was nifty so shared. Would love to see a real CS person's version of this and/or best prompt to build something like this accurately and keep it up to date as models advance and SOTA shifts. | |||||||||||||||||
| ▲ | nottorp 3 hours ago | parent | prev | next [-] | ||||||||||||||||
What about my desktop? Will it detect what models a desktop can run? | |||||||||||||||||
| ▲ | harvey9 5 hours ago | parent | prev | next [-] | ||||||||||||||||
Reports android tablet as a 'linux PC'. | |||||||||||||||||
| ▲ | haeberli 5 hours ago | parent | prev | next [-] | ||||||||||||||||
auto-detect failed to correctly detect 128GB ram vs 32GB ram on MacBook Pro M5 | |||||||||||||||||
| |||||||||||||||||
| ▲ | jrm4 5 hours ago | parent | prev | next [-] | ||||||||||||||||
Interestingly wrong; probably has to do with the fingerprinting and whatnot. I do appreciate that the "canirun" one 1) was also wrong 2) but let me pick my real card from the dropdown with results that seemed much more accurate. Genuine question - is there literally any factor besides RAM and GPU (with VRAM info?) | |||||||||||||||||
| ▲ | efilife 3 hours ago | parent | prev | next [-] | ||||||||||||||||
I recommend llmfit. It shows you exactly what models you can run and at what speeds | |||||||||||||||||
| ▲ | dmitrygr 5 hours ago | parent | prev | next [-] | ||||||||||||||||
Firefox on macOS. site reported M1 and 16GB. Mac is M4 + 24GB | |||||||||||||||||
| ▲ | nailer 6 hours ago | parent | prev | next [-] | ||||||||||||||||
Great idea! You're 95% of the way there and the rest is a couple of UI tweaks. 1. I thought the table showing a bunch of models after my laptop specs would be models I could run on my laptop.
'Your tier' is too subtle. I would make 'Your tier' highlight the ENTIRE row in some bright color to make it more obvious, and maybe fade the other rows slightly.2. I don't know what 'usable' means. How can these models be status:usable if they are not 'my tier'? I deduce 'usable' doesn't mean usable on my laptop but I don't know what 'usable' does mean. 3. Give me links to set up the best model I can. | |||||||||||||||||
| |||||||||||||||||
| ▲ | cyanydeez 6 hours ago | parent | prev [-] | ||||||||||||||||
One word: wrong. | |||||||||||||||||
| |||||||||||||||||