| ▲ | kergonath 2 days ago | |
Hang on, starting benchmarks on my Raspberry Pi. | ||
| ▲ | euroderf 2 days ago | parent | next [-] | |
By the year 2035, toasters will run LLMs. | ||
| ▲ | pickle-wizard a day ago | parent | prev [-] | |
On a lark a friend setup Ollama on a 8GB Raspberry Pi with one of the smaller models. It worked by it was very slow. IIRC it did 1 token/second. | ||