| ▲ | abrookewood 2 hours ago | |
man, that is really really quick. What is your desktop setup??? GPU? | ||
| ▲ | jjcm 2 hours ago | parent [-] | |
It is fast, but I do have good hardware. A few people have asked for my local inference build, so I have an existing guide that mirrors my setup: https://non.io/Local-inference-build | ||