| ▲ | yjftsjthsd-h 10 hours ago |
| Ah. In that case... Yeah. Is it using GPU, and does the whole model fit in your (V)RAM? |
|
| ▲ | ekianjo 10 hours ago | parent [-] |
| This is a CPU implementation only. |
| |
| ▲ | yjftsjthsd-h 3 hours ago | parent [-] | | Oh, that's interesting. The readme talks about GPU acceleration on Apple Silicon and I didn't see anything explicit for other platforms, so I assumed it needs GPU everywhere, but it does BLAS acceleration which a web search seems to agree is just a CPU optimized math library. That's great; should really increase the places where it's useful:) |
|