| ▲ | sgt 2 hours ago | |
Can I run this on my RTX 5090? | ||
| ▲ | skohan an hour ago | parent [-] | |
Yes they have quants for 32GB and 20GB use-cases (including mmproj and kv cache + context) | ||
| ▲ | sgt 2 hours ago | |
Can I run this on my RTX 5090? | ||
| ▲ | skohan an hour ago | parent [-] | |
Yes they have quants for 32GB and 20GB use-cases (including mmproj and kv cache + context) | ||