| ▲ | zoobab an hour ago | |
Strata gave local AI a boost with 12GB (and even 8GB) cards being able to run Qwen code assistant with RAM offloading. | ||
| ▲ | jabron an hour ago | parent [-] | |
The issue with local AI is the availability of competitive open weight models, not necessarily the availability of compute and memory. | ||