| ▲ | operatingthetan 18 hours ago | |
Are we at the point where 2x 9070XT's are a viable LLM platform? (I know this has 4, just wondering for myself). | ||
| ▲ | oceanplexian 18 hours ago | parent | next [-] | |
These things don’t have Flash Attention or either have a really hacked together version of it. Is it viable for a hobby? Sure. Is it viable for a serious workload with all the optimizations, CUDA, etc.. Not really. | ||
| ▲ | cyanydeez 16 hours ago | parent | prev [-] | |
I'd go with strix halo if you're looking at that old of tech. the latest AMD GPUs are RX 9070 XT w/32GB each | ||