| ▲ | manmal 4 hours ago | |||||||
Have you tried the 27B dense version? It’s way better for coding. | ||||||||
| ▲ | anana_ 4 hours ago | parent [-] | |||||||
Unfortunately on Strix Halo or any similar unified memory set up, dense models are gonna be dirt slow due to the tiny memory bandwidth... But I agree, 27B is superior. | ||||||||
| ||||||||