Remix.run Logo
manmal 4 hours ago

Have you tried the 27B dense version? It’s way better for coding.

anana_ 4 hours ago | parent [-]

Unfortunately on Strix Halo or any similar unified memory set up, dense models are gonna be dirt slow due to the tiny memory bandwidth... But I agree, 27B is superior.

stymaar 3 hours ago | parent [-]

Exactly. That's why I'm disappointed there wasn't a 122B version, it's 27B but for Strix Halo users.