| ▲ | bwv848 2 hours ago | |
I've been trying the Q4_K_M version, and sometimes it gets stuck in a loop. Gemma 4 doesn’t have this issue. | ||
| ▲ | yencabulator an hour ago | parent [-] | |
This has happened before with quantizations and other backends (ones not used by the research lab). Give it a week, download latest versions of everything, and try again. | ||