| ▲ | electronsoup 3 hours ago | |
> It gets into loops quite often, and surprisingly often gets the edit tool call wrong I find that running better quantization, like Q8 tend to prevent this even though its a bit slower to run, it saves overall time with less churn Using 3.6-27b is even slower again than 3.6-35b, but I find the accuracy really pays off | ||