| ▲ | Local Models in Mid-2026(coles.codes) |
| 2 points by colescodes 11 hours ago | 3 comments |
| |
|
| ▲ | denn-gubsky 9 hours ago | parent | next [-] |
| Thank you for sharing. I'm running Gemma4:12b and qwen-coder-next MoE on my local RTX5080 (yes, 16Gb). Using them for local agentic tasks with tools and MCP tools usage. Both hallucinating on my setup. Do you have a rating for most appropriate local models for local agenting tasks? I also tried kimi2.6, qwen3.6 - no luck. |
| |
| ▲ | colescodes 9 hours ago | parent [-] | | I'd try Qwen 3.6 35B-A3B or 27B with a temperature of around 0.6. You'd need to offload some of it to RAM though. I've had okay luck with Gemma 4 12B with a temperature of 1.0 but it will miss things a lot :( |
|
|
| ▲ | 11 hours ago | parent | prev [-] |
| [deleted] |
