| ▲ | simonw 2 hours ago | |
I got Codex CLI running against it and was sadly very unimpressed - it got stuck in a loop running "ls" for some reason when I asked it to create a new file. | ||
| ▲ | danielhanchen 18 minutes ago | parent [-] | |
Yes sadly that sometimes happens - the issue is Codex CLI / Claude Code were designed for GPT / Claude models specifically, so it'll be hard for OSS models directly to utilize the full spec / tools etc, and might get loops sometimes - I would maybe try the MXFP4_MOE quant to see if it helps, and maybe try Qwen CLI (was planning to make a guide for it as well) I guess until we see the day OSS models truly utilize Codex / CC very well, then local models will really take off | ||