Yeah, I spent the last week with Deepseek Flash 4.1-1017, Kimi 3, and GLM 5.3 (and 5.3-flash). None of them were literally useless but also none of them were capable of making progress on the main project I am working on where Opus, Sol, and even Gemini Flash have all done very good work. Benchmarks might have you believe open models are only barely behind the big US labs in intelligence, but it feels much worse in practice.

As a counter-example, I use Deepseek v4.1 Flash to make progress on multiple projects (Python, C++, CUDA) every single day.

Interesting! If you are at liberty to disclose, what problem space are you working in, what harness do you use?