Yeah unfortunately the confabulations are the real problem with models of this size.

IMHO you need at least 500B weights before the confabulation problem is really under control. i.e. DeepSeek 4.1 or GLM.

I admit some days I'm just lazy and throw a whole Kimi or QwenMax at it.

> before the confabulation problem is really under control

It's definitely much better at bigger sizes, but I've still seen it at the frontier when coworkers ask me about changes their Ai made to code I originally wrote. (a good habit that organically emerged on the dev team)