Remix.run Logo
dcl a day ago

How have you found Muse Spark 1.3? It doesn't get much mention, despite pretty good benchmarks. I've been using a bit at home and find it quite good, often finding mistakes made by Opus 5.

sieve a day ago | parent | next [-]

MS13 is pretty sharp and has been my workhorse for the past month. It follows my coding style and commit/clean workflows referenced in AGENTS.md perfectly but has the habit of doing things without conferring with me (the Gemini problem). So you need some kind of instruction for that.

It starts failing around the 5-600K context mark, but you can have it generate a handover document and continue in the next session.

I would not use it at sticker price, but the Contributor version is priced just about right.

gtirloni 20 hours ago | parent [-]

[dead]

slopinthebag 20 hours ago | parent | prev [-]

shocking. the code it generated, while technically working, was entirely garbage. i used it for code review and it flagged twenty issues, sol checked the review and found 75% of them were hallucinations. sol was much closer to reality. i no longer trust benchmarks at all because of it.