Remix.run Logo
▲ CAP_NET_ADMIN an hour ago

Maybe there's something wrong with your harness/docs - I've been able to achieve better results with Neon high than Opus 5.5 high.

▲ricardobeat an hour ago | parent [-]

I'm currently doing a round of fairly simple changes - refactoring some code based on different memory allocation strategies. Neon (high) is working on a single file < 1000 lines, Opus (low) reviews, I'm manually coordinating, using their own harnesses, agy/CC.

n = ±10, but Opus always catches a subtle bug, a leftover comment, a missed edge case, naming inconsistency, tooling gap. Which Neon seems oblivious to. So far 100% of its reviews have been correct; accepted, fixed and validated by Neon.

Performance is highly dependent on the task/domain, yes, but you'd expect at least one of those four models, the more expensive one, to catch up to Opus in the coding department, but that does not seem to be the case.

▲disgruntledphd2 41 minutes ago | parent [-]

What happens if you swap the models writing and reviewing? So Opus implementor, Neon reviewer.

▲ricardobeat 2 minutes ago | parent [-]

Ok, I had some time to kill :)

I made two new worktrees, hard reset to the commit preceding a simple fix. The issue: "temporary buffers (out_buf, cps, out_cps, src_cps) are manually freed across multiple return branches. Pairing each acquisition with defer mem::free(...) — or using @pool() + mem::temp_array for the short-lived out_buf / out_cps scratch arrays — removes the branch-by-branch cleanup".

## Round 1

Neon implements. ~6 minutes.

Opus reviews. 30s. Prompt is simply "review the unstaged changes".

- The heap_buf + defer if (heap_buf != null) combination is clunky, much like the committed flag was. C3 has a built-in way to do this [shows example]

- if no character actually changes, return the string itself to skip the buffer

- Allocator mismatch: unicode_normalize_simple in src/unicode_wrapper.c allocates with libc realloc, but result_cps is released with mem::free

## Round 2

Opus implements. 2m44s.

Neon reviews. 4m30s.

"Looks good — no bugs or leaks introduced."