Remix.run Logo
dvt 2 hours ago

> This sure looks like a race to the bottom

Always has been. My prediction is that both OpenAI and Claude will go bust unless they deliver a killer product. And unlike scrappy startups, they have a pretty serious deadline because creditors will come a-knockin'.

There's little to no functional difference between Kimi, Qwen, Sol, Opus, etc. All flagship models are within like 1-5% of each other and the real moat will be what's always been the hard part: making a good product.

matheusmoreira an hour ago | parent [-]

> All flagship models are within like 1-5% of each other

Don't know about that.

I'm using code review of my lone lisp project as a benchmark. It's a massive parallel code review where a coordinator cuts up the codebase into sections and dispatches agents to consider each part from different perspectives like quality, maintainability, consistency, correctness, rigor, etc.

Ran a complete Fable/max code review. Took over a month on a subscription. Now I've switched to OpenAI and am repeating the exact same review with Sol/max.

It's still not done yet but preliminary findings suggest Sol can only reproduce 70-90% of Fable's findings. So I think these models aren't as close as we've been led to believe.

huflungdung 41 minutes ago | parent [-]

[dead]