Remix.run Logo
mvkel 6 hours ago

Open weight LLMs aren't supposed to "beat" closed models, and they never will. That isn’t their purpose. Their value is as a structural check on the power of proprietary systems; they guarantee a competitive floor. They’re essential to the ecosystem, but they’re not chasing SOTA.

barrell 6 hours ago | parent | next [-]

I can attest to Mistral beating OpenAI in my use cases pretty definitively :)

pants2 5 hours ago | parent | prev | next [-]

> Their value is as a structural check on the power of proprietary systems

Unfortunately that doesn't pay the electricity bill

cmrdporcupine 5 hours ago | parent | prev | next [-]

This may be the case, but DeepSeek 3.2 is "good enough" that it competes well with Sonnet 4 -- maybe 4.5 -- for about 80% of my use cases, at a fraction of the cost.

I feel we're only a year or two away from hitting a plateau with the frontier closed models having diminishing returns vs what's "open"

troyvit 3 hours ago | parent [-]

I think you're right, and I feel the same about Mistral. It's "good enough", super cheap, privacy friendly, and doesn't burn coal by the shovel-full. No need to pay through the nose for the SOTA models just to get wrapped into the same SaaS games that plague the rest of the industry.

re-thc 6 hours ago | parent | prev [-]

> Open weight LLMs aren't supposed to "beat" closed models, and they never will. That isn’t their purpose.

Do things ever work that way? What if Google did Open source Gemini. Would you say the same? You never know. There's never "supposed" and "purpose" like that.

lowkey_ 5 hours ago | parent [-]

Not the above poster, but:

OpenAI went closed (despite open literally being in the name) once they had the advantage. Meta also is going closed now that they've caught up.

Open-source makes sense to accelerate to catch up, but once ahead, closed will come back to retain advantage.