| ▲ | ricardobeat an hour ago | |||||||||||||||||||||||||||||||||||||||||||
Neon / Carbon / Argon / Hydrogen are all in the same ballpark, why did they even release four different models? Neon doesn't seem particularly strong at coding vs Argon, and Opus 5.5 still beats both in my experience. The neurons it lost that made it incompetent at English seem to have been fully dedicated to being a freak at engineering. | ||||||||||||||||||||||||||||||||||||||||||||
| ▲ | brainwad 10 minutes ago | parent | next [-] | |||||||||||||||||||||||||||||||||||||||||||
Argon is fully obsoleted by Carbon. The other two are smaller and thus faster/cheaper. | ||||||||||||||||||||||||||||||||||||||||||||
| ▲ | derefr an hour ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||||||||
In general, one could assert without knowing any details that: 1. the models likely have orders-of-magnitude different backend costs to run (e.g. each warmed instance of the model reserving one slice of one GPU, vs one full GPU, vs layers distributed across multiple GPUs) -- as otherwise it wouldn't be worth explicitly distinguishing these models and putting different token spends on them (they'd instead just be automatically routed between); and 2. there's at least one particular specialized problem domain, not captured by this benchmark yet still relevant to external customers (so not just "it's better at training data evaluation/synthesis"), where these models are more-competent-enough to make their higher per-token costs "worth it" to those external customers. I won't hazard a guess at what that problem domain is; I'm sure it'll be deduced after people spend a few weeks playing with it. | ||||||||||||||||||||||||||||||||||||||||||||
| ▲ | anon7000 25 minutes ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||||||||
I mean, I was very impressed with Neon over a couple days vs Opus 5.5. It accomplished tasks faster, found root causes of problems faster, wayyy nicer to talk to, didn’t create super flowery PR descriptions. I would say it had moderately difficult tasks. Not super simple, but also not wildly difficult or broad in scope. It doesn’t feel actually dumb, like many other models. (Definitely smarter than Sonnet which was already ok.) And it’s cheaper. So I think it’ll be my go to for most tasks | ||||||||||||||||||||||||||||||||||||||||||||
| ▲ | raincole an hour ago | parent | prev [-] | |||||||||||||||||||||||||||||||||||||||||||
Because benchmarks aren't everything? If you see Neon and Hydrogen get the same score in a benchmark you should question if the benchmark measures what we care instead of suspecting that Neon and Hydrogen are equally powerful. | ||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||