| ▲ | dannyw 34 minutes ago | |||||||||||||||||||||||||||||||
A Microsoft Azure page briefly claimed Sol runs with less looped transformer passes; and so you could speculate that Sol and Astra might share weights; but have different “loop” factors. That would make a lot of sense from an inference optimisation perspective. The same prefill and decode machines can hold one set of weights, and serve both Astra and Sol requests. At (multi-)terabyte-scale model weights, and when you have to offer not just the latest like Fable 5.2 but still serve 5.1, 5.0, etc; heck I think Opus 4.6 is still around; you really care about overall compute utilisation. Idle GPUs are wasted GPUs; and even over the fastest interlinks you’re not hotswapping multi terabytes of weights. With MoEs, there’s probably stuff you can play around with varying the number of active experts; or other clever optimisations. Maybe Sonnet 5.5 could be just Opus 5.5 with a different router and less active params? Who knows; I’m just theorycrafting now :) | ||||||||||||||||||||||||||||||||
| ▲ | onlyrealcuzzo 21 minutes ago | parent | next [-] | |||||||||||||||||||||||||||||||
> A Microsoft Azure page briefly claimed Sol runs with less looped transformer passes; This doesn't really make sense given how the models released. OpenAI released Astra long before latent-space looping was a thing at the frontier space. Then they released Sol 6, which was fast, clearly not looped. Then they release Sol 6.1 which was nearly as good as Astra, but way cheaper, and WAY slower -> this would follow it just being a looped version of Sol 6. It doesn't seem likely that Astra 6.2 is just a looped Astra 6... It's too fast, and they'd go bankrupt if they're charging the same price... It may be a further looped version of Sol than Sol 6.2 - which would explain why it's not as much better as we would've hoped. It may also explain why their release is not going as well as they hoped. It's hard to predict how your first looped models are going to fare. If you look at how long it took Google to recover from their failed 3.5 Pro, it would be surprising if GPT recovered from their rumored failed run on Astra in under a month. That would give them reason to release a looped Sol and call it Astra. | ||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||
| ▲ | nicoburns 31 minutes ago | parent | prev [-] | |||||||||||||||||||||||||||||||
I heard rumours that Sol 6.1 was cut down Astra because Sol 6.0 was received badly. But I thought that was the exception (and a result of Open AI's actual Sol-class model being uncompetitive) rather than the rule. | ||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||