Remix.run Logo
orthoxerox 2 days ago

Does it even fit into a 5090 or a Ryzen 395+?

Tiberium 2 days ago | parent [-]

Oh, of course not, you might need up to 100GB VRAM to have those models at decent speeds even just for low-quant versions.

And all the hype about Macs with unified memory is a bit dishonest because the actual generation speed will be very bad, especially if you fill the context.

One of the things that makes Opus 4.5 special in comparison to e.g. GPT 5.2 is the fact that it doesn't have to reason for multiple minutes to make some simple changes.

kace91 2 days ago | parent [-]

Do we have an estimate for how much they cost to run? Or in other words, how much are they financing the end user cost?

Not only the energy fuel but the hardware’s percentage of cost.