Remix.run Logo
hirako2000 5 hours ago

You've got to understand, proprietary models operate as the following:

- release: full precision, debrided, uncapped context

- shortly after, hooked: quantized, governance department slammed, and a pseudo large context, attention reduced to start and end of thread.

- down the road: 4bit quantized or worse with nerf incantation to make the next upcoming model feel amazing.

Rince and repeat.

klipklop 4 hours ago | parent [-]

They have to be doing some variant of this in the life cycle because of how wildly the performance changes over time. I refuse to give Anthropic my own money because the subscription plans are essentially useless. It's rather nice with a company API account with no spending limit though. But really oAI models are more consistent over time in my experience.