| ▲ | hirako2000 5 hours ago | |
You've got to understand, proprietary models operate as the following: - release: full precision, debrided, uncapped context - shortly after, hooked: quantized, governance department slammed, and a pseudo large context, attention reduced to start and end of thread. - down the road: 4bit quantized or worse with nerf incantation to make the next upcoming model feel amazing. Rince and repeat. | ||
| ▲ | klipklop 4 hours ago | parent [-] | |
They have to be doing some variant of this in the life cycle because of how wildly the performance changes over time. I refuse to give Anthropic my own money because the subscription plans are essentially useless. It's rather nice with a company API account with no spending limit though. But really oAI models are more consistent over time in my experience. | ||