| ▲ | Workaccount2 4 days ago | |||||||
I (and others) have a strong suspicion that they can modulate models intelligence in almost real time by adjusting quantization and thinking time. It seems if anyone wants, they can really gas a model up in the moment and back it off after the hype wave. | ||||||||
| ▲ | qeternity 4 days ago | parent | next [-] | |||||||
Quantization is not some magical dial you can just turn. In practice you basically have 3 choices: fp16, fp8 and fp4. Also thinking time means more tokens which costs more especially at the API level where you are paying per token and would be trivially observable. There is basically no evidence that either of these are occurring in the way you suggest (boosting up and down). | ||||||||
| ||||||||
| ▲ | bamboozled 4 days ago | parent | prev [-] | |||||||
Yeah I've noticed with Claude, around the time of the Opus 4.5 release, at least for a few days, Sonnet 4.5 was just dumb, but it seems temporary. I feel that redirected resources to Opus. | ||||||||