| ▲ | Rapzid 18 hours ago | |||||||
Yes, I'm aware that there have been a number of isolated platform and harness regressions (bugs and behavior changes). But the model NERF conspiracies are bunk. | ||||||||
| ▲ | cma 15 hours ago | parent [-] | |||||||
I think the bug one wasn't bad intent, but it was a fact that even without the bug you got different behavior with the approximate logit sampling on TPUs. I say that was jut a minor platform optimization though and wouldn't be too upset about them not disclosing it. But the harness one was not just a random harness regression; they were getting a huge influx of users and pretty clearly did it to save capacity. Not a great thing when you might be relying on attention to those thinking traces to reduce the risk of prompt injection etc. and it could have gone beyond major task degradation into a safety/security issue. | ||||||||
| ||||||||