| ▲ | Imustaskforhelp 4 hours ago | |
Although I am not sure about it but there was something I read which said that models intentionally degrade slowly by lower quantizations as a new model is going to drop. This felt particularly visible during the 4.6 when people said that 4.6 felt dumber and I remember someone doing some analysis and it sort of proved that models were getting dumber over time. This has both benefits of costing less for the company to run while taking a standard subscription but also, at the same time, making the next model when it drops to public to "feel" more good comparatively. Again, I am not sure if this is the case or not but merely proposing something that I feel like it might be in the possibility of realm. | ||