| ▲ | tick_tock_tick a day ago | |
> does it matter if you generate at half the speed? Yes, massively it's not even linear 1/2 speed is probably 1/8 or less the value of "full speed". It's going to be even more pronounced as "full speed" gets faster. | ||
| ▲ | lelanthran a day ago | parent [-] | |
> Yes, massively it's not even linear 1/2 speed is probably 1/8 or less the value of "full speed". It's going to be even more pronounced as "full speed" gets faster. I don't think that's true for most use-cases (content generation, including artwork, code/software, reading material, summarising, etc). Something that takes a day without an LLM might take only 30m with GPT5 (artwork), or maybe one hour with Claude Code. Does the user really care that their full-day artwork task is now one hour and not 30m? Or that their full-day coding task is now only two hours, and not one hour? After all, from day one of the ChatGPT release, literally no one complained that it was too slow (and it was much slower than it is now). Right now no one is asking for faster token generation, everyone is asking for more accurate solutions, even at the expense of speed. | ||