▲ | dns_snek 3 days ago | |
> while an hour of active GPT-4 chatting (assuming 20 queries at 0.3 Wh each) We're not talking about a human occasionally chatting with ChatGPT, that's not who the article and earlier comments are about. People creating this sort of AI slop are running agents that provide huge contexts and apply multiple layers of brute-force, like "reasoning" and dozens/hundreds of iterations until the desired output is achieved. They end up using hundreds (or even thousands) of dollars worth of inference per month on their $200 plans, currently sponsored by the AI bubble. |