| ▲ | ShinyLeftPad 2 hours ago | |
All LLMs use obscene tokens just programmers are more aware of it | ||
| ▲ | Gagarin1917 2 hours ago | parent [-] | |
That’s not true. The different use cases of LLMs objectively use different amounts of tokens. AI coding agents can parse half a dozen or more files on each request, plus use a ton for thinking. Writing an email barely uses any in comparison. | ||