Remix.run Logo
ShinyLeftPad 2 hours ago

All LLMs use obscene tokens just programmers are more aware of it

Gagarin1917 2 hours ago | parent [-]

That’s not true. The different use cases of LLMs objectively use different amounts of tokens. AI coding agents can parse half a dozen or more files on each request, plus use a ton for thinking.

Writing an email barely uses any in comparison.