Remix.run Logo
dannyw a day ago

I feel like everyone does it though. Like who really runs frontier LLMs at `max`?

It feels like a benchmark-only setting, just for ArtificialAnalysis really.

springtimesun a day ago | parent | next [-]

I run fable at max for basically any non-trivial task. Not even for the result of that task, I get so many “I noticed in passing” bullets at the end that have led to productive refactors and caught bugs it’s worth the tokens by itself. Obvious caveats, depends on your language, framework, codebase, prompt… I also have a “no gardening” rule that tells Claude not to bundle unrelated changes or refactors and it really respects it.

Just to add before someone objects, but the tokens! I have only once maxed out a 5x subscription week (which I then upgraded and maxed out a 20x week so it was a big push). I don’t understand how some people are using so many tokens

theowaway213456 a day ago | parent | prev [-]

> Like who really runs frontier LLMs at `max`?

Umm what? Lots of people do