Don't index on tokens. Costs for useful unit of work had gone down in my experience, and that's what actually matters.

Counting tokens is like counting lines of code.