| ▲ | jstummbillig 2 days ago | |
Why this instead of cpu/gpu time? | ||
| ▲ | antiframe 2 days ago | parent | next [-] | |
CPU/GPU time is opaque to me before I send my data, but tokens I can count before I decide to send it. That means I can verify the metering. With CPU time I send the data and then the company says "That cost X CPU units, which is $500". | ||
| ▲ | typpilol 2 days ago | parent | prev [-] | |
I'm assuming token count and usage is pretty closely tied | ||