Remix.run Logo
misiti3780 5 days ago

is there a website where i can compare openai, anthropic and gemini models on cost/token ?

jsnell 5 days ago | parent | next [-]

There are plenty. But it's not the comparison you want to be making. There is too much variability between the number of tokens used for a single response, especially once reasoning models became a thing. And it gets even worse when you put the models into a variable length output loop.

You really need to look at the cost per task. artificialanalysis.ai has a good composite score, measures the cost of running all the benchmarks, and has 2d a intelligence vs. cost graph.

misiti3780 5 days ago | parent [-]

thanks

deaux 4 days ago | parent [-]

For reference the above completely depends on what you're using them for. For many tasks, the number of tokens used is consistent within 10~20%.

deaux 4 days ago | parent | prev | next [-]

https://www.helicone.ai/llm-cost

Tried a lot of them and settled on this one, they update instantly on model release and having all models on one page is the best UX.

rrhartjr 4 days ago | parent | prev | next [-]

https://www.llm-prices.com/

int_19h 5 days ago | parent | prev [-]

https://openrouter.ai/models