| ▲ | Models.dev: open-source database of AI model specs, pricing, and capabilities(github.com) | |||||||||||||
| 83 points by maxloh 3 hours ago | 11 comments | ||||||||||||||
| ▲ | sandeepkd 3 hours ago | parent | next [-] | |||||||||||||
Its interesting and pretty useful if it can be kept updated in long run. Also some way to capturing the changes in pricing if any given that one of the arguments is that over the time the prices should come down. nit suggestion: It took a while to realize that I have to scroll to right to see more details. Most users are in habit of scrolling down or click on some button to see more details. | ||||||||||||||
| ||||||||||||||
| ▲ | wavemode 3 hours ago | parent | prev | next [-] | |||||||||||||
Really useful database, though the website could really use a filtering feature rather than just sorting. | ||||||||||||||
| ▲ | m_m_carvalho 3 hours ago | parent | prev | next [-] | |||||||||||||
Interesting approach. The unified pricing table is helpful, but I'd love to see latency benchmarks across providers – that's often the hidden cost beyond price/token. | ||||||||||||||
| ▲ | jubilanti 2 hours ago | parent | prev | next [-] | |||||||||||||
> There's no single database with information about all the available AI models. We started Models.dev as a community-contributed project to address this. There are literally dozens of existing projects that are doing what you are trying to do. Insert XKCD standards reference here: https://www.helicone.ai/llm-cost https://docs.litellm.ai/docs/provider_registration/add_model... https://artificialanalysis.ai/api-reference https://github.com/simonw/llm-prices https://github.com/assistant-ui/modelpedia https://github.com/pydantic/genai-prices https://github.com/Portkey-AI/models https://github.com/truefoundry/models https://github.com/agentstation/starmap https://github.com/dcSpark/ai-model-catalog | ||||||||||||||
| ||||||||||||||
| ▲ | sixtyj 3 hours ago | parent | prev | next [-] | |||||||||||||
Absolute gem. And after recent tweak this table is fast af even it is huge with a lot of rows. | ||||||||||||||
| ▲ | varispeed 21 minutes ago | parent | prev | next [-] | |||||||||||||
This is missing data like when particular model was nerfed or how often provider routes to cheaper less capable model (variants of so called adaptive reasoning). Cost per token says nothing. For instance if model goes dumb half way the task and you have to start again. If model does that all the time, then the cost is substantially higher than headline figure. Probably such a service should constantly run various types of tasks on such models and gauge quality of output (though still provider can detect it and pin their best model to skew the results). | ||||||||||||||
| ▲ | giancarlostoro 3 hours ago | parent | prev | next [-] | |||||||||||||
Definitely needs filtering for all the data, so you can block out "closed" models, and even models that are not LLMs. | ||||||||||||||
| ▲ | Imustaskforhelp 3 hours ago | parent | prev [-] | |||||||||||||
This seems really interesting, thanks maxloh for sharing. I have a quick question but https://aihubmix.com/model/coding-glm-5.1-free seems to be free in the chances of "coding-glm-5.1-free is the open and free version of coding-glm-5.1. To ensure stable service performance, usage limits are in place: up to 5 requests per minute, 500 requests per day, and a daily token allowance of 1 million." Is there any catch aside from that for this aihubmix? I use opencode-zen from free version mostly if I want agents but this seems interesting to me as well and I think that it mught be able to get integrated into opencode itself as well given this repo is from opencode (well anomalyco) A quick question but is there any tangible benefit of using these AIhubmix or others over something like opencode-zen itself that I may be missing? | ||||||||||||||