It's more or less all stupid anyways. Benchmarks can give someone and understanding of what a model was trained on but they don't explain tone, consistency, the type of answers, the restrictions, what the money is going to, how good it is on your task, etc.

Most use of llms is gambling. So a lot of people get hooked on their one machine or whatever despite all reasons to the contrary. Some of the most deranged LLM users I e encountered are hooked on a variety of models but still use ones from like 2 years ago for specific tasks for emotional reasons.

The truth is, for 99.999% of use cases the top 10 models are more or less interchangeable. Either they can mostly do what someone wants, or none of them should probably be used for that application even if s leading lab is advertising it.

[dead]