| ▲ | mirekrusin 3 hours ago | |
It would be great if numbers weren't off, would include optimised versions (ie. speculative decoding), context size, include allowed parallel inference (single agents use parallel inference a lot) etc. I don't think in general people care about long list of models, they just care about the best one. Also dual gpu is common setup, there should be ie. 2x 4090. | ||