| ▲ | mickeyp 4 days ago | |
The 5090 is a firecracker of a GPU. RAM of course is a part of this; but it's also just... a really good card. I bought it ostensibly for gaming and light AI, but now I use it for Qwen 3.8 27B running in ninfer and in (shameless plug) dreamcoder.ai it absolutely flies. I get ~2-3k per second prefill (important for large contexts), 256k context and ~150 tok/s. I have 30 years of coding experience. That tiny model is no Opus 5.5, but make no mistake: it's a very strong coder in the hands of a capable developer. | ||