| ▲ | nullbio 9 hours ago | |
The first company to release solid open-weight models on hardware LLMs to general consumers will change the world. I don't see a good reason to invest in something like an M5 ultra when it'll be so unbearably slow to generate tokens. Imagine getting stuck with something doing 50 TPS when everyone else is doing 2000-10,000 TPS (10k TPS is what the latest chips hit, I'm not pulling that number out of thin air). | ||