| ▲ | RussianCow a day ago | |||||||
Once you've used a model that runs at hundreds of TPS, it's hard to go back. Everything completes so quickly that you can iterate without breaking out of flow state. My biggest gripe with slow (<50tps) LLMs is that I've lost all the mental context I built up by the time it's done, which makes it extremely difficult to explore or iterate on solutions. | ||||||||
| ▲ | nmfisher a day ago | parent | next [-] | |||||||
Completely agree. Slow but smart models (Fable, Sol, GLM5.2 etc) are great, but they leave me with zero mental model of the code that's been written. Most of the time my mind wanders off and I go check social media or fire off a prompt for some other random project, it's a big productivity drain. Working with models that are super fast, but slightly dumber (like mimo-v2.5-pro-ultraspeed) is amazing, I feel like I'm still the one that's actually making every decision. | ||||||||
| ||||||||
| ▲ | hx8 a day ago | parent | prev | next [-] | |||||||
I'd rather have slower and better output than worse and faster output. | ||||||||
| ||||||||
| ▲ | ngcc_hk a day ago | parent | prev [-] | |||||||
In 1980s ibm has studied and said why sub-second response needed to maintain the mental flow. That time you send a whole screen unlike unix like character by character. This proves very true even when you deal with form processing. I think that we are dealing with the same issue here. Keep your mental context in your brain is critical | ||||||||