| ▲ | lnenad a day ago | ||||||||||||||||||||||||||||||||||
Why? I'm personally on the opposite end. Less babysitting/higher quality means more time goes back to me/the user. 1000tps of bad code means you have to keep validating the output and circling back. | |||||||||||||||||||||||||||||||||||
| ▲ | anthonypasq a day ago | parent | next [-] | ||||||||||||||||||||||||||||||||||
id rather iterate multiple times than wait 15 minutes to notice it made a mistake. | |||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||
| ▲ | aunty_helen a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||
High tps is good for deeper agent thinking loops and openclaw etc. I was running cerebus recently doing some data heavy tasks, it managed to crash the server I was submitting posts to. 6 hour task down to ~1hr | |||||||||||||||||||||||||||||||||||
| ▲ | unshavedyak a day ago | parent | prev [-] | ||||||||||||||||||||||||||||||||||
So i agree with you, but there's no SOTA model that i don't have to babysit. I'm not going to just throw a large pile of code in there unreviewed, and so what i want is faster iteration on code in logical, reviewable chunks. Ie just like i'd normally write myself; small, logical commits. Faster iteration means i mentally checkout less and am more involved with the code being created. My hope is that in the far far future, we can get LLMs so fast that i can work in my IDE like normal and the LLM will just be an extension of autocomplete. I can state a goal, rough out functions, code, etc, and it'll just work around me like a very fast pair programmer / autocomplete. The chat interface is an intermediate step that frankly i hate. The faster it is the less i wait. Now for vibe-slop i'm making on the side, yea i don't care about speed. But that's not something i'm employed to do or anything i truly care about. It's a different workflow entirely. | |||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||