| |
| ▲ | ttoinou 9 hours ago | parent [-] | | Cerebras is already 200-800 tps, do you need even faster ? | | |
| ▲ | overfeed 8 hours ago | parent [-] | | Yes! I don't try to read agent tokens as they are generated, so if code generation decreases from 1 minute to 6 seconds, I'll be delighted. I'll even accept 10s -> 1s speedups. Considering how often I've seen agents spin wheels with different approaches, faster is always better, until models can 1-shot solutions without the repeated "No, wait..." / "Actually..." thinking loops | | |
| ▲ | pqtyw 4 hours ago | parent [-] | | > until models can 1-shot solutions without the repeated "No, wait..." / "Actually..." thinking loops That would imply they'd have to be actually smarter than humans, not just faster and be able to scale infinitely. IMHO that's still very far away.. |
|
|
|
