| ▲ | jrm4 a day ago | |
For roughly the same reason you might slow down and read a book on how to do something as opposed to speedrunning 20 youtube videos? | ||
| ▲ | criley2 a day ago | parent [-] | |
Are you insinuating that your agents are more effective at 20 tok/s than 200 tok/s? I don't even understand your analogy. I'm not watching the youtube video or reading the book. The model is. And a big computer can watch 20 youtube videos faster than a small computer can watch 1, and do a far better job understanding all of them (bigger model at data center scale is both smarter and faster than smaller model at local scale). | ||