Remix.run Logo
nojs 3 hours ago

> Humans are still 22x more efficient, which is not that far considering the rate of progress in this area.

Based on a human output rate of 3.3 tok/s, which seems questionable as a means of comparison

xyzsparetimexyz an hour ago | parent | next [-]

I do believe that this is the trade off. We are more efficient but slower in terms of thinking (at the same level of intelligence). Some animals go much further in terms of that trade off, see https://en.wikipedia.org/wiki/Portia_(spider) for example.

falcor84 2 hours ago | parent | prev [-]

What exactly are you questioning?

nojs 2 hours ago | parent [-]

The claim that tok/s independent of quality is a useful comparison (I can get thousands of tok/s on a suitable small model), and secondarily that humans can’t output “tokens” faster than than in some sense, which I am less confident about