Remix.run Logo
winstonp 4 hours ago

16 tokens / s is not nothing.

throwaway219450 3 hours ago | parent | next [-]

It's the other way around due to poor framing, it would be much easier to compare if you [the repo] said 0.02 tps.

whatsThisBtn4 3 hours ago | parent | prev | next [-]

Confusing numbers everywhere.

16tk/s... Then 3 tks per minute. Then someone else posted 0.3tk/s.

Azantys 4 hours ago | parent | prev [-]

? Readme says 60-70s per token