Remix.run Logo
smusamashah 11 hours ago

Does it mean if it was embedded on a Talaas chip, it could generate ~50,000+ tokens per second?

Havoc an hour ago | parent [-]

Think pretty much anything is going to get a enormous speed boost if the model isn’t undergoing mem latency but is just inherently baked into the circuits asic style