| ▲ | smusamashah 11 hours ago | |
Does it mean if it was embedded on a Talaas chip, it could generate ~50,000+ tokens per second? | ||
| ▲ | Havoc an hour ago | parent [-] | |
Think pretty much anything is going to get a enormous speed boost if the model isn’t undergoing mem latency but is just inherently baked into the circuits asic style | ||