| ▲ | sosodev 29 minutes ago | |
What about do you mean by single threaded? Each token is predicted by using parallel computation on the GPU. | ||
| ▲ | josh-wrale 4 minutes ago | parent [-] | |
[delayed] | ||
| ▲ | sosodev 29 minutes ago | |
What about do you mean by single threaded? Each token is predicted by using parallel computation on the GPU. | ||
| ▲ | josh-wrale 4 minutes ago | parent [-] | |
[delayed] | ||