| ▲ | ImPostingOnHN 2 days ago | |
Token caching might help here, but if it returns the same result, faster, for the same price as priority, seems good | ||
| ▲ | awwaiid 2 days ago | parent [-] | |
I wonder how parallel token caches are, like when exploring a tree of sample continuations. | ||