| ▲ | rgbrgb 6 hours ago | |
this is a good one, so fun. congrats and good work! what's cost like rn with the lightweight model? | ||
| ▲ | michaelstewart 4 hours ago | parent [-] | |
The lightweight model is incredibly cheap. Cost so far today $0.06. It within the same order of magnitude as the per-request cost of the write to cloudflare KV storage (which I'm using to cache the inference result). | ||