| ▲ | liuliu 4 hours ago | |||||||
> We have a local model we would like to distribute but don't have a good CDN. That is not true. I am serving models off Cloudflare R2. It is 1 petabyte per month in egress use and I basically pay peanuts (~$200 everything included). | ||||||||
| ▲ | logicallee 3 hours ago | parent [-] | |||||||
1 petabyte per month is 1 million downloads of a 1 GB file. We intend to scale to more than 1 million downloads per month. We have a specific scaling architecture in mind. We're qualified to say this because we've ported a billion parameter model to run in your browser - fast - on either webgpu or wasm. (You can see us doing it live at the youtube link in my comment above.) There is a lot of demand for that. | ||||||||
| ||||||||