Remix.run Logo
cyanydeez 4 hours ago

No, you can't. These companies have two infrastructures: model training and model inference.

Inference needs to cache, it can't cache random model data, so it's essentially dedicated; it can't spin up models on demand, it has to know what demand is coming.

These companies are going to end up with very few models offered and that's probably generous. They might end up with just one model and you pay for removing it's safe guards.