| ▲ | wredcoll 3 hours ago | |
I think the context here is that small models run locally, not rented from a cloud. | ||
| ▲ | giraffe_lady 2 hours ago | parent [-] | |
Yes small models are and will be useful for lots of stuff for several reasons. But the idea they’d be better than a bigger model is cope, you’re pretty much always better off running the biggest one you can bring to bear within your constraints. | ||