| ▲ | m101 3 hours ago | |
It’s not clear at all because model training upfront costs and how you depreciate them are big unknowns, even for deprecated models. See my last comment for a bit more detail. | ||
| ▲ | ACCount37 an hour ago | parent [-] | |
By now, model lifetime inference compute is >10x model training compute, for mainstream models. Further amortized by things like base model reuse. | ||